As part of our research, we are very keen on building proof-of-concepts, prototypes, and tools. Here is a selection of recent concrete open source tools that emerged from our work.
Cloud Workbench
 |
Cloud WorkBench (CWB) is a web-based framework for scheduling and executing IaaS benchmarks. CWB is grounded on the notion of Infrastructure-as-Code (IaC) to foster simple definition, execution, and repetition of benchmarks over a wide array of cloud providers and configurations. Source code and documentation can be found on GitHub. |
Main reference:
Joel Scheuner, Philipp Leitner, Jürgen Cito, and Harald Gall (2014), Cloud WorkBench – Infrastructure-as-Code Based Cloud Benchmarking, in Proceedings of the 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’14), 2014. DOI: https://doi.org/10.1109/CloudCom.2014.98
Usage example:
Philipp Leitner, Jürgen Cito (2016). Patterns in the Chaos – A Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology, 16(3), pp. 15:1–15:23. New York, NY, USA. DOI: https://doi.org/10.1145/2885497
PerformanceHat
 |
The aim of this project is to integrate runtime monitoring data from production deployments of the software into the tools developers utilize in their daily workflows (i.e., IDEs) to enable tighter feedback loops. We refer to this notion as feedback-driven development (FDD). Source code and documentation can be found on GitHub. PerformanceHat has been featured in Adrian Colyer’s influencial The Morning Paper blog. |
Main references:
Jürgen Cito, Philipp Leitner, Harald C. Gall, Aryan Dadashi, Anne Keller, and Andreas Roth. 2015. Runtime metric meets developer: building better cloud applications using feedback. In 2015 ACM International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) (Onward! 2015). ACM, New York, NY, USA, 14-27. DOI: http://dx.doi.org/10.1145/2814228.2814232
Jürgen Cito, Philipp Leitner, Christian Bosshard, Markus Knecht, Genc Mazlami, and Harald C. Gall. 2018. PerformanceHat: augmenting source code with runtime performance traces in the IDE. In Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings (ICSE ’18). ACM, New York, NY, USA, 41-44. DOI: https://doi.org/10.1145/3183440.3183481