- Write your own benchmarks with Cloud WorkBench sealuzh/cwb-benchmarks
- Install CWB: sealuzh/cwb-chef-repo
- cwb Utility Cookbook (Chef): Chef Supermarket
- cwb Client (RubyGem): sealuzh/cwb
- Joel Scheuner, Philipp Leitner, Jürgen Cito, and Harald Gall (2014), Cloud WorkBench – Infrastructure-as-Code Based Cloud Benchmarking, in Proceedings of the 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’14), 2014. DOI: 10.1109/CloudCom.2014.98
- Joel Scheuner, Jürgen Cito, Philipp Leitner, and Harald Gall (2015), Cloud WorkBench: Benchmarking IaaS Providers based on Infrastructure-as-Code, in Proceedings of the 24th International World Wide Web Conference (WWW’15) – Demo Track, 2015. DOI: 10.1145/2740908.2742833
- Screencast of previous CWB version
- Joel Scheuner, Philipp Leitner (2019). Performance Benchmarking of Infrastructure-as-a-Service (IaaS) Clouds with Cloud WorkBench in Companion of the 2019 ACM/SPEC International Conference on Performance Engineering (ICPE'19). DOI: 10.1145/3302541.3310294
- Joel Scheuner, Philipp Leitner (2019). Tutorial – Performance Benchmarking of Infrastructure-as-a-Service (IaaS) Clouds with Cloud WorkBench 2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W). Presented at ICAC/SASO'19. DOI: 10.1109/FAS-W.2019.00070
-
Christoph Laaber, Joel Scheuner, Philipp Leitner (2019), Software Microbenchmarking in the Cloud. How Bad is it Really? Empirical Software Engineering Journal (EMSE’19), 2019. DOI: 10.1007/s10664-019-09681-1
-
Joel Scheuner, Philipp Leitner (2018). Estimating Cloud Application Performance Based on Micro-Benchmark Profiling in Proceedings of the 11th IEEE International Conference on Cloud Computing (CLOUD'18). DOI: 10.1109/CLOUD.2018.00019
-
Joel Scheuner, Philipp Leitner (2018). A Cloud Benchmark Suite Combining Micro and Applications Benchmarks, in Proceedings of the 4th International Workshop on Quality-Aware DevOps (QUDOS'18@ICPE). DOI: 10.1145/3185768.3186286
-
Christian Davatz, Christian Inzinger, Joel Scheuner, and Philipp Leitner (2017). An Approach and Case Study of Cloud Instance Type Selection for Multi-Tier Web Applications. in Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid'17). DOI: 10.1109/CCGRID.2017.12
-
Philipp Leitner, Jürgen Cito (2016). Patterns in the Chaos - A Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology (TOIT). DOI: 10.1145/2885497
-
Joel Scheuner, Jürgen Cito, Philipp Leitner, and Harald Gall (2015), Cloud WorkBench: Benchmarking IaaS Providers based on Infrastructure-as-Code, in Proceedings of the 24th International World Wide Web Conference (WWW’15) – Demo Track, 2015. DOI: 10.1145/2740908.2742833
-
Philipp Leitner, Joel Scheuner (2015). Bursting With Possibilities – an Empirical Study of Credit-Based Bursting Cloud Instance Types. In Proceedings of the 8th IEEE/ACM International Conference on Utility and Cloud Computing (UCC). DOI: 10.1109/UCC.2015.39
-
Joel Scheuner, Philipp Leitner, Jürgen Cito, and Harald Gall (2014), Cloud WorkBench – Infrastructure-as-Code Based Cloud Benchmarking, in Proceedings of the 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’14), 2014. DOI: 10.1109/CloudCom.2014.98
Find a detailed list of benchmarks used by each study here.
Find more screenshots under /docs/img
Interested in your own Cloud WorkBench installation?
Feel free to contact us: scheuner[AT]chalmers.se or philipp.leitner[AT]chalmers.se
Most parts are automated and configurable via Chef, some manual steps are required to setup credentials and Chef server configuration.
Step-by-step guidance is given here
- Execute a basic CLI benchmark: sealuzh/cwb-benchmarks
- Write your first benchmark: sealuzh/cwb-benchmarks
Checkout our detailed tutorials for Slides and Step-by-Step Instructions with Screenshots including a Video.
Automated as part of the installation or manually triggerable.
See DEVELOPMENT.md