Review of Cloud Computing Simulation Platforms and Related Environments

1. Review of Cloud Computing Simulation Platforms and Related Environments Dr. James Byrne, DCU Business School The 6th National Conference on Cloud Computing and Commerce (NC4) Dublin, April 11th, 2017

2. INTRODUCTION Similar increase noted in discrete-event simulation tools for Cloud Computing Cloud computing still growing in popularity, scale & complexity Advantages Far less expensive economically than using a testbed (typically) Experiments can be run in a timelier fashion Experimentation is repeatable and potentially scalable Stochastic inputs can be taken into account However Assumptions/simplifications might not represent the real system (real test bed validation might be necessary) Aim to analyse Behaviour of data centre resources, that host VMs in multi-tenancy scenarios over non-deterministic timeframes with variable user load

3. BACKGROUND 1 Short Paper, 1 Position Paper * Byrne, J., Svorobej, S. Giannoutakis, K., Tsovaras, D., Byrne, P.J., Ostberg, P-O & Lynn, T. (2017). A Review of Cloud Computing Simulation Platforms and Related Environments. CLOSER 2017. In Press, Corrected Proof. * Lynn, T., Gourinovitch, A., Byrne, J., Byrne, P. J., Svorobej, S., Kenny, D., Morrison, J. (2017). A Preliminary Systematic Review of Computer Science Literature on Cloud Computing Research using Open Source Simulation Platforms. CLOSER 2017. In Press, Corrected Proof. Review of tools against specific high-level criteria Preliminary systematic review of literature of open source tools (256 Papers – 2009 to 2016) 2 Accepted Papers - CLOSER 2017*, April 2017

4. IDENTIFIED SIMULATION PLATFORMS 18 are derivatives / extensions of CloudSim 33 Cloud Simulation Tools identified

5. COMPARISON CRITERIA Licence(s) Initial Publication Year Underlying Software Stack Lines of Code (LOC) Availability of User Documentation Source Code Availability Binary Availability Language(s) Platform Portability Distributed Architecture Model Persistence Type Web API Availability Graphical User Interface Headless Execution Format of Result Output

6. FEATURE COMPARISON – UNDERLYING STACK CDOSim Bazaar-Extension Cloud2Sim CloudAnalyst CloudEXP CloudReports CloudSimDisk CloudSimSDN CMCloudSimulator DartCSim EMUSim iFogSim MR-CloudSim TeachCloud Ucloud WorkflowSim CloudSim Omnet++ / INET ICanCloud CloudNetSim++ CACTOSim Palladio/Simulizar NS-2 GreenCloud None CloudSched CloudSim DCSim1 GDCSim SimGrid

7. FEATURE COMPARISON – LICENCE(S) CloudSim CDOSim Bazaar-Extension Cloud2Sim CloudAnalyst CloudEXP CloudReports CloudSimDisk CloudSimSDN CMCloudSimulator DartCSim EMUSim iFogSim MR-CloudSim TeachCloud Ucloud WorkflowSim CloudNetSim++ CACTOSim DCSim2 DISSECT-CF GreenCloud MDCSim NetworkCloudSim CloudSched SimIC DISSECT-CF SPECI CloudSim DCSim1 GDCSim SimGrid iCanCloud GPL / GPLv3 Apache 2.0 LGPLv3 EPL V1 BSD MIT

8. FEATURE COMPARISON – LINES OF CODE 94951 46914 38708 28450 19274 1668115619 9891 9153 8714 8397 7369 6543 5564 5269 4006 3277 3061 2994 2276 1901 1369 566

9. FEATURE COMPARISON – PUB. YEAR, LAST UPDATE YEAR 2014 2012 2015 2014 2009 2014 2011 2015 2009 2015 2015 2016 2012 2015 2012 2011 2010 2010 2011 2013 2016 2012 2016 2012 2015 2015 2010 2014 2015 2015 2016 2015 2015 2016 2014 2016 2012 2011 2016 2010 2015 2016 2014 2016 2015 2009 2010 2011 2012 2013 2014 2015 2016

10. FEATURE COMPARISON – DOCUMENTATION AVAILABILITY CACTOSim CDOSim Cloud2Sim CloudAnalyts CloudReports CloudSim CloudSimDisk CloudSimSDN DCSim2 DISSECT-CF EMUSim GreenCloud GroudSim SimGrid Workflowsim Bazaar Extension CEPSim CloudEXP CloudNetSim++ CloudSched CMCloudSimulator DartCSim DCSim1 GDCSim iCanCloud MDCSim MR-CloudSim SimIC SPECI TeachCloud Ucloud iFogSim

11. FEATURE COMPARISON – SOURCE CODE AVAILABILITY Bazaar Extension CloudEXP DartCSim DCSim1 MDCSim MR-CloudSim SimIC SPECI Ucloud

12. FEATURE COMPARISON – LANGUAGE(S) Bazaar Extension CACTOSim CDOSim CEPSim Cloud2Sim CloudAnalyst CloudEXP CloudReports CloudSched CloudSim CloudSimDisk CloudSimSDN CMCloudSimulator DartCSim DCSim1 DISSECT-CF EMUSim GroudSim iFogSim SimIC TeachCloud Ucloud WorkflowSim CloudNetSim++ DartCSim GDCSim GreenCloud iCanCloud SimGrid C/C++ 23 simulation tools based on Java 17 of these based on CloudSim 6 based on C/C++ 33 in total

13. FEATURE COMPARISON – PLATFORM PORTABILITY EMUSim GDCSim GreenCloud Multiple Operating Systems (e.g. Windows, Linux) Without significant effort or notable claimed performance difference

14. FEATURE COMPARISON – GUI AVAILABILITY Both Modelling Building and Presentation Analysis of Results CACTOSim CDOSim CEPSim CloudAnalyst CloudNetSim++ CloudReports CloudSched DartCSim GreenCloud iCanCloud iFogSim SimGrid TeachCloud

15. OS CLOUD SIMULATION RESEARCH – PUBLICATION OUTLET AND YEAR Buyya, Ranjan and Calheiros Introduce CloudSim 78 2 93% Conference Papers 7% Journals (earliest in 2013) 256 Papers – 2009 to 2016 85% overall based on CloudSim (extensions / derivative simulators)

16. TOTAL PUBLICATIONS BY YEAR (256 PAPERS) 45 Papers relate to design, development and extension of simulation platforms 211 Papers relate to the use of platforms for Research 92% of these relate to CloudSim

17. DESIGN / DEV / EXTENSION OF SIMULATION PLATFORMS (45 PAPERS) 45 Papers relate to design, development and extension of simulation platforms

18. USE OF SIMULATION PLATFORMS FOR RESEARCH (211 PAPERS) Taxonomic Analysis – 6 key elements (Rimal et al (2009)) Architecture – includes private, public, hybrid and federated cloud Virtualisation Management – includes any related activity to abstraction of resources away from physical resources Services – includes IaaS, PaaS and SaaS Fault Tolerance– includes simulation of outages Security – includes attack simulation and methods for enhanced security / trust Majority of papers: Virtualisation/Resource Management Classification of papers: Singh and Chana’s high level taxonomy of resource management Other – includes load balancing, interoperability, and data storage

19. USE OF SIMULATION PLATFORMS FOR RESEARCH - ARCHITECTURE Architecture – includes private, public, hybrid and federated cloud Vast Majority, but Not Specified

20. USE OF SIMULATION PLATFORMS FOR RESEARCH - SERVICES Services – includes IaaS and SaaS

21. USE OF SIMULATION PLATFORMS FOR RESEARCH – VIRTUALISATION MANAGEMENT Virtualisation Management – includes any related activity to abstraction of resources away from physical resources

25. USE OF SIMULATION PLATFORMS FOR RESEARCH – FAULT TOLERANCE Fault Tolerance– includes simulation of outages

26. USE OF SIMULATION PLATFORMS FOR RESEARCH – SECURITY Security – includes attack simulation and methods for enhanced security / trust

27. USE OF SIMULATION PLATFORMS FOR RESEARCH – OTHER Other – includes load balancing, interoperability, and data storage

28. CONCLUSIONS Clearly, CloudSim is the main platform being used for research purposes May be advantageous to choose CloudSim Volume of research output Active simulation community (for support and updates) Valuable extensions Noted limitations with these studies Comparison of features at a high level Need for direct comparison of features based on validated models Systematic review limited to IEEE Xplore Library – further surveys needed (wider set of publication outlets, proprietary simulation platforms)

Review of Cloud Computing Simulation Platforms and Related Environments

RECAP Project

Review of Cloud Computing Simulation Platforms and Related Environments