Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Master thesis presentation on 'Cloud Service Broker'

3,327 views

Published on

Throughout the history of computer systems, experts have been reshaping IT infrastructure for improving the efficiency of organizations by enabling shared access to computational resources. The advent of cloud computing has sparked a new paradigm providing better hosting and service delivery over the Internet. It offers advantages over traditional solutions by providing ubiquitous, scalable and on-demand access to shared pools of computational resources.

Over the course of these last years, we have seen new market players offering cloud services at competitive prices and different Service Level Agreements. With the unprecedented increasing adoption of cloud computing, cloud providers are on the look out for the creation and offering of new and value-added services towards their customers. Market competitiveness, numerous service options and business models led to gradual entropy. Mismatching cloud terminology got introduced and incompatible APIs locked-in users to specific cloud service providers. Billing and charging become fragmented when consuming cloud services from multiple vendors. An entity recommend- ing cloud providers and acting as an intermediary between the cloud consumer and providers would harmonize this interaction.

This dissertation proposes and implements a Cloud Service Broker focusing on assisting and encouraging developers for running their applications on the cloud. Developers can easily describe their applications, where an intelligent algorithm will be able to recommend cloud offerings that better suit application requirements. In this way, users are aided in deploying, managing, monitoring and migrating their applications in a cloud of clouds. A single API is required for orchestrating the whole process in tandem with truly decoupled cloud managers. Users can also interact with the Cloud Service Broker through a Web portal, a command-line interface, and client libraries.

Published in: Software, Technology, Business

Master thesis presentation on 'Cloud Service Broker'

  1. 1. CLOUD SERVICE BROKER Carlos Gonçalves <carlos.goncalves@ua.pt>   Mestrado Integrado em Engenharia de Computadores e Telemática Supervised by: Prof. Dr. Diogo Gomes & Prof. Dr. João Paulo Barraca DETI – University of Aveiro20 December 2013
  2. 2. Outline •  Introduction & Motivation •  Brokering Cloud Services •  Solution for a Cloud Service Broker •  Results •  Conclusions 20 December 2013 Cloud Service Broker 2
  3. 3. INTRODUCTION 20 December 2013 3Cloud Service Broker
  4. 4. 20 December 2013 Cloud Service Broker 4 More devices & more broadband!
  5. 5. 20 December 2013 Cloud Service Broker 5 Is It born in us?
  6. 6. 20 December 2013 Cloud Service Broker 6 We’ve been producing data …
  7. 7. 20 December 2013 Cloud Service Broker 7 … lots of data!
  8. 8. 20 December 2013 Cloud Service Broker 8 Photos, videos, music, docs, emails …
  9. 9. 20 December 2013 Cloud Service Broker 9 Anywhere
  10. 10. 20 December 2013 Cloud Service Broker 10 Anytime
  11. 11. 20 December 2013 Cloud Service Broker 11 Anyhow
  12. 12. 20 December 2013 Cloud Service Broker 12 Everything accessible at user’s fingertips
  13. 13. 20 December 2013 Cloud Service Broker 13 Cloud computing in a nutshell
  14. 14. Definition “Cloud computing is a model for enabling ubiquitous, convenient, on- demand network access to a shared pool of configurable computing resources […] that can be rapidly provisioned and released with minimal management effort or service provider interaction.” — NIST 20 December 2013 Cloud Service Broker 14
  15. 15. Essential characteristics 1.  On-demand self-service 2.  Rapid elasticity 3.  Ubiquitous network access 4.  Resource pooling 5.  Measured service 20 December 2013 Cloud Service Broker 15
  16. 16. Delivery models Networking Storage Servers Virtualization Operating System Middleware Runtime Data Applications Networking Storage Servers Virtualization Operating System Middleware Runtime Data Applications Networking Storage Servers Virtualization Operating System Middleware Runtime Data Applications DeliveredasaserviceUsermanages UsermanagesDeliveredasaservice Deliveredasaservice Infrastructure as a Service Platform as a Service Software as a Service 20 December 2013 Cloud Service Broker 16
  17. 17. Deployment models •  Public cloud •  Private cloud •  Community cloud •  Hybrid cloud 20 December 2013 Cloud Service Broker 17 Community cloud On premise Private cloud Community cloud Off premise Public cloud Community cloud Community cloud
  18. 18. Interoperability Ability to easily move resources from one provider to another and between same or different deployment models •  Heterogeneity of solutions •  Different data models, interfaces, authentication and authorization mechanisms, … •  Vendor lock-in! •  Standardization initiatives •  OVF, OCCI, CIMI, TOSCA, CAMP, … 20 December 2013 Cloud Service Broker 18
  19. 19. Motivation •  Functional requirements •  Location •  Elasticity •  Billing / business models 20 December 2013 Cloud Service Broker 19
  20. 20. BROKERING CLOUD SERVICES 20 December 2013 20Cloud Service Broker
  21. 21. Cloud Service Broker “An entity that manages the use, performance and delivery of cloud services and negotiates relationships between cloud providers and cloud consumers” — Gartner 20 December 2013 Cloud Service Broker 21 Enterprise CSB Platform CSPN CSP1 CSP2 Enterprise CSB Platform CSPN CSP1 CSP2 CSB Platform CSPN CSP1 CSP2 Enterprise CSB Platform
  22. 22. Tools and CSBs •  Multi-cloud tools •  Jclouds, Deltacloud, Fog, Libcloud, Pkgcloud, Gophercloud •  Ongoing CSB projects •  Industry: Appsecute, Jamcracker •  Research: MOSAIC, STRATOS, Broker@Cloud 20 December 2013 Cloud Service Broker 22
  23. 23. SOLUTION FOR A CLOUD SERVICE BROKER 20 December 2013 23Cloud Service Broker
  24. 24. Cloud Service Broker Intelligent and autonomous CSB capable of recommending CSPs and easing applications lifecycle, orchestrating the whole process in a cloud of clouds 20 December 2013 Cloud Service Broker 24
  25. 25. Architecture overview 20 December 2013 Cloud Service Broker 25 Cloud Service Broker PaaS Manager Heroku Cloud Foundry ... Web PortalCLI SCM Private PaaS Private PaaS Manager IaaS Manager Amazon EC2 Open Stack Rackspace Microsoft Azure
  26. 26. PaaS Manager PaaS Manager API Monitoring Engine CloudBees API App#1 CloudFoundry API App#1 App#2 App#3 Heroku API App#1 App#2 Information Resources Management Resources IronFoundry API App#1 App#2 NewRelic NewRelic NewRelic Git Server PaaSManager Database Mgmt PaaS Adapters Info PaaS Adapters 20 December 2013 Cloud Service Broker 26
  27. 27. IaaS Manager 20 December 2013 Cloud Service Broker 27 IaaS Manager API Data store IaaS 1 IaaS 2 IaaS 3 ... Common Cloud API Images Machines CIMI
  28. 28. Private PaaS Manager 20 December 2013 Cloud Service Broker 28 Private Paas Manager API Cloud Foundry Mgmt PaaS 1 PaaS 2 PaaS N …Data store Job queueing SSH / NATS …
  29. 29. App deployment SCM Manager API SVNGit Hg User 1. Push to SCM (git/svn/hg/https) CSB API PM client Applications Resource PaaS Manager PaaS Manager API Common PaaS API PaaS 1 PaaS 2 PaaS N SCM client 4. REST 3. REST CSB plugin Repository Hooks Plugins 2. REST ACM 20 December 2013 Cloud Service Broker 29
  30. 30. RESULTS 20 December 2013 30Cloud Service Broker
  31. 31. Recommendation <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <manifest> <rules> <rule> <name>runtime</name> <params> <param>Ruby</param> <param>less-equal</param> <param>1.9.3</param> </params> </rule> <rule> <name>framework</name> <params> <param>Rails</param> <param>greater-equal</param> <param>3.0</param> </params> </rule> <rule> <name>service</name> <params> <param>POSTGRESQL_9_1</param> </params> </rule> <rule> <name>metric</name> <params> <param>response_time</param> </params> </rule> <rule> <name>metric</name> <params> <param>usage_cpu</param> </params> </rule> </rules> </manifest> 20 December 2013 Cloud Service Broker 31 0 50 100 150 200 250 0 100 200 300 400 500 600 700 800 900 1000 Time(ms) Requests Total time CSB time PaaS Manager CSB Total Average (ms) 35.878 10.893 52.976 Confidence interval (95%) 0.645 0.819 0.710 Standard deviation (ms) 10.387 1.641 11.449 Error (%) 1.797 0.935 1.341
  32. 32. Web API •  RESTful •  CSP recommendation •  Application CRUD operations •  Service CRUD operations •  Resources scaling •  Monitoring •  Migration •  Logging •  Security •  OAuth 1.0a •  HTTP Basic Authentication 20 December 2013 Cloud Service Broker 32 User Consumer Service request_token grant request_token redirect to auth page authorize request_token acknowledge authorization redirect to consumer access_token grant access_token access protected resource return requested data access protected resource return requested data access protected resource return requested data Authentication completed
  33. 33. App provisioning on a Private PaaS 20 December 2013 Cloud Service Broker 33 1.  Create VM 2.  Bootstrap Private PaaS 3.  Register Private PaaS 4.  Deploy pending apps VM @ IaaS Cloud Service Broker PaaS Manager Private PaaS Manager IaaS Manager Private PaaS User 1. Push application) 2 2.1 3 3.1 4, 5 4.1, 5.1
  34. 34. User interfaces •  Web portal •  RubyGem library •  Command-line Interface 20 December 2013 Cloud Service Broker 34
  35. 35. CONCLUSIONS 20 December 2013 35Cloud Service Broker
  36. 36. Conclusions •  Cloud computing presents a new paradigm to explore new ways of offering better solutions to customers •  Migrating from one CSP to another can be tricky, time- consuming and expensive •  Cloud interoperability should be of paramount importance •  A CSB architecture was proposed and implemented •  Recommends the most appropriate platform from a catalog of miscellaneous PaaS offerings •  Delivers cloud services on a cloud of clouds 20 December 2013 Cloud Service Broker 36
  37. 37. Future work •  PT Inovação S.A. is integrating the CSB in a larger project •  PaaS CSPs have different business models •  Predicting costs for clients is troublesome •  Reevaluate the CAMP API 20 December 2013 Cloud Service Broker 37
  38. 38. Contributions •  C. Gonçalves, D. Cunha, P. Neves, P. Sousa, J. P. Barraca, and D. Gomes, “Towards a Cloud Service Broker for the Meta-Cloud” in 12a Conferência sobre Redes de Computadores, 2012, pp. 7–13 •  http://revistas.ua.pt/index.php/crc/article/view/2035 •  DMTF CIMI Java model and client library •  LGPLv3 •  https://github.com/cgoncalves/cimi-java •  DeltaCloud •  Discussions and testing •  Code contribution •  OpenStack cloud on ATNoG •  Code contributions to OpenStack •  Add commands used by NFS volume driver to rootwrap (Cinder) •  No handler for NFS volume (Nova) 20 December 2013 Cloud Service Broker 38
  39. 39. Acknowledgments 20 December 2013 Cloud Service Broker 39
  40. 40. Q & A Thank you DETI – University of Aveiro20 December 2013
  41. 41. CLOUD SERVICE BROKER Carlos Gonçalves <carlos.goncalves@ua.pt>   Mestrado Integrado em Engenharia de Computadores e Telemática Supervised by: Prof. Dr. Diogo Gomes & Prof. Dr. João Paulo Barraca DETI – University of Aveiro20 December 2013

×