OpenStack at Scale: Lessons learned from HP Cloud

Like this? Share it with your network

Share

OpenStack at Scale: Lessons learned from HP Cloud

  • 3,618 views
Uploaded on

Blake Yeager, Director of Product Management at HP Cloud Services presented a keynote at Gluecon 2013 on the OpenStack Public Cloud and the lessons learned from building the HP Public Cloud.

Blake Yeager, Director of Product Management at HP Cloud Services presented a keynote at Gluecon 2013 on the OpenStack Public Cloud and the lessons learned from building the HP Public Cloud.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
3,618
On Slideshare
3,584
From Embeds
34
Number of Embeds
2

Actions

Shares
Downloads
190
Comments
0
Likes
12

Embeds 34

https://twitter.com 32
http://cafe.naver.com 2

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. © Copyright 2013 Hewlett-Packard Development Company, L.P.OpenStackatScaleLessonslearnedbuildingHPCloudServicesBlake YeagerDirector of Product Managementblake.yeager@hp.com
  • 2. © Copyright 2012 Hewlett-Packard Development Company, L.P.WhatisOpenStack?
  • 3. © Copyright 2013 Hewlett-Packard Development Company, L.P.What is OpenStack?OpenStack is an open source cloud management platform,consisting of a collection of open source projects developedand released together which when deployed allow you toquickly stand up an infrastructure-as-a-service cloud.
  • 4. © Copyright 2013 Hewlett-Packard Development Company, L.P.A Brief History of OpenStack• Launched by Rackspace & NASA at OSCON in Portland, July 2010• Original projects: Compute, Image Management and Object Storage• OpenStack has expanded to include 9 “Integrated” projects• The OpenStack Foundation was created in 2012• Community of over 200 companies and growing• Currently working on “Havana”, the 8th major release
  • 5. © Copyright 2013 Hewlett-Packard Development Company, L.P.OpenStack’s MissionThe OpenStack Open Source Cloud Mission:To produce the ubiquitous Open Source Cloud Computing platform that willmeet the needs of public and private clouds regardless of size, by beingsimple to implement and massively scalableOpenStack’s Three Opens:Open Design ProcessOpen Development ModelOpen Community
  • 6. © Copyright 2013 Hewlett-Packard Development Company, L.P.The Projects of OpenStack (Havana Release)Integrated Projects• Compute (Nova)• Object Storage (Swift)• Image Management (Glance)• Identity Management (Keystone)• Dashboard (Horizon)• Networking (Quantum)• Block Storage (Cinder)• Monitoring and Metering (Ceilometer)• Orchestration (Heat)Plus multiple library, infrastructure,documentation, continuous integrationand other supporting projects
  • 7. © Copyright 2013 Hewlett-Packard Development Company, L.P.The Projects of OpenStack (Havana Release)Incubated Projects• Ironic (Bare Metal Provisioning)• Red Dwarf (Relational Database)Related Projects• Triple O (OpenStack on OpenStack)• Moniker (DNS-as-a-Service)• Marconi (Message Queuing)• Savanna (Hadoop Provisioning)• Murano (Windows Orchestration)• Convection (Task System Service)
  • 8. © Copyright 2013 Hewlett-Packard Development Company, L.P.OpenStack ReleasesOpenStack uses a fixed time release cadence• First 2 releases where on a 3 month release cycle• OpenStack now uses a 6 month release cycle with releases in April & OctoberPrior to each release a design summit is held for developers and the community• Community meets and to discuss priorities and work for the next releaseRelease are named alphabetically• Normally named after a city or county in which the design summit is heldAustinOct 2010BexarJan 2011CactusApr 2011DiabloOct 2011EssexApr 2012FolsomOct 2012GrizzlyApr 2013HavanaOct 2013“I”Apr 2014
  • 9. © Copyright 2012 Hewlett-Packard Development Company, L.P.WhatdoesscalemeantoIaaSproviders?
  • 10. © Copyright 2013 Hewlett-Packard Development Company, L.P.What is scale? – The wrong questions to ask…How manynodes (hosts)does your cloudhave?How many regions oravailability zonesdoes your cloudinclude?How manyinstances (VMs)are running inyour cloud?
  • 11. © Copyright 2013 Hewlett-Packard Development Company, L.P.What is scale? – The wrong questions to ask…How manynodes (hosts)does your cloudhave?How many regions oravailability zonesdoes your cloudinclude?How manyinstances (VMs)are running inyour cloud?
  • 12. © Copyright 2013 Hewlett-Packard Development Company, L.P.What is scale? – The right questions to ask…How long doesit take to createan instance inyour cloud?How many APIrequests per secondcan your cloudhandle?How manyinstances (VMs) canyou createconcurrently inyour cloud?
  • 13. © Copyright 2013 Hewlett-Packard Development Company, L.P.
  • 14. © Copyright 2013 Hewlett-Packard Development Company, L.P.
  • 15. © Copyright 2012 Hewlett-Packard Development Company, L.P.PlanningyourOpenStackdeployment
  • 16. © Copyright 2013 Hewlett-Packard Development Company, L.P.Per availability zone deployment modelAZ1 AZ2 AZ3Region ANova, Glance,Cinder &NetworkNova, Glance,Cinder &NetworkNova, Glance,Cinder &NetworkSwiftKeystoneComputeNodesComputeNodesComputeNodes
  • 17. © Copyright 2013 Hewlett-Packard Development Company, L.P.Per availability zone deployment model• Each control plane is fully isolated, good for availability• Control plane is easier to scale, good for scalability• But, the overall user experience suffers…• Images can’t be used in multiple availability zones• Networks and IP addresses can span multiple availability zones
  • 18. © Copyright 2013 Hewlett-Packard Development Company, L.P.Per region deployment model with host aggregatesAZ1 AZ2 AZ3Region ASwiftKeystoneComputeNodesComputeNodesComputeNodesNova, Glance, Cinder & Network Control PlaneHost AggregateHost Aggregate Host Aggregate
  • 19. © Copyright 2013 Hewlett-Packard Development Company, L.P.Per region deployment model with cellsAZ1 AZ2 AZ3Region ANova “Cell” Nova “Cell”Nova “Cell”SwiftKeystoneComputeNodesComputeNodesComputeNodesNova API “Cell”Block, Glance & Network
  • 20. © Copyright 2012 Hewlett-Packard Development Company, L.P.ScalingtheOpenStackcontrolplane
  • 21. © Copyright 2013 Hewlett-Packard Development Company, L.P.The detailed architecture of OpenStack*Image provided by Ken Pepple under the following license: CC BY-SA 3.0
  • 22. © Copyright 2013 Hewlett-Packard Development Company, L.P.Areas where it is easy to horizontally scale*Image provided by Ken Pepple under the following license: CC BY-SA 3.0
  • 23. © Copyright 2013 Hewlett-Packard Development Company, L.P.Areas to focus on for improved scalability*Image provided by Ken Pepple under the following license: CC BY-SA 3.0
  • 24. © Copyright 2013 Hewlett-Packard Development Company, L.P.Glance’s role in starting new instances1. A request for new instance is received and scheduled on a compute node2. The compute node checks if it has a local copy of the image it needs3. If it does not, the compute node requests the image from Glance4. Glance then streams the image to the compute nodeThe ability to create multiple instances concurrently isdirectly tied Glance’s ability to stream the instances to thecompute nodes starting the instances
  • 25. © Copyright 2013 Hewlett-Packard Development Company, L.P.Pre-caching popular images on compute nodes• Allows for fastest instance startup• Allows Glance to handle only custom or rare images• Compute node cache should be actively managed
  • 26. © Copyright 2013 Hewlett-Packard Development Company, L.P.Other key areas for scalabilityNova DatabaseThe Nova Database is probably the single most critical component of Nova forscalability, size this component wiselyNova Compute NodesA compute node will only be able to create so many instances at a time withoutdestroying performance of existing instances
  • 27. © Copyright 2013 Hewlett-Packard Development Company, L.P.Other key areas for scalabilityNetworkPick your network deployment model very carefully, VLANs and even a flat networkingmodel are very hard to scale, a good SDN solution will go a long wayKeystoneThe number of API calls your service can handle is directly tied to the number ofauthorization requests Keystone can handle
  • 28. © Copyright 2012 Hewlett-Packard Development Company, L.P.DeployingOpenStackatScale
  • 29. © Copyright 2013 Hewlett-Packard Development Company, L.P.Triple O - “OpenStack on OpenStack”Goal of the project is to deploy an OpenStack cloud using an OpenStack cloudRequirements:1. Basic server management – Nova2. Bare metal provisioning – Ironic3. Orchestration – Heat4. Image Management – Glance5. Configuration – Chef/Puppet/etc.
  • 30. © Copyright 2012 Hewlett-Packard Development Company, L.P.Thankyou!www.hpcloud.comblake.yeager@hp.com@Blake_Yeager