1April 26, 2013Deploying OpenStack with Chef and Operational Tooling#chefconf 2013
RACKSPACE® HOSTING | WWW.RACKSPACE.COMWho Are We?Justin ShepherdPrincipal ArchitectRackspace Private Cloudgithub.com/galst...
3RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Only consume Open Source projects• All changes go upstream• CHEF-3889 - tunables ...
4RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Jenkins is used for testing and gating of our cookbooks• Syntax Verification (pep...
5RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow Did We Get Here?5
6RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Installing Bexar and Cactus by hand• Problems• Deployed from trunk• No packages a...
7RACKSPACE® HOSTING | WWW.RACKSPACE.COMDefining Our Mission7
8RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We need to make it easy to install• We need to make the installation repeatable• ...
9RACKSPACE® HOSTING | WWW.RACKSPACE.COMAutomating OpenStack Deployment9
10RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Deploying Cactus and Diablo• Puppet• Inherited from OpenStack Team• djeep based•...
11RACKSPACE® HOSTING | WWW.RACKSPACE.COMMission StatusWe need to make it easy to install FAILWe need to make the installat...
12RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Crowbar• Dell platform for deployment• Chef based• Very heavyweight• ISO install...
13RACKSPACE® HOSTING | WWW.RACKSPACE.COMMission StatusWe need to make it easy to install Almost PassedWe need to make the ...
14RACKSPACE® HOSTING | WWW.RACKSPACE.COMFeature Creep14
15RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We need to make it easy to install• We need to make the installation repeatable•...
16RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did Puppet do?We need to make it easy to install FAILWe need to make the insta...
17RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did Crowbar do?We need to make it easy to install Almost PassedWe need to make...
18RACKSPACE® HOSTING | WWW.RACKSPACE.COMNext Steps in Automation18
19RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Deploying Essex• Started to build our own cookbooks• Heavy utilization of Chef s...
20RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Deploying Folsom• Creating LWRPs for REST based Services• Rewrites of many cookb...
21RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did we do?We need to make it easy to install PASSEDWe need to make the install...
22RACKSPACE® HOSTING | WWW.RACKSPACE.COMMore Feature Creep22
23RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We need to make it easy to install• We need to make the installation repeatable•...
24RACKSPACE® HOSTING | WWW.RACKSPACE.COM• keepalived for failover IP• haproxy for load balancing REST based services• Mult...
25RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Support for multiple Cinder Backends• Currently NetApp and EMC• Support for SDN•...
26RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did we do?We need to make it easy to install FAILED!We need to make the instal...
27RACKSPACE® HOSTING | WWW.RACKSPACE.COMThe Tipping Point27
28RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We had a system that can do real interesting things• You now need to have staff ...
29RACKSPACE® HOSTING | WWW.RACKSPACE.COMOpenCenter29
30RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Simplifies, speeds up deployment• Lowers Operator overhead• Minimizes the intern...
31RACKSPACE® HOSTING | WWW.RACKSPACE.COMWhat is OpenCenter?
32RACKSPACE® HOSTING | WWW.RACKSPACE.COMWhat is OpenCenter
33RACKSPACE® HOSTING | WWW.RACKSPACE.COMLowers Operator Overhead
34RACKSPACE® HOSTING | WWW.RACKSPACE.COMResiliency for Private Cloud
35RACKSPACE® HOSTING | WWW.RACKSPACE.COMSolver – Automates Operator Tasks
36RACKSPACE® HOSTING | WWW.RACKSPACE.COMExtensibleWrite your own Python/Bash scripts to createworkflows that extend OpenCe...
37RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did we do?We need to make it easy to install PASSEDWe need to make the install...
38RACKSPACE® HOSTING | WWW.RACKSPACE.COMErrata38
39RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Partial Searches and Templates• Remove dependencies on monitoring and logging• M...
4040RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | W...
Upcoming SlideShare
Loading in …5
×

Rackspace Private Cloud presentation for ChefConf 2013

1,673 views

Published on

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,673
On SlideShare
0
From Embeds
0
Number of Embeds
110
Actions
Shares
0
Downloads
32
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Joe
  • Both
  • Joe
  • Joe
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep
  • Joe
  • Joe
  • Joe
  • Joe
  • Joe
  • Joe
  • Joe
  • Joe
  • Joe
  • Joe
  • Joe
  • Shep
  • Shep
  • Shep
  • Shep
  • Shep OpenCenter automates the following key complex tasks Install Chef Server, Create Nova Cluster, Create Availability Zone, Adding Compute Nodes to Cluster, Evacuating hosts
  • Shep Reduce Risk and Provides Automated Failover
  • Shep
  • Shep
  • Shep
  • Joe
  • Joe
  • Both
  • Rackspace Private Cloud presentation for ChefConf 2013

    1. 1. 1April 26, 2013Deploying OpenStack with Chef and Operational Tooling#chefconf 2013
    2. 2. RACKSPACE® HOSTING | WWW.RACKSPACE.COMWho Are We?Justin ShepherdPrincipal ArchitectRackspace Private Cloudgithub.com/galstrom21Joseph BreuDeployment EngineerRackspace Private Cloudgithub.com/rackerjoe@rackerjoe
    3. 3. 3RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Only consume Open Source projects• All changes go upstream• CHEF-3889 - tunables for postgres• CHEF-3849 - redirect login bug• Everything must be automated through the deployment andmanagement stacks.• Everything we build is Open Souce• https:/github.com/rcbops• github.com/rcbops-cookbooksRackspace Private Cloud Philosophy
    4. 4. 4RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Jenkins is used for testing and gating of our cookbooks• Syntax Verification (pep8, foodcritic)• Unit Tests for OpenCenter• Full deployment of OpenStack utilizing the cookbooks withthe proposed changeset applied• Functional Tests of OpenStack• OpenStack API Testing• OpenStack CLI Testing• Upstream opscode cookbooks are tested before inclusionTesting
    5. 5. 5RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow Did We Get Here?5
    6. 6. 6RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Installing Bexar and Cactus by hand• Problems• Deployed from trunk• No packages available for distributions• Not easily repeatable• Not easily supportedIn The BeginningEarly 2011
    7. 7. 7RACKSPACE® HOSTING | WWW.RACKSPACE.COMDefining Our Mission7
    8. 8. 8RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We need to make it easy to install• We need to make the installation repeatable• We need to model “Real World Deployments”The MissionEarly 2011
    9. 9. 9RACKSPACE® HOSTING | WWW.RACKSPACE.COMAutomating OpenStack Deployment9
    10. 10. 10RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Deploying Cactus and Diablo• Puppet• Inherited from OpenStack Team• djeep based• Very simplistic, not flexible• Represented the developer case - not real world deployments10Automate!Late 2011
    11. 11. 11RACKSPACE® HOSTING | WWW.RACKSPACE.COMMission StatusWe need to make it easy to install FAILWe need to make the installation repeatable PASSWe need to model “Real World Deployments” FAIL
    12. 12. 12RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Crowbar• Dell platform for deployment• Chef based• Very heavyweight• ISO installation• Boot shim for system discovery• Used for a few deployments and contributed code upstream• Upgrades were painful or not possible at all12Automate!Late 2011 - Diablo
    13. 13. 13RACKSPACE® HOSTING | WWW.RACKSPACE.COMMission StatusWe need to make it easy to install Almost PassedWe need to make the installation repeatable PASSWe need to model “Real World Deployments” Almost Passed
    14. 14. 14RACKSPACE® HOSTING | WWW.RACKSPACE.COMFeature Creep14
    15. 15. 15RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We need to make it easy to install• We need to make the installation repeatable• We need to mode “Real World Deployments”• We need to handle updates• We need to quickly consume new OpenStack services• We need to plug into existing infrastructure (PXE, DNS, LDAP, etc)15We now need to…March 2012
    16. 16. 16RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did Puppet do?We need to make it easy to install FAILWe need to make the installation repeatable PASSWe need to model “Real World Deployments” FAILWe need to handle updates FAILWe need to quickly consume new OpenStack Services FAILWe need to plug into existing infrastructure FAIL
    17. 17. 17RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did Crowbar do?We need to make it easy to install Almost PassedWe need to make the installation repeatable PASSWe need to model “Real World Deployments” Almost PassedWe need to handle updates FAILWe need to quickly consume new OpenStack Services FAILWe need to plug into existing infrastructure FAIL
    18. 18. 18RACKSPACE® HOSTING | WWW.RACKSPACE.COMNext Steps in Automation18
    19. 19. 19RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Deploying Essex• Started to build our own cookbooks• Heavy utilization of Chef search• Modeled real world deployments• Support for multiple Operating SystemsNext Steps in AutomationMarch 2012
    20. 20. 20RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Deploying Folsom• Creating LWRPs for REST based Services• Rewrites of many cookbooks to support multiple Operating Systems• Debian and RedHat based• Search wrapper functions for ease of useNext Steps in AutomationLate 2012
    21. 21. 21RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did we do?We need to make it easy to install PASSEDWe need to make the installation repeatable PASSEDWe need to model “Real World Deployments” PASSEDWe need to handle updates PASSEDWe need to quickly consume new OpenStack Services PASSEDWe need to plug into existing infrastructure Almost PASSED
    22. 22. 22RACKSPACE® HOSTING | WWW.RACKSPACE.COMMore Feature Creep22
    23. 23. 23RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We need to make it easy to install• We need to make the installation repeatable• We need to mode “Real World Deployments”• We need to handle updates• We need to quickly consume new OpenStack services• We need to plug into existing infrastructure (PXE, DNS, LDAP, etc)• We need provide Highly Available OpenStack Services• We need to provide support for Vendor Integration for Block Storage• We need to support Software Defined Networks23We now need to…December 2012
    24. 24. 24RACKSPACE® HOSTING | WWW.RACKSPACE.COM• keepalived for failover IP• haproxy for load balancing REST based services• Multi-master MySQL replication and keepalived• Active/Passive RabbitmQ and keepalived• This is sketchy in Folsom - better in GrizzlyCreating Highly Available ServicesEarly 2013
    25. 25. 25RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Support for multiple Cinder Backends• Currently NetApp and EMC• Support for SDN• Currently only OVS• LDAP Support• Greenfield LDAP deployments only• No AD support... yet...Other ServicesEarly 2013
    26. 26. 26RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did we do?We need to make it easy to install FAILED!We need to make the installation repeatable PASSEDWe need to model “Real World Deployments” PASSEDWe need to handle updates PASSEDWe need to quickly consume new OpenStack Services PASSEDWe need to plug into existing infrastructure PASSEDWe need to provide Highly Available OpenStackservicesPASSEDWe need to provide support for Vendor Integration forBlock StoragePASSEDWe need to Support Software Defined Networks PASSED
    27. 27. 27RACKSPACE® HOSTING | WWW.RACKSPACE.COMThe Tipping Point27
    28. 28. 28RACKSPACE® HOSTING | WWW.RACKSPACE.COM• We had a system that can do real interesting things• You now need to have staff with strong Chef knowledge to use it• And strong OpenStack knowledge...• OpenSource Chef is great for some things – but not everything• We need to orchestrate changes across a cluster• We need to do it in a defined orderThe Tipping PointEarly 2013
    29. 29. 29RACKSPACE® HOSTING | WWW.RACKSPACE.COMOpenCenter29
    30. 30. 30RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Simplifies, speeds up deployment• Lowers Operator overhead• Minimizes the internal OpenStack knowledge• Provides resiliency in the Cloud• API for command line accessWhat is OpenCenter?
    31. 31. 31RACKSPACE® HOSTING | WWW.RACKSPACE.COMWhat is OpenCenter?
    32. 32. 32RACKSPACE® HOSTING | WWW.RACKSPACE.COMWhat is OpenCenter
    33. 33. 33RACKSPACE® HOSTING | WWW.RACKSPACE.COMLowers Operator Overhead
    34. 34. 34RACKSPACE® HOSTING | WWW.RACKSPACE.COMResiliency for Private Cloud
    35. 35. 35RACKSPACE® HOSTING | WWW.RACKSPACE.COMSolver – Automates Operator Tasks
    36. 36. 36RACKSPACE® HOSTING | WWW.RACKSPACE.COMExtensibleWrite your own Python/Bash scripts to createworkflows that extend OpenCenter
    37. 37. 37RACKSPACE® HOSTING | WWW.RACKSPACE.COMHow did we do?We need to make it easy to install PASSEDWe need to make the installation repeatable PASSEDWe need to model “Real World Deployments” PASSEDWe need to handle updates PASSEDWe need to quickly consume new OpenStack Services PASSEDWe need to plug into existing infrastructure PASSEDWe need to provide Highly Available OpenStackservicesPASSEDWe need to provide support for Vendor Integration forBlock StoragePASSEDWe need to Support Software Defined Networks PASSED
    38. 38. 38RACKSPACE® HOSTING | WWW.RACKSPACE.COMErrata38
    39. 39. 39RACKSPACE® HOSTING | WWW.RACKSPACE.COM• Partial Searches and Templates• Remove dependencies on monitoring and logging• Make our cookbooks more easily consumable• Upstream our cookbooks to the OpsCode OpenStack repos• Utilize OpenStack CI testing and gatingLooking forward
    40. 40. 4040RACKSPACE® HOSTING | 5000 WALZEM ROAD | SAN ANTONIO, TX 78218US SALES: 1-800-961-2888 | US SUPPORT: 1-800-961-4454 | WWW.RACKSPACE.COMRACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM

    ×