Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Manage your dev-test-prod like a cloud

9,794 views

Published on

This presentation was part of cloudcamp Ghent 2011.

Published in: Technology
  • Be the first to comment

Manage your dev-test-prod like a cloud

  1. 1. Manage Non-Cloud Dev & Test Environment With a Cloud Hat OnPatrick Debois http://jedi.be/blog
  2. 2. What I learned from managing Production Servers http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
  3. 3. A Single Server WEB APP DB
  4. 4. Starts GrowingWEB WEB WEBAPP APP APP DB
  5. 5. Generic Servers become Specific Servers WEB WEB WEB APP APP APP DB
  6. 6. Physical becomes VirtualWEB WEB WEBAPP APP APP DB xen/vsphere/kvm/...
  7. 7. We learn cloning isn’t workingWEBvI WEBv2 WEBv1 APP APP APP DB
  8. 8. We introduce config managementWEB APP DB = = =WEB APP DBConfig Config ConfigJEOS JEOS JEOS
  9. 9. Infrastructure as codeWEB APP DBConfig Config ConfigJEOS JEOS JEOS Config Management Code Repository Cfengine/Puppet/Chef
  10. 10. What I learned from managing Test Servers http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
  11. 11. Reuse Across EnvironmentsDEV TEST PROD WEB WEB APP APP DB DB Infrastructure Code Repository
  12. 12. Explosion of VM creationDEV TEST PROD WEB APP DB WEB APP DB WEB APP DB WEB APP DB WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure Application Code Repository Code Repository
  13. 13. UI Interface toAutomated Provisioning of VMS APP WEB APP DB INFRA WEB APP DB VM VM VM Cobbler,Spacewalk, ...
  14. 14. Metadata Registry for Systems APP WEB APP DB Config Puppet/ChefINFRA WEB APP DB Management Server VM VM VM
  15. 15. What I learned from managing development Servers http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
  16. 16. Development moves from host into virtual machines VMWEB WEBAPP APP DB DBHOST HOST
  17. 17. Development start using config mgt VM VMWEB WEBAPP APP DB DBHOST Config JEOS HOST
  18. 18. Reuse “code” across EnvironmentsDEV TEST PRODWEB WEB WEBAPP APP APPDB DB DB Infrastructure Code Repository
  19. 19. Integrate with Continuous Integration DEV TEST PRODAPP WEB APP DB WEB APP DB WEB APP DBINFRA WEB APP DB WEB APP DB WEB APP DB Infrastructure Application Code Repository Code Repository
  20. 20. Continuous Integration to Continuous Delivery Faster/Delivery DEV TEST PRODAPP WEB APP DB WEB APP DB WEB APP DBINFRA WEB APP DB WEB APP DB WEB APP DB Faster/Feedback Infrastructure Application Code Repository Code Repository
  21. 21. Development Workflow UP PROVISION VM HALT DESTROY VM Management WEB Simple CLI APP Vagrantfile DB Puppet/Chef Config Basebox JEOSStarted using vagrant HOSThttp://vagrantup.com/
  22. 22. TEST WEB APP DB WEB APP DB WEB APP DB DEV WEB APP DB PRODAPP WEB APP DB WEB APP DB WEB APP DBINFRA WEB APP DB WEB APP DB WEB APP DB Setup Outgrew Setup Outgrew Peak Capacity VM on Laptop Test Lab needed in Prod CLOUD
  23. 23. What I learned working in the (Amazon)cloud
  24. 24. My initial mindset what’s the difference ? Internal Cloud Web,App,DB Web,App,DB Config Mgmt Config MgmtMetadata Registry Metadata Registry JEOS AMI VM Xen UI Provision AWS Console
  25. 25. From console to API Abstracted Web UI “Internals” API APIAWS Console AWS API Fog Jcloud Boto
  26. 26. Beyond Servers Components Server(s) + Loadbalancers DNS Service IP Address Email Service EBS Volume Firewall Keys
  27. 27. From server to stackCloudformation Json file specifyingorder of component creation and dependencies
  28. 28. DEV TEST PRODWeb,App,DB Web,App,DB Web,App,DBConfig Mgmt Config Mgmt Config Mgmt JEOS JEOS JEOS AWS AWS AWS Fog Library (API) Mccloud (simple CLI)Reuse workflow across environments Self Servicing via namespaces
  29. 29. Cloud Libs (Jclouds/Fog/Boto) embracing even more “personal” “old” “new”Virtualbox Vsphere Kvm AWS OpenstackVM Fusion Libvirt Rackspace Eucalyptus
  30. 30. +Reuse workflow across hypervisorsWeb,App,DB Web,App,DB Web,App,DBConfig Mgmt Config Mgmt Config Mgmt JEOS JEOS JEOSVirtualbox KVM AWS Fog Library Mccloud (simple CLI)
  31. 31. So maybe you don’t haveunlimited resources http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
  32. 32. But you can shape your internal IT as a cloud
  33. 33. TODO:Orchestration
  34. 34. App App Continuous Load App Monitoring Alerting Metrics LoggingDeployment Integration Testing MetricsHeroku Cloudbees Blitz.io New Relic Pingdom Pager Duty DatadogHQ Loggly Repeating Service Pattern Simple API/CLI , Self-Servicing
  35. 35. Happy to take questions during beer http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html

×