Puppet Camp Munich 2013: Puppet at the centre of everything

554 views

Published on

"Puppet at the centre of everything" by David Mytton of Server Density presented at Puppet Camp Munich 2013

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
554
On SlideShare
0
From Embeds
0
Number of Embeds
16
Actions
Shares
0
Downloads
23
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Puppet Camp Munich 2013: Puppet at the centre of everything

  1. 1. Puppet at the centre of everything
  2. 2. David Mytton Woop Japan!
  3. 3. Server Density Architecture •100 servers - Ubuntu 12.04
  4. 4. Server Density Architecture •100 servers - Ubuntu 12.04 •50% virtual
  5. 5. Server Density Architecture •100 servers - Ubuntu 12.04 •Nginx, Python, MongoDB •50% virtual
  6. 6. Server Density Architecture •100 servers - Ubuntu 12.04 •Nginx, Python, MongoDB •25TB data per month •50% virtual
  7. 7. Use cases • Config
  8. 8. Use cases • Config • Failover
  9. 9. Use cases • Config • Code deploys • Failover
  10. 10. Use cases • Config • Code deploys • System updates • Failover
  11. 11. • Base manifest Config
  12. 12. • Base manifest Config • Sub manifests
  13. 13. • base • softlayer • softlayer-dedicated • rackspace • ...
  14. 14. Failover • /etc/hosts <%= metrics2IP %> alerts.honshuu.prod audit.honshuu.prod auth.honshuu.prod cloud.honshuu.prod datastore.honshuu.prod inventory.honshuu.prod ...
  15. 15. Failover • /etc/hosts 108.168.254.33 puppet
  16. 16. Expected Dealing with outages
  17. 17. Really test your vendors Dealing with outages
  18. 18. Simulations Dealing with outages
  19. 19. • Commit Code deploys
  20. 20. • Commit Code deploys • Build
  21. 21. • Commit Code deploys • Build • Deploy
  22. 22. /opt/puppet/bin/mco puppetd runonce -I <host>
  23. 23. • Commit Code deploys • Build • Deploy • Puppet run
  24. 24. Code deploys Advantages APIs
  25. 25. Code deploys Advantages APIs Already there
  26. 26. Code deploys Advantages APIs Already there System facts
  27. 27. Code deploys Disadvantages Slow
  28. 28. Code deploys Disadvantages Slow Puppet run already
  29. 29. Code deploys Disadvantages Slow Puppet run already Eventually consistent
  30. 30. System updates • Bash script
  31. 31. System updates • Bash script • Remote commands
  32. 32. System updates • Bash script • Remote commands • Notifications
  33. 33. System updates • Bash script • Remote commands • Notifications • Canaries
  34. 34. •Build master (buildbot): VM x2 CPU 2.0Ghz, 2GB RAM – $89/m •Build slave (buildbot): VM x1 CPU 2.0Ghz, 1GB RAM – $40/m •Staging load balancer: VM x1 CPU 2.0Ghz, 1GB RAM – $40/m •Staging server 1: VM x2 CPU 2.0Ghz, 8GB RAM – $165/m •Staging server 2: VM x1 CPU 2.0Ghz, 2GB RAM – $50/m •Puppet master: VM x2 CPU 2.0Ghz, 2GB RAM – $89/m Colo experiment
  35. 35. Colo experiment •Dell 1U R415 •x2 8C AMD 2.8Ghz •32GB RAM
  36. 36. Colo experiment •Dell 1U R415 •x2 8C AMD 2.8Ghz •32GB RAM •Dual PSU, NIC
  37. 37. Colo experiment •Dell 1U R415 •x2 8C AMD 2.8Ghz •32GB RAM •Dual PSU, NIC •x4 1TB SATA hot swappable
  38. 38. Dedicated?
  39. 39. Dedicated? •Hardware replacement
  40. 40. Dedicated? •Hardware replacement •Managed/support
  41. 41. Dedicated? •Hardware replacement •Managed/support •Networking
  42. 42. Colo?
  43. 43. Colo? •Hardware spec/value
  44. 44. Colo? •Hardware spec/value •Total cost
  45. 45. Colo? •Hardware spec/value •Total cost •Internal skills?
  46. 46. Colo? •Hardware spec/value •Total cost •Internal skills? •More fun?!
  47. 47. Colo: Power •£300-350/kWh/m •4.5A = £520/m •9A = £900/m
  48. 48. David Mytton david@serverdensity.com @davidmytton Woop Japan! blog.serverdensity.com

×