Your SlideShare is downloading. ×
0
Puppet at the centre of everything
David Mytton
Woop Japan!
Server Density Architecture
•100 servers - Ubuntu 12.04
Server Density Architecture
•100 servers - Ubuntu 12.04
•50% virtual
Server Density Architecture
•100 servers - Ubuntu 12.04
•Nginx, Python, MongoDB
•50% virtual
Server Density Architecture
•100 servers - Ubuntu 12.04
•Nginx, Python, MongoDB
•25TB data per month
•50% virtual
Use cases
• Config
Use cases
• Config
• Failover
Use cases
• Config
• Code deploys
• Failover
Use cases
• Config
• Code deploys
• System updates
• Failover
• Base manifest
Config
• Base manifest
Config
• Sub manifests
• base
• softlayer
• softlayer-dedicated
• rackspace
• ...
Failover
• /etc/hosts
<%= metrics2IP %> alerts.honshuu.prod
audit.honshuu.prod auth.honshuu.prod
cloud.honshuu.prod datast...
Failover
• /etc/hosts
108.168.254.33 puppet
Expected
Dealing with outages
Really test your vendors
Dealing with outages
Simulations
Dealing with outages
• Commit
Code deploys
• Commit
Code deploys
• Build
• Commit
Code deploys
• Build
• Deploy
/opt/puppet/bin/mco puppetd runonce -I <host>
• Commit
Code deploys
• Build
• Deploy
• Puppet run
Code deploys
Advantages
APIs
Code deploys
Advantages
APIs
Already there
Code deploys
Advantages
APIs
Already there
System facts
Code deploys
Disadvantages
Slow
Code deploys
Disadvantages
Slow
Puppet run already
Code deploys
Disadvantages
Slow
Puppet run already
Eventually consistent
System updates
• Bash script
System updates
• Bash script
• Remote commands
System updates
• Bash script
• Remote commands
• Notifications
System updates
• Bash script
• Remote commands
• Notifications
• Canaries
•Build master (buildbot): VM x2 CPU 2.0Ghz, 2GB
RAM – $89/m
•Build slave (buildbot): VM x1 CPU 2.0Ghz, 1GB
RAM
– $40/m
•St...
Colo experiment
•Dell 1U R415
•x2 8C AMD 2.8Ghz
•32GB RAM
Colo experiment
•Dell 1U R415
•x2 8C AMD 2.8Ghz
•32GB RAM
•Dual PSU, NIC
Colo experiment
•Dell 1U R415
•x2 8C AMD 2.8Ghz
•32GB RAM
•Dual PSU, NIC
•x4 1TB SATA hot swappable
Dedicated?
Dedicated?
•Hardware replacement
Dedicated?
•Hardware replacement
•Managed/support
Dedicated?
•Hardware replacement
•Managed/support
•Networking
Colo?
Colo?
•Hardware spec/value
Colo?
•Hardware spec/value
•Total cost
Colo?
•Hardware spec/value
•Total cost
•Internal skills?
Colo?
•Hardware spec/value
•Total cost
•Internal skills?
•More fun?!
Colo: Power
•£300-350/kWh/m
•4.5A = £520/m
•9A = £900/m
David Mytton
david@serverdensity.com
@davidmytton
Woop Japan!
blog.serverdensity.com
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Puppet Camp Munich 2013: Puppet at the centre of everything
Upcoming SlideShare
Loading in...5
×

Puppet Camp Munich 2013: Puppet at the centre of everything

353

Published on

"Puppet at the centre of everything" by David Mytton of Server Density presented at Puppet Camp Munich 2013

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
353
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
21
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "Puppet Camp Munich 2013: Puppet at the centre of everything "

  1. 1. Puppet at the centre of everything
  2. 2. David Mytton Woop Japan!
  3. 3. Server Density Architecture •100 servers - Ubuntu 12.04
  4. 4. Server Density Architecture •100 servers - Ubuntu 12.04 •50% virtual
  5. 5. Server Density Architecture •100 servers - Ubuntu 12.04 •Nginx, Python, MongoDB •50% virtual
  6. 6. Server Density Architecture •100 servers - Ubuntu 12.04 •Nginx, Python, MongoDB •25TB data per month •50% virtual
  7. 7. Use cases • Config
  8. 8. Use cases • Config • Failover
  9. 9. Use cases • Config • Code deploys • Failover
  10. 10. Use cases • Config • Code deploys • System updates • Failover
  11. 11. • Base manifest Config
  12. 12. • Base manifest Config • Sub manifests
  13. 13. • base • softlayer • softlayer-dedicated • rackspace • ...
  14. 14. Failover • /etc/hosts <%= metrics2IP %> alerts.honshuu.prod audit.honshuu.prod auth.honshuu.prod cloud.honshuu.prod datastore.honshuu.prod inventory.honshuu.prod ...
  15. 15. Failover • /etc/hosts 108.168.254.33 puppet
  16. 16. Expected Dealing with outages
  17. 17. Really test your vendors Dealing with outages
  18. 18. Simulations Dealing with outages
  19. 19. • Commit Code deploys
  20. 20. • Commit Code deploys • Build
  21. 21. • Commit Code deploys • Build • Deploy
  22. 22. /opt/puppet/bin/mco puppetd runonce -I <host>
  23. 23. • Commit Code deploys • Build • Deploy • Puppet run
  24. 24. Code deploys Advantages APIs
  25. 25. Code deploys Advantages APIs Already there
  26. 26. Code deploys Advantages APIs Already there System facts
  27. 27. Code deploys Disadvantages Slow
  28. 28. Code deploys Disadvantages Slow Puppet run already
  29. 29. Code deploys Disadvantages Slow Puppet run already Eventually consistent
  30. 30. System updates • Bash script
  31. 31. System updates • Bash script • Remote commands
  32. 32. System updates • Bash script • Remote commands • Notifications
  33. 33. System updates • Bash script • Remote commands • Notifications • Canaries
  34. 34. •Build master (buildbot): VM x2 CPU 2.0Ghz, 2GB RAM – $89/m •Build slave (buildbot): VM x1 CPU 2.0Ghz, 1GB RAM – $40/m •Staging load balancer: VM x1 CPU 2.0Ghz, 1GB RAM – $40/m •Staging server 1: VM x2 CPU 2.0Ghz, 8GB RAM – $165/m •Staging server 2: VM x1 CPU 2.0Ghz, 2GB RAM – $50/m •Puppet master: VM x2 CPU 2.0Ghz, 2GB RAM – $89/m Colo experiment
  35. 35. Colo experiment •Dell 1U R415 •x2 8C AMD 2.8Ghz •32GB RAM
  36. 36. Colo experiment •Dell 1U R415 •x2 8C AMD 2.8Ghz •32GB RAM •Dual PSU, NIC
  37. 37. Colo experiment •Dell 1U R415 •x2 8C AMD 2.8Ghz •32GB RAM •Dual PSU, NIC •x4 1TB SATA hot swappable
  38. 38. Dedicated?
  39. 39. Dedicated? •Hardware replacement
  40. 40. Dedicated? •Hardware replacement •Managed/support
  41. 41. Dedicated? •Hardware replacement •Managed/support •Networking
  42. 42. Colo?
  43. 43. Colo? •Hardware spec/value
  44. 44. Colo? •Hardware spec/value •Total cost
  45. 45. Colo? •Hardware spec/value •Total cost •Internal skills?
  46. 46. Colo? •Hardware spec/value •Total cost •Internal skills? •More fun?!
  47. 47. Colo: Power •£300-350/kWh/m •4.5A = £520/m •9A = £900/m
  48. 48. David Mytton david@serverdensity.com @davidmytton Woop Japan! blog.serverdensity.com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×