Berlin Devops: Managing systems with Marionette Collective

1,364 views

Published on

My talk @blndevops Meetup 12Q3

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,364
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Berlin Devops: Managing systems with Marionette Collective

  1. 1. Managing large systems withMarionette Collectiveandreas.schmidt@cassini.detwitter @aschmidt75© 2012 Cassini Consulting GmbH
  2. 2. About myself Software Development C++, Java (EE) Web Operations Solaris, Linux, Shell Infrastructure Development Puppet, Ruby About Cassini Systems Management IT Security Configuration Mgt & Deployment Automation2
  3. 3. What is MCollective? What is needed to set it up? How does it work? Small demo3
  4. 4. 1 year later Test / Production 200 hosts stage 20 hosts Development Stage 5 hosts4
  5. 5. 5
  6. 6. „ “ ssh in a for loop is not a solution - Luke Kanies6
  7. 7. „ If you ever have to log on to a single box, you‘re doing it wrong. “ Kristian Köhntopp, OSDC20127
  8. 8. „ mcollective is ssh on steroids “ @kbuytaert8
  9. 9. SSH … mcollective … is a protocol connecting is a broadcast-oriented two endpoints framework is used primarily to transports structured transport text data within an API9 19.07.2012
  10. 10. Marionette Collective Overview10
  11. 11. Architecture | What does it do? Me Messaging Middleware My Hosts11
  12. 12. Ruby 1.8.7+ Architecture | Components mcollective client stomp ActiveMQ | RabbitMQ Ruby 1.8.7+ mcollective stomp facter agent code12
  13. 13. Architecture | Collectives Collective13
  14. 14. Architecture | Collectives Collective Subcollective14
  15. 15. facter: Adressing by Facts operatingsystem=centos ipaddress=~^10.1.3015
  16. 16. Walk-Through client sends request to middleware topic 2 All hosts watch 1 topic and, reading request as it becomes 5 available 3 Client reads 6 all results from topic Results are delivered 4 Host w/ matching facts execute agent call16
  17. 17. DEMO17
  18. 18. Backup // DEMO18
  19. 19. Backup // DEMO19
  20. 20. Backup // DEMO20
  21. 21. Backup // DEMO21
  22. 22. Backup // DEMO22
  23. 23. Backup // DEMO23
  24. 24. Backup // DEMO24
  25. 25. Backup // DEMO25
  26. 26. Backup // DEMO26
  27. 27. Backup // DEMO27
  28. 28. Backup // DEMO28
  29. 29. Backup // DEMO29
  30. 30. 30
  31. 31. What about security? AES Security Plugin Client Messaging Node Middleware Stomp Stomp Agent mcollective Message mcollectived server Payload User SK AES User PK Server PK Server SK + Authorization Plugin + Auditing Plugin31
  32. 32. MCollective 2.0 • Direct Addressing Mode • Message TTLs • Complex Discovery Statements • Pluggable discovery32
  33. 33. True Parallelism API w/ data validation Deterministic timing Added Velocity Scales really well33
  34. 34. Q& ACassini Consultingandreas.schmidt@cassini.detwitter @aschmidt7534

×