Extending Cloud Foundry - London CF User Group Sept 2014.pptx
•Download as PPTX, PDF•
3 likes•1,437 views
Extending Cloud Foundry with Open Source Toys. A user group talk covering reliably deploying and testing Cloud Foundry using Jenkins and seamlessly and scalably monitoring your Cloud Foundry Deployments using Sensu. Presented by Troy Astle and Matt Johnson at the September 2014 Cloud Foundry London Meetup
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Extending Cloud Foundry - London CF User Group Sept 2014.pptx
Similar to Extending Cloud Foundry - London CF User Group Sept 2014.pptx (20)
Recently uploaded
Recently uploaded (20)
Extending Cloud Foundry - London CF User Group Sept 2014.pptx
- 1. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Extending Cloud Foundry withOpen Source toys Troy Astle Matt Johnson Cisco UK Cisco UK @buggalo @mattdashj ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 2. Who are we? © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Cisco Cloud Security Engineers Unholy dev/ops combo ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 3. Why are we using Cloud Foundry? © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. We needed better tools Consistent dev, test & prod environments Custom built tooling outdated Speed up development ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 4. Starting out with Cloud Foundry © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Trial and Error Learning by debugging “Borrowing” chunks of BOSH yaml. Manually building and verifying CF deployments ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 5. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential “I’ve got a running CloudFoundry system, and if you’ve ever tried to run CloudFoundry and BOSH, you may never have got to this point…” Dr Nic Williams, CEO Stark & Wayne, CF Platform 2013
- 6. The BOSH learning curve © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Day 1: Why do I need BOSH? Day 2: I don’t want to learn BOSH Day 10: BOSH actually works... Day 12: BOSH is Cool Day 30: BOSH is Awesome Day 50: I got to get me some more BOSH ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 7. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BOSH Deployed successfully... But does it work?
- 8. We needed to reliably upgrade and test Cloud Foundry © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Deploy, Test and Upgrade CF using Jenkins & BOSH Separate CF manifest from environment manifest, merge with Spiff Create new deployments using the same CF manifest, guarantee consistency Project named C3CI Joint work between Cisco and CloudCredo Available on Github ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 9. Abundance of CF Tests Available © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Several Cloud Foundry test suites already available online Older: ● YETI ● NYET Newer: ● Smoke Tests ● CATS We used the NYET and Smoke tests as they were the most reliable ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 10. BOSH + Jenkins + Spiff + NYET + Smoke = CF CF BOSH Release © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential C3CI Jenkins BOSH Release Base CF manifest Environment specific manifest ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 11. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
- 12. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Consistency without development lockdown Environment specific manifest Prod Branch - Consistent base manifest Only Environment specifics change Dev Branch A Dev Branch B Dev Branch X Branch allows development and testing of any part of the deployment manifest Base CF manifest ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 13. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Like an engine… Only with more moving parts
- 14. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential We needed to know what was going on inside Cloud Foundry… Without spending the evening with Wireshark.
- 15. Requirements © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Monitor & graph the vitals of Cloud Foundry VMs deployed with BOSH. Alert if a part of Cloud Foundry is degraded or offline. Integrate with the tools used to monitor our other VMs. - ELK - Puppet-deployed Services ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 16. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Enter Sensu! ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. Subscription Checks Control Queue (Per Subscription) Results Queue (Shared) Handlers TCP3030
- 17. “What! no Nagios?” © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Scalability Dynamic Provisioning / Registration Resilience Extensibility !(Nagios Love) ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 18. Cloud Foundry © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Monitoring Cloud Foundry with Sensu Job(s) Sensu Client Job CollectD Job ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. Individual VMs
- 19. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
- 20. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
- 21. How the Sensu BOSH release works © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Sensu Client BOSH release deployed along with CF-Release Sensu Client, CollectD and Nagios checks installed on all BOSH VMs Sensu checks and CollectD metrics pushed to Sensu Server over RabbitMQ Small Python application runs as a Sensu Check to report Monit job health Uchiwa GUI is used to display Sensu Alerts Sensu routes metric data to Graphite for Graphing ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
- 22. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Thanks for having us Troy Astle @buggalo Matt Johnson @mattdashj github.com/FreightTrain/C3CI github.com/FreightTrain/sensu-client-boshrelease ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.