Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
Extending Cloud Foundry 
withOpen Source t...
Who are we? 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Cisco. Creative Commons ...
Why are we using 
Cloud Foundry? 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Cis...
Starting out with 
Cloud Foundry 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Cis...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
“I’ve got a running CloudFoundry system, a...
The BOSH 
learning curve 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Cisco. Crea...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
BOSH Deployed successfully... 
But does it...
We needed to 
reliably upgrade 
and test 
Cloud Foundry 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco ...
Abundance of CF 
Tests Available 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Cis...
BOSH + Jenkins + Spiff + NYET + Smoke = CF 
CF BOSH 
Release 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
C...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
Consistency without development lockdown 
...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
Like an engine… Only with more moving part...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
We needed to know what 
was going on insid...
Requirements 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Cisco. Creative Commons...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
Enter Sensu! 
©Cisco System 2014 - This wo...
“What! no Nagios?” 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Cisco. Creative C...
Cloud Foundry 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
Monitoring Cloud Foundry wi...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential
How the Sensu 
BOSH release works 
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
2014 Ci...
© 2013 Cisco and/or its affiliates. All rights 
reserved. 
Cisco 
Confidential 
Thanks for having us 
Troy Astle 
@buggalo...
Upcoming SlideShare
Loading in …5
×

Extending Cloud Foundry - London CF User Group Sept 2014.pptx

1,270 views

Published on

Extending Cloud Foundry with Open Source Toys.

A user group talk covering reliably deploying and testing Cloud Foundry using Jenkins and seamlessly and scalably monitoring your Cloud Foundry Deployments using Sensu.

Presented by Troy Astle and Matt Johnson at the September 2014 Cloud Foundry London Meetup

Published in: Technology
  • Be the first to comment

Extending Cloud Foundry - London CF User Group Sept 2014.pptx

  1. 1. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Extending Cloud Foundry withOpen Source toys Troy Astle Matt Johnson Cisco UK Cisco UK @buggalo @mattdashj ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  2. 2. Who are we? © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Cisco Cloud Security Engineers Unholy dev/ops combo ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  3. 3. Why are we using Cloud Foundry? © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. We needed better tools Consistent dev, test & prod environments Custom built tooling outdated Speed up development ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  4. 4. Starting out with Cloud Foundry © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Trial and Error Learning by debugging “Borrowing” chunks of BOSH yaml. Manually building and verifying CF deployments ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  5. 5. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential “I’ve got a running CloudFoundry system, and if you’ve ever tried to run CloudFoundry and BOSH, you may never have got to this point…” Dr Nic Williams, CEO Stark & Wayne, CF Platform 2013
  6. 6. The BOSH learning curve © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Day 1: Why do I need BOSH? Day 2: I don’t want to learn BOSH Day 10: BOSH actually works... Day 12: BOSH is Cool Day 30: BOSH is Awesome Day 50: I got to get me some more BOSH ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  7. 7. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential BOSH Deployed successfully... But does it work?
  8. 8. We needed to reliably upgrade and test Cloud Foundry © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Deploy, Test and Upgrade CF using Jenkins & BOSH Separate CF manifest from environment manifest, merge with Spiff Create new deployments using the same CF manifest, guarantee consistency Project named C3CI Joint work between Cisco and CloudCredo Available on Github ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  9. 9. Abundance of CF Tests Available © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Several Cloud Foundry test suites already available online Older: ● YETI ● NYET Newer: ● Smoke Tests ● CATS We used the NYET and Smoke tests as they were the most reliable ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  10. 10. BOSH + Jenkins + Spiff + NYET + Smoke = CF CF BOSH Release © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential C3CI Jenkins BOSH Release Base CF manifest Environment specific manifest ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  11. 11. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
  12. 12. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Consistency without development lockdown Environment specific manifest Prod Branch - Consistent base manifest Only Environment specifics change Dev Branch A Dev Branch B Dev Branch X Branch allows development and testing of any part of the deployment manifest Base CF manifest ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  13. 13. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Like an engine… Only with more moving parts
  14. 14. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential We needed to know what was going on inside Cloud Foundry… Without spending the evening with Wireshark.
  15. 15. Requirements © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Monitor & graph the vitals of Cloud Foundry VMs deployed with BOSH. Alert if a part of Cloud Foundry is degraded or offline. Integrate with the tools used to monitor our other VMs. - ELK - Puppet-deployed Services ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  16. 16. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Enter Sensu! ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. Subscription Checks Control Queue (Per Subscription) Results Queue (Shared) Handlers TCP3030
  17. 17. “What! no Nagios?” © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Scalability Dynamic Provisioning / Registration Resilience Extensibility !(Nagios Love) ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  18. 18. Cloud Foundry © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Monitoring Cloud Foundry with Sensu Job(s) Sensu Client Job CollectD Job ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. Individual VMs
  19. 19. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
  20. 20. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
  21. 21. How the Sensu BOSH release works © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2014 Cisco. Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. Sensu Client BOSH release deployed along with CF-Release Sensu Client, CollectD and Nagios checks installed on all BOSH VMs Sensu checks and CollectD metrics pushed to Sensu Server over RabbitMQ Small Python application runs as a Sensu Check to report Monit job health Uchiwa GUI is used to display Sensu Alerts Sensu routes metric data to Graphite for Graphing ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
  22. 22. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Thanks for having us Troy Astle @buggalo Matt Johnson @mattdashj github.com/FreightTrain/C3CI github.com/FreightTrain/sensu-client-boshrelease ©Cisco System 2014 - This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

×