Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Spinnaker - Bay Area AWS Meetup - 20160726

614 views

Published on

A talk given at the 2016-07-26 edition of the Bay Area AWS Meetup. Covers the Spinnaker Continuous Delivery platform from Netflix.

Published in: Technology
  • Login to see the comments

Spinnaker - Bay Area AWS Meetup - 20160726

  1. 1. Spinnaker Bay Area AWS User Group July 26th, 2016 Shifting the Curve Towards Reliable and Cost Effective Cloud Operations
  2. 2. Assumed Knowledge * Cloud Deployment (doesn't have to be AWS) * Continuous Delivery and the value of repeatable deployment pipelines * Immutable Infrastructure * Red/Black (or Blue/Green) Deployments
  3. 3. How many teams deploy more than once per day?
  4. 4. How many teams deploy more than twice per day?
  5. 5. How many teams deploy more than ten times per day?
  6. 6. How many teams deploy more than fifty times per day?
  7. 7. Deployments (by day) 1000 2000 3000 4000 May June July
  8. 8. This all sounds great ... but HOW?
  9. 9. https://flic.kr/p/56suBd
  10. 10. https://flic.kr/p/56suBd Tools
  11. 11. https://flic.kr/p/56suBd Tools Culture
  12. 12. https://flic.kr/p/56suBd Tools * Asgard Culture
  13. 13. https://flic.kr/p/56suBd Tools * Asgard * Mimir Culture
  14. 14. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins Culture
  15. 15. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins * Spinnaker Culture
  16. 16. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins * Spinnaker Culture * Freedom and Responsibility
  17. 17. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins * Spinnaker Culture * Freedom and Responsibility * Context over Control
  18. 18. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins * Spinnaker Culture * Freedom and Responsibility * Context over Control * Microservices
  19. 19. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins * Spinnaker Culture * Freedom and Responsibility * Context over Control * Microservices * Run what you build
  20. 20. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins * Spinnaker Culture * Freedom and Responsibility * Context over Control * Microservices * Run what you build * No dedicated DevOps
  21. 21. https://flic.kr/p/56suBd Tools * Asgard * Mimir * Jenkins * Spinnaker Culture * Freedom and Responsibility * Context over Control * Microservices * Run what you build * No dedicated DevOps Contributors * 8 engineers from Netflix (Delivery Engineering) * 6 engineers from Google * 3 engineers from Microsoft * 1 engineer from Pivotal + numerous open-source committers (Target, Veritas, Full Contact, Stitch Fix etc.)
  22. 22. Running @ Netflix * Layer custom components and configuration over open source JARs (Bintray) * No forking * Dedicated cluster for every Spinnaker service * Dedicated datastore for every Spinnaker service * Authentication via SAML or x509 https://flic.kr/p/cpijTm
  23. 23. Running @ Netflix * Layer custom components and configuration over open source JARs (Bintray) * No forking * Dedicated cluster for every Spinnaker service * Dedicated datastore for every Spinnaker service * Authentication via SAML or x509 Supporting Systems * Atlas * Eureka (aka Discovery) * Automated Canary Analysis (aka ACA) * Chronos (event tracking) * Lemur (x509 Certificate Manager) https://flic.kr/p/cpijTm
  24. 24. Running @ Netflix * Layer custom components and configuration over open source JARs (Bintray) * No forking * Dedicated cluster for every Spinnaker service * Dedicated datastore for every Spinnaker service * Authentication via SAML or x509 Supporting Systems * Atlas * Eureka (aka Discovery) * Automated Canary Analysis (aka ACA) * Chronos (event tracking) * Lemur (x509 Certificate Manager) Extensions * Additional Cloud Provider (Titus) * Internal Spot Market (Reservation Reports) * Canaries * Fast/Dynamic Properties * Application-specific IAM roles * Service Migration (EC2 Classic -> VPC) https://flic.kr/p/cpijTm
  25. 25. What does a Netflix engineer really care about?
  26. 26. Application
  27. 27. Application Multiple Accounts
  28. 28. Application Multiple Accounts Multiple Regions
  29. 29. Application Multiple Accounts Multiple Regions ScalingPolicies
  30. 30. Application Multiple Accounts Multiple Regions ScalingPolicies Discovery
  31. 31. Application Multiple Accounts Multiple Regions ScalingPolicies DiscoveryELB
  32. 32. Application Multiple Accounts Multiple Regions ScalingPolicies DiscoveryELB * 500+
  33. 33. Application Multiple Accounts Multiple Regions ScalingPolicies DiscoveryELB ControlPlane * 500+
  34. 34. Application Multiple Accounts Multiple Regions ScalingPolicies DiscoveryELB ControlPlane * 500+ Pager Duty Chaos Monkey AtlasEdda Discovery / Eureka Integrations Jenkins
  35. 35. Lessons Learned
  36. 36. Lessons Learned * Adoption does not come for free!
  37. 37. Lessons Learned * Adoption does not come for free! * Spinnaker Office Hours
  38. 38. Lessons Learned * Adoption does not come for free! * Spinnaker Office Hours * Operational Metrics and Dashboards
  39. 39. Lessons Learned * Adoption does not come for free! * Spinnaker Office Hours * Operational Metrics and Dashboards * Ask yourself ... What could Spinnaker have done to prevent this outage?
  40. 40. Lessons Learned * Adoption does not come for free! * Spinnaker Office Hours * Operational Metrics and Dashboards * Ask yourself ... What could Spinnaker have done to prevent this outage? * Deploy Spinnaker with Spinnaker
  41. 41. Lessons Learned * Adoption does not come for free! * Spinnaker Office Hours * Operational Metrics and Dashboards * Ask yourself ... What could Spinnaker have done to prevent this outage? * Deploy Spinnaker with Spinnaker * Teams with embedded QA have much tighter integrations with Spinnaker
  42. 42. Spinnaker in Action (Demo)
  43. 43. Adam Jordens @ajordens Tomas Lin @tomaslin
  44. 44. We're Hiring. and accepting pull requests!
  45. 45. Further Reading http://spinnaker.io http://join.spinnaker.io (Slack) http://techblog.netflix.com https://continuousdelivery.com/implementing/patterns

×