1.
Spinnaker
Bay Area AWS User Group
July 26th, 2016
Shifting the Curve Towards Reliable and Cost Effective Cloud Operations

2.
Assumed Knowledge
* Cloud Deployment (doesn't have to be AWS)
* Continuous Delivery and the value of repeatable deployment pipelines
* Immutable Infrastructure
* Red/Black (or Blue/Green) Deployments

3.
How many teams deploy more than once per day?

4.
How many teams deploy more than twice per day?

5.
How many teams deploy more than ten times per day?

6.
How many teams deploy more than fifty times per day?

7.
Deployments (by day)
1000
2000
3000
4000
May June July

8.
This all sounds great ... but HOW?

9.
https://flic.kr/p/56suBd

10.
https://flic.kr/p/56suBd
Tools

11.
https://flic.kr/p/56suBd
Tools
Culture

12.
https://flic.kr/p/56suBd
Tools
* Asgard
Culture

13.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
Culture

14.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
Culture

15.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture

16.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility

17.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control

18.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices

19.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices
* Run what you build

20.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices
* Run what you build
* No dedicated DevOps

21.
https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices
* Run what you build
* No dedicated DevOps
Contributors
* 8 engineers from Netflix (Delivery Engineering)
* 6 engineers from Google
* 3 engineers from Microsoft
* 1 engineer from Pivotal
+ numerous open-source committers (Target, Veritas, Full
Contact, Stitch Fix etc.)

22.
Running @ Netflix
* Layer custom components and configuration over open source JARs (Bintray)
* No forking
* Dedicated cluster for every Spinnaker service
* Dedicated datastore for every Spinnaker service
* Authentication via SAML or x509
https://flic.kr/p/cpijTm

23.
Running @ Netflix
* Layer custom components and configuration over open source JARs (Bintray)
* No forking
* Dedicated cluster for every Spinnaker service
* Dedicated datastore for every Spinnaker service
* Authentication via SAML or x509
Supporting Systems
* Atlas
* Eureka (aka Discovery)
* Automated Canary Analysis (aka ACA)
* Chronos (event tracking)
* Lemur (x509 Certificate Manager)
https://flic.kr/p/cpijTm

24.
Running @ Netflix
* Layer custom components and configuration over open source JARs (Bintray)
* No forking
* Dedicated cluster for every Spinnaker service
* Dedicated datastore for every Spinnaker service
* Authentication via SAML or x509
Supporting Systems
* Atlas
* Eureka (aka Discovery)
* Automated Canary Analysis (aka ACA)
* Chronos (event tracking)
* Lemur (x509 Certificate Manager)
Extensions
* Additional Cloud Provider (Titus)
* Internal Spot Market (Reservation Reports)
* Canaries
* Fast/Dynamic Properties
* Application-specific IAM roles
* Service Migration (EC2 Classic -> VPC)
https://flic.kr/p/cpijTm

25.
What does a Netflix engineer really care about?

26.
Application

27.
Application
Multiple
Accounts

28.
Application
Multiple
Accounts
Multiple
Regions

29.
Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies

30.
Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
Discovery

31.
Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB

32.
Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB
*
500+

33.
Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB
ControlPlane
*
500+

34.
Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB
ControlPlane
*
500+
Pager Duty
Chaos
Monkey
AtlasEdda
Discovery /
Eureka
Integrations
Jenkins

35.
Lessons Learned

36.
Lessons Learned
* Adoption does not come for free!

37.
Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours

38.
Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards

39.
Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards
* Ask yourself ... What could Spinnaker have done to prevent this
outage?

40.
Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards
* Ask yourself ... What could Spinnaker have done to prevent this
outage?
* Deploy Spinnaker with Spinnaker

41.
Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards
* Ask yourself ... What could Spinnaker have done to prevent this
outage?
* Deploy Spinnaker with Spinnaker
* Teams with embedded QA have much tighter integrations with
Spinnaker

42.
Spinnaker in Action
(Demo)

43.
Adam Jordens
@ajordens
Tomas Lin
@tomaslin

44.
We're Hiring.
and accepting pull requests!

45.
Further Reading
http://spinnaker.io
http://join.spinnaker.io (Slack)
http://techblog.netflix.com
https://continuousdelivery.com/implementing/patterns