Your SlideShare is downloading. ×
Open Business Conference: Continuous Delivery At Netflix -- Powered by Open Source
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Open Business Conference: Continuous Delivery At Netflix -- Powered by Open Source

487
views

Published on

How can we engineer velocity by weaving together tooling and culture with software …

How can we engineer velocity by weaving together tooling and culture with software
development to expose and elevate highly effective practices? This talk describes various
components of Netflix’s continuous delivery platform -- much of which is available in open
source. I’ll show how these pieces fit together and allow us to build scaffolding so that we’re comfortable with software developers making the decision to push the button for prod deployment -- and helps them to recover if necessary. As a result, we can run fast, trusting our tooling and our culture. I’ll also describe how we test our resiliency through simulating failure, unleashing the monkeys (Simian Army) on our production environment. Because if you’re afraid of cute little monkeys, imagine how afraid you’ll be of a production environment that offers those same risks but doesn’t give you an opportunity to test your response to those dangers.

Throughout this talk, I hope that you will challenge yourself to consider how your company can "shift the curve" through tooling and to achieve a high velocity environment without negatively impacting reliability.

Published in: Software, Technology

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
487
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
14
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Continuous Delivery at Netflix: Powered by Open Source Dianne Marsh San Francisco, May 6, 2014 http://www.linkedin.com/in/diannemarsh
  • 2. Building Continuous Delivery
  • 3. Netflix Goals High Availability But … Move fast Tools encourage Best Practices But … Freedom to do the right thing
  • 4. Teams Deploy Their Own Code Run What You Wrote • Rapid Innovation • Rapid Detection • Rapid Response = Freedom + Responsibility
  • 5. Nebula/Gradle • Netflix Build Language • Gradle plugins • Supports internal and open source builds https://github.com/nebula-plugins BUILD
  • 6. BUILD Jenkins Job DSL Configuration as Code Groovy Script Scripts go in Version Control http://www.slideshare.net/quidryan/configuration-as-code
  • 7. BUILD BAKE
  • 8. Aminator • Create AMI from Base AMI • Image contains service and everything needed to run it • Unit of Deployment for Test and Prod • Abstracts Cloud Details http://techblog.netflix.com/2013/03/ami-creation-with-aminator.html BAKE
  • 9. BUILD DEPLOYBAKE
  • 10. DEPLOY Asgard: AWS Deployment Tool Deploys Netflix to the Cloud Red/Black push http://www.infoq.com/presentations/asgard
  • 11. CANARY ANALYSIS Test, Int, Prod Choose where to deploy Run canary analysis Scale up new instances Turn on traffic to new ASG Turn off traffic to old ASG Wait … analyze … continue
  • 12. Asgard Developer Portal
  • 13. GLISTEN Extending Asgard’s Workflow Automated Red/Black Push Run canary/analysis Scale up new instances Turn on traffic/Run Tests/Turn off traffic Wait … analyze … continue http://techblog.netflix.com/2013/09/glisten-groovy-way-to-use-amazons.html
  • 14. One Button Deployment?
  • 15. Regional Isolation Limit Impact of Human Error • Stagger deployments? • Canary testing per region? Know your service!
  • 16. Multi-Region Consistency Build Tooling to: • Schedule Deployments • Prefer off peak • Choose next available region automatically • Provide high visibility per region
  • 17. BUILD DEPLOY BAKE
  • 18. Simian Army • Chaos Monkey • Latency Monkey • Janitor Monkey • Conformity Monkey (and more!) Test resiliency at runtime http://www.infoq.com/presentations/netflix-resiliency-failure-cloud
  • 19. Send in the Conformity Monkey Have deployments diverged?  Balance regional consistency with regional isolation  Provide meaningful thresholds  Build best practices into tooling and reporting
  • 20. Clean up with the Janitor Monkey • Disassociate unused EIPs • Delete unassociated Amazon EBS volumes • Delete older Amazon EBS snapshots • Leverage Amazon S3 Object Expiration
  • 21. Key Elements for Netflix • Value Self-service • Test Everywhere • Build Awareness of Multiple Regions • Avoid peak times • Roll back quickly and easily • Be Cloud Native
  • 22. Netflix OSS More at netflix.github.com
  • 23. Thanks! Dianne Marsh (@dmarsh) dmarsh@netflix.com Thanks!