Your SlideShare is downloading. ×
  • Like
  • Save
From Code to Monkeys: Continuous Delivery at Netflix
Upcoming SlideShare
Loading in...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.


Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply

From Code to Monkeys: Continuous Delivery at Netflix


Video and slides synchronized, mp3 and slide download available at URL …

Video and slides synchronized, mp3 and slide download available at URL

Dianne Marsh presents the open source tools used by Netflix to keep the continuous delivery wheels spinning. Filmed at

Dianne Marsh is a Director of Engineering for Netflix in Los Gatos, CA, where she leads a team responsible for tools and systems used by nearly all engineers in the company for continuous integration, delivery and deployment to the AWS cloud. Dianne earned her Master of Science degree in computer science from Michigan Technological University.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads


Total Views
On SlideShare
From Embeds
Number of Embeds



Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

    No notes for slide


  • 1. Continuous Delivery at Netflix: From Code to the Monkeys QCon – San Francisco, November 2013 Dianne Marsh @dmarsh 1
  • 2. Watch the video with slide synchronization on! /netflix-continuous-delivery News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month
  • 3. Presented at QCon San Francisco Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide
  • 5. Netflix Goals High Availability But … Move fast Tools encourage Best Practices But … Freedom to do the right thing
  • 6. Teams Deploy Their Own Code Run What You Wrote §  Rapid Innovation §  Rapid Detection §  Rapid Response = Freedom + Responsibility
  • 7. BUILD Jenkins Job DSL Configuration as Code Groovy Script Scripts go in Version Control
  • 9. BAKE Aminator •  Create AMI from Base AMI •  Image contains service and everything needed to run it •  Unit of Deployment for Test and Prod •  Abstracts Cloud Details
  • 11. DEPLOY Asgard: AWS Deployment Tool Deploys Netflix to the Cloud Red/Black push
  • 12. CANARY ANALYSIS Test, Int, Prod Choose where to deploy Run canary analysis Scale up new instances Turn on traffic to new ASG Turn off traffic to old ASG Wait … analyze … continue
  • 13. Asgard Developer Portal
  • 14. GLISTEN Extending Asgard’s Workflow Automated Red/Black Push Test, Int, Prod stacks Run canary/analysis Scale up new instances Turn on traffic to new ASG Run more tests Turn off traffic to old ASG Wait … analyze … continue
  • 16. Simian Army •  •  •  •  •  Chaos Monkey Latency Monkey Janitor Monkey Conformity Monkey (and more!) Test resiliency at runtime
  • 17. One Button Deployment?
  • 18. Regional Isolation Limit Impact of Human Error §  Stagger deployments §  Canary testing per region
  • 19. Multi-Region Consistency Build Tooling to: §  Schedule Deployments §  Prefer off peak §  Choose next available region automatically §  Provide high visibility per region
  • 20. Send in the Conformity Monkey Have deployments diverged? §  Balance regional consistency with regional isolation §  Provide meaningful thresholds §  Build best practices into tooling and reporting
  • 21. Clean up with Janitor Monkey §  Disassociate unused EIPs §  Delete unassociated Amazon EBS volumes §  Delete older Amazon EBS snapshots §  Leverage Amazon S3 Object Expiration
  • 22. Key Elements for Netflix §  Value Self-service §  Test Everywhere §  Build Awareness of Multiple Regions §  Avoid peak times §  Roll back quickly and easily §  Be Cloud Native
  • 23. Put NetflixOSS to Work for You Netflix Platform AMINATOR Glisten ** And 30+ more projects at
  • 24. Keep the Conversation Going Continuous Delivery Open Space Ballroom B/C (here!) 1:35-2:25, immediately following lunch
  • 25. Thanks! We’re always hiring! Dianne Marsh (@dmarsh)
  • 26. Watch the video with slide synchronization on!