SlideShare a Scribd company logo

Self service build and deployment at Netflix (Agile 2013)

Gareth Bowles
Gareth Bowles
Gareth BowlesSpecial Projects Group - Software at Apple

How Netflix lets all of our engineers build and deploy their own code to production.

Self service build and deployment at Netflix (Agile 2013)

1 of 57
Download to read offline
Tweet @garethbowles with feedback!
Self-Service Build & Deployment @Netflix
Monday, August 5, 13
Tweet @garethbowles with feedback!
• How would your organization be different if all
of your engineers could build, test and deploy
their own code ...
• ... and were responsible for fixing what they
broke at 3am ?
Monday, August 5, 13
Tweet @garethbowles with feedback!
Gareth Bowles
Monday, August 5, 13
Tweet @garethbowles with feedback!
Monday, August 5, 13
Tweet @garethbowles with feedback!
Netflix is the world’s leading Internet television
network with more than 36 million members in 40
countries enjoying more than one billion hours ofTV
shows and movies per month, including original
series.
Source: http://ir.netflix.com
Monday, August 5, 13
Tweet @garethbowles with feedback!
The Challenge
• We need to innovate rapidly, driven by:
• Global competition
• New connected devices
• Continuous customer feedback
• And we need fast rollback
Monday, August 5, 13

Recommended

Engineering Velocity: Shifting the Curve at Netflix
Engineering Velocity: Shifting the Curve at NetflixEngineering Velocity: Shifting the Curve at Netflix
Engineering Velocity: Shifting the Curve at NetflixDianne Marsh
 
2016 - Continuously Delivering Microservices in Kubernetes using Jenkins
2016 - Continuously Delivering Microservices in Kubernetes using Jenkins2016 - Continuously Delivering Microservices in Kubernetes using Jenkins
2016 - Continuously Delivering Microservices in Kubernetes using Jenkinsdevopsdaysaustin
 
Disruption of Enterprise IT and DevOps
Disruption of Enterprise IT and DevOpsDisruption of Enterprise IT and DevOps
Disruption of Enterprise IT and DevOpsmike d. kail
 
Analyst Keynote: Continuous Delivery: Making DevOps Awesome
Analyst Keynote: Continuous Delivery: Making DevOps AwesomeAnalyst Keynote: Continuous Delivery: Making DevOps Awesome
Analyst Keynote: Continuous Delivery: Making DevOps AwesomeCA Technologies
 
Wealthfront Equity Plan
Wealthfront Equity PlanWealthfront Equity Plan
Wealthfront Equity PlanWealthfront
 
I Don't Test Often ...
I Don't Test Often ...I Don't Test Often ...
I Don't Test Often ...Gareth Bowles
 

More Related Content

Recently uploaded

CIRCLE geometry lesson 2nd quarter grade 10
CIRCLE geometry lesson 2nd quarter  grade 10CIRCLE geometry lesson 2nd quarter  grade 10
CIRCLE geometry lesson 2nd quarter grade 10RicFernandez4
 
Traffic Signboard Classification with Voice alert to the driver.pptx
Traffic Signboard Classification with Voice alert to the driver.pptxTraffic Signboard Classification with Voice alert to the driver.pptx
Traffic Signboard Classification with Voice alert to the driver.pptxharimaxwell0712
 
Azure Migration Guide for IT Professionals
Azure Migration Guide for IT ProfessionalsAzure Migration Guide for IT Professionals
Azure Migration Guide for IT ProfessionalsChristine Shepherd
 
Put a flag on it. A busy developer's guide to feature toggles.
Put a flag on it. A busy developer's guide to feature toggles.Put a flag on it. A busy developer's guide to feature toggles.
Put a flag on it. A busy developer's guide to feature toggles.Mateusz Kwasniewski
 
Microsoft Azure - GAA and Irish Tech Society Hackathon
Microsoft Azure - GAA and Irish Tech Society HackathonMicrosoft Azure - GAA and Irish Tech Society Hackathon
Microsoft Azure - GAA and Irish Tech Society HackathonJuarez Junior
 
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdf
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdfLLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdf
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdfThomas Poetter
 
Zi-Stick UBS Dongle ZIgbee from Aeotec manual
Zi-Stick UBS Dongle ZIgbee from  Aeotec manualZi-Stick UBS Dongle ZIgbee from  Aeotec manual
Zi-Stick UBS Dongle ZIgbee from Aeotec manualDomotica daVinci
 
Manual sensor Zigbee 3.0 MOES ZSS-X-PIRL-C
Manual  sensor Zigbee 3.0 MOES ZSS-X-PIRL-CManual  sensor Zigbee 3.0 MOES ZSS-X-PIRL-C
Manual sensor Zigbee 3.0 MOES ZSS-X-PIRL-CDomotica daVinci
 
Enhancing SaaS Performance: A Hands-on Workshop for Partners
Enhancing SaaS Performance: A Hands-on Workshop for PartnersEnhancing SaaS Performance: A Hands-on Workshop for Partners
Enhancing SaaS Performance: A Hands-on Workshop for PartnersThousandEyes
 
Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024Daniel Toomey
 
From eSIMs to iSIMs: It’s Inside the Manufacturing
From eSIMs to iSIMs: It’s Inside the ManufacturingFrom eSIMs to iSIMs: It’s Inside the Manufacturing
From eSIMs to iSIMs: It’s Inside the ManufacturingSoracom Global, Inc.
 
Dissecting Real-World Database Performance Dilemmas
Dissecting Real-World Database Performance DilemmasDissecting Real-World Database Performance Dilemmas
Dissecting Real-World Database Performance DilemmasScyllaDB
 
Bluetooth Low Energy(BLE) and beacons working
Bluetooth Low Energy(BLE) and beacons workingBluetooth Low Energy(BLE) and beacons working
Bluetooth Low Energy(BLE) and beacons workingshrey Ansh
 
My sample product research idea for you!
My sample product research idea for you!My sample product research idea for you!
My sample product research idea for you!KivenRaySarsaba
 
AWS reInvent 2023 recaps from Chicago AWS user group
AWS reInvent 2023 recaps from Chicago AWS user groupAWS reInvent 2023 recaps from Chicago AWS user group
AWS reInvent 2023 recaps from Chicago AWS user groupAWS Chicago
 
Navigating the Never Normal Strategies for Portfolio Leaders
Navigating the Never Normal Strategies for Portfolio LeadersNavigating the Never Normal Strategies for Portfolio Leaders
Navigating the Never Normal Strategies for Portfolio LeadersOnePlan Solutions
 
Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...
Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...
Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...Raphaël PINSON
 

Recently uploaded (20)

CIRCLE geometry lesson 2nd quarter grade 10
CIRCLE geometry lesson 2nd quarter  grade 10CIRCLE geometry lesson 2nd quarter  grade 10
CIRCLE geometry lesson 2nd quarter grade 10
 
COE AI Lab Universities
COE AI Lab UniversitiesCOE AI Lab Universities
COE AI Lab Universities
 
Traffic Signboard Classification with Voice alert to the driver.pptx
Traffic Signboard Classification with Voice alert to the driver.pptxTraffic Signboard Classification with Voice alert to the driver.pptx
Traffic Signboard Classification with Voice alert to the driver.pptx
 
Azure Migration Guide for IT Professionals
Azure Migration Guide for IT ProfessionalsAzure Migration Guide for IT Professionals
Azure Migration Guide for IT Professionals
 
Put a flag on it. A busy developer's guide to feature toggles.
Put a flag on it. A busy developer's guide to feature toggles.Put a flag on it. A busy developer's guide to feature toggles.
Put a flag on it. A busy developer's guide to feature toggles.
 
Microsoft Azure - GAA and Irish Tech Society Hackathon
Microsoft Azure - GAA and Irish Tech Society HackathonMicrosoft Azure - GAA and Irish Tech Society Hackathon
Microsoft Azure - GAA and Irish Tech Society Hackathon
 
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdf
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdfLLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdf
LLMs, LMMs, their Improvement Suggestions and the Path towards AGI.pdf
 
Zi-Stick UBS Dongle ZIgbee from Aeotec manual
Zi-Stick UBS Dongle ZIgbee from  Aeotec manualZi-Stick UBS Dongle ZIgbee from  Aeotec manual
Zi-Stick UBS Dongle ZIgbee from Aeotec manual
 
Manual sensor Zigbee 3.0 MOES ZSS-X-PIRL-C
Manual  sensor Zigbee 3.0 MOES ZSS-X-PIRL-CManual  sensor Zigbee 3.0 MOES ZSS-X-PIRL-C
Manual sensor Zigbee 3.0 MOES ZSS-X-PIRL-C
 
Enhancing SaaS Performance: A Hands-on Workshop for Partners
Enhancing SaaS Performance: A Hands-on Workshop for PartnersEnhancing SaaS Performance: A Hands-on Workshop for Partners
Enhancing SaaS Performance: A Hands-on Workshop for Partners
 
Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024Microsoft Azure News - Feb 2024
Microsoft Azure News - Feb 2024
 
From eSIMs to iSIMs: It’s Inside the Manufacturing
From eSIMs to iSIMs: It’s Inside the ManufacturingFrom eSIMs to iSIMs: It’s Inside the Manufacturing
From eSIMs to iSIMs: It’s Inside the Manufacturing
 
Dissecting Real-World Database Performance Dilemmas
Dissecting Real-World Database Performance DilemmasDissecting Real-World Database Performance Dilemmas
Dissecting Real-World Database Performance Dilemmas
 
Bluetooth Low Energy(BLE) and beacons working
Bluetooth Low Energy(BLE) and beacons workingBluetooth Low Energy(BLE) and beacons working
Bluetooth Low Energy(BLE) and beacons working
 
Russia Ukraine war Cyberspace operations (2022-2024)
Russia Ukraine war Cyberspace operations (2022-2024)Russia Ukraine war Cyberspace operations (2022-2024)
Russia Ukraine war Cyberspace operations (2022-2024)
 
My sample product research idea for you!
My sample product research idea for you!My sample product research idea for you!
My sample product research idea for you!
 
AWS reInvent 2023 recaps from Chicago AWS user group
AWS reInvent 2023 recaps from Chicago AWS user groupAWS reInvent 2023 recaps from Chicago AWS user group
AWS reInvent 2023 recaps from Chicago AWS user group
 
Navigating the Never Normal Strategies for Portfolio Leaders
Navigating the Never Normal Strategies for Portfolio LeadersNavigating the Never Normal Strategies for Portfolio Leaders
Navigating the Never Normal Strategies for Portfolio Leaders
 
Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...
Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...
Cfgmgmtcamp 2024 — eBPF-based Security Observability & Runtime Enforcement wi...
 
5 Tech Trend to Notice in ESG Landscape- 47Billion
5 Tech Trend to Notice in ESG Landscape- 47Billion5 Tech Trend to Notice in ESG Landscape- 47Billion
5 Tech Trend to Notice in ESG Landscape- 47Billion
 

Featured

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming LanguageSimplilearn
 

Featured (20)

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming Language
 

Self service build and deployment at Netflix (Agile 2013)

  • 1. Tweet @garethbowles with feedback! Self-Service Build & Deployment @Netflix Monday, August 5, 13
  • 2. Tweet @garethbowles with feedback! • How would your organization be different if all of your engineers could build, test and deploy their own code ... • ... and were responsible for fixing what they broke at 3am ? Monday, August 5, 13
  • 3. Tweet @garethbowles with feedback! Gareth Bowles Monday, August 5, 13
  • 4. Tweet @garethbowles with feedback! Monday, August 5, 13
  • 5. Tweet @garethbowles with feedback! Netflix is the world’s leading Internet television network with more than 36 million members in 40 countries enjoying more than one billion hours ofTV shows and movies per month, including original series. Source: http://ir.netflix.com Monday, August 5, 13
  • 6. Tweet @garethbowles with feedback! The Challenge • We need to innovate rapidly, driven by: • Global competition • New connected devices • Continuous customer feedback • And we need fast rollback Monday, August 5, 13
  • 7. Tweet @garethbowles with feedback! The Challenge • We need to scale to cope with: • Growing customer base • Peaks in demand: • Special events: holidays, Oscars • Daily fluctuations (weekdays vs. weekends, daytime vs. evening) Monday, August 5, 13
  • 8. Tweet @garethbowles with feedback! Things That Help • We can push out updates whenever we like • Company culture Monday, August 5, 13
  • 9. Tweet @garethbowles with feedback! Things That Got in Our Way Monday, August 5, 13
  • 10. Tweet @garethbowles with feedback! A Few ShortYears Ago ... • Monolithic web app • Single points of failure • Releases were done by following runbooks • DC-based infrastructure • Different teams used different tools Monday, August 5, 13
  • 11. Tweet @garethbowles with feedback! Meeting the Challenge Monday, August 5, 13
  • 12. Tweet @garethbowles with feedback! http://www.slideshare.net/reed2001/culture-1798664 Monday, August 5, 13
  • 13. Tweet @garethbowles with feedback! Freedom and Responsibility • Hire mature people who work well with others • Give them the context for company success • Then get out of their way • But hold them responsible for results Monday, August 5, 13
  • 14. Tweet @garethbowles with feedback! Context, not Control • Be transparent about what the company needs to succeed • Minimize the processes people need to go through to achieve success • Value results, not planning and process Monday, August 5, 13
  • 15. Tweet @garethbowles with feedback! Highly Aligned, Loosely Coupled • Clear strategy and goals • Team interactions focus on strategy, not tactics • Minimal cross-functional meetings • Occasional post-mortems to increase alignment Monday, August 5, 13
  • 16. Tweet @garethbowles with feedback! What This Helped Us Achieve • DVD to Streaming • DC to cloud • US-only to 40-plus countries Monday, August 5, 13
  • 17. Tweet @garethbowles with feedback! Architecture Credit: Steve Somers Monday, August 5, 13
  • 18. Tweet @garethbowles with feedback! Key Changes • Service oriented architecture • Many small teams, each providing their own interconnected service • Deploy on Amazon Web Services • Increased reliance on open source Monday, August 5, 13
  • 19. Tweet @garethbowles with feedback! Highly aligned, loosely coupled • Services are built by different teams who work together to figure out what each service will provide. • The service owner publishes an API that anyone can use. Monday, August 5, 13
  • 20. Tweet @garethbowles with feedback! What AWS Provides • Machine Images (AMI) • Instances (EC2) • Elastic IPs • Load Balancers • Security groups / Autoscaling groups Monday, August 5, 13
  • 21. Tweet @garethbowles with feedback! Freedom and Responsibility • Developers deploy when they want • They also manage their own capacity and autoscaling • And fix anything that breaks at 3am! Monday, August 5, 13
  • 22. Tweet @garethbowles with feedback! Personaliza-­‐ Eon  Engine User  Info Movie   Metadata Movie   RaEngs Similar   Movies API Reviews A/B  Test   Engine 2B  requests   per  day   into  the  Ne3lix   API 12B  outbound   requests  per   day  to  API   dependencies Monday, August 5, 13
  • 23. Tweet @garethbowles with feedback! Personaliza-­‐ Eon  Engine User  Info Movie   Metadata Movie   RaEngs Similar   Movies API Reviews A/B  Test   Engine 2B  requests   per  day   into  the  Ne3lix   API 12B  outbound   requests  per   day  to  API   dependencies Monday, August 5, 13
  • 24. Tweet @garethbowles with feedback! Build and Deployment Monday, August 5, 13
  • 25. Tweet @garethbowles with feedback! The Audience • ~700 engineers • Large majority are developers • Test engineers • Delivery teams • Operations & reliability engineering Monday, August 5, 13
  • 26. Tweet @garethbowles with feedback! Our Goal • Lower the barriers to build, test and deployment until the entire process is accessible to every developer. Monday, August 5, 13
  • 27. Tweet @garethbowles with feedback! The Team • 11 engineers and 1 director (but we’re hiring !) • Developers, build / release engineers, DevOps • Specialize, but understand the full stack • Service oriented Monday, August 5, 13
  • 28. Tweet @garethbowles with feedback! Self-Service Build & Deployment • Channel best practices Monday, August 5, 13
  • 29. Tweet @garethbowles with feedback! Self-Service Build & Deployment • Channel best practices • Promote, don’t dictate Monday, August 5, 13
  • 30. Tweet @garethbowles with feedback! Self-Service Build & Deployment • Channel best practices • Promote, don’t dictate • Make adoption easy Monday, August 5, 13
  • 31. Tweet @garethbowles with feedback! Self-Service Build & Deployment • Channel best practices • Promote, don’t dictate • Make adoption easy • Make tools flexible Monday, August 5, 13
  • 32. Tweet @garethbowles with feedback! Building and Deploying Perforce / Git libraries source Ant targets Ivy Groovy all over snapshot / release libraries / apps Jenkins sync resolve buildcompile report publishtest Artifactory yum Aminator Asgard rpms Monday, August 5, 13
  • 33. Tweet @garethbowles with feedback! Building and Deploying Perforce / Git libraries source Ant targets Ivy Groovy all over snapshot / release libraries / apps Jenkins sync resolve buildcompile report publishtest Artifactory yum Aminator Asgard rpms Monday, August 5, 13
  • 34. Tweet @garethbowles with feedback! Is That Really Self-Service ? Monday, August 5, 13
  • 35. Tweet @garethbowles with feedback! Common Build Framework • Define a build with just a few lines of Ant code • Templates for libraries and webapps • Override standard targets if you need to Monday, August 5, 13
  • 36. Tweet @garethbowles with feedback! Jenkins Job DSL • Define Jenkins build jobs using a domain specific language (based on Groovy) • Loop to create multiple jobs (e.g. for building different branches) • Make one change and rerun to update all jobs • The code is the configuration • https://wiki.jenkins-ci.org/display/JENKINS/Job Monday, August 5, 13
  • 37. Tweet @garethbowles with feedback! Jenkins Dynaslaves • Create build slaves in AWS • Dedicated slave pools for teams • Scale slave pools up and down on demand • https://github.com/Netflix-Skunkworks/ dynaslave-plugin Monday, August 5, 13
  • 38. Tweet @garethbowles with feedback! From Build to Deployment Monday, August 5, 13
  • 39. Tweet @garethbowles with feedback! Aminator • Create (“bake”) AMIs • Image contains a service and everything needed to run it • Can be automatically triggered as a build step • https://github.com/Netflix/aminator Monday, August 5, 13
  • 40. Tweet @garethbowles with feedback! How Baking is Different https://github.com/Netflix/aminator Monday, August 5, 13
  • 41. Tweet @garethbowles with feedback! How Baking is Different Traditional: •launch OS •install packages •install app https://github.com/Netflix/aminator Monday, August 5, 13
  • 42. Tweet @garethbowles with feedback! How Baking is Different Generic AMI Instance Traditional: •launch OS •install packages •install app https://github.com/Netflix/aminator Monday, August 5, 13
  • 43. Tweet @garethbowles with feedback! How Baking is Different Generic AMI Instance Traditional: •launch OS •install packages •install app https://github.com/Netflix/aminator Monday, August 5, 13
  • 44. Tweet @garethbowles with feedback! How Baking is Different Generic AMI Instance Traditional: •launch OS •install packages •install app https://github.com/Netflix/aminator Monday, August 5, 13
  • 45. Tweet @garethbowles with feedback! How Baking is Different Generic AMI Instance Traditional: •launch OS •install packages •install app Netflix: •launch OS+app https://github.com/Netflix/aminator Monday, August 5, 13
  • 46. Tweet @garethbowles with feedback! How Baking is Different Generic AMI Instance Traditional: •launch OS •install packages •install app Netflix: •launch OS+app App AMI Instance https://github.com/Netflix/aminator Monday, August 5, 13
  • 47. Tweet @garethbowles with feedback! Linux Base AMI (CentOS or Ubuntu) Java (JDK 6 or 7) Tomcat Optional Apache Monitoring Log Rotation to S3 Appdynamics Machine Agent Appdynamics App Agent monitoring Application war file, base servlet, platform, interface jars for dependent services GC and thread dump logging Healthcheck, status servlets, JMX interface, Servo autoscale Monday, August 5, 13
  • 48. Tweet @garethbowles with feedback! At Netflix, the AMI is the unit of deployment. Monday, August 5, 13
  • 49. Tweet @garethbowles with feedback! Asgard • Web UI and REST API for service deployment and management • Manage ASGs, ELBs, security groups, ... • Application -> cluster -> ASG • Rapid deployment and rollback • Available to all engineers • https://github.com/Netflix/asgard Monday, August 5, 13
  • 50. Tweet @garethbowles with feedback! Red / Black Deployment Monday, August 5, 13
  • 51. Tweet @garethbowles with feedback! Netflix has moved the granularity from the instance to the cluster. Monday, August 5, 13
  • 52. Tweet @garethbowles with feedback! Simple Service Setup Effort • Write the code (variable :-)) • 15 minutes to write a build file and define dependencies • 15 mins to create a Jenkins build, 2 to 10 mins to run it • 5 mins to bake an AMI • 10 mins to deploy in test, another 10 for prod Monday, August 5, 13
  • 53. Tweet @garethbowles with feedback! Just a quick reminder... (Some of) Netflix is open source: https://github.com/netflix Monday, August 5, 13
  • 54. Tweet @garethbowles with feedback! Why We Open Source • Give back to Apache license OSS community • Motivate, retain, hire top engineers • Benefit from a shared ecosystem • Make Netflix solutions into common standards Monday, August 5, 13
  • 55. Tweet @garethbowles with feedback! The Netflix Platform Discovery (Eureka) Entrypoints (Edda) Configuration (Archaius) Zookeeper (Exhibitor) logging (Blitz4j & Honu) NIWS (Ribbon) Geo Base Hystrix Circuit Breakers (Hystrix) Cassandra (Priam & Astyanax & CassJMeter) Cryptex AKMS EvCache Zuul i18n L10n Open Source Monday, August 5, 13
  • 56. Tweet @garethbowles with feedback! https://github.com/Netflix/Cloud-Prize/wiki Monday, August 5, 13
  • 57. Tweet @garethbowles with feedback! ThankYou ! Email: gbowles@{gmail,netflix}.com Twitter: @garethbowles Linkedin: www.linkedin.com/in/garethbowles Monday, August 5, 13