SlideShare a Scribd company logo
Netflix Builds Its Open Sourced
Cloud Technologies on the
CloudBees Platform
CASE STUDY
More than 36 million Netflix members worldwide view streamed content and access Netflix
features delivered via cloud technology that the company has been developing since 2009. Netflix
operates on a cloud platform based on Amazon Web Services (AWS). Over the years, Netflix
engineers have developed numerous cloud tools and technologies, which the company has now
shared with the development community as open source software.
While many companies may be leery of freely sharing core technology, Netflix sees several
compelling advantages to the move. First, the company aims to establish its solutions as standards
that are widely used throughout the industry. Second, improvements contributed by the community
to improve performance or add support for other cloud services will improve the standard
for everyone, advancing the platform robustness and quality. Third, the move will burnish the
company’s reputation as a technology leader, which was boosted in 2012 by winning an Emmy
for Technical Achievement. Lastly, it will help Netflix attract, engage and retain expert engineers,
because it can draw directly from a wide pool of proven contributors.
To help maximize these advantages, Netflix chose the CloudBees Platform as a Service (PaaS)
solution to support the public builds of its NetflixOSS open source projects. “Open sourcing our
cloud-based architecture projects is a way to reduce risk, improve our service and contribute to
the broader cloud-based community,” says Gareth Bowles, senior tools engineer at Netflix. “The
CloudBees platform is helping us achieve these objectives by enabling Netflix engineers and
external contributors to rapidly build and test changes, instantly see the quality of the changes
being made and continue to realize the benefits of continuous integration with Jenkins.”
Challenge: Simplify and Streamline Open Source Development
Netflix needed a way to transition dozens of internal projects to open source projects as efficiently
and cost-effectively as possible. “We wanted to make our builds public, in a way that enabled
everyone—including the Netflix engineers that would continue to work on the projects and the new
external contributors—to see the effect of changes as soon as possible. We wanted the community
to be able to assess the quality of each project at any point in time,” says Bowles. “And because we
were already very heavy on-premise Jenkins users, we wanted a Jenkins-based cloud service for
continuous integration.”
At the same time, the company was looking to keep costs and maintenance requirements down.
“We are sharing our code with the community at no cost, and we needed a low cost way to do it
that would not require extensive resources and ongoing maintenance,” says Bowles.
A Solution for Rapid Feedback and Continuous Integration
Netflix transitioned its open source projects to the CloudBees DEV@cloud development platform.
Netflix engineers set up a few prototype builds with Jenkins, the CloudBees Platform and several
key Jenkins plugins. They had everything up and running within two to three hours. “The move was
very easy and we had great support from the CloudBees technical team,” says Bowles.
CHALLENGE
Support and promote
contributions to the open
source development of
cloud technologies for video
streaming and large-scale
cloud deployments
SOLUTION
Use the CloudBees platform,
with Jenkins in the cloud,
to streamline development,
provide immediate build
feedback to the community
and minimize maintenance
overhead and costs
RESULTS
>> Immediate feedback
on builds
 Minimal maintenance
overhead
 Cost-effective pricing
SERVICES
 DEV@cloud
The team then began using the Jenkins Job DSL plugin to create new projects programmatically,
updating the location of the GitHub repository that each project used. Once a project is open to
the community, developers—both internal and external—can instantly see its current build status,
which is displayed using the Jenkins Embeddable Build Status plugin.
Among contributors, the ability to build pull requests before they are merged into the main branch
has been a much-appreciated feature. Made possible by the GitHub Pull Request Builder plugin,
this capability provides virtually instant feedback when a pull request is made.
“This feature acts as an extra reviewer for the code changes that developers submit,” says
Bowles. “Our developers have been really impressed with the ability to get instant feedback
on their changes.”
The CloudBees Platform is also playing a central role in the Netflix Cloud Prize contest, in
which participants fork one of the Netflix open source repositories on GitHub, implement an
improvement or new functionality and submit their changes for judging to win a prize in one of
10 categories. Netflix will set up new builds on the CloudBees Platform for entries that use a
compatible build structure.
Ultimately all Netflix open source projects will be built on the CloudBees Platform. Netflix has
already migrated most of them, including Asgard (a web interface for application deployments and
cloud management on AWS) and SimianArmy, which includes the Chaos Monkey resiliency tool
that helps applications tolerate random instance failures.
Results
 Immediate feedback on builds. “With
the CloudBees platform, Jenkins triggers
a build when changes are submitted,
so developers get feedback on their
submissions within seconds, instead of
having to wait 15 minutes or longer.
Plus, everyone can see the current build
status immediately,” says Bowles. “That
benefits the entire developer community
and spurs more contributions, because it
reduces friction and makes the entire process smoother.”
 Minimal maintenance overhead. “Once we’ve created a build job, we rarely need to change
the configuration so minimal maintenance is required,” says Bowles. “We don’t need a full-
time employee to manage all of these projects; we just check in a couple times a day. It’s
nice to know that CloudBees is handling the entire infrastructure for us, behind the scenes.”
 Cost-effective pricing. “We are grateful for the CloudBees Platform because it has enabled
us to keep costs to a minimum as we open source our code,” says Bowles. “Since we are
sharing our technology with the community for no cost, we appreciate that CloudBees has
provided an affordable option for open source projects and that we can use the CloudBees
infrastructure to publicly build those projects.”
“The CloudBees
platform is helping
us achieve our goals
to open source our
code by making it
easier for developers
to contribute, give
rapid feedback on
pull requests, provide
the current status
of projects and
support low-cost
public builds. This
spurs an increased
pace of innovation
that benefits not
only Netflix and our
customers, but the
entire community.”
 Gareth Bowles, Netflix
CloudBees Jenkins Enterprise and CloudBees Jenkins Operations Center are built on top of open source Jenkins, an independent community project.
Read more at: www.cloudbees.com/jenkins/about
© 2015 CloudBees, Inc. CloudBees is a registered trademark and CloudBees Jenkins Enterprise, CloudBees Jenkins Operations Center and
DEV@cloud are trademarks of CloudBees, Inc. Other product or brand names may be trademarks or registered trademarks of their respective holders.	
0115v01
CloudBees, Inc.
289 South San Antonio Rd
Suite 200
Los Altos, CA 94022
United States
www.cloudbees.com
info@cloudbees.com
Learn More About Netflix:
www.netflix.com

More Related Content

What's hot

What is Multi-Tenant Architecture ?
What is Multi-Tenant Architecture ?What is Multi-Tenant Architecture ?
What is Multi-Tenant Architecture ?
Sufalam Technologies Pvt Ltd
 
Mastering Customer Data on Apache Spark
Mastering Customer Data on Apache SparkMastering Customer Data on Apache Spark
Mastering Customer Data on Apache Spark
Caserta
 
Getting Started with Amazon EC2
Getting Started with Amazon EC2Getting Started with Amazon EC2
Getting Started with Amazon EC2
Amazon Web Services
 
Monitoring Microservices
Monitoring MicroservicesMonitoring Microservices
Monitoring Microservices
Weaveworks
 
Cloud Migration Strategy and Best Practices
Cloud Migration Strategy and Best PracticesCloud Migration Strategy and Best Practices
Cloud Migration Strategy and Best Practices
QBurst
 
AWS Managed Services and SaaS Partner Programs
AWS Managed Services and SaaS Partner ProgramsAWS Managed Services and SaaS Partner Programs
AWS Managed Services and SaaS Partner Programs
Amazon Web Services
 
What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...
What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...
What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...
Simplilearn
 
Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million UsersScaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million Users
Amazon Web Services
 
[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들
[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들
[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들
NAVER D2
 
Introduction to Amazon Web Services
Introduction to Amazon Web ServicesIntroduction to Amazon Web Services
Introduction to Amazon Web Services
Amazon Web Services
 
Power up! Mass Migrations at Speed and Scale - Accenture
Power up! Mass Migrations at Speed and Scale - AccenturePower up! Mass Migrations at Speed and Scale - Accenture
Power up! Mass Migrations at Speed and Scale - Accenture
Amazon Web Services
 
Cloud computing and migration strategies to cloud
Cloud computing and migration strategies to cloudCloud computing and migration strategies to cloud
Cloud computing and migration strategies to cloud
Sourabh Saxena
 
Introduction to Google Cloud Platform
Introduction to Google Cloud PlatformIntroduction to Google Cloud Platform
Introduction to Google Cloud Platform
dhruv_chaudhari
 
Event-driven microservices
Event-driven microservicesEvent-driven microservices
Event-driven microservices
Andrew Schofield
 
AWS Storage services
AWS Storage servicesAWS Storage services
AWS Storage services
Nagesh Ramamoorthy
 
AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...
AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...
AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...
Simplilearn
 
Introduction to Amazon EKS
Introduction to Amazon EKSIntroduction to Amazon EKS
Introduction to Amazon EKS
Amazon Web Services
 
Introduction to AWS Lambda and Serverless Applications
Introduction to AWS Lambda and Serverless ApplicationsIntroduction to AWS Lambda and Serverless Applications
Introduction to AWS Lambda and Serverless Applications
Amazon Web Services
 
Data Migration to Azure
Data Migration to AzureData Migration to Azure
Data Migration to Azure
Sanjay B. Bhakta
 
Introduction to Amazon EC2
Introduction to Amazon EC2Introduction to Amazon EC2
Introduction to Amazon EC2
Amazon Web Services
 

What's hot (20)

What is Multi-Tenant Architecture ?
What is Multi-Tenant Architecture ?What is Multi-Tenant Architecture ?
What is Multi-Tenant Architecture ?
 
Mastering Customer Data on Apache Spark
Mastering Customer Data on Apache SparkMastering Customer Data on Apache Spark
Mastering Customer Data on Apache Spark
 
Getting Started with Amazon EC2
Getting Started with Amazon EC2Getting Started with Amazon EC2
Getting Started with Amazon EC2
 
Monitoring Microservices
Monitoring MicroservicesMonitoring Microservices
Monitoring Microservices
 
Cloud Migration Strategy and Best Practices
Cloud Migration Strategy and Best PracticesCloud Migration Strategy and Best Practices
Cloud Migration Strategy and Best Practices
 
AWS Managed Services and SaaS Partner Programs
AWS Managed Services and SaaS Partner ProgramsAWS Managed Services and SaaS Partner Programs
AWS Managed Services and SaaS Partner Programs
 
What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...
What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...
What Is Cloud Computing? | Cloud Computing For Beginners | Cloud Computing Tr...
 
Scaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million UsersScaling on AWS for the First 10 Million Users
Scaling on AWS for the First 10 Million Users
 
[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들
[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들
[115]쿠팡 서비스 클라우드 마이그레이션 통해 배운것들
 
Introduction to Amazon Web Services
Introduction to Amazon Web ServicesIntroduction to Amazon Web Services
Introduction to Amazon Web Services
 
Power up! Mass Migrations at Speed and Scale - Accenture
Power up! Mass Migrations at Speed and Scale - AccenturePower up! Mass Migrations at Speed and Scale - Accenture
Power up! Mass Migrations at Speed and Scale - Accenture
 
Cloud computing and migration strategies to cloud
Cloud computing and migration strategies to cloudCloud computing and migration strategies to cloud
Cloud computing and migration strategies to cloud
 
Introduction to Google Cloud Platform
Introduction to Google Cloud PlatformIntroduction to Google Cloud Platform
Introduction to Google Cloud Platform
 
Event-driven microservices
Event-driven microservicesEvent-driven microservices
Event-driven microservices
 
AWS Storage services
AWS Storage servicesAWS Storage services
AWS Storage services
 
AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...
AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...
AWS vs Azure | AWS vs Azure Comparison | Difference Between AWS And Azure | S...
 
Introduction to Amazon EKS
Introduction to Amazon EKSIntroduction to Amazon EKS
Introduction to Amazon EKS
 
Introduction to AWS Lambda and Serverless Applications
Introduction to AWS Lambda and Serverless ApplicationsIntroduction to AWS Lambda and Serverless Applications
Introduction to AWS Lambda and Serverless Applications
 
Data Migration to Azure
Data Migration to AzureData Migration to Azure
Data Migration to Azure
 
Introduction to Amazon EC2
Introduction to Amazon EC2Introduction to Amazon EC2
Introduction to Amazon EC2
 

Viewers also liked

Rakuten and Microsoft talk DevOps in Real World
Rakuten and Microsoft talk DevOps in Real WorldRakuten and Microsoft talk DevOps in Real World
Rakuten and Microsoft talk DevOps in Real World
Tsuyoshi Ushio
 
DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...
DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...
DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...
DevDay Dresden
 
Transforming Software Development
Transforming Software Development Transforming Software Development
Transforming Software Development
Amazon Web Services
 
It transformation - DevOps Day - 02/02/2017
It transformation - DevOps Day - 02/02/2017It transformation - DevOps Day - 02/02/2017
It transformation - DevOps Day - 02/02/2017
Clara Feuillet
 
IBM Design Thinking & the Bluemix Garage Method
IBM Design Thinking & the Bluemix Garage Method IBM Design Thinking & the Bluemix Garage Method
IBM Design Thinking & the Bluemix Garage Method
Dev_Events
 
设计思维、敏捷、Dev ops —— 助力创新交付
设计思维、敏捷、Dev ops —— 助力创新交付设计思维、敏捷、Dev ops —— 助力创新交付
设计思维、敏捷、Dev ops —— 助力创新交付
Yi Xu
 
Netflix Velocity Conference 2011
Netflix Velocity Conference 2011Netflix Velocity Conference 2011
Netflix Velocity Conference 2011
Adrian Cockcroft
 
Feature driven development
Feature driven developmentFeature driven development
Feature driven development
Hendrik Ebbers
 
DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...
DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...
DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...
Gene Kim
 
Seven habits of effective devops - DevOps Day - 02/02/2017
Seven habits of effective devops - DevOps Day - 02/02/2017Seven habits of effective devops - DevOps Day - 02/02/2017
Seven habits of effective devops - DevOps Day - 02/02/2017
Clara Feuillet
 
IBM Bluemix Workshop version 3
IBM Bluemix Workshop version 3IBM Bluemix Workshop version 3
IBM Bluemix Workshop version 3
Nguyen Tai Dzung
 
(DVO203) The Life of a Netflix Engineer Using 37% of the Internet
(DVO203) The Life of a Netflix Engineer Using 37% of the Internet(DVO203) The Life of a Netflix Engineer Using 37% of the Internet
(DVO203) The Life of a Netflix Engineer Using 37% of the Internet
Amazon Web Services
 
20140708 - Jeremy Edberg: How Netflix Delivers Software
20140708 - Jeremy Edberg: How Netflix Delivers Software20140708 - Jeremy Edberg: How Netflix Delivers Software
20140708 - Jeremy Edberg: How Netflix Delivers Software
DevOps Chicago
 
Netflix Case Study
Netflix Case StudyNetflix Case Study
Netflix Case Study
Kikuyu Daniels
 
AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
Amazon Web Services
 
Kickstarting Design Thinking
Kickstarting Design ThinkingKickstarting Design Thinking
Kickstarting Design Thinking
Erin 'Folletto' Casali
 

Viewers also liked (16)

Rakuten and Microsoft talk DevOps in Real World
Rakuten and Microsoft talk DevOps in Real WorldRakuten and Microsoft talk DevOps in Real World
Rakuten and Microsoft talk DevOps in Real World
 
DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...
DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...
DevDay 2016: Artur Speth - DevOps - Microsoft Developer Divisions Weg ins näc...
 
Transforming Software Development
Transforming Software Development Transforming Software Development
Transforming Software Development
 
It transformation - DevOps Day - 02/02/2017
It transformation - DevOps Day - 02/02/2017It transformation - DevOps Day - 02/02/2017
It transformation - DevOps Day - 02/02/2017
 
IBM Design Thinking & the Bluemix Garage Method
IBM Design Thinking & the Bluemix Garage Method IBM Design Thinking & the Bluemix Garage Method
IBM Design Thinking & the Bluemix Garage Method
 
设计思维、敏捷、Dev ops —— 助力创新交付
设计思维、敏捷、Dev ops —— 助力创新交付设计思维、敏捷、Dev ops —— 助力创新交付
设计思维、敏捷、Dev ops —— 助力创新交付
 
Netflix Velocity Conference 2011
Netflix Velocity Conference 2011Netflix Velocity Conference 2011
Netflix Velocity Conference 2011
 
Feature driven development
Feature driven developmentFeature driven development
Feature driven development
 
DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...
DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...
DOES SFO 2016 - Sam Guckenheimer & Ed Blankenship "Moving to One Engineering ...
 
Seven habits of effective devops - DevOps Day - 02/02/2017
Seven habits of effective devops - DevOps Day - 02/02/2017Seven habits of effective devops - DevOps Day - 02/02/2017
Seven habits of effective devops - DevOps Day - 02/02/2017
 
IBM Bluemix Workshop version 3
IBM Bluemix Workshop version 3IBM Bluemix Workshop version 3
IBM Bluemix Workshop version 3
 
(DVO203) The Life of a Netflix Engineer Using 37% of the Internet
(DVO203) The Life of a Netflix Engineer Using 37% of the Internet(DVO203) The Life of a Netflix Engineer Using 37% of the Internet
(DVO203) The Life of a Netflix Engineer Using 37% of the Internet
 
20140708 - Jeremy Edberg: How Netflix Delivers Software
20140708 - Jeremy Edberg: How Netflix Delivers Software20140708 - Jeremy Edberg: How Netflix Delivers Software
20140708 - Jeremy Edberg: How Netflix Delivers Software
 
Netflix Case Study
Netflix Case StudyNetflix Case Study
Netflix Case Study
 
AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
AWS re:Invent 2016: Another Day in the Life of a Netflix Engineer (DEV209)
 
Kickstarting Design Thinking
Kickstarting Design ThinkingKickstarting Design Thinking
Kickstarting Design Thinking
 

Similar to Netflix Case Study - AWS

CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018
Krishna-Kumar
 
Building cloud native microservices
Building cloud native microservicesBuilding cloud native microservices
Building cloud native microservices
Brian Pulito
 
Containers, microservices and serverless for realists
Containers, microservices and serverless for realistsContainers, microservices and serverless for realists
Containers, microservices and serverless for realists
Karthik Gaekwad
 
Migrating to Microservices – It's Easier Than You Think
Migrating to Microservices – It's Easier Than You ThinkMigrating to Microservices – It's Easier Than You Think
Migrating to Microservices – It's Easier Than You Think
DevOps.com
 
"The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming" "The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming"
James Watters
 
Application Centric Microservices Architecture
Application Centric Microservices ArchitectureApplication Centric Microservices Architecture
Application Centric Microservices Architecture
Ken Owens
 
Cloudfoundry + K8S : Prendre le meilleur des deux mondes
Cloudfoundry + K8S  :  Prendre le meilleur des deux mondesCloudfoundry + K8S  :  Prendre le meilleur des deux mondes
Cloudfoundry + K8S : Prendre le meilleur des deux mondes
Erwan Bornier
 
OpenWhisk - Serverless Architecture
OpenWhisk - Serverless Architecture OpenWhisk - Serverless Architecture
OpenWhisk - Serverless Architecture
Dev_Events
 
IBM Open Cloud Update XCITE Fall 2014
IBM Open Cloud Update   XCITE Fall 2014IBM Open Cloud Update   XCITE Fall 2014
IBM Open Cloud Update XCITE Fall 2014
Christopher Ferris
 
Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...
Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...
Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...
Michael Elder
 
Cloud Foundry Technical Overview at IBM Interconnect 2016
Cloud Foundry Technical Overview at IBM Interconnect 2016Cloud Foundry Technical Overview at IBM Interconnect 2016
Cloud Foundry Technical Overview at IBM Interconnect 2016
Stormy Peters
 
Using Containers to More Effectively Manage DevOps Continuous Integration
Using Containers to More Effectively Manage DevOps Continuous IntegrationUsing Containers to More Effectively Manage DevOps Continuous Integration
Using Containers to More Effectively Manage DevOps Continuous Integration
Cognizant
 
Serverless Apps with Open Whisk
Serverless Apps with Open Whisk Serverless Apps with Open Whisk
Serverless Apps with Open Whisk
Dev_Events
 
Containers and Microservices for Realists
Containers and Microservices for RealistsContainers and Microservices for Realists
Containers and Microservices for Realists
Oracle Developers
 
Containers and microservices for realists
Containers and microservices for realistsContainers and microservices for realists
Containers and microservices for realists
Karthik Gaekwad
 
Intro to DevOps 4 undergraduates
Intro to DevOps 4 undergraduates Intro to DevOps 4 undergraduates
Intro to DevOps 4 undergraduates
Liran Levy
 
Compass digital ocean’s customer advisory group 2021_10
Compass digital ocean’s customer advisory group 2021_10Compass digital ocean’s customer advisory group 2021_10
Compass digital ocean’s customer advisory group 2021_10
Pierre Mavro
 
AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...
AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...
AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...
Amazon Web Services
 
Defi Development Services.pdf
Defi Development Services.pdfDefi Development Services.pdf
Defi Development Services.pdf
Bharathraj923421
 
Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...
Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...
Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...
jaxconf
 

Similar to Netflix Case Study - AWS (20)

CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018
 
Building cloud native microservices
Building cloud native microservicesBuilding cloud native microservices
Building cloud native microservices
 
Containers, microservices and serverless for realists
Containers, microservices and serverless for realistsContainers, microservices and serverless for realists
Containers, microservices and serverless for realists
 
Migrating to Microservices – It's Easier Than You Think
Migrating to Microservices – It's Easier Than You ThinkMigrating to Microservices – It's Easier Than You Think
Migrating to Microservices – It's Easier Than You Think
 
"The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming" "The Cloud Native Enterprise is Coming"
"The Cloud Native Enterprise is Coming"
 
Application Centric Microservices Architecture
Application Centric Microservices ArchitectureApplication Centric Microservices Architecture
Application Centric Microservices Architecture
 
Cloudfoundry + K8S : Prendre le meilleur des deux mondes
Cloudfoundry + K8S  :  Prendre le meilleur des deux mondesCloudfoundry + K8S  :  Prendre le meilleur des deux mondes
Cloudfoundry + K8S : Prendre le meilleur des deux mondes
 
OpenWhisk - Serverless Architecture
OpenWhisk - Serverless Architecture OpenWhisk - Serverless Architecture
OpenWhisk - Serverless Architecture
 
IBM Open Cloud Update XCITE Fall 2014
IBM Open Cloud Update   XCITE Fall 2014IBM Open Cloud Update   XCITE Fall 2014
IBM Open Cloud Update XCITE Fall 2014
 
Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...
Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...
Continuous Delivery on IBM Bluemix: Manage Cloud Native Services with Cloud N...
 
Cloud Foundry Technical Overview at IBM Interconnect 2016
Cloud Foundry Technical Overview at IBM Interconnect 2016Cloud Foundry Technical Overview at IBM Interconnect 2016
Cloud Foundry Technical Overview at IBM Interconnect 2016
 
Using Containers to More Effectively Manage DevOps Continuous Integration
Using Containers to More Effectively Manage DevOps Continuous IntegrationUsing Containers to More Effectively Manage DevOps Continuous Integration
Using Containers to More Effectively Manage DevOps Continuous Integration
 
Serverless Apps with Open Whisk
Serverless Apps with Open Whisk Serverless Apps with Open Whisk
Serverless Apps with Open Whisk
 
Containers and Microservices for Realists
Containers and Microservices for RealistsContainers and Microservices for Realists
Containers and Microservices for Realists
 
Containers and microservices for realists
Containers and microservices for realistsContainers and microservices for realists
Containers and microservices for realists
 
Intro to DevOps 4 undergraduates
Intro to DevOps 4 undergraduates Intro to DevOps 4 undergraduates
Intro to DevOps 4 undergraduates
 
Compass digital ocean’s customer advisory group 2021_10
Compass digital ocean’s customer advisory group 2021_10Compass digital ocean’s customer advisory group 2021_10
Compass digital ocean’s customer advisory group 2021_10
 
AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...
AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...
AWS re:Invent 2016: Open Source at AWS—Contributions, Support, and Engagement...
 
Defi Development Services.pdf
Defi Development Services.pdfDefi Development Services.pdf
Defi Development Services.pdf
 
Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...
Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...
Amazon Web Services and PaaS - Enterprise Java for the Cloud Era? - Mark Pric...
 

Netflix Case Study - AWS

  • 1. Netflix Builds Its Open Sourced Cloud Technologies on the CloudBees Platform CASE STUDY More than 36 million Netflix members worldwide view streamed content and access Netflix features delivered via cloud technology that the company has been developing since 2009. Netflix operates on a cloud platform based on Amazon Web Services (AWS). Over the years, Netflix engineers have developed numerous cloud tools and technologies, which the company has now shared with the development community as open source software. While many companies may be leery of freely sharing core technology, Netflix sees several compelling advantages to the move. First, the company aims to establish its solutions as standards that are widely used throughout the industry. Second, improvements contributed by the community to improve performance or add support for other cloud services will improve the standard for everyone, advancing the platform robustness and quality. Third, the move will burnish the company’s reputation as a technology leader, which was boosted in 2012 by winning an Emmy for Technical Achievement. Lastly, it will help Netflix attract, engage and retain expert engineers, because it can draw directly from a wide pool of proven contributors. To help maximize these advantages, Netflix chose the CloudBees Platform as a Service (PaaS) solution to support the public builds of its NetflixOSS open source projects. “Open sourcing our cloud-based architecture projects is a way to reduce risk, improve our service and contribute to the broader cloud-based community,” says Gareth Bowles, senior tools engineer at Netflix. “The CloudBees platform is helping us achieve these objectives by enabling Netflix engineers and external contributors to rapidly build and test changes, instantly see the quality of the changes being made and continue to realize the benefits of continuous integration with Jenkins.” Challenge: Simplify and Streamline Open Source Development Netflix needed a way to transition dozens of internal projects to open source projects as efficiently and cost-effectively as possible. “We wanted to make our builds public, in a way that enabled everyone—including the Netflix engineers that would continue to work on the projects and the new external contributors—to see the effect of changes as soon as possible. We wanted the community to be able to assess the quality of each project at any point in time,” says Bowles. “And because we were already very heavy on-premise Jenkins users, we wanted a Jenkins-based cloud service for continuous integration.” At the same time, the company was looking to keep costs and maintenance requirements down. “We are sharing our code with the community at no cost, and we needed a low cost way to do it that would not require extensive resources and ongoing maintenance,” says Bowles. A Solution for Rapid Feedback and Continuous Integration Netflix transitioned its open source projects to the CloudBees DEV@cloud development platform. Netflix engineers set up a few prototype builds with Jenkins, the CloudBees Platform and several key Jenkins plugins. They had everything up and running within two to three hours. “The move was very easy and we had great support from the CloudBees technical team,” says Bowles. CHALLENGE Support and promote contributions to the open source development of cloud technologies for video streaming and large-scale cloud deployments SOLUTION Use the CloudBees platform, with Jenkins in the cloud, to streamline development, provide immediate build feedback to the community and minimize maintenance overhead and costs RESULTS >> Immediate feedback on builds Minimal maintenance overhead Cost-effective pricing SERVICES DEV@cloud
  • 2. The team then began using the Jenkins Job DSL plugin to create new projects programmatically, updating the location of the GitHub repository that each project used. Once a project is open to the community, developers—both internal and external—can instantly see its current build status, which is displayed using the Jenkins Embeddable Build Status plugin. Among contributors, the ability to build pull requests before they are merged into the main branch has been a much-appreciated feature. Made possible by the GitHub Pull Request Builder plugin, this capability provides virtually instant feedback when a pull request is made. “This feature acts as an extra reviewer for the code changes that developers submit,” says Bowles. “Our developers have been really impressed with the ability to get instant feedback on their changes.” The CloudBees Platform is also playing a central role in the Netflix Cloud Prize contest, in which participants fork one of the Netflix open source repositories on GitHub, implement an improvement or new functionality and submit their changes for judging to win a prize in one of 10 categories. Netflix will set up new builds on the CloudBees Platform for entries that use a compatible build structure. Ultimately all Netflix open source projects will be built on the CloudBees Platform. Netflix has already migrated most of them, including Asgard (a web interface for application deployments and cloud management on AWS) and SimianArmy, which includes the Chaos Monkey resiliency tool that helps applications tolerate random instance failures. Results Immediate feedback on builds. “With the CloudBees platform, Jenkins triggers a build when changes are submitted, so developers get feedback on their submissions within seconds, instead of having to wait 15 minutes or longer. Plus, everyone can see the current build status immediately,” says Bowles. “That benefits the entire developer community and spurs more contributions, because it reduces friction and makes the entire process smoother.” Minimal maintenance overhead. “Once we’ve created a build job, we rarely need to change the configuration so minimal maintenance is required,” says Bowles. “We don’t need a full- time employee to manage all of these projects; we just check in a couple times a day. It’s nice to know that CloudBees is handling the entire infrastructure for us, behind the scenes.” Cost-effective pricing. “We are grateful for the CloudBees Platform because it has enabled us to keep costs to a minimum as we open source our code,” says Bowles. “Since we are sharing our technology with the community for no cost, we appreciate that CloudBees has provided an affordable option for open source projects and that we can use the CloudBees infrastructure to publicly build those projects.” “The CloudBees platform is helping us achieve our goals to open source our code by making it easier for developers to contribute, give rapid feedback on pull requests, provide the current status of projects and support low-cost public builds. This spurs an increased pace of innovation that benefits not only Netflix and our customers, but the entire community.” Gareth Bowles, Netflix CloudBees Jenkins Enterprise and CloudBees Jenkins Operations Center are built on top of open source Jenkins, an independent community project. Read more at: www.cloudbees.com/jenkins/about © 2015 CloudBees, Inc. CloudBees is a registered trademark and CloudBees Jenkins Enterprise, CloudBees Jenkins Operations Center and DEV@cloud are trademarks of CloudBees, Inc. Other product or brand names may be trademarks or registered trademarks of their respective holders. 0115v01 CloudBees, Inc. 289 South San Antonio Rd Suite 200 Los Altos, CA 94022 United States www.cloudbees.com info@cloudbees.com Learn More About Netflix: www.netflix.com