Netflix uses cloud computing to address challenges in scaling its infrastructure to support unpredictable growth. It has transitioned its website to be nearly 100% cloud-based using Amazon Web Services (AWS) to gain the scale, availability and agility needed. AWS provides tools and features like auto-scaling that allow Netflix to easily expand capacity as its subscriber base grows by over 50% per year. By leveraging AWS' mature cloud platform, Netflix can focus on its core video business rather than managing data centers.
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Adrian Cockcroft
Presentation given in October 2011 at the High Performance Transaction Systems Workshop http://hpts.ws - describes how Netflix used AWS to run a set of highly scalable Cassandra benchmarks on hundreds of instances in only a few hours.
SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft
Architecture overview of Netflix Cloud Architecture with a focus on the Open Source components that Netflix has put and is planning to release on http://netflix.github.com
This is an update/review of the predictions I made over the last few years, in the form of a 5-minute Ignite! talk with 15 seconds per slide.
It will be given on Monday June 22, 2009 as part of the Velocity Conference evening Ignite session.
Keeping Movies Running Amid Thunderstorms!Sid Anand
How does Netflix strive to deliver an uninterrupted service? This talk, delivered for the first time in November, 2011, covers some engineering design concepts that help us deliver features at a rapid pace while assuring high availability.
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Adrian Cockcroft
Presentation given in October 2011 at the High Performance Transaction Systems Workshop http://hpts.ws - describes how Netflix used AWS to run a set of highly scalable Cassandra benchmarks on hundreds of instances in only a few hours.
SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft
Architecture overview of Netflix Cloud Architecture with a focus on the Open Source components that Netflix has put and is planning to release on http://netflix.github.com
This is an update/review of the predictions I made over the last few years, in the form of a 5-minute Ignite! talk with 15 seconds per slide.
It will be given on Monday June 22, 2009 as part of the Velocity Conference evening Ignite session.
Keeping Movies Running Amid Thunderstorms!Sid Anand
How does Netflix strive to deliver an uninterrupted service? This talk, delivered for the first time in November, 2011, covers some engineering design concepts that help us deliver features at a rapid pace while assuring high availability.
Cloud Architecture Tutorial - Running in the Cloud (3of3)Adrian Cockcroft
Part 3 of the talk covers how to transition to cloud, how to bootstrap developers, how to run cloud services including Cassandra, capacity planning and workload analysis, and organizational structure
Cloud Computing and Eclipse technology - how does it fit together?Markus Knauer
Today, many companies, such as Amazon, Google, Microsoft, and others claim to provide the one and only cloud solution, but their offerings are different, aren’t they? Or do they have more in common than we think? Our talk starts with an introduction to cloud technology as it exists today by comparing the different products from the cloud providers. Next we will outline how technology from the Eclipse Runtime projects can contribute to a combined ’Cloud Stack’ and discuss currently available and possible future scenarios.
In this presentation, the Eclipse plugins from Amazon (announced at EclipseCon 2009) will be compared with the tooling for Microsoft Azure (announced at Eclipse Summit Europe 2009). Additionally, the features of the g-Eclipse project will be presented. g-Eclipse 1.0 was released in December 2009 as an Eclipse project for Grid and Cloud computing within the Eclipse community. g-Eclipse is a framework that allows users and developers to access Computing Grids and Cloud Computing resources in a unified way.
This is the meat of the presentation, it describes in detail how do use anti-architecture to define what gets done, then discusses patterns, type systems, PaaS frameworks, services and components. There is a detailed explanation of Cassandra as a data store and open source components.
Slides from QConSF Nov 19th, 2011 focusing this time on describing the globally distributed and scaled industrial strength Java Platform as a Service that Netflix has built and run on top of AWS and Cassandra. Parts of that platform are being released as open source - Curator, Priam and Astyanax.
The fourth in our series of webinars, 'Journey Through the AWS Cloud'. This complimentary presentation discusses the use of services offered by AWS that alleviate the need for you to install and manage software on EC2 instances. We introduce the key services customers employ to keep them focused on developing their applications, whilst AWS takes care of running the scalable and reliable building blocks upon which they are built.
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...Amazon Web Services
Getting started with Amazon Web Services (AWS) is fast and simple. This presentation outlines best practice guidance from the Amazon Web Services team.
By Ryan Shuttleworth, AWS Technical Evangelist
AWS Evangelist, Ryan Shuttleworth, explores the extended features of AWS S3 in this Masterclass webinar.
AWS S3 hosts over 1.3 trillion objects and is used for storing a wide range of data, from system backups, web site assets and digital media. In this webinar we will explain the features of S3 from static website hosting, through server side encryption to Glacier integration. We'll dive deep into the feature sets of S3 to give a rounded overview of its capabilities, looking at common use cases, APIs and best practice.
To see the recording and demostration for this webinar on YouTube, please click on the following links:
Masterclass Webinar: Amazon S3 Recording - http://www.youtube.com/watch?v=HHuRJZChCYQ
Masterclass Webinar: Amazon S3 Demonstration - http://www.youtube.com/watch?v=JuffWMBeJkw
A round up of all the features & improvements released since our last update, we'll walk through the timeline to bring you up to speed on the continuous innovation at AWS.
Presentation for the NJIT OpenSocial Hackathon on OpenSocial and it's use cases, OpenSocial Templates and Proxied Content, the OpenSocial Foundation, Apache Shindig and OpenSocial 2.0
Notes Version - NonProfit Website Fundraising Foundations - ESCHouston 2013 A...Sarah M Worthy
Download this version as a PDF with my notes from the August 2013 ESCHouston Seminar where I talked about how to get started with the technology foundations for a successful nonprofit fundraising website.
Cloud Architecture Tutorial - Running in the Cloud (3of3)Adrian Cockcroft
Part 3 of the talk covers how to transition to cloud, how to bootstrap developers, how to run cloud services including Cassandra, capacity planning and workload analysis, and organizational structure
Cloud Computing and Eclipse technology - how does it fit together?Markus Knauer
Today, many companies, such as Amazon, Google, Microsoft, and others claim to provide the one and only cloud solution, but their offerings are different, aren’t they? Or do they have more in common than we think? Our talk starts with an introduction to cloud technology as it exists today by comparing the different products from the cloud providers. Next we will outline how technology from the Eclipse Runtime projects can contribute to a combined ’Cloud Stack’ and discuss currently available and possible future scenarios.
In this presentation, the Eclipse plugins from Amazon (announced at EclipseCon 2009) will be compared with the tooling for Microsoft Azure (announced at Eclipse Summit Europe 2009). Additionally, the features of the g-Eclipse project will be presented. g-Eclipse 1.0 was released in December 2009 as an Eclipse project for Grid and Cloud computing within the Eclipse community. g-Eclipse is a framework that allows users and developers to access Computing Grids and Cloud Computing resources in a unified way.
This is the meat of the presentation, it describes in detail how do use anti-architecture to define what gets done, then discusses patterns, type systems, PaaS frameworks, services and components. There is a detailed explanation of Cassandra as a data store and open source components.
Slides from QConSF Nov 19th, 2011 focusing this time on describing the globally distributed and scaled industrial strength Java Platform as a Service that Netflix has built and run on top of AWS and Cassandra. Parts of that platform are being released as open source - Curator, Priam and Astyanax.
The fourth in our series of webinars, 'Journey Through the AWS Cloud'. This complimentary presentation discusses the use of services offered by AWS that alleviate the need for you to install and manage software on EC2 instances. We introduce the key services customers employ to keep them focused on developing their applications, whilst AWS takes care of running the scalable and reliable building blocks upon which they are built.
AWS for Start-ups - Architectural Best Practices & Automating Your Infrastruc...Amazon Web Services
Getting started with Amazon Web Services (AWS) is fast and simple. This presentation outlines best practice guidance from the Amazon Web Services team.
By Ryan Shuttleworth, AWS Technical Evangelist
AWS Evangelist, Ryan Shuttleworth, explores the extended features of AWS S3 in this Masterclass webinar.
AWS S3 hosts over 1.3 trillion objects and is used for storing a wide range of data, from system backups, web site assets and digital media. In this webinar we will explain the features of S3 from static website hosting, through server side encryption to Glacier integration. We'll dive deep into the feature sets of S3 to give a rounded overview of its capabilities, looking at common use cases, APIs and best practice.
To see the recording and demostration for this webinar on YouTube, please click on the following links:
Masterclass Webinar: Amazon S3 Recording - http://www.youtube.com/watch?v=HHuRJZChCYQ
Masterclass Webinar: Amazon S3 Demonstration - http://www.youtube.com/watch?v=JuffWMBeJkw
A round up of all the features & improvements released since our last update, we'll walk through the timeline to bring you up to speed on the continuous innovation at AWS.
Presentation for the NJIT OpenSocial Hackathon on OpenSocial and it's use cases, OpenSocial Templates and Proxied Content, the OpenSocial Foundation, Apache Shindig and OpenSocial 2.0
Notes Version - NonProfit Website Fundraising Foundations - ESCHouston 2013 A...Sarah M Worthy
Download this version as a PDF with my notes from the August 2013 ESCHouston Seminar where I talked about how to get started with the technology foundations for a successful nonprofit fundraising website.
[Full slides now also available at http://www.slideshare.net/adrianco/netflix-on-cloud-combined-slides-for-dev-and-ops]
Short summary of why Netflix is running on the Amazon cloud, what is running there, what we have learned and where this is taking us.
This is the introduction section to a series of public presentations that will go into much more detail. The Silicon Valley Cloud Computing Meetup was on Oct 14th, QCon San Francisco November 3rd.
Cloud Architecture Tutorial - Why and What (1of 3) Adrian Cockcroft
Introduction to the Netflix Cloud Architecture Tutorial - discusses the why and what of cloud including the thinking behind Netflix choice of AWS, and the product features that Netflix runs in the cloud.
O'Reilly Webcast: Architecting Applications For The CloudO'Reilly Media
This presentation analyzes aspects of the Amazon EC2 IaaS cloud environment that differ from a traditional data center and introduces general best practices for ensuring data privacy, storage persistence, and reliable DBMS backup. Presented by Jorge Noa, CTO of Hyperstratus
Convergence of Containers and Serverless by Mency WooTriNimbus
Presentation slides from the Vancouver AWS User Group Meetup on Jan. 29, 2019 with Mency Woo. Title is "The Convergence of Containers and Severless on AWS"
You have heard how containers are great for running microservices, but running and managing large scale applications with microservices architectures is hard and often requires operating complex container management infrastructure. So what exactly is needed to get microservices to run in production at scale?
In this session, we will explore the reasoning and concepts behind microservices and how containers simplify building microservices based applications, and we will walk through a number of patterns used by our customers to run their microservices platforms. We will also dive deep into some of the challenges of running microservices, such as load balancing, service discovery, and secrets management, and we’ll see how Amazon EC2 Container Service (ECS) can help address them. We will also demo how you can easily deploy complex microservices applications using Amazon ECS.
The recent decades have witnessed a significant change in the work environment of organizations and businesses around the world. The Technological advancements and the pioneering of Cloud and cloud computing platforms have been a considerable thrust behind this growth. At present, most businesses are utilizing or are intending to utilize Cloud Computing for their operations, which have led to a gigantic surge in the need for cloud experts.
Why Scale Matters and How the Cloud is Really Different (at scale)Amazon Web Services
Cloud computing gives you a number of advantages, such as being able to scale your application on demand. As a new business looking to use the cloud, you inevitably ask yourself, "Where do I start?" Join us in this session to understand best practices for scaling your resources from zero to millions of users. We will show you how to best combine different AWS services, make smarter decisions for architecting your application, and best practices for scaling your infrastructure in the cloud.
Presenter:
Santanu Dutt, Solution Architect, Amazon Internet Services
Vinayak Hegde, Vice President – Engineering, Helpshift
Sunny Saxena, Product Lead, Sprinklr
1. Ne#lix
in
the
Cloud
Qcon
Beiing
April
9,
2011
Adrian
Cockcro=
@adrianco
#ne#lixcloud
h@p://slideshare.net/adrianco
acockcro=@ne#lix.com
2. Who,
Why,
What
Ne#lix
in
the
Cloud
Cloud
Challenges
and
Learnings
Systems
and
OperaKons
Architecture
(see
presentaKon
at
15:50-‐16:50)
3. Ne#lix
Inc.
With
more
than
20
million
subscribers
in
the
United
States
and
Canada,
Ne9lix,
Inc.
is
the
world’s
leading
Internet
subscripAon
service
for
enjoying
movies
and
TV
shows.
InternaAonal
Expansion
We
plan
to
expand
into
an
addiAonal
market
in
the
second
half
of
2011…
If
the
second
market
meets
our
expectaAons…
we
will
conAnue
to
invest
and
expand
aggressively
in
2012.
Source:
h@p://ir.ne#lix.com
5. Adrian
Cockcro=
• Director,
Architecture
for
Cloud
Systems,
Ne#lix
Inc.
– Previously
Director
for
PersonalizaKon
Pla#orm
• DisKnguished
Availability
Engineer,
eBay
Inc.
2004-‐7
– Founding
member
of
eBay
Research
Labs
• DisKnguished
Engineer,
Sun
Microsystems
Inc.
1988-‐2004
– 2003-‐4
Chief
Architect
High
Performance
Technical
CompuKng
– 2001
Author:
Capacity
Planning
for
Web
Services
– 1999
Author:
Resource
Management
– 1995
&
1998
Author:
Sun
Performance
and
Tuning
– 1996
Japanese
EdiKon
of
Sun
Performance
and
Tuning
•
SPARC
&
Solaris ( )
7. Ne#lix
is
Path-‐finding
The
Cloud
ecosystem
is
evolving
very
fast
Share
with
and
learn
from
the
cloud
community
8. We
want
to
use
clouds,
not
build
them
Cloud
technology
should
be
a
commodity
Public
cloud
and
open
source
for
agility
and
scale
9. Why
Use
Cloud?
For
Be@er
Business
Agility
For
Unpredictable
Business
Growth
10. Data
Center
Ne#lix
could
not
build
new
datacenters
fast
enough
Capacity
growth
is
acceleraKng,
unpredictable
Product
launch
spikes
-‐
iPhone,
Wii,
PS3,
XBox
11. 20
Million
Customers
2010-‐Q3
year/year
+52%
Total
and
+145%
Streaming
25
20
15
10
5
0
2009Q2
2009Q3
2009Q4
2010Q1
2010Q2
2010Q3
2010Q4
Source:
h@p://ir.ne#lix.com
12. Out-‐Growing
Data
Center
h@p://techblog.ne#lix.com/2011/02/redesigning-‐ne#lix-‐api.html
37x
Growth
Jan
2010-‐Jan
2011
Datacenter
Capacity
13. Ne#lix.com
is
now
~100%
Cloud
Account
sign-‐up
is
currently
being
moved
to
cloud
All
internaKonal
product
will
be
cloud
based
USA
specific
logisKcs
remains
in
the
Datacenter
14. Leverage
AWS
Scale
“the
biggest
public
cloud”
AWS
investment
in
tooling
and
automaKon
Use
many
AWS
zones
for
high
availability,
scalability
AWS
skills
are
most
common
on
resumes…
15. Leverage
AWS
Feature
Set
“the
market
leader”
EC2,
S3,
SDB,
SQS,
EBS,
EMR,
ELB,
ASG,
IAM,
RDB,
VPC…
h@p://aws.amazon.com/jp
16. Amazon Cloud Terminology
See http://aws.amazon.com/ for details
This is not a full list of Amazon Web Service features
• AWS
–
Amazon
Web
Services
(common
name
for
Amazon
cloud)
• AMI
–
Amazon
Machine
Image
(archived
boot
disk,
Linux,
Windows
etc.
plus
applicaKon
code)
• EC2
–
ElasKc
Compute
Cloud
– Range
of
virtual
machine
types
m1,
m2,
c1,
cc,
cg.
Varying
memory,
CPU
and
disk
configuraKons.
– Instance
–
a
running
computer
system.
Ephemeral,
when
it
is
de-‐allocated
nothing
is
kept.
– Reserved
Instances
–
pre-‐paid
to
reduce
cost
for
long
term
usage
– Availability
Zone
–
datacenter
with
own
power
and
cooling
hosKng
cloud
instances
– Region
–
group
of
Availability
Zones
–
US-‐East,
US-‐West,
EU-‐Eire,
Asia-‐Singapore,
Asia-‐Japan
• ASG
–
Auto
Scaling
Group
(instances
booKng
from
the
same
AMI)
• S3
–
Simple
Storage
Service
(h@p
access)
• EBS
–
ElasKc
Block
Storage
(network
disk
filesystem
can
be
mounted
on
an
instance)
• RDB
–
RelaKonal
Data
Base
(managed
MySQL
master
and
slaves)
• SDB
–
Simple
Data
Base
(hosted
h@p
based
NoSQL
data
store)
• SQS
–
Simple
Queue
Service
(h@p
based
message
queue)
• SNS
–
Simple
NoKficaKon
Service
(h@p
and
email
based
topics
and
messages)
• EMR
–
ElasKc
Map
Reduce
(automaKcally
managed
Hadoop
cluster)
• ELB
–
ElasKc
Load
Balancer
• EIP
–
ElasKc
IP
(stable
IP
address
mapping
assigned
to
instance
or
ELB)
• VPC
–
Virtual
Private
Cloud
(extension
of
enterprise
datacenter
network
into
cloud)
• IAM
–
IdenKty
and
Access
Management
(fine
grain
role
based
security
keys)
17. Simple
AWS
Architecture
AutomaKc
configuraKon
of
this
using
“CloudFormaKon”
and
“ElasKc
Beanstalk”
External
DNS
CName
Route
53
ElasKc
IP
Persistent
IP
Address
Address
EIP
Round
Robin
Load
ElasKc
Load
Balancer
Balancer
ELB
Auto
Scaling
Groups
of
m1.xlarge
JVM
m1.xlarge
JVM
m1.xlarge
JVM
m1.xlarge
JVM
Instances
running
AMIs
app.war
app.war
app.war
app.war
Simple
RelaKonal
Simple
Storage
Simple
Queue
Cloud
Storage
Services
Database
Service
SDB
Service
S3
Service
SQS
Database
Service
mySQL
18. “The
cloud
lets
its
users
focus
on
delivering
differenAaAng
business
value
instead
of
wasAng
valuable
resources
on
the
undifferen)ated
heavy
li0ing
that
makes
up
most
of
IT
infrastructure.”
Werner
Vogels
Amazon
CTO
19. We
want
to
use
clouds,
we
don’t
have
Kme
to
build
them
Public
cloud
for
agility
and
scale
AWS
because
they
are
big
enough
to
allocate
thousands
of
instances
per
hour
when
we
need
to
20. Ne#lix
EC2
Instances
per
Account
(summer
2010,
producKon
is
much
higher
now…)
“Many
Thousands”
Content
Encoding
Test
and
ProducKon
Log
Analysis
“Several
Months”
21. Ne#lix
Deployed
on
AWS
Content
Logs
Play
WWW
API
Video
S3
DRM
Search
Metadata
Masters
Movie
EC2
EMR
Hadoop
CDN
rouKng
Device
Config
Choosing
TV
Movie
S3
Hive
Bookmarks
RaKngs
Choosing
Content
Business
Mobile
Delivery
Logging
Similars
Intelligence
iPhone
Network
CDN
22. Cloud
Encoding
Pipeline
Encode
S3
Encode
S3
Movie
Master
Network
S3
Copy
to
CDN
Stream
Studios
Ne#lix
Master
Mezza-‐ Mezza-‐ to
50+
Origin
Origin
Tapes
Upload
nine
files
CDN
to
TV
nine
files
Licensed
content
is
provided
to
Ne#lix
as
high
quality
master
tapes
Many
formats
are
reduced
to
a
single
high
quality
mezzanine
format
on
S3
Individual
formats
and
speeds
are
encoded
in
over
50
combinaKons
Many
formats
for
older
and
newer
hardware
and
various
game
consoles
Many
speeds
from
mobile
through
standard
and
high
definiKon
StaKc
files
are
copied
to
each
Content
Delivery
Network’s
“origin
server”
CDNs
migrate
files
to
“edge
servers”
near
the
end
user
Files
stream
to
PC/Mac/iPad
or
TV
over
HTTP
using
“range
get”
to
move
chunks
24. Product
Trade-‐off
User
Experience
ImplementaKon
Consistent
Development
Experience
complexity
OperaKonal
Low
Latency
complexity
25. Learnings
• Datacenter
oriented
tools
don’t
work
– Ephemeral
instances
– High
rate
of
change
– Need
too
much
hand-‐holding
and
manual
setup
• Cloud
Tools
Don’t
Scale
for
Enterprise
– Too
many
tools
are
“Startup”
oriented
– Built
our
own
tools
for
1000’s
of
instances
– Drove
vendors
to
be
dynamic,
scale,
add
APIs
• Un-‐modified
Datacenter
Apps
are
Fragile
– Too
many
datacenter
oriented
assumpKons
– We
re-‐wrote
our
code
base!
– (We
re-‐write
it
conKnuously
anyway)
27. ImplicaKons
for
IT
OperaKons
• Cloud
is
run
by
developer
organizaKon
– Our
IT
department
is
Amazon
Cloud
• Cloud
capacity
is
much
bigger
than
Datacenter
– Datacenter
oriented
IT
staffing
is
flat
– We
have
no
IT
staff
working
on
cloud
– We
have
moved
3
people
out
of
IT
to
write
code
• TradiKonal
IT
Roles
are
going
away
– Don’t
need
SA,
DBA,
Storage,
Network
admins
28. Next
Few
Years…
• “System
of
Record”
moves
to
Cloud
(now)
– Master
copies
of
data
live
only
in
the
cloud,
with
backups
– Cut
the
datacenter
to
cloud
replicaKon
link
• InternaKonal
Expansion
–
Global
Clouds
(later
in
2011)
– Rapid
deployments
to
new
markets
• Cloud
StandardizaKon?
– Cloud
features
and
APIs
should
be
a
commodity
not
a
differenKator
– DifferenKate
on
scale
and
quality
of
service
– CompeKKon
also
drives
cost
down
– Higher
resilience
and
scalability
We
would
prefer
to
be
an
insignificant
customer
in
a
giant
cloud
29. Takeaway
Ne9lix
is
path-‐finding
the
use
of
public
AWS
cloud
to
replace
in-‐house
IT
for
non-‐trivial
applicaAons
with
hundreds
of
developers
and
thousands
of
systems.
acockcro=@ne#lix.com
h@p://www.linkedin.com/in/adriancockcro=
@adrianco
#ne#lixcloud