• Save
Netflix in the Cloud
Upcoming SlideShare
Loading in...5
×
 

Netflix in the Cloud

on

  • 19,075 views

[Full slides now also available at http://www.slideshare.net/adrianco/netflix-on-cloud-combined-slides-for-dev-and-ops] ...

[Full slides now also available at http://www.slideshare.net/adrianco/netflix-on-cloud-combined-slides-for-dev-and-ops]

Short summary of why Netflix is running on the Amazon cloud, what is running there, what we have learned and where this is taking us.

This is the introduction section to a series of public presentations that will go into much more detail. The Silicon Valley Cloud Computing Meetup was on Oct 14th, QCon San Francisco November 3rd.

Statistics

Views

Total Views
19,075
Views on SlideShare
15,431
Embed Views
3,644

Actions

Likes
19
Downloads
0
Comments
2

57 Embeds 3,644

http://ws-security.blogspot.com 1549
http://softwarestrategiesblog.com 577
http://www.hackingnetflix.com 561
http://ws-security.blogspot.in 347
http://www.1nima.com 263
http://ws-security.blogspot.co.uk 53
http://ws-security.blogspot.com.au 32
http://ws-security.blogspot.ca 26
http://ws-security.blogspot.jp 18
http://ws-security.blogspot.de 15
http://unlimited-data.blogspot.com 13
http://www.linkedin.com 13
http://ws-security.blogspot.nl 13
http://ws-security.blogspot.fr 11
http://ws-security.blogspot.com.es 10
http://ws-security.blogspot.se 10
http://ws-security.blogspot.it 10
http://www.ws-security.blogspot.com 8
http://ws-security.blogspot.sg 8
http://webcache.googleusercontent.com 7
http://translate.googleusercontent.com 7
http://ws-security.blogspot.pt 7
http://ws-security.blogspot.ch 6
http://ws-security.blogspot.com.br 6
http://ws-security.blogspot.co.il 5
http://feeds.feedburner.com 5
https://www.linkedin.com 4
http://pmomale-ld1 4
http://www.ws-security.blogspot.in 3
http://ws-security.blogspot.be 3
http://ws-security.blogspot.hk 3
http://www.ws-security.blogspot.co.uk 3
http://static.slidesharecdn.com 3
http://ws-security.blogspot.ru 3
http://ws-security.blogspot.mx 3
http://ws-security.blogspot.dk 3
http://ws-security.blogspot.co.nz 3
http://ws-security.blogspot.com.ar 3
http://onlinesecuritytips.bijayblog.com 2
http://www.ws-security.blogspot.com.au 2
http://unlimited-data.blogspot.ru 2
http://irr.posterous.com 2
http://ws-security.blogspot.hu 2
http://ws-security.blogspot.cz 2
http://itnewscast.com 2
http://ws-security.blogspot.fi 1
http://unlimited-data.blogspot.co.at 1
http://rdbcci:8100 1
http://unlimited-data.blogspot.in 1
http://theoldreader.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • See http://www.slideshare.net/adrianco/netflix-on-cloud-combined-slides-for-dev-and-ops for the full version
    Are you sure you want to
    Your message goes here
    Processing…
  • This is one the most significant advances in cloud computing in 2010. It is not just another cloud. It the proof that a 15 million user data center can be operated from a cloud infrastructure other created for commercial use
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Netflix in the Cloud Netflix in the Cloud Presentation Transcript

  • Ne#lix  in  the  Cloud   Oct  7,  2010   Adrian  Cockcro:   @adrianco   h<p://www.linkedin.com/in/adriancockcro:  
  • With  more  than  15  million  members,  Ne#lix,  Inc.   is  the  world’s  largest  subscripJon  service   streaming  movies  and  TV  episodes  over  the   Internet  and  sending  DVDs  by  mail.  
  • Why  Use  AWS?   •  Stop  building  our  own  datacenters   –  Capacity  growth  rate  is  acceleraJng,  unpredictable   –  Product  launch  spikes  -­‐  iPhone,  Wii,  PS3,  XBox   –  DC  is  large  inflexible  capital  commitment   •  Leverage  AWS  Scale  –  the  biggest   –  AWS  investment  in  tooling  and  automaJon   –  AWS  zones  for  high  availability,  scalability   –  AWS  skills  are  common  on  resumes…   •  Leverage  AWS  Feature  Set  –  most  advanced   –  EC2,  S3,  SDB,  SQS,  EBS,  EMR,  ELB,  ASG,  RDB..  
  • Ne#lix  Deployed  on  AWS   •  “batch”  Movie  Encoding  farm  (2009)   –  Thousands  of  EC2  instances,  Petabytes  of  S3   –  Movie  files  staged  out  to  CDNs  for  delivery   •  Hadoop  -­‐  ElasJc  Map-­‐Reduce  (2009)   –  Large  scale  log  processing  and  analyJcs   •  Streaming  Service  Back-­‐end  (early  2010)   –  Highly  available  and  scalable  “play  bu<on”   •  Web  site,  a  page  at  a  Jme  (through  2010)   –  Ramp  from  25%  of  views  to  80%  in  the  coming  weeks   •  API  for  TV  devices  and  iPhone  etc.  (2010)   –  Personalized  movie  choosing  algorithm  back-­‐end  
  • Learnings…   •  Datacenter  oriented  tools  don’t  work   –  Ephemeral  instances,  high  rate  of  change   •  Cloud  Tools  Don’t  Scale  for  Enterprise   –  Built  our  own  tools,  drove  vendors  hard   •  It’s  faster  in  the  end  to  re-­‐code  than  Jnker   –  “fork-­‐li:ed”  apps  don’t  work  well   –  Re-­‐architected  and  re-­‐wrote  much  of  our  code  base  using   fine  grain  web  services,  leveraging  open  source  in  Java,   highly  instrumented.  “NoSQL”  SimpleDB  backend.   In  the  datacenter,  robust  code  is  best  prac2ce.  In  the   cloud,  it’s  essen2al  
  • Next  Few  Years…   •  “System  of  Record”  moves  to  Cloud   –  Cut  the  datacenter  to  cloud  replicaJon  link   •  InternaJonal  Expansion  –  Global  Clouds   –  Rapid  deployments  to  new  markets   •  GPU  Clouds  opJmized  for  video  encoding   •  MulJple  Vendor  Deployments   –  Ne#lix  already  uses  several  streaming  CDN  vendors   –  Large  scale  compeJtors  will  offer  AWS  clones   –  Higher  resilience,  higher  scalability   –  CompeJJon  drives  cost  down   We  would  prefer  to  be  an  insignificant  customer  in  a  giant  cloud  
  • Takeaway   Ne#lix  is  path-­‐finding  the  use  of  public  AWS   cloud  to  replace  in-­‐house  IT  for  non-­‐trivial   applicaJons  with  hundreds  of  developers  and   thousands  of  systems.   h<p://www.linkedin.com/in/adriancockcro:   @adrianco