• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
How NYTimes.com uses Amazon Web Services - AWS Summit 2011
 

How NYTimes.com uses Amazon Web Services - AWS Summit 2011

on

  • 6,544 views

The deck I presented at AWS Summit 2011 in Hilton New York

The deck I presented at AWS Summit 2011 in Hilton New York

Statistics

Views

Total Views
6,544
Views on SlideShare
6,291
Embed Views
253

Actions

Likes
9
Downloads
103
Comments
0

44 Embeds 253

https://twitter.com 157
http://www.linkedin.com 11
http://www.onlydoo.com 8
http://www.mongodb.org 8
http://www.utpl.edu.ec 7
https://www.linkedin.com 6
http://importanciadelasticsyeducacion.wikispaces.com 6
http://www.istikbal.gr 4
http://asoladas.blogspot.com 3
http://www.petrobras.com.br 3
http://paper.li 2
http://drizzlin.com 2
http://www.2g-cenergy.com 2
http://localhost:52886 2
http://asoladas.blogspot.com.es 2
http://aprendersociales.blogspot.com 2
http://campobag.blogspot.com 1
http://www.tbliconference.com 1
http://bibliotheque.estp.fr 1
http://www.jlorihuela.com 1
http://www.cottica.net 1
http://jacgmur.blogspot.com 1
http://flow3.typo3.org 1
http://test-613f9co4dddc3f5cf000.ning.com 1
http://127.0.0.1:51235 1
http://moderation.local 1
http://preacherspen.org 1
http://www.vmworld.com 1
http://prevesci.blogspot.com 1
http://www.society30.com 1
http://netadblog.com 1
http://entornoseducativos-barruntica.blogspot.com 1
http://www.watersummit.ca 1
http://www.telnet-ri.es 1
http://www.hr-benchmark.cn 1
http://educadorinfantil.blogspot.com 1
http://www.widgetolab.com 1
http://infosystem7.blogspot.com 1
http://www.massey.ac.nz 1
http://www.usabilidoido.com.br 1
http://www.saujana.sg 1
http://co3k.org 1
http://www.bamboohouseindia.org 1
http://twitter.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • comments on articles and blogs - we get about 130K comments per month and 1.5 million reader recommendations.\n
  • rate and review for movies, theater, dining and travel destinations\n
  • \n
  • The key here we thought was not only scaling up for spikes but perhaps scaling down at night when not as many of you were commenting. \n
  • The key here we thought was not only scaling up for spikes but perhaps scaling down at night when not as many of you were commenting. \n
  • \n
  • We had lots of questions that were fun to answer. How would the front ends know which api instance to request? Or where exactly is that database the api instance is supposed to query? Better yet, how are we going to manage all of these instances? How exactly will it scale? How will we request internal api’s that live back in our data center?\n\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n

How NYTimes.com uses Amazon Web Services - AWS Summit 2011 How NYTimes.com uses Amazon Web Services - AWS Summit 2011 Presentation Transcript

  • NYTimes.comVadim JelezniakovAWS Summit 2011 1
  • Next 10 min The Company Why CloudThe App Examples Progress So Far What’s Next 2
  • The New York Times Company The New York TimesThe International Herald Tribune The Boston Globe 15 daily newspapers 50 Web sites NYTimes.com Boston.com About.com 3
  • NYTimes.com’s StatsIn the US:38.1 mil unique users / month810 mil page views / monthWorldwide:62 mil unique users / month984 mil page views / month#1 individual newspaper site#2 media site bloggers link to the most*#4 news and information Web site comScore Report, April 2011 *Technoratis index 4
  • Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 5
  • Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 6
  • Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 7
  • Examples On Demand Capacity - TimesMachineFlexibility - Times SkimmerScalability - User Generated Content (Comments) 8
  • TimesMachine (2007, 2008) 130 years of archives in 36 hours 400K objects, 4T of data S3, EC2, Hadoop http://timesmachine.nytimes.com 9
  • Skimmer Private Beta (Feb 14th, 2009) http://www.nytimes.com/skimmer/ 10
  • “SkimmerGate”11:00 News leaks toTechCrunch, Google Finance11:10 Average load on theinstance is 4011:15 Snapshotting theinstance, configuring the LB,testing12:00 Four Skimmerinstances load balanced,quality is restored1 hour - from prototype toproduction 11
  • Comments on Articles and Blogs 12
  • Rate and Review for Movies, Theater, Dining and Travel 13
  • We like To be able to scale quickly on demand We don’t likecalls from Systems team at 6PM on Fridays 14
  • Traffic Spikes - Add Capacity 15
  • Traffic Spikes - Add Capacity 15
  • Load Balancing / Security View 16
  • Everyone’s Favorites:Development Instances! 17
  • Gap Analysis• Load Balancing• Communication between instances• Talking back to existing Datacenter• Scaling up and back• Securing the instances 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • Tools Developed for the Cloud Nimbul Light Cloud Manager http://github.com/nimbul/nimbul Emissary Fast AMQP Messaging http://github.com/nimbul/emissary CloudSource Simple SVN Deployment http://github.com/nimbul/cloudsource based on ServerMattic developed by WordPress 26
  • Progress So Far 27
  • NYTimes.com EC2 ExpansionClusters: from 2 to 100. Instances: from 30 to 400. 28
  • NYTimes.com EC2 Expansion 2009 2011 EC2 DC in comparison with other DCs from 4% to 36%(VMs/pure physical servers/instance count) 29
  • NYTimes.com AWS ExpansionAWS contributes ~27% of total operational cost across DCs (including space, power, bandwidth and excluding CDN) 30
  • What’s NextMulti-AZ and Multi-RegionSNS, SNS2SQS - in DevMulti-AZ MySQL RDSNeed smarter ELBNeed multi-AZ support in VPC 31
  • email: vadimj@nytimes.comtwitter: @vadimjhttp://www.nytimes.comhttp://www.nytimes.com/skimmer/http://timesmachine.nytimes.comhttp://open.nytimes.comhttp://github.com/nimbul/ images licensed from http://www.dreamstime.com/ charts generated using google docs 32