0
NYTimes.comVadim JelezniakovAWS Summit 2011                    1
Next 10 min The Company  Why CloudThe App Examples Progress So Far  What’s Next                   2
The New York Times Company     The New York TimesThe International Herald Tribune      The Boston Globe      15 daily news...
NYTimes.com’s StatsIn the US:38.1 mil unique users / month810 mil page views / monthWorldwide:62 mil unique users / month9...
Why Cloud?                Why AWS?On Demand Availability       Cost-Effective      Scalability            IaaS = Flexible ...
Why Cloud?                Why AWS?On Demand Availability       Cost-Effective      Scalability            IaaS = Flexible ...
Why Cloud?                Why AWS?On Demand Availability       Cost-Effective      Scalability            IaaS = Flexible ...
Examples  On Demand Capacity -     TimesMachineFlexibility - Times SkimmerScalability - User Generated   Content (Comments...
TimesMachine (2007, 2008) 130 years of archives in 36 hours 400K objects, 4T of data S3, EC2, Hadoop http://timesmachine.n...
Skimmer Private Beta (Feb 14th, 2009)      http://www.nytimes.com/skimmer/                                        10
“SkimmerGate”11:00 News leaks toTechCrunch, Google Finance11:10 Average load on theinstance is 4011:15 Snapshotting theins...
Comments on Articles and Blogs              12
Rate and Review for Movies, Theater, Dining and Travel            13
We like  To be able to scale  quickly on demand  We don’t likecalls from Systems team    at 6PM on Fridays                ...
Traffic Spikes - Add Capacity                               15
Traffic Spikes - Add Capacity                               15
Load Balancing / Security View                                 16
Everyone’s Favorites:Development Instances!                         17
Gap Analysis• Load Balancing• Communication between instances• Talking back to existing Datacenter• Scaling up and back• S...
19
20
21
22
23
24
25
Tools Developed for the Cloud    Nimbul    Light Cloud Manager    http://github.com/nimbul/nimbul    Emissary    Fast AMQP...
Progress So Far                  27
NYTimes.com EC2 ExpansionClusters: from 2 to 100. Instances: from 30 to 400.                       28
NYTimes.com EC2 Expansion        2009                  2011 EC2 DC in comparison with other DCs            from 4% to 36%(...
NYTimes.com AWS ExpansionAWS contributes ~27% of total operational cost across DCs (including space, power, bandwidth and ...
What’s NextMulti-AZ and Multi-RegionSNS, SNS2SQS - in DevMulti-AZ MySQL RDSNeed smarter ELBNeed multi-AZ support in VPC   ...
email: vadimj@nytimes.comtwitter: @vadimjhttp://www.nytimes.comhttp://www.nytimes.com/skimmer/http://timesmachine.nytimes....
Upcoming SlideShare
Loading in...5
×

How NYTimes.com uses Amazon Web Services - AWS Summit 2011

6,302

Published on

The deck I presented at AWS Summit 2011 in Hilton New York

Published in: Technology
0 Comments
9 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
6,302
On Slideshare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
106
Comments
0
Likes
9
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • comments on articles and blogs - we get about 130K comments per month and 1.5 million reader recommendations.\n
  • rate and review for movies, theater, dining and travel destinations\n
  • \n
  • The key here we thought was not only scaling up for spikes but perhaps scaling down at night when not as many of you were commenting. \n
  • The key here we thought was not only scaling up for spikes but perhaps scaling down at night when not as many of you were commenting. \n
  • \n
  • We had lots of questions that were fun to answer. How would the front ends know which api instance to request? Or where exactly is that database the api instance is supposed to query? Better yet, how are we going to manage all of these instances? How exactly will it scale? How will we request internal api’s that live back in our data center?\n\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Transcript of "How NYTimes.com uses Amazon Web Services - AWS Summit 2011"

    1. 1. NYTimes.comVadim JelezniakovAWS Summit 2011 1
    2. 2. Next 10 min The Company Why CloudThe App Examples Progress So Far What’s Next 2
    3. 3. The New York Times Company The New York TimesThe International Herald Tribune The Boston Globe 15 daily newspapers 50 Web sites NYTimes.com Boston.com About.com 3
    4. 4. NYTimes.com’s StatsIn the US:38.1 mil unique users / month810 mil page views / monthWorldwide:62 mil unique users / month984 mil page views / month#1 individual newspaper site#2 media site bloggers link to the most*#4 news and information Web site comScore Report, April 2011 *Technoratis index 4
    5. 5. Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 5
    6. 6. Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 6
    7. 7. Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 7
    8. 8. Examples On Demand Capacity - TimesMachineFlexibility - Times SkimmerScalability - User Generated Content (Comments) 8
    9. 9. TimesMachine (2007, 2008) 130 years of archives in 36 hours 400K objects, 4T of data S3, EC2, Hadoop http://timesmachine.nytimes.com 9
    10. 10. Skimmer Private Beta (Feb 14th, 2009) http://www.nytimes.com/skimmer/ 10
    11. 11. “SkimmerGate”11:00 News leaks toTechCrunch, Google Finance11:10 Average load on theinstance is 4011:15 Snapshotting theinstance, configuring the LB,testing12:00 Four Skimmerinstances load balanced,quality is restored1 hour - from prototype toproduction 11
    12. 12. Comments on Articles and Blogs 12
    13. 13. Rate and Review for Movies, Theater, Dining and Travel 13
    14. 14. We like To be able to scale quickly on demand We don’t likecalls from Systems team at 6PM on Fridays 14
    15. 15. Traffic Spikes - Add Capacity 15
    16. 16. Traffic Spikes - Add Capacity 15
    17. 17. Load Balancing / Security View 16
    18. 18. Everyone’s Favorites:Development Instances! 17
    19. 19. Gap Analysis• Load Balancing• Communication between instances• Talking back to existing Datacenter• Scaling up and back• Securing the instances 18
    20. 20. 19
    21. 21. 20
    22. 22. 21
    23. 23. 22
    24. 24. 23
    25. 25. 24
    26. 26. 25
    27. 27. Tools Developed for the Cloud Nimbul Light Cloud Manager http://github.com/nimbul/nimbul Emissary Fast AMQP Messaging http://github.com/nimbul/emissary CloudSource Simple SVN Deployment http://github.com/nimbul/cloudsource based on ServerMattic developed by WordPress 26
    28. 28. Progress So Far 27
    29. 29. NYTimes.com EC2 ExpansionClusters: from 2 to 100. Instances: from 30 to 400. 28
    30. 30. NYTimes.com EC2 Expansion 2009 2011 EC2 DC in comparison with other DCs from 4% to 36%(VMs/pure physical servers/instance count) 29
    31. 31. NYTimes.com AWS ExpansionAWS contributes ~27% of total operational cost across DCs (including space, power, bandwidth and excluding CDN) 30
    32. 32. What’s NextMulti-AZ and Multi-RegionSNS, SNS2SQS - in DevMulti-AZ MySQL RDSNeed smarter ELBNeed multi-AZ support in VPC 31
    33. 33. email: vadimj@nytimes.comtwitter: @vadimjhttp://www.nytimes.comhttp://www.nytimes.com/skimmer/http://timesmachine.nytimes.comhttp://open.nytimes.comhttp://github.com/nimbul/ images licensed from http://www.dreamstime.com/ charts generated using google docs 32
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×