Awssummit2011nytimesfinal com-110610112751-phpapp01

230 views

Published on

Published in: Technology, Design
  • Be the first to comment

  • Be the first to like this

Awssummit2011nytimesfinal com-110610112751-phpapp01

  1. 1. NYTimes.comVadim JelezniakovAWS Summit 2011 1
  2. 2. Next 10 min The Company Why CloudThe App Examples Progress So Far What’s Next 2
  3. 3. The New York Times Company The New York TimesThe International Herald Tribune The Boston Globe 15 daily newspapers 50 Web sites NYTimes.com Boston.com About.com 3
  4. 4. NYTimes.com’s StatsIn the US:38.1 mil unique users / month810 mil page views / monthWorldwide:62 mil unique users / month984 mil page views / month#1 individual newspaper site#2 media site bloggers link to the most*#4 news and information Web site comScore Report, April 2011 *Technoratis index 4
  5. 5. Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 5
  6. 6. Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 6
  7. 7. Why Cloud? Why AWS?On Demand Availability Cost-Effective Scalability IaaS = Flexible Rapid Deployment Comprehensive 7
  8. 8. Examples On Demand Capacity - TimesMachineFlexibility - Times SkimmerScalability - User Generated Content (Comments) 8
  9. 9. TimesMachine (2007, 2008) 130 years of archives in 36 hours 400K objects, 4T of data S3, EC2, Hadoop http://timesmachine.nytimes.com 9
  10. 10. Skimmer Private Beta (Feb 14th, 2009) http://www.nytimes.com/skimmer/ 10
  11. 11. “SkimmerGate”11:00 News leaks toTechCrunch, Google Finance11:10 Average load on theinstance is 4011:15 Snapshotting theinstance, configuring the LB,testing12:00 Four Skimmerinstances load balanced,quality is restored1 hour - from prototype toproduction 11
  12. 12. Comments on Articles and Blogs 12
  13. 13. Rate and Review for Movies, Theater, Dining and Travel 13
  14. 14. We like To be able to scale quickly on demand We don’t likecalls from Systems team at 6PM on Fridays 14
  15. 15. Traffic Spikes - Add Capacity 15
  16. 16. Traffic Spikes - Add Capacity 15
  17. 17. Load Balancing / Security View 16
  18. 18. Everyone’s Favorites:Development Instances! 17
  19. 19. Gap Analysis• Load Balancing• Communication between instances• Talking back to existing Datacenter• Scaling up and back• Securing the instances 18
  20. 20. 19
  21. 21. 20
  22. 22. 21
  23. 23. 22
  24. 24. 23
  25. 25. 24
  26. 26. 25
  27. 27. Tools Developed for the Cloud Nimbul Light Cloud Manager http://github.com/nimbul/nimbul Emissary Fast AMQP Messaging http://github.com/nimbul/emissary CloudSource Simple SVN Deployment http://github.com/nimbul/cloudsource based on ServerMattic developed by WordPress 26
  28. 28. Progress So Far 27
  29. 29. NYTimes.com EC2 ExpansionClusters: from 2 to 100. Instances: from 30 to 400. 28
  30. 30. NYTimes.com EC2 Expansion 2009 2011 EC2 DC in comparison with other DCs from 4% to 36%(VMs/pure physical servers/instance count) 29
  31. 31. NYTimes.com AWS ExpansionAWS contributes ~27% of total operational cost across DCs (including space, power, bandwidth and excluding CDN) 30
  32. 32. What’s NextMulti-AZ and Multi-RegionSNS, SNS2SQS - in DevMulti-AZ MySQL RDSNeed smarter ELBNeed multi-AZ support in VPC 31
  33. 33. email: vadimj@nytimes.comtwitter: @vadimjhttp://www.nytimes.comhttp://www.nytimes.com/skimmer/http://timesmachine.nytimes.comhttp://open.nytimes.comhttp://github.com/nimbul/ images licensed from http://www.dreamstime.com/ charts generated using google docs 32

×