News.me - AWS Start-Up Customer

893 views
831 views

Published on

Published in: Technology, Business
1 Comment
0 Likes
Statistics
Notes
  • Be the first to like this

No Downloads
Views
Total views
893
On SlideShare
0
From Embeds
0
Number of Embeds
18
Actions
Shares
0
Downloads
0
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide

News.me - AWS Start-Up Customer

  1. 1. Michael Young, Founder & CTO @myoung
  2. 2. •intro to news.me•our technology stack on aws•why use aws?•a few parting tips
  3. 3. team news.me
  4. 4. news.me for email
  5. 5. daily email
  6. 6. daily email
  7. 7. news.me for iphone
  8. 8. news stream
  9. 9. news stream
  10. 10. news stream
  11. 11. news stream
  12. 12. article view
  13. 13. reactions
  14. 14. sharing
  15. 15. read later
  16. 16. read later
  17. 17. read later
  18. 18. read later
  19. 19. read later
  20. 20. paperboy
  21. 21. this app is great for the subway
  22. 22. exposé
  23. 23. exposé
  24. 24. web beta coming soon. beta testers?
  25. 25. “Finding more of anything never staysa problem long on the web...What is hard is finding less, butordered by quality, relevance orurgency.” - Clay Shirky
  26. 26. our mission... deliver an amazing newsexperience, and make it fast
  27. 27. avoid this...sad newspaper boy == fail whale
  28. 28. •queuing•beanstalk(d)•caching•redis news.me stack•memcache•database•mongo (1.8 with replica sets). EBS backed•s3
  29. 29. news.me apis (ec2 + s3) kinda big content data store™ api-1.news.me memcache memcache mongoelb api-2.news.me mongo api-n.news.me redis redis
  30. 30. some api notes•have to be fast: few hundred milliseconds•returning full-text feeds for offline caching•but feeds can be 300K+ (not great for 3/4G networks)•gzip! (400K down to 80K)•balancing speed with utility (again, for offline caching)
  31. 31. news.me backend (ec2 + s3)content from: kinda big content data store™ aggregator-1 mongo aggregator-2 mongo redis aggregator-n redis
  32. 32. some aggregation notes•aggregating ~30 million tweets and fb shares (with links) per day•the streams move pretty fast. had some growing pains with mongo•kinda big content data store™ = article content and metadata stored inmemcache + multiple ec2 instances + s3•kinda big content data store™ = over 1 TB of content data•auto scale the aggregators when we need them - helps keep the costdown :-)
  33. 33. why use aws?easy to scalefocus on productpay for what you needcommunity (all of Betaworks companies are onAWS)
  34. 34. do it for the back rubs!
  35. 35. a few tips...decouple everything (makes dealing with failureand scaling easier)measure everything!keep it lean - one persondon’t reinvent the wheel
  36. 36. p.s. we’re hiring

×