Glen Sanford: Engineering for Real-Time at Twitter

  • 39,571 views
Uploaded on

I gave this talk at UC Davis on behalf of Twitter on 10/18/11. It was based on a talk Raffi Krikorian gave earlier this year at Stanford. …

I gave this talk at UC Davis on behalf of Twitter on 10/18/11. It was based on a talk Raffi Krikorian gave earlier this year at Stanford. (http://www.slideshare.net/raffikrikorian/twitter-engineering-for-realtime-stanford-acm-2011). It's an overview of the path of a Tweet through Twitter.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
39,571
On Slideshare
0
From Embeds
0
Number of Embeds
24

Actions

Shares
Downloads
0
Comments
0
Likes
23

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Monday, October 24, 2011
  • 2. @9len Glen D Sanford Giving a talk at Davis tomorrow about engineering for real-time at Twitter. #davistechtalk 1 min ago via Twitter for Mac Favorite Retweet ReplyMonday, October 24, 2011
  • 3. “Instantly connect people everywhere to what is most meaningful to them”Monday, October 24, 2011
  • 4. IreneMonday, October 24, 2011
  • 5. @washingtonpost The Washington Post Hurricane #Irenes predicted path: wapo.st/olG9em 26 Aug via SocialFlow Favorite Retweet ReplyMonday, October 24, 2011
  • 6. @thelede NYTimes The Lede Update: Hurricane Center Expects Storm to Strike I-95 Corridor nyti.ms/rbya1s #Irene 26 Aug via The New York Times Favorite Retweet ReplyMonday, October 24, 2011
  • 7. @CNN CNN Twitter list of CNN journalists with boots on the ground covering Hurricane #Irene -- tinyurl.com/3wcurxr 26 Aug via web Favorite Retweet ReplyMonday, October 24, 2011
  • 8. Monday, October 24, 2011
  • 9. @JordnJnkieJuice !Finally"MF"Famous! EARTHQUAKE !!!!! 1 min ago via Echofon Favorite Retweet ReplyMonday, October 24, 2011
  • 10. @usgsMonday, October 24, 2011
  • 11. Monday, October 24, 2011
  • 12. Monday, October 24, 2011
  • 13. 300 miles to NYCMonday, October 24, 2011
  • 14. Monday, October 24, 2011
  • 15. @remedyoakland Remedy Strawberry scones and rhubarb turnovers in the house! 14 Apr via Facebook Favorite Retweet ReplyMonday, October 24, 2011
  • 16. What’s a Tweet?Monday, October 24, 2011
  • 17. 48 characters +1 for the bird What’s a Tweet? It’s a short message thats sent through 140 characters maxMonday, October 24, 2011
  • 18. 1 tweetMonday, October 24, 2011
  • 19. sizeof(1 tweet)= 140 charactersMonday, October 24, 2011
  • 20. = 140 characters sizeof(1 tweet) ! 200 bytesMonday, October 24, 2011
  • 21. @Astro_Soichi Soichi Noguchi http://twitpic.com/17dfqb - 8 Mar 10 via TwitPic Favorite Retweet ReplyMonday, October 24, 2011
  • 22. @Astro_Soichi Soichi Noguchi http://twitpic.com/17dfqb - 8 Mar 10 via TwitPic Favorite Retweet ReplyMonday, October 24, 2011
  • 23. @tw1tt3rart TW1TT3Rart THANK YOU STEVE #ThankYouSteve #TwitterArt 6 Oct via web Favorite Retweet ReplyMonday, October 24, 2011
  • 24. Monday, October 24, 2011
  • 25. Monday, October 24, 2011
  • 26. Monday, October 24, 2011
  • 27. Monday, October 24, 2011
  • 28. @9len Glen D SanfordMonday, October 24, 2011
  • 29. @9len Glen D SanfordMonday, October 24, 2011
  • 30. Monday, October 24, 2011
  • 31. Monday, October 24, 2011
  • 32. Monday, October 24, 2011
  • 33. Monday, October 24, 2011
  • 34. @9len Glen D SanfordMonday, October 24, 2011
  • 35. Sounds easy, right? trick questionMonday, October 24, 2011
  • 36. More Than 1,000,000,000 Tweets a weekMonday, October 24, 2011
  • 37. 1E9 tweets weekMonday, October 24, 2011
  • 38. 1E9 tweets 1700 tweets ! week secondMonday, October 24, 2011
  • 39. 1E9 tweets 1700 tweets ! week second steady stateMonday, October 24, 2011
  • 40. Tokyo 6,600 TPSMonday, October 24, 2011
  • 41. 7,196 TPSMonday, October 24, 2011
  • 42. 8,800 TPSMonday, October 24, 2011
  • 43. @9len Glen D Sanford status/updateMonday, October 24, 2011
  • 44. @9len Glen D Sanford status/updateMonday, October 24, 2011
  • 45. status/update HTTP 200 OKMonday, October 24, 2011 {
  • 46. status/update HTTP 200 OKMonday, October 24, 2011
  • 47. Snowflake http://github.com/twitter/snowflake sMonday, October 24, 2011
  • 48. s RockdoveMonday, October 24, 2011
  • 49. t.coMonday, October 24, 2011
  • 50. Storage {Monday, October 24, 2011
  • 51. Storage Gizzard https://github.com/twitter/gizzard {Monday, October 24, 2011
  • 52. status/update HTTP 200 OKMonday, October 24, 2011 {
  • 53. status/update HTTP 200 OKMonday, October 24, 2011 {
  • 54. HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  • 55. status/update HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  • 56. status/update HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  • 57. Monday, October 24, 2011
  • 58. status/update Fanout HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  • 59. te Flock http://github.com/twitter/flockdb FanoutK Monday, October 24, 2011
  • 60. te FanoutK Monday, October 24, 2011
  • 61. status/update Fanout HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  • 62. @ladygaga mother mons†er 14.6 million followers @justinbieber Justin Bieber 13.5 million followers @BarackObama 44th President of the United States 10.6 million followers @9len software engineer, fundamentally ok guy 0.0021 million followersMonday, October 24, 2011
  • 63. @ladygaga mother mons†er 14.6 million followers @9len software engineer, fundamentally ok guy 0.0021 million followers 10000x more followers than meMonday, October 24, 2011
  • 64. @ladygaga mother mons†er 14.6 million followers @9len software engineer, fundamentally ok guy 0.0021 million followers scaling for 107Monday, October 24, 2011
  • 65. is a Real-Time Event-driven & ProblemMonday, October 24, 2011
  • 66. What happens in the World happens onMonday, October 24, 2011
  • 67. We’re working on... Really large scale systems Analytics Relevancy engines Indexing and search Databases and storage UX / HCI designMonday, October 24, 2011
  • 68. Follow me at Questions? twitter.com/9lenMonday, October 24, 2011