Monday, October 24, 2011
@9len                                     Glen D Sanford                           Giving a talk at Davis tomorrow about  ...
“Instantly connect people everywhere                    to what is most meaningful to them”Monday, October 24, 2011
IreneMonday, October 24, 2011
@washingtonpost                                    The Washington Post                           Hurricane #Irenes predict...
@thelede                                    NYTimes The Lede                           Update: Hurricane Center Expects   ...
@CNN                                    CNN                           Twitter list of CNN journalists with                ...
Monday, October 24, 2011
@JordnJnkieJuice                                    !Finally"MF"Famous!                           EARTHQUAKE !!!!!        ...
@usgsMonday, October 24, 2011
Monday, October 24, 2011
Monday, October 24, 2011
300 miles                              to                             NYCMonday, October 24, 2011
Monday, October 24, 2011
@remedyoakland                                    Remedy                           Strawberry scones and rhubarb          ...
What’s a Tweet?Monday, October 24, 2011
48 characters                                                                         +1 for the bird                     ...
1 tweetMonday, October 24, 2011
sizeof(1 tweet)= 140 charactersMonday, October 24, 2011
= 140 characters                           sizeof(1 tweet)                                           ! 200 bytesMonday, Oc...
@Astro_Soichi                                     Soichi Noguchi                           http://twitpic.com/17dfqb -    ...
@Astro_Soichi                                     Soichi Noguchi                           http://twitpic.com/17dfqb -    ...
@tw1tt3rart                                    TW1TT3Rart                                                                T...
Monday, October 24, 2011
Monday, October 24, 2011
Monday, October 24, 2011
Monday, October 24, 2011
@9len                           Glen D SanfordMonday, October 24, 2011
@9len                           Glen D SanfordMonday, October 24, 2011
Monday, October 24, 2011
Monday, October 24, 2011
Monday, October 24, 2011
Monday, October 24, 2011
@9len                           Glen D SanfordMonday, October 24, 2011
Sounds easy, right?                                                 trick questionMonday, October 24, 2011
More Than                           1,000,000,000                              Tweets a weekMonday, October 24, 2011
1E9 tweets                             weekMonday, October 24, 2011
1E9 tweets   1700 tweets                                      !                             week         secondMonday, Oct...
1E9 tweets   1700 tweets                                      !                             week         second           ...
Tokyo                           6,600 TPSMonday, October 24, 2011
7,196                           TPSMonday, October 24, 2011
8,800 TPSMonday, October 24, 2011
@9len                           Glen D Sanford                                 status/updateMonday, October 24, 2011
@9len                           Glen D Sanford                                 status/updateMonday, October 24, 2011
status/update                               HTTP 200 OKMonday, October 24, 2011                           {
status/update                            HTTP 200 OKMonday, October 24, 2011
Snowflake       http://github.com/twitter/snowflake                                             sMonday, October 24, 2011
s                           RockdoveMonday, October 24, 2011
t.coMonday, October 24, 2011
Storage                                     {Monday, October 24, 2011
Storage   Gizzard                                     https://github.com/twitter/gizzard                                  ...
status/update                               HTTP 200 OKMonday, October 24, 2011                           {
status/update                               HTTP 200 OKMonday, October 24, 2011                           {
HTTP 200 OK                           {                               …                               "text":"Tweet!"     ...
status/update                               HTTP 200 OK                           {                               …       ...
status/update                               HTTP 200 OK                           {                               …       ...
Monday, October 24, 2011
status/update                                                 Fanout                               HTTP 200 OK            ...
te                                        Flock                                        http://github.com/twitter/flockdb  ...
te                               FanoutK    Monday, October 24, 2011
status/update                                                 Fanout                               HTTP 200 OK            ...
@ladygaga                           mother mons†er                           14.6 million followers                       ...
@ladygaga                                  mother mons†er                                  14.6 million followers         ...
@ladygaga                           mother mons†er                           14.6 million followers                       ...
is a             Real-Time Event-driven                           &                           ProblemMonday, October 24, 2...
What happens in the                               World                               happens onMonday, October 24, 2011
We’re working on...                            Really large scale systems                                    Analytics    ...
Follow me at                      Questions?   twitter.com/9lenMonday, October 24, 2011
Upcoming SlideShare
Loading in...5
×

Glen Sanford: Engineering for Real-Time at Twitter

39,740

Published on

I gave this talk at UC Davis on behalf of Twitter on 10/18/11. It was based on a talk Raffi Krikorian gave earlier this year at Stanford. (http://www.slideshare.net/raffikrikorian/twitter-engineering-for-realtime-stanford-acm-2011). It's an overview of the path of a Tweet through Twitter.

Published in: Technology
0 Comments
24 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
39,740
On Slideshare
0
From Embeds
0
Number of Embeds
27
Actions
Shares
0
Downloads
0
Comments
0
Likes
24
Embeds 0
No embeds

No notes for slide

Glen Sanford: Engineering for Real-Time at Twitter

  1. 1. Monday, October 24, 2011
  2. 2. @9len Glen D Sanford Giving a talk at Davis tomorrow about engineering for real-time at Twitter. #davistechtalk 1 min ago via Twitter for Mac Favorite Retweet ReplyMonday, October 24, 2011
  3. 3. “Instantly connect people everywhere to what is most meaningful to them”Monday, October 24, 2011
  4. 4. IreneMonday, October 24, 2011
  5. 5. @washingtonpost The Washington Post Hurricane #Irenes predicted path: wapo.st/olG9em 26 Aug via SocialFlow Favorite Retweet ReplyMonday, October 24, 2011
  6. 6. @thelede NYTimes The Lede Update: Hurricane Center Expects Storm to Strike I-95 Corridor nyti.ms/rbya1s #Irene 26 Aug via The New York Times Favorite Retweet ReplyMonday, October 24, 2011
  7. 7. @CNN CNN Twitter list of CNN journalists with boots on the ground covering Hurricane #Irene -- tinyurl.com/3wcurxr 26 Aug via web Favorite Retweet ReplyMonday, October 24, 2011
  8. 8. Monday, October 24, 2011
  9. 9. @JordnJnkieJuice !Finally"MF"Famous! EARTHQUAKE !!!!! 1 min ago via Echofon Favorite Retweet ReplyMonday, October 24, 2011
  10. 10. @usgsMonday, October 24, 2011
  11. 11. Monday, October 24, 2011
  12. 12. Monday, October 24, 2011
  13. 13. 300 miles to NYCMonday, October 24, 2011
  14. 14. Monday, October 24, 2011
  15. 15. @remedyoakland Remedy Strawberry scones and rhubarb turnovers in the house! 14 Apr via Facebook Favorite Retweet ReplyMonday, October 24, 2011
  16. 16. What’s a Tweet?Monday, October 24, 2011
  17. 17. 48 characters +1 for the bird What’s a Tweet? It’s a short message thats sent through 140 characters maxMonday, October 24, 2011
  18. 18. 1 tweetMonday, October 24, 2011
  19. 19. sizeof(1 tweet)= 140 charactersMonday, October 24, 2011
  20. 20. = 140 characters sizeof(1 tweet) ! 200 bytesMonday, October 24, 2011
  21. 21. @Astro_Soichi Soichi Noguchi http://twitpic.com/17dfqb - 8 Mar 10 via TwitPic Favorite Retweet ReplyMonday, October 24, 2011
  22. 22. @Astro_Soichi Soichi Noguchi http://twitpic.com/17dfqb - 8 Mar 10 via TwitPic Favorite Retweet ReplyMonday, October 24, 2011
  23. 23. @tw1tt3rart TW1TT3Rart THANK YOU STEVE #ThankYouSteve #TwitterArt 6 Oct via web Favorite Retweet ReplyMonday, October 24, 2011
  24. 24. Monday, October 24, 2011
  25. 25. Monday, October 24, 2011
  26. 26. Monday, October 24, 2011
  27. 27. Monday, October 24, 2011
  28. 28. @9len Glen D SanfordMonday, October 24, 2011
  29. 29. @9len Glen D SanfordMonday, October 24, 2011
  30. 30. Monday, October 24, 2011
  31. 31. Monday, October 24, 2011
  32. 32. Monday, October 24, 2011
  33. 33. Monday, October 24, 2011
  34. 34. @9len Glen D SanfordMonday, October 24, 2011
  35. 35. Sounds easy, right? trick questionMonday, October 24, 2011
  36. 36. More Than 1,000,000,000 Tweets a weekMonday, October 24, 2011
  37. 37. 1E9 tweets weekMonday, October 24, 2011
  38. 38. 1E9 tweets 1700 tweets ! week secondMonday, October 24, 2011
  39. 39. 1E9 tweets 1700 tweets ! week second steady stateMonday, October 24, 2011
  40. 40. Tokyo 6,600 TPSMonday, October 24, 2011
  41. 41. 7,196 TPSMonday, October 24, 2011
  42. 42. 8,800 TPSMonday, October 24, 2011
  43. 43. @9len Glen D Sanford status/updateMonday, October 24, 2011
  44. 44. @9len Glen D Sanford status/updateMonday, October 24, 2011
  45. 45. status/update HTTP 200 OKMonday, October 24, 2011 {
  46. 46. status/update HTTP 200 OKMonday, October 24, 2011
  47. 47. Snowflake http://github.com/twitter/snowflake sMonday, October 24, 2011
  48. 48. s RockdoveMonday, October 24, 2011
  49. 49. t.coMonday, October 24, 2011
  50. 50. Storage {Monday, October 24, 2011
  51. 51. Storage Gizzard https://github.com/twitter/gizzard {Monday, October 24, 2011
  52. 52. status/update HTTP 200 OKMonday, October 24, 2011 {
  53. 53. status/update HTTP 200 OKMonday, October 24, 2011 {
  54. 54. HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  55. 55. status/update HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  56. 56. status/update HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  57. 57. Monday, October 24, 2011
  58. 58. status/update Fanout HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  59. 59. te Flock http://github.com/twitter/flockdb FanoutK Monday, October 24, 2011
  60. 60. te FanoutK Monday, October 24, 2011
  61. 61. status/update Fanout HTTP 200 OK { … "text":"Tweet!" … }Monday, October 24, 2011
  62. 62. @ladygaga mother mons†er 14.6 million followers @justinbieber Justin Bieber 13.5 million followers @BarackObama 44th President of the United States 10.6 million followers @9len software engineer, fundamentally ok guy 0.0021 million followersMonday, October 24, 2011
  63. 63. @ladygaga mother mons†er 14.6 million followers @9len software engineer, fundamentally ok guy 0.0021 million followers 10000x more followers than meMonday, October 24, 2011
  64. 64. @ladygaga mother mons†er 14.6 million followers @9len software engineer, fundamentally ok guy 0.0021 million followers scaling for 107Monday, October 24, 2011
  65. 65. is a Real-Time Event-driven & ProblemMonday, October 24, 2011
  66. 66. What happens in the World happens onMonday, October 24, 2011
  67. 67. We’re working on... Really large scale systems Analytics Relevancy engines Indexing and search Databases and storage UX / HCI designMonday, October 24, 2011
  68. 68. Follow me at Questions? twitter.com/9lenMonday, October 24, 2011

×