I gave this talk at UC Davis on behalf of Twitter on 10/18/11. It was based on a talk Raffi Krikorian gave earlier this year at Stanford. (http://www.slideshare.net/raffikrikorian/twitter-engineering-for-realtime-stanford-acm-2011). It's an overview of the path of a Tweet through Twitter.

1. Monday, October 24, 2011

2. @9len
Glen D Sanford
Giving a talk at Davis tomorrow about
engineering for real-time at Twitter.
#davistechtalk
1 min ago via Twitter for Mac Favorite Retweet Reply
Monday, October 24, 2011

3. “Instantly connect people everywhere
to what is most meaningful to them”
Monday, October 24, 2011

4. Irene
Monday, October 24, 2011

5. @washingtonpost
The Washington Post
Hurricane #Irene's predicted path:
wapo.st/olG9em
26 Aug via SocialFlow Favorite Retweet Reply
Monday, October 24, 2011

6. @thelede
NYTimes The Lede
Update: Hurricane Center Expects
Storm to Strike I-95 Corridor
nyti.ms/rbya1s #Irene
26 Aug via The New York Times Favorite Retweet Reply
Monday, October 24, 2011

7. @CNN
CNN
Twitter list of CNN journalists with
'boots on the ground' covering
Hurricane #Irene --
tinyurl.com/3wcurxr
26 Aug via web Favorite Retweet Reply
Monday, October 24, 2011

8. Monday, October 24, 2011

9. @JordnJnkieJuice
!Finally"MF"Famous!
EARTHQUAKE !!!!!
1 min ago via Echofon Favorite Retweet Reply
Monday, October 24, 2011

10. @usgs
Monday, October 24, 2011

11. Monday, October 24, 2011

12. Monday, October 24, 2011

13. 300 miles
to
NYC
Monday, October 24, 2011

14. Monday, October 24, 2011

15. @remedyoakland
Remedy
Strawberry scones and rhubarb
turnovers in the house!
14 Apr via Facebook Favorite Retweet Reply
Monday, October 24, 2011

16. What’s a Tweet?
Monday, October 24, 2011

17. 48 characters
+1 for the bird
What’s a Tweet?
It’s a short message that's sent through
140 characters max
Monday, October 24, 2011

18. 1 tweet
Monday, October 24, 2011

19. sizeof(1 tweet)= 140 characters
Monday, October 24, 2011

20. = 140 characters
sizeof(1 tweet)
! 200 bytes
Monday, October 24, 2011

21. @Astro_Soichi
Soichi Noguchi
http://twitpic.com/17dfqb -
8 Mar 10 via TwitPic Favorite Retweet Reply
Monday, October 24, 2011

22. @Astro_Soichi
Soichi Noguchi
http://twitpic.com/17dfqb -
8 Mar 10 via TwitPic Favorite Retweet Reply
Monday, October 24, 2011

23. @tw1tt3rart
TW1TT3Rart
THANK
YOU
STEVE
#ThankYouSteve #TwitterArt
6 Oct via web Favorite Retweet Reply
Monday, October 24, 2011

24. Monday, October 24, 2011

25. Monday, October 24, 2011

26. Monday, October 24, 2011

27. Monday, October 24, 2011

28. @9len
Glen D Sanford
Monday, October 24, 2011

29. @9len
Glen D Sanford
Monday, October 24, 2011

30. Monday, October 24, 2011

31. Monday, October 24, 2011

32. Monday, October 24, 2011

33. Monday, October 24, 2011

34. @9len
Glen D Sanford
Monday, October 24, 2011

35. Sounds easy, right?
trick question
Monday, October 24, 2011

36. More Than
1,000,000,000
Tweets a week
Monday, October 24, 2011

37. 1E9 tweets
week
Monday, October 24, 2011

38. 1E9 tweets 1700 tweets
!
week second
Monday, October 24, 2011

39. 1E9 tweets 1700 tweets
!
week second
steady state
Monday, October 24, 2011

40. Tokyo
6,600 TPS
Monday, October 24, 2011

41. 7,196
TPS
Monday, October 24, 2011

42. 8,800 TPS
Monday, October 24, 2011

43. @9len
Glen D Sanford
status/update
Monday, October 24, 2011

44. @9len
Glen D Sanford
status/update
Monday, October 24, 2011

45. status/update
HTTP 200 OK
Monday, October 24, 2011
{

46. status/update
HTTP 200 OK
Monday, October 24, 2011

47. Snowflake
http://github.com/twitter/snowflake
s
Monday, October 24, 2011

48. s
Rockdove
Monday, October 24, 2011

49. t.co
Monday, October 24, 2011

50. Storage
{
Monday, October 24, 2011

51. Storage Gizzard
https://github.com/twitter/gizzard
{
Monday, October 24, 2011

52. status/update
HTTP 200 OK
Monday, October 24, 2011
{

53. status/update
HTTP 200 OK
Monday, October 24, 2011
{

54. HTTP 200 OK
{
…
"text":"Tweet!"
…
}
Monday, October 24, 2011

55. status/update
HTTP 200 OK
{
…
"text":"Tweet!"
…
}
Monday, October 24, 2011

56. status/update
HTTP 200 OK
{
…
"text":"Tweet!"
…
}
Monday, October 24, 2011

57. Monday, October 24, 2011

58. status/update
Fanout
HTTP 200 OK
{
…
"text":"Tweet!"
…
}
Monday, October 24, 2011

59. te
Flock
http://github.com/twitter/flockdb
Fanout
K
Monday, October 24, 2011

60. te
Fanout
K
Monday, October 24, 2011

61. status/update
Fanout
HTTP 200 OK
{
…
"text":"Tweet!"
…
}
Monday, October 24, 2011

62. @ladygaga
mother mons†er
14.6 million followers
@justinbieber
Justin Bieber
13.5 million followers
@BarackObama
44th President of the United States
10.6 million followers
@9len
software engineer, fundamentally ok guy
0.0021 million followers
Monday, October 24, 2011

63. @ladygaga
mother mons†er
14.6 million followers
@9len
software engineer, fundamentally ok guy
0.0021 million followers
10000x more followers than me
Monday, October 24, 2011

64. @ladygaga
mother mons†er
14.6 million followers
@9len
software engineer, fundamentally ok guy
0.0021 million followers
scaling for 107
Monday, October 24, 2011

65. is a
Real-Time Event-driven
&
Problem
Monday, October 24, 2011

66. What happens in the
World
happens on
Monday, October 24, 2011

67. We’re working on...
Really large scale systems
Analytics
Relevancy engines
Indexing and search
Databases and storage
UX / HCI design
Monday, October 24, 2011

68. Follow me at
Questions? twitter.com/9len
Monday, October 24, 2011