• Save
Twitter: Engineering for Real-Time (Stanford ACM 2011)
Upcoming SlideShare
Loading in...5
×
 

Twitter: Engineering for Real-Time (Stanford ACM 2011)

on

  • 5,414 views

 

Statistics

Views

Total Views
5,414
Views on SlideShare
5,240
Embed Views
174

Actions

Likes
17
Downloads
0
Comments
0

11 Embeds 174

http://paper.li 106
http://www.linkedin.com 27
http://a0.twimg.com 13
http://www.certipost.com 12
http://us-w1.rockmelt.com 3
http://us-w1.rockmelt.com 3
http://staging-assets.local.twitter.com 3
http://staging-assets.local.twitter.com 3
http://www.twylah.com 2
https://si0.twimg.com 1
https://twitter.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Twitter: Engineering for Real-Time (Stanford ACM 2011) Twitter: Engineering for Real-Time (Stanford ACM 2011) Presentation Transcript

    • @raffi Raffi KrikorianGiving a talk at @StanfordACM.Want to know about engineering forreal-time?1 min ago via Twitter for iPhone Favorite Retweet Reply
    • @JordnJnkieJuice ✔Finally✈MF✈Famous✔EARTHQUAKE !!!!!1 min ago via Echofon Favorite Retweet Reply
    • @usgs
    • 300 miles to NYC
    • @remedyoakland RemedyStrawberry scones and rhubarbturnovers in the house!14 Apr via Facebook Favorite Retweet Reply
    • What’s a Tweet?
    • 48 characters +1 for the birdWhat’s a Tweet?It’s a short message thats sent through 140 characters max
    • 1 tweet
    • sizeof(1 tweet)
    • sizeof(1 tweet)= 140 characters
    • sizeof(1 tweet)= 140 characters
    • sizeof(1 tweet)= 140 characters
    • sizeof(1 tweet)= 140 characters
    • sizeof(1 tweet)≈ 200 bytes
    • sizeof(1 tweet)≈ 200 bytes
    • = 140 characterssizeof(1 tweet) ≈ 200 bytes
    • = 140 characterssizeof(1 tweet) ≈ 200 bytes
    • @Astro_Soichi Soichi Noguchihttp://twitpic.com/17dfqb -8 Mar 10 via TwitPic Favorite Retweet Reply
    • @Astro_Soichi Soichi Noguchihttp://twitpic.com/17dfqb -8 Mar 10 via TwitPic Favorite Retweet Reply
    • AboutTweets a day
    • About230,000,000 Tweets a day
    • 2.3E6 tweets day
    • 2.3E6 tweets 2600 tweets ≈ day second
    • 2.3E6 tweets 2600 tweets ≈ day second
    • 2.3E6 tweets 2600 tweets ≈ day second
    • 2.3E6 tweets 2600 tweets ≈ day second
    • 2.3E6 tweets 2600 tweets ≈ day second steady state
    • 7,196TPS
    • Tokyo6,600 TPS
    • 8,800 TPS
    • status/update
    • status/update
    • status/update
    • status/update HTTP 200 OK{
    • status/update HTTP 200 OK{
    • status/update HTTP 200 OK
    • status/update HTTP 200 OK
    • st
    • s
    • Snowflakehttps://github.com/twitter/snowflake s
    • s
    • s
    • s
    • s
    • sRockdove
    • s
    • s
    • t.co
    • {
    • {
    • Storage {
    • {
    • status/update HTTP 200 OK{
    • status/update HTTP 200 OK{
    • status/update HTTP 200 OK{
    • HTTP 200 OK{ … "text":"Tweet!" …}
    • HTTP 200 OK{ … "text":"Tweet!" …}
    • HTTP 200 OK{ … "text":"Tweet!" …}
    • status/update HTTP 200 OK{ … "text":"Tweet!" …}
    • status/update HTTP 200 OK{ … "text":"Tweet!" …}
    • status/update HTTP 200 OK{ … "text":"Tweet!" …}
    • status/update Fanout HTTP 200 OK{ … "text":"Tweet!" …}
    • status/update Fanout HTTP 200 OK{ … "text":"Tweet!" …}
    • te FanoutK
    • te FanoutK
    • te FanoutK
    • te Flock FanoutK
    • te FanoutK
    • te FanoutK
    • status/update Fanout HTTP 200 OK{ … "text":"Tweet!" …}
    • status/update Fanout HTTP 200 OK{ … "text":"Tweet!" …}
    • followed by following
    • @ladygagamother mons†er13.2 million followers@justinbieberJustin Bieber12.4 million followers@BarackObama44th President of the United States9.9 million followers@raffime!0.01 million followers
    • @ladygagamother mons†er13.2 million followers@raffime!0.01 million followers
    • @ladygagamother mons†er13.2 million followers@raffime!0.01 million followers
    • @ladygaga mother mons†er 13.2 million followers @raffi me! 0.01 million followers10000x more followers than me
    • @ladygagamother mons†er13.2 million followers@raffime!0.01 million followers scaling for 107
    • Has...⇢ huge number of concurrent connections⇢ lots of I/O⇢ few persistent objects
    • Gosai KijiPhasianus versicolor alsoknown as Japanese Pheasantis a bird of the lowlands.Closely related to theCommon Pheasant, the cockis distinguished by darkgreen plumage on breast andmantle. The male has aniridescent violet neck, redbare facial skin and purplishgreen tail. The female issmaller than male, and has adull brown plumage withdark spots.
    • Gosai KijiPhasianus versicolor alsoknown as Japanese Pheasantis a bird of the lowlands.Closely related to theCommon Pheasant, the cockis distinguished by darkgreen plumage on breast andmantle. The male has aniridescent violet neck, redbare facial skin and purplishgreen tail. The female issmaller than male, and has adull brown plumage withdark spots.
    • needS...⇢ ability to handle server workloads
    • needS...⇢ ability to handle server workloads⇢ flexibility in language
    • needS...⇢ ability to handle server workloads⇢ flexibility in language
    • needS...⇢ ability to handle server workloads⇢ flexibility in language
    • needS...⇢ ability to handle server workloads⇢ flexibility in language
    • needS...⇢ ability to handle server workloads⇢ flexibility in language
    • needS...⇢ ability to handle server workloads⇢ flexibility in language⇢ a real concurrency model
    • finagle |fəˈnāgəl| needS... verb [ trans. ] informal obtain (something) by devious or dishonest means : Ted attended all the football games he could finagle tickets for. • [ intrans. ] act in a devious or dishonest manner : they wrangled and finagled over the fine points.⇢ ability to handle server workloads DERIVATIVES⇢ flexibility in language finagler |fəˈnāg(ə)lər| noun⇢ a real concurrency model ORIGIN 1920s (originally U.S.): from dialect fainaigue [cheat] ; perhaps from Old French fornier ‘deny.’
    • finagle |fəˈnāgəl| needS... verb [ trans. ] informal obtain (something) by devious or dishonest means : Ted attended all the football games he could finagle tickets for. • [ intrans. ] act in a devious or dishonest manner : they wrangled and finagled over the fine points.⇢ ability to handle server workloads DERIVATIVES⇢ flexibility in language finagler |fəˈnāg(ə)lər| noun⇢ a real concurrency model ORIGIN 1920s (originally U.S.): from dialect fainaigue [cheat] ; perhaps from Old French fornier ‘deny.’
    • finagle |fəˈnāgəl| needS... verb [ trans. ] informal obtain (something) by devious or dishonest means : Ted attended all the football games he could finagle tickets for. • [ intrans. ] act in a devious or dishonest manner : they wrangled and finagled over the fine points.⇢ ability to handle server workloads DERIVATIVES⇢ flexibility in language finagler |fəˈnāg(ə)lər| noun⇢ a real concurrency model ORIGIN 1920s (originally U.S.): from dialect fainaigue [cheat] ; perhaps from Old French fornier ‘deny.’
    • finagle |fəˈnāgəl| verb [ trans. ] informal needS... obtain (something) by devious or dishonest means : Ted attended all the football games he could finagle tickets for. • [ intrans. ] act in a devious or dishonest manner : they wrangled and finagled over the fine points.⇢ ability to handle server workloads DERIVATIVES⇢ flexibility in language finagler |fəˈnāg(ə)lər| noun⇢ a real concurrency model ORIGIN 1920s (originally U.S.): from dialect fainaigue [cheat] ; perhaps from Old French fornier ‘deny.’
    • ’S Infrastructure trades in...⇢ RAM & CPU⇢ bandwidth⇢ machine density
    • Switching to doesn’t implythat is a mistake
    • is aReal-Time Event-driven & Problem
    • What happens in the World happens on
    • Follow me atQuestions? twitter.com/raffi