Your SlideShare is downloading. ×
0
Scaling Twitter
      Alex & Britt
    (from Twitter)
Preconceived notions.
The story.
So, what happened?
What we did.
More boxes.
  Not so many then. But now...
‣
  Mongrels across 19 cores.
‣
  Message processing/delivery across 16 cores.
...
That’s a lot.
Why?
    200 - 300 connections per second.
‣
    Spiking at 800 connections per second.
‣
    We’ve done 11,000 connection...
memcache.
memcache.
memcache.
Cache the hell out of everything.
Denormalize.
find(:all,
     :conditions => quot;substring(
        truncate(id,0),-2,1) =
        #{@fugly_dist_idx}quot;,
     :limit...
Starling.
Community.
YOU CAN HAS QUESTIONS
Upcoming SlideShare
Loading in...5
×

Scaling Twitter - Railsconf 2007

124,558

Published on

A conversational presentation on Twitter's scaling success with Rails.

Published in: Technology, Business
8 Comments
43 Likes
Statistics
Notes
  • The world is waiti tourism png for you with all her scenic beautiful places, and the right tour program takes you there. Its RightTravelsOnline.comackages for you; to take to the places, that you had only seen in photographs or televisions. Come and visit www.righttravelsonline.com/international-travel-tour-package.asp to get this world explored before you.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Impressive presentation of 'Scaling Twitter - Railsconf 2007'. You've shown your credibility on presentation with this slideshow. This one deserves thumbs up. I'm John, owner of www.freeringtones.ws/ . Hope to see more quality slides from you.

    Best wishes.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • exceptional presentation..convinced me to have a hardlook at my company model..outstanding
    Anisa
    http://financejedi.com http://healthjedi.com
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • The scaling story deserves more details. Hope you can make time to post them to this nice blog. For those who are interested: more details can also be found in this web site hosting blog: http://get-website-hosting.com/
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Considering how many times I've seen that ugly cat, it seems that your strategy did not work very well!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
124,558
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
585
Comments
8
Likes
43
Embeds 0
No embeds

No notes for slide

Transcript of "Scaling Twitter - Railsconf 2007"

  1. 1. Scaling Twitter Alex & Britt (from Twitter)
  2. 2. Preconceived notions.
  3. 3. The story.
  4. 4. So, what happened?
  5. 5. What we did.
  6. 6. More boxes. Not so many then. But now... ‣ Mongrels across 19 cores. ‣ Message processing/delivery across 16 cores. ‣ Jabber across 2 cores. ‣ MySQL on one big 8 core box. ‣ 16GB+ for memcache across a bunch of ‣ machines. ‣ 32 cores total.
  7. 7. That’s a lot.
  8. 8. Why? 200 - 300 connections per second. ‣ Spiking at 800 connections per second. ‣ We’ve done 11,000 connections per second. ‣ MySQL has spiked to 2,400 queries per second. ‣ Alexa says we have a whole mess o’ traffic, and ‣ they’re not even seeing the API traffic.
  9. 9. memcache.
  10. 10. memcache.
  11. 11. memcache.
  12. 12. Cache the hell out of everything.
  13. 13. Denormalize.
  14. 14. find(:all, :conditions => quot;substring( truncate(id,0),-2,1) = #{@fugly_dist_idx}quot;, :limit => 10)
  15. 15. Starling.
  16. 16. Community.
  17. 17. YOU CAN HAS QUESTIONS
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×