Scaling Twitter - Railsconf 2007

  • 124,324 views
Uploaded on

A conversational presentation on Twitter's scaling success with Rails.

A conversational presentation on Twitter's scaling success with Rails.

More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
  • The world is waiti tourism png for you with all her scenic beautiful places, and the right tour program takes you there. Its RightTravelsOnline.comackages for you; to take to the places, that you had only seen in photographs or televisions. Come and visit www.righttravelsonline.com/international-travel-tour-package.asp to get this world explored before you.
    Are you sure you want to
    Your message goes here
  • Impressive presentation of 'Scaling Twitter - Railsconf 2007'. You've shown your credibility on presentation with this slideshow. This one deserves thumbs up. I'm John, owner of www.freeringtones.ws/ . Hope to see more quality slides from you.

    Best wishes.
    Are you sure you want to
    Your message goes here
  • exceptional presentation..convinced me to have a hardlook at my company model..outstanding
    Anisa
    http://financejedi.com http://healthjedi.com
    Are you sure you want to
    Your message goes here
  • The scaling story deserves more details. Hope you can make time to post them to this nice blog. For those who are interested: more details can also be found in this web site hosting blog: http://get-website-hosting.com/
    Are you sure you want to
    Your message goes here
  • Considering how many times I've seen that ugly cat, it seems that your strategy did not work very well!
    Are you sure you want to
    Your message goes here
No Downloads

Views

Total Views
124,324
On Slideshare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
584
Comments
8
Likes
43

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Scaling Twitter Alex & Britt (from Twitter)
  • 2. Preconceived notions.
  • 3. The story.
  • 4. So, what happened?
  • 5. What we did.
  • 6. More boxes. Not so many then. But now... ‣ Mongrels across 19 cores. ‣ Message processing/delivery across 16 cores. ‣ Jabber across 2 cores. ‣ MySQL on one big 8 core box. ‣ 16GB+ for memcache across a bunch of ‣ machines. ‣ 32 cores total.
  • 7. That’s a lot.
  • 8. Why? 200 - 300 connections per second. ‣ Spiking at 800 connections per second. ‣ We’ve done 11,000 connections per second. ‣ MySQL has spiked to 2,400 queries per second. ‣ Alexa says we have a whole mess o’ traffic, and ‣ they’re not even seeing the API traffic.
  • 9. memcache.
  • 10. memcache.
  • 11. memcache.
  • 12. Cache the hell out of everything.
  • 13. Denormalize.
  • 14. find(:all, :conditions => quot;substring( truncate(id,0),-2,1) = #{@fugly_dist_idx}quot;, :limit => 10)
  • 15. Starling.
  • 16. Community.
  • 17. YOU CAN HAS QUESTIONS