+ Follow

Scaling Twitter - Railsconf 2007

by Alex Payne on May 20, 2007

121K views

A conversational presentation on Twitter's scaling success with Rails.

More…

A conversational presentation on Twitter's scaling success with Rails.

Less

17 Embeds 119

http://www.slideshare.net	51
http://informatica4d272012.blogspot.com	16
http://coderwall.com	13
http://www.jasonslater.co.uk	10
http://myvideonewsletter.net	5
http://www.slideshow.com	5
http://www.twitteritaly.com	3
http://www.lonerunners.net	3
http://youredoingitwrong.mee.nu	3
http://facebook.iframe-apps.com	2
http://informatica4d272012.blogspot.com.es	2
http://www.techgig.com	1
http://multiversenews.com	1
http://a2.vox-data.com	1
http://www.marketing-podcast-nl.com	1
http://64.233.183.104	1
http://twitter.pivari.com	1

More...

Statistics

Favorites: 43
Downloads: 577
Comments: 9
Embed Views: 119
Views on SlideShare: 121K
Total Views: 121K

Scaling Twitter - Railsconf 2007 — Presentation Transcript

Scaling Twitter Alex & Britt (from Twitter)

Preconceived notions.

The story.

So, what happened?

What we did.

More boxes. Not so many then. But now... ‣ Mongrels across 19 cores. ‣ Message processing/delivery across 16 cores. ‣ Jabber across 2 cores. ‣ MySQL on one big 8 core box. ‣ 16GB+ for memcache across a bunch of ‣ machines. ‣ 32 cores total.

That’s a lot.

Why? 200 - 300 connections per second. ‣ Spiking at 800 connections per second. ‣ We’ve done 11,000 connections per second. ‣ MySQL has spiked to 2,400 queries per second. ‣ Alexa says we have a whole mess o’ traffic, and ‣ they’re not even seeing the API traffic.

memcache.

Cache the hell out of everything.

Denormalize.

find(:all, :conditions => quot;substring( truncate(id,0),-2,1) = #{@fugly_dist_idx}quot;, :limit => 10)

Starling.

Community.

YOU CAN HAS QUESTIONS

righttravelsonline The world is waiti tourism png for you with all her scenic beautiful places, and the right tour program takes you there. Its RightTravelsOnline.comackages for you; to take to the places, that you had only seen in photographs or televisions. Come and visit www.righttravelsonline.com/international-travel-tour-package.asp to get this world explored before you. 5 months ago

Are you sure you want to Yes No

John Granule , Web Developer at Home Impressive presentation of 'Scaling Twitter - Railsconf 2007'. You've shown your credibility on presentation with this slideshow. This one deserves thumbs up. I'm John, owner of www.freeringtones.ws/ . Hope to see more quality slides from you.

Best wishes. 1 year ago

Anisa Sliney Mark , Self Employed at Uni exceptional presentation..convinced me to have a hardlook at my company model..outstanding Anisa http://financejedi.com http://healthjedi.com 1 year ago

Dick Detering The scaling story deserves more details. Hope you can make time to post them to this nice blog. For those who are interested: more details can also be found in this web site hosting blog: http://get-website-hosting.com/ 2 years ago

guestef2819 Join my Twitter today
http://twitter.com/Explodinglist 3 years ago

Nicola Mattina , Ceo at Elastic Considering how many times I've seen that ugly cat, it seems that your strategy did not work very well! 5 years ago

mcgurk Protip: MEMCACHE! Also, slide 17. 5 years ago

britt Yes, the slides were very terse and the talk was for the most part conversational. For more technical information check out Blaine's talk given at SDForum:

http://www.slideshare.net/Blaine/scaling-twitter
http://video.google.com/videoplay?docid=-7846959339830379167 5 years ago

lninyo I would like to see more details on how you guys did the scaling.. I guess its in the talk.. are you going to post the mp3 at all? seems like it was a cool presentation.

thanks, 5 years ago

Scaling Twitter - Railsconf 2007

by Alex Payne on May 20, 2007

Accessibility

Categories

Tags

Upload Details

Usage Rights

17 Embeds 119

Statistics

Scaling Twitter - Railsconf 2007 — Presentation Transcript