+ Follow

Scaling Twitter - Railsconf 2007

by Alex Payne

131K views

A conversational presentation on Twitter's scaling success with Rails.

Accessibility

View text version

Upload Details

Uploaded via SlideShare as Adobe PDF

Usage Rights

File a copyright complaint

20 Embeds 143

http://www.slideshare.net	51
http://informatica4d272012.blogspot.com	16
http://www.linkedin.com	14
http://coderwall.com	13
http://www.jasonslater.co.uk	10
http://dorick.com	6
http://myvideonewsletter.net	5
http://www.slideshow.com	5
http://www.dorick.com	3
http://youredoingitwrong.mee.nu	3
http://www.twitteritaly.com	3
http://informatica4d272012.blogspot.com.es	3
http://www.lonerunners.net	3
http://facebook.iframe-apps.com	2
http://64.233.183.104	1
http://www.techgig.com	1
http://multiversenews.com	1
http://a2.vox-data.com	1
http://www.marketing-podcast-nl.com	1
http://twitter.pivari.com	1

More...

Statistics

Likes: 43
Downloads: 580
Comments: 8
Embed Views: 143
Views on SlideShare: 131K
Total Views: 131K

Scaling Twitter - Railsconf 2007 Presentation Transcript

Scaling Twitter Alex & Britt (from Twitter)

Preconceived notions.

The story.

So, what happened?

What we did.

More boxes. Not so many then. But now... ‣ Mongrels across 19 cores. ‣ Message processing/delivery across 16 cores. ‣ Jabber across 2 cores. ‣ MySQL on one big 8 core box. ‣ 16GB+ for memcache across a bunch of ‣ machines. ‣ 32 cores total.

That’s a lot.

Why? 200 - 300 connections per second. ‣ Spiking at 800 connections per second. ‣ We’ve done 11,000 connections per second. ‣ MySQL has spiked to 2,400 queries per second. ‣ Alexa says we have a whole mess o’ traffic, and ‣ they’re not even seeing the API traffic.

memcache.

Cache the hell out of everything.

Denormalize.

find(:all, :conditions => quot;substring( truncate(id,0),-2,1) = #{@fugly_dist_idx}quot;, :limit => 10)

Starling.

Community.

YOU CAN HAS QUESTIONS

righttravelsonline The world is waiti tourism png for you with all her scenic beautiful places, and the right tour program takes you there. Its RightTravelsOnline.comackages for you; to take to the places, that you had only seen in photographs or televisions. Come and visit www.righttravelsonline.com/international-travel-tour-package.asp to get this world explored before you. 1 year ago

Are you sure you want to

Your message goes here

John Granule, Web Developer at Home Impressive presentation of 'Scaling Twitter - Railsconf 2007'. You've shown your credibility on presentation with this slideshow. This one deserves thumbs up. I'm John, owner of www.freeringtones.ws/ . Hope to see more quality slides from you.

Best wishes. 3 years ago

Anisa Sliney Mark, Self Employed at Uni exceptional presentation..convinced me to have a hardlook at my company model..outstanding Anisa http://financejedi.com http://healthjedi.com 3 years ago

Dick Detering The scaling story deserves more details. Hope you can make time to post them to this nice blog. For those who are interested: more details can also be found in this web site hosting blog: http://get-website-hosting.com/ 3 years ago

Nicola Mattina, Ceo at Elastic Considering how many times I've seen that ugly cat, it seems that your strategy did not work very well! 6 years ago

mcgurk Protip: MEMCACHE! Also, slide 17. 6 years ago

britt Yes, the slides were very terse and the talk was for the most part conversational. For more technical information check out Blaine's talk given at SDForum:

http://www.slideshare.net/Blaine/scaling-twitter
http://video.google.com/videoplay?docid=-7846959339830379167 6 years ago

lninyo I would like to see more details on how you guys did the scaling.. I guess its in the talk.. are you going to post the mp3 at all? seems like it was a cool presentation.

thanks, 6 years ago