confidential scaling the synchronous web October 10 th , 2008

scaling the synchronous web October 10 th , 2008 confidential Elaine Wherry Co-Founder, VP Products Paul Sowden Lead Software Engineer

www +

2 3 4 5 6 7

traditional versus nontraditional... traditional versus nontraditional...

asynchronous versus synchronous ...

asynchronous versus synchronous ... page views versus persistence ... content versus application ... database versus memory ...

simpler is better know your bottlenecks quick fix or homerun useful abstractions

simpler is better

know your bottlenecks

quick fix or homerun

useful abstractions

#1: simpler is better

protocol plugins msn jabber yahoo oscar (aim) gaim 1.5.0 ui & core & services

yahoo gaim 1.5.0 core & services protocol plugins msn jabber yahoo oscar (aim) meebo network layer

confidential

#1: simpler is better Don’t try to solve a scaling problem you don’t have (yet) Build it as quickly and as inexpensively as possible You want to save time to iterate upon other ideas in case this one doesn’t work Setting yourself up for success – easier to optimize something you understand

Don’t try to solve a scaling problem you don’t have (yet)

Build it as quickly and as inexpensively as possible

You want to save time to iterate upon other ideas in case this one doesn’t work

Setting yourself up for success – easier to optimize something you understand

#2 know your bottlenecks confidential

tools strace gdb oprofile httpanalyzer monitoring

strace

gdb

oprofile

httpanalyzer

monitoring

#2: know your bottlenecks your type of app determines the type of scaling don’t prematurely optimize know system at different levels: oprofile, valgrind, gdb know your bottlenecks: memory, cpu, bandwidth, storage, disk i/o confidential

your type of app determines the type of scaling

don’t prematurely optimize

know system at different levels: oprofile, valgrind, gdb

know your bottlenecks: memory, cpu, bandwidth, storage, disk i/o

#3: quick fix or homerun! confidential

kill –9 <pid>

confidential

confidential

cgi fastcgi mod_meebo

#3: quick fix or homerun users just want it to work (now) use the time the quick fix affords you wisely aim for small or big, avoid the middle fix the root issue

users just want it to work (now)

use the time the quick fix affords you wisely

aim for small or big, avoid the middle

fix the root issue

#4: useful abstractions

meebo util.js ajax ui dlg menu button element IMDlg BuddyListDlg EventMgr NetworkMgr

meeboApp meeboApp meeboApp meebo ui util ajax PubSub Buddy BuddyList Account EventMgr NetworkMgr dlg menu button element iPhone iPhone Firefox

#4: useful abstractions keep it simple, flexible, so you can adapt quickly to changes and scale with needs abstractions allow you to reuse existing components to scale to new challenges it’s hard to know where the useful abstractions are when you start a project

keep it simple, flexible, so you can adapt quickly to changes and scale with needs

abstractions allow you to reuse existing components to scale to new challenges

it’s hard to know where the useful abstractions are when you start a project

simpler is better know your bottlenecks quick fix or homerun useful abstractions

simpler is better

know your bottlenecks

quick fix or homerun

useful abstractions

today 3 years old 45 people (2 dogs) 35 million uniques per month 350 years worth of usage per day 200 million messages per day 54,000 kiss emoticons each day :-* 2.5 hour session length

3 years old

45 people (2 dogs)

35 million uniques per month

350 years worth of usage per day

200 million messages per day

54,000 kiss emoticons each day :-*

2.5 hour session length

thank you confidential