Scaling LAMP Stacks

Slide 1: Scalable LAMP Stacks Jakob Heuser Alan Kasindorf OPSON Lamp Meetup Feb 2008

Slide 2: • Jakob Heuser - Gaia Online Engineer, Architect • Alan Kasindorf - Six Apart DBA, Former head of Gaia’s Operations

Slide 3: Reality: Scale Out

Slide 4: What We Had LB W W W W W W W W W W W W W write write M read read M S S S S

Slide 5: What We Had D BA LB W W W W W W W W W W W W W D write BA write M read read M D S S S S BA it’s too easy to end up like this

Slide 6: LAMP • Hardware • Package Management

Slide 7: LAMP • Not starting a religious war • Commodity != Cheap

Slide 8: LAMP • Automate • Simplify

Slide 9: LAMP • Avoid starvation • It doesn’t have to be Apache (shhhh)

Slide 10: Amazingly even BIGGER DB LAMP Even BIGGER DB Bigger DB DB This is Bad

Slide 11: Sharding Users 1-99,999 Users 100,000-199,999 Users 1-499,999 Users 200,000-299,999 Users 300,000-399,999 Users 400,000-499,999 LAMP

Slide 12: Sharding Users 1-99,999 DB 1 Users 100,000-199,999 Users 1-499,999 Users 200,000-299,999 Users 300,000-399,999 DB 2 Users 400,000-499,999 LAMP

Slide 13: Sharding Users 1-99,999 DB 1 Users 100,000-199,999 Users 1-499,999 Users 200,000-299,999 Users 300,000-399,999 DB 2 Users 400,000-499,999 DB 3 LAMP

Slide 14: LAMP • Caching • Replication • Fuzz testing

Slide 15: LAMP • Pick a framework • Avoid DB Layers that depend on “join”

Slide 16: Outside the Stack • OSS for anything • Pay services too

Slide 17: ?