Building Big on the Web

Building big on the web Cal Henderson

OH HAI

Much code Much data Much customers

I don’t care about process

Robots!

Tools

Whatever the process, tools can help

Not a silver bullet do things faster

Identify what’s slow

But it’s a waste of time!

10% is reasonable

Develop Deploy Maintain

Development

Editing stuff

Source control

svn merge -r 303:302 file:///svn/trunk svn copy -r 123 file:///svn/trunk/foo.php ./foo.php svn revert awesome.js

Things to do

Bug tracker

25 fields

Martin Fowler

Continuous integration

Tests

Tests are good Tests are dull

Regression

Tinderbox

Tinderbox + alerts = win

blame = win

Release management

Continuous production

Glass

Continuous release/deploy

Incrementalists Completionists vs

The deploy cycle

develop stage QA release

source control staging production dev1 dev2 dev3

dev1 alpha1 alpha2 source control staging production beta1 beta2

Branching vs flags

Flags?

Deploying

SCP

SCP + fixups

Million step process

Managing complexity

Single button

Synchronization

Shouting at each other

IM

IRC

Release manager

Deploy log

Deploy tools

Visible error messages

Automate common tasks

Shrink-wrap ware

Alpha Beta RC RTM GA/GM

Completionists win!

but wait!

Flickr Uploadr

XUL Runner Javascript and stuff

Adobe Air Flash and stuff Proprietary Evil

AUS

Maintenance

Create dashboards

Nagios

Ganglia

ganglia.sourceforge.net

Custom graphing with RRD

Not just RRD

I heart SVG

I heart XML

God tools

GNE

A Photo

Photo overview

Cache inspector

User overview

API Usage

API Key Detail

Customer care

At-a-glance summaries

Business metrics

Ghetto-queue monitor

Translation

FAQ Manager

Email footers

Phew!

Take aways

Robots

One button

KTHXBYE

I’m in ur photoz, complying with ur licensez

http://flickr.com/photos/eggplant/9865764/

http://flickr.com/photos/isolano/423026153/

http://flickr.com/photos/docman/36125185/

http://flickr.com/photos/tashland/259178493/

http://flickr.com/photos/grendelkhan/118876699/

http://flickr.com/photos/pulpolux/11187139/

http://flickr.com/photos/dancoulter/21042744/

http://flickr.com/photos/jasoncross/638462445/

http://flickr.com/photos/stinkypeter/91821887/

http://flickr.com/photos/eoino/406383/

http://flickr.com/photos/thecraftons/156008588/

http://flickr.com/photos/judeanpeoplesfront/1752217791/

http://flickr.com/photos/elsie/8229790/

http://flickr.com/photos/thejokker/279638176/

http://flickr.com/photos/hamed/155343130/

http://flickr.com/photos/fienna/200842643/

http://flickr.com/photos/io2/6452772/

http://flickr.com/photos/santos/1704875109/

http://flickr.com/photos/laffy4k/404298099/

http://flickr.com/photos/hurleygurley/4338767/

http://flickr.com/photos/ableman/323253768/

http://flickr.com/photos/usonian/106005435/

http://flickr.com/photos/cogdog/19490596/

http://flickr.com/photos/thomashawk/340185708/

http://flickr.com/photos/gaetanlee/298160415/

http://flickr.com/photos/pragdave/173640462/

http://flickr.com/photos/massenpunkt/47429687/

http://flickr.com/photos/wader/11827393/

http://flickr.com/photos/mickyates/289301449/

http://flickr.com/photos/carowallis1/252562895/

http://flickr.com/photos/foreversouls/4803469/

http://flickr.com/photos/crystalginn/121558483/ http://flickr.com/photos/misocrazy/170302255/ http://flickr.com/photos/drainhook/1122266155/ http://flickr.com/photos/jurvetson/52581560/ http://flickr.com/photos/dws/11303021/ http://flickr.com/photos/jamesdale10/2158945531/ http://flickr.com/photos/richardlowkes/23877075/ http://flickr.com/photos/coda/186599041/ http://flickr.com/photos/ole/829555775/ http://flickr.com/photos/bigpinkcookie/27483119/ http://flickr.com/photos/41188800@N00/759082567/ http://flickr.com/photos/ianalexandermartin/225390382/ http://flickr.com/photos/vidiot/69075298/ http://flickr.com/photos/shoreliner/2210857064/ http://flickr.com/photos/swiv/499851330/ http://flickr.com/photos/big-e-mr-g/128131839/ http://flickr.com/photos/xesc/358521405/ http://flickr.com/photos/mnscouser/551967808/ http://flickr.com/photos/trlc/3795673/ http://flickr.com/photos/raymondyee/118550863/ http://flickr.com/photos/hinderik/223169683/ http://flickr.com/photos/bohdel/1546969429/ http://flickr.com/photos/mybigtrip/6111406/ http://flickr.com/photos/livboo/2235730695/ http://flickr.com/photos/pen3ya/2058646288/ http://flickr.com/photos/zoomar/132638187/ http://flickr.com/photos/gfranco/384846997/ http://flickr.com/photos/madmask/421679860/ http://flickr.com/photos/photomonkey/12746989/ http://flickr.com/photos/alexander_johmann/213426525/ http://flickr.com/photos/difusa/131100622/

find these slides online iamcal.com/talks