Put a Button on It: Removing Barriers to Going Fast

Put a Button on itRemoving Barriers to Going Fast kastner@gmail.com / @kastner jgoulah@gmail.com / @johngoulah

1+ Billion Pageviews Per Month

~80 Engineers

Barriers

Deployinator

We’re Hiringhttp://etsy.com/jobs

Optimization

Happiness

Sad Engineersare Bad Engineers

Barriers

Process

“Process is an embeddedreaction to prior stupidity” – Clay Shirky

Correctness

"My strategy has always been: be wrong as Textfast as we can, Which basically means, weregonna screw up, … Lets not be afraid of that." – Andrew Stanton

Legacy

Communication

Openness

Constant Improvement

Then vs. Now

2009 2011

2009Single Deploy Master

2009 2011Single Deploy Anyone Can Master Deploy

2009Rollback in Fear

2009 2011Rollback in Roll Forward Fear to Victory

2009All DayDeploys

2009 2011All Day Deploy AllDeploys Day

How… for reals

So, what does Etsy optimize for?

MTTR vs. MTBF

Default to Open

Culture First

If it’s your ﬁrst day atEtsy, you must deploy!

Doing the dumbest thing that can possibly work

Committing to Trunk

Branching in Code

if ($cfg["new_search"]) { // new hotness $resp = search_solr();} else { // old busted $resp = search_grep();}

Conﬁguration is Code

$cfg["new_search"] = true;

BlamelessPost-mortems

Databases are Diﬀerent

Does it Work?

6 Change-relatedincidents in 2010

November code-freeze

November code-freeze 721 Deploys

Deployinator

Capistrano

Capistrano Puppet

Capistrano Puppet Fabric

Capistrano Puppet Fabric Chef

“Framework”

STACK=search rake new_stack

run_cmd %Q{cap deploy}

log_and_stream "Starting Web deploy<br>"

log_and_shout({ :old_build => old_build, :build => build, :send_email => true })

Communication

Dashboard Driven Development

5:27 < devbot> PRODUCTION deployed by vthommeret version:7f08b7a-20110722-191739-UTC took: 131.042598 secondsdiﬀ: http://deployinator.etsycorp.com/diﬀ/web/0cbf2f0/7f08b7a

e ntial Co nf idEtsy

Deployinator Deploy HostWeb 1 Web 2 Web N

Deployinator ssh Deploy HostWeb 1 Web 2 Web N

Deployinator ssh Deploy Host dshWeb 1 Web 2 Web N

Deployinator ssh Deploy Host dsh RsyncWeb 1 Web 2 Web N

What’s Stopping You?

Know what you’re optimizing for

Deployinator is Open Source Software!

Deployinator is Open Source Software!http://github.com/etsy/deployinator

Deployinator is Open Source Software!http://github.com/etsy/deployinator (right after this talk)

Thank you

Thank youhttp://github.com/etsy/deployinator

http://blog.johngoulah.com	1868
http://lornlab.org	584
http://localhost	34
http://www.lornlab.org	29
http://twitter.com	29
http://aodeusdouniverso.com.br	24
http://tweetedtimes.com	24
http://lanyrd.com	23
https://twitter.com	16
http://lorn.github.com	15
http://blog.lornlab.org	13
http://igrejaaodeusdouniverso.com.br	5
http://webcache.googleusercontent.com	3
http://trunk.ly	3
http://feeds.feedburner.com	2
http://a0.twimg.com	2
http://www.redditmedia.com	2
https://api.twitter.com	1
http://abtasty.com	1
http://linkivy.com	1
http://www.thesearchengine.net	1
http://www.techgig.com	1
http://www.twylah.com	1
http://zootool.com	1
http://team.paper.li	1
http://kbklj.wiwohk-proxy-server.appspot.com	1
http://96.126.114.20	1

Put a Button on It: Removing Barriers to Going Fast

by OSCON Byrum

Accessibility

Categories

Upload Details

Usage Rights

27 Embeds 2,686

Statistics

Put a Button on It: Removing Barriers to Going Fast Presentation Transcript