InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese an...
Presented at QCon London
www.qconlondon.com
Purpose of QCon
- to empower software development by facilitating the spread o...
Development, Deployment
and Collaboration at Etsy
Daniel Schauenberg
dschauenberg@etsy.com
@mrtazz
@mrtazz
@mrtazz
@mrtazzItem by TheBackPackShoppe
http://www.flickr.com/photos/brianglanz/1095706242
avg 50 deploys/
day
avg n > m deploys/
day
How comfortable
are you deploying
a change right
now?
@mrtazzhttp://www.flickr.com/photos/renaissancechambara/2349811492
small change
Config
Flags
Item by RocajoStudio
“If this is your first
day at Etsy, you
deploy the site”
Developer VMs
@mrtazz
Developer VMs
• KVM
• Every engineer has one
• Fully Chef’d with the Etsy Stack
• Different sizes and Chef roles
Continuous
Integration
@mrtazz
Continuous Integration
• Run set of tests before each deploy
• Full QA suite
• Princess/Production smoker tests
• ...
http://www.flickr.com/photos/egfocus/6962179321
@mrtazz
The Bobs
• LXC virtualized hosts
• 14/physical hosts
• Spread over 3 SSDs
• Most of them attached to try
Item by decomodwalls
Deployinator
@mrtazz
Deployinator
• 2 Buttons, no ambiguity
• Overview of current state of deploy
• Links to Logwatcher and Dashboards
...
http://www.flickr.com/photos/jbgeronimi/6363087361
Monitoring
@mrtazz
shouldigraphit.com
@mrtazz
Monitoring
• Devs do their feature monitoring
• Everybody can access all the graphs
• Dashboard All The Things!
• ...
On Call
If you are writing
code, you are
on-call
@mrtazz
On-Call Schedules
• ops on-call
• dev on-call
• payments on-call
• support on-call
@mrtazz
Dev On-Call
• Scheduled for 6 months
• On-call roughly every 4 weeks for 1 week
• L1 and L2 escalations
• L1 if it...
Incident Response
@mrtazz
Incident Response
• “This graph looks funny”
• “Hey I just got paged for elevated error rate
after deploys”
• “Sup...
#warroom
@mrtazz
#warroom
• only outage related conversations
• coordinate investigation, communication,
countermeasures and monito...
Post Mortems
blameless
Everybody’s invited
Learning Opportunity
Summary
@mrtazz
Summary
• These are things that work for *us*
• Culture is an on-going effort
• Share everything
• Encourage learn...
@mrtazz
Summary
• Lunch ’n learns
• DC visits
• On-call for a day
• Bootcamps/Senior rotations
codeascraft.com	

etsy.com/codeascraft/talks	

etsy.github.com	

etsy.com/careers
Questions?
Development,
Deployment and
Collaboration at Etsy
Daniel Schauenberg
dschauenberg@etsy.com
Watch the video with slide synchronization on
InfoQ.com!
http://www.infoq.com/presentations/development
-deployment-collab...
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Development, Deployment & Collaboration at Etsy
Upcoming SlideShare
Loading in...5
×

Development, Deployment & Collaboration at Etsy

261

Published on

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1p0c5ks.

Daniel Schauenberg provides insights into how Etsy develops software and what tools and processes they utilize to help them achieve their goals. Filmed at qconlondon.com.

Daniel Schauenberg is a Senior Software Engineer at Etsy's infrastructure and development tools team. Automation, documentation and simplicity are his usual tools for improving the status quo. He previously worked in systems and network administration, on connecting chemical plants to IT systems and as an embedded systems networking engineer.

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
261
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Development, Deployment & Collaboration at Etsy

  1. 1. InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations /development-deployment- collaboration-etsy
  2. 2. Presented at QCon London www.qconlondon.com Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide
  3. 3. Development, Deployment and Collaboration at Etsy Daniel Schauenberg dschauenberg@etsy.com @mrtazz
  4. 4. @mrtazz
  5. 5. @mrtazz
  6. 6. @mrtazzItem by TheBackPackShoppe
  7. 7. http://www.flickr.com/photos/brianglanz/1095706242
  8. 8. avg 50 deploys/ day
  9. 9. avg n > m deploys/ day
  10. 10. How comfortable are you deploying a change right now?
  11. 11. @mrtazzhttp://www.flickr.com/photos/renaissancechambara/2349811492 small change
  12. 12. Config Flags Item by RocajoStudio
  13. 13. “If this is your first day at Etsy, you deploy the site”
  14. 14. Developer VMs
  15. 15. @mrtazz Developer VMs • KVM • Every engineer has one • Fully Chef’d with the Etsy Stack • Different sizes and Chef roles
  16. 16. Continuous Integration
  17. 17. @mrtazz Continuous Integration • Run set of tests before each deploy • Full QA suite • Princess/Production smoker tests • Try (yup, there is one)
  18. 18. http://www.flickr.com/photos/egfocus/6962179321
  19. 19. @mrtazz The Bobs • LXC virtualized hosts • 14/physical hosts • Spread over 3 SSDs • Most of them attached to try
  20. 20. Item by decomodwalls
  21. 21. Deployinator
  22. 22. @mrtazz Deployinator • 2 Buttons, no ambiguity • Overview of current state of deploy • Links to Logwatcher and Dashboards • Easy to add stacks for new tools to deploy
  23. 23. http://www.flickr.com/photos/jbgeronimi/6363087361
  24. 24. Monitoring
  25. 25. @mrtazz shouldigraphit.com
  26. 26. @mrtazz Monitoring • Devs do their feature monitoring • Everybody can access all the graphs • Dashboard All The Things! • Stream All The Logs!
  27. 27. On Call
  28. 28. If you are writing code, you are on-call
  29. 29. @mrtazz On-Call Schedules • ops on-call • dev on-call • payments on-call • support on-call
  30. 30. @mrtazz Dev On-Call • Scheduled for 6 months • On-call roughly every 4 weeks for 1 week • L1 and L2 escalations • L1 if it’s your first time
  31. 31. Incident Response
  32. 32. @mrtazz Incident Response • “This graph looks funny” • “Hey I just got paged for elevated error rate after deploys” • “Supergrep is going crazy!!”
  33. 33. #warroom
  34. 34. @mrtazz #warroom • only outage related conversations • coordinate investigation, communication, countermeasures and monitoring • good place to lurk for new engineers
  35. 35. Post Mortems
  36. 36. blameless
  37. 37. Everybody’s invited
  38. 38. Learning Opportunity
  39. 39. Summary
  40. 40. @mrtazz Summary • These are things that work for *us* • Culture is an on-going effort • Share everything • Encourage learning/teaching
  41. 41. @mrtazz Summary • Lunch ’n learns • DC visits • On-call for a day • Bootcamps/Senior rotations
  42. 42. codeascraft.com etsy.com/codeascraft/talks etsy.github.com etsy.com/careers
  43. 43. Questions?
  44. 44. Development, Deployment and Collaboration at Etsy Daniel Schauenberg dschauenberg@etsy.com
  45. 45. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/development -deployment-collaboration-etsy

×