Your SlideShare is downloading. ×
Scaling Engineering Culture at Twitter
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Scaling Engineering Culture at Twitter

540

Published on

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1dfyyWw. …

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1dfyyWw.

Raffi Krikorian discusses the software engineering challenges met re-architecting Twitter and the cultural change impact that came with it. Filmed at qconsf.com.

Raffi Krikorian is the VP of Engineering in charge of @twittereng's Platform, the core infrastructure of Twitter. His teams manage, amongst other things, the business logic, the scalable services, APIs, storage, core libraries, and the internal development model of all of Twitter.

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
540
On Slideshare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. every problem is a scaling problem @raffi qcon SF 2013
  • 2. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations /twitter-scalability-culture InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month
  • 3. Presented at QCon San Francisco www.qconsf.com Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide
  • 4. @raffi qcon SF 2013
  • 5. @raffi qcon SF 2013
  • 6. @raffi qcon SF 2013
  • 7. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • 8. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • 9. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • 10. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • 11. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • 12. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • 13. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  • 14. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  • 15. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  • 16. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • 17. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • 18. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Monorail @raffi qcon SF 2013
  • 19. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Monorail Flock Memcache Redis @raffi qcon SF 2013
  • 20. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Monorail Flock Memcache Redis @raffi qcon SF 2013
  • 21. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Flock Memcache Redis @raffi qcon SF 2013
  • 22. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet MySQL User T-Bird Timeline Flock Social Graph Memcache DMS Redis @raffi qcon SF 2013
  • 23. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMS Redis PRESENTATION @raffi qcon SF 2013
  • 24. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMS Redis PRESENTATION @raffi qcon SF 2013
  • 25. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 26. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 27. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 28. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 29. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • 30. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • 31. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • 32. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • 33. @raffi qcon SF 2013
  • 34. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 35. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 36. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 37. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 38. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • 39. team ⇢ small and 5-7 people ⇢ “sit” together ⇢ dedicated ⇢ can publicly accept responsibility ⇢ autonomous @raffi qcon SF 2013
  • 40. http://tattly.com/products/everyday-im-hustlin @raffi qcon SF 2013
  • 41. contracts ⇢ stick to the interfaces ⇢ publicly accountable ⇢ focus on results @raffi qcon SF 2013
  • 42. @raffi qcon SF 2013
  • 43. @raffi qcon SF 2013
  • 44. @raffi qcon SF 2013
  • 45. @raffi qcon SF 2013
  • 46. @raffi qcon SF 2013
  • 47. @raffi qcon SF 2013
  • 48. #branchingout ⇢ the engineer is the atomic unit of the atomic unit ⇢ individuals dictate teams ⇢ vote with your feet @raffi qcon SF 2013
  • 49. @raffi qcon SF 2013
  • 50. @raffi qcon SF 2013
  • 51. @raffi qcon SF 2013
  • 52. @raffi qcon SF 2013
  • 53. We want Twitter to be the best place in the world for engineers to work. @raffi qcon SF 2013
  • 54. thanks! @raffi qcon SF 2013
  • 55. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/twitterscalability-culture

×