• Save
Scaling Engineering Culture at Twitter
Upcoming SlideShare
Loading in...5
×
 

Scaling Engineering Culture at Twitter

on

  • 490 views

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1dfyyWw. ...

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1dfyyWw.

Raffi Krikorian discusses the software engineering challenges met re-architecting Twitter and the cultural change impact that came with it. Filmed at qconsf.com.

Raffi Krikorian is the VP of Engineering in charge of @twittereng's Platform, the core infrastructure of Twitter. His teams manage, amongst other things, the business logic, the scalable services, APIs, storage, core libraries, and the internal development model of all of Twitter.

Statistics

Views

Total Views
490
Views on SlideShare
490
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Scaling Engineering Culture at Twitter Scaling Engineering Culture at Twitter Presentation Transcript

  • every problem is a scaling problem @raffi qcon SF 2013
  • Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations /twitter-scalability-culture InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month
  • Presented at QCon San Francisco www.qconsf.com Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  • ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  • ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Monorail @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Monorail Flock Memcache Redis @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Monorail Flock Memcache Redis @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Flock Memcache Redis @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet MySQL User T-Bird Timeline Flock Social Graph Memcache DMS Redis @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMS Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMS Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  • team ⇢ small and 5-7 people ⇢ “sit” together ⇢ dedicated ⇢ can publicly accept responsibility ⇢ autonomous @raffi qcon SF 2013
  • http://tattly.com/products/everyday-im-hustlin @raffi qcon SF 2013
  • contracts ⇢ stick to the interfaces ⇢ publicly accountable ⇢ focus on results @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • #branchingout ⇢ the engineer is the atomic unit of the atomic unit ⇢ individuals dictate teams ⇢ vote with your feet @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • @raffi qcon SF 2013
  • We want Twitter to be the best place in the world for engineers to work. @raffi qcon SF 2013
  • thanks! @raffi qcon SF 2013
  • Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/twitterscalability-culture