Your SlideShare is downloading. ×
0
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Facebook Scaling Overview
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Facebook Scaling Overview

1,159

Published on

Tiny presentation i did for a course.

Tiny presentation i did for a course.

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,159
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Facebook Scaling WalkthroughMoritz Haarmann - Ultrasuperlargescale Systems
  • 2. Numbers
  • 3. • 800.000.000 active users• > 50% log on every given day• 250.000.000 Photos every single day ( Flickr: 6Bn total )• 30.000.000.000 new pieces of content monthly
  • 4. 30.000.000.000
  • 5. 30.000.000.000As if everyone now living on earth posts 4.28 updates every month.
  • 6. Building Blocks
  • 7. Facebook is built using• Web Servers ( Running Hip-Hop PHP )• Services ( Search, Ads )• Memcached & MySQL• Immense amounts of glue
  • 8. Write Strategy• Writes take place centrally in California• 3.5 Million Changed Rows per Second ( Peak )• 2010: 1800 DB Servers• horizontal scaling approach not disclosed• consistency is important ( avoiding „unhappy users“ )
  • 9. Glue• Massively distributed architecture• Glue keeping it together• Many systems built in-house to meet giiaaanoourmus requirements
  • 10. Haystack• Photos• Handles everything from HTTP to storage• Aimed at minimizing IO-Operations• Append-Only!
  • 11. Memcached• Placed between MySQL and Web Tier• Stores only „plain data“, no joins or other complicated stuff• Faster if Web Server works on data
  • 12. BigPipe• Assembles the output pages• everything that is needed retrieved in parallel• Fault tolerant, will work even if parts of a page are not available
  • 13. What else?
  • 14. Live Profiling• Facebook monitors their life systems continously at a PHP-Method level ( using XHProf ).
  • 15. Graceful Degradation• High awareness ( Monitoring ) of perfomance problems• Features can be disabled ( very ne-grained ) to keep the core features running smoothly
  • 16. Keeping it running• New features are launched ,dark‘, without visible elements, to stress test the backend with real load• Incremental roll-outs decrease the impact of bug or malfunction
  • 17. Open Source• Most parts are open source• Either used or created and then os‘d
  • 18. Big Bang • On September 23, 2010, Facebook was down for most users for about 3 hours • A wrongly identi ed ,invalid‘ cache value lead to requests hammering the DB tier • A system designed to prevent failures created one! • Only way to recover was to completely shut down access to the DB - downtimehttps://www.facebook.com/note.php?note_id=431441338919&id=9445547199&ref=mf ( great comments, too )
  • 19. Thanks.
  • 20. Sources• http://royal.pingdom.com/2010/06/18/the-software-behind- facebook/• https://www.facebook.com/note.php?note_id=76191543919• https://www.facebook.com/notes/facebook-engineering/bigpipe- pipelining-web-pages-for-high-performance/389414033919• http://blog.kissmetrics.com/facebook-statistics/

×