Successfully reported this slideshow.

Scaling Web 2.0

985 views

Published on

A very high level overview of scaling websites and in particular web 2.0 - using Apache, Memcache, MySQL

Published in: Technology, Education
  • Be the first to comment

Scaling Web 2.0

  1. 1. NICK HALSTEAD FOUNDER
  2. 2. MY STRATEGY (feel free to ignore it) at your peril Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 2
  3. 3. Open Source ★IT IS FREE SO USE IT! Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 3
  4. 4. Open Source ★IT IS FREE SO USE IT! ★THEN THROW IT AWAY AGAIN Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 3
  5. 5. Open Source ★IT IS FREE SO USE IT! ★THEN THROW IT AWAY AGAIN WHY? Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 3
  6. 6. Open Source ★YOU END UP RE-WRITING IT :( Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 4
  7. 7. Open Source ★YOU END UP RE-WRITING IT :( ★BUT DEVELOPMENT WILL HAVE BEEN FASTER (hopefully) Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 4
  8. 8. Frameworks ★Start with a Framework Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 5
  9. 9. Frameworks ★Don’t believe it will scale Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 6
  10. 10. Frameworks ★Language is Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 7
  11. 11. Frameworks ★They all resolve down to 0+1’s Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 8
  12. 12. Frameworks ★Feel Free to Take An Axe To it Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 9
  13. 13. Frameworks ★Feel Free to Take An Axe To it Choose framework that lets you do this! Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 9
  14. 14. Frameworks Speed VS Scalability Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 10
  15. 15. SPEED (zooom) Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 11
  16. 16. SPEED (zooom) 1x SERVER SUPPORTING 100,000 UNIQUE USERS Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 11
  17. 17. SPEED (zooom) WHAT HAPPENS WHEN WE GET 1,000,000 USERS? Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 12
  18. 18. SPEED (zooom) WHAT HAPPENS WHEN WE GET 1,000,000 USERS? Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 12
  19. 19. SPEED (zooom) WHAT HAPPENS WHEN WE GET 1,000,000 USERS? OR 10,000,000? (woohoo!) Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 12
  20. 20. SPEED (zooom) WHAT HAPPENS WHEN WE GET 1,000,000 USERS? OR 10,000,000? (woohoo!) BUY 100 SERVERS? (STEWART WOULD BE SO HAPPY :P) Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 12
  21. 21. SPEED (zooom) Fast still matters!!! 2x faster: 50 servers instead of 100 Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 13
  22. 22. SPEED (zooom) Fast still matters!!! 2x faster: 50 servers instead of 100 10x faster: 10 servers instead of 100 Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 13
  23. 23. SPEED (zooom) Fast still matters!!! 2x faster: 50 servers ★ 100x faster: instead of 100 = 1 SERVER!!! 10x faster: 10 servers instead of 100 Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 13
  24. 24. SPEED (zooom) HOW? ★FAST CODE (duh!) ★CACHING ★DB OPTIMISATION ★OFFLINE PROCESSING ★PUSH TO THE CLOUD ★THEN REPLICATE (last!) Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 14
  25. 25. FAST CODE ★NO EASY ROUTE ★‘JUST’ - NEED QUALITY CODERS ★+ GIVE THEM TIME TO DO IT RIGHT Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 15
  26. 26. CACHING ★ONE WORD ‘MEMCACHE’ ★CACHE EVERYTHING (including sink) ★GO VISIT HTTP:// www.danga.com/ Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 16
  27. 27. DATABASE Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 17
  28. 28. OFFLINE All Tasks that Do NOT need to happen NOW ★RUN ON ANY SERVER ★AT ANY SPEED (within reason) ★SCHEDULED ★DOESNT IMPACT USER EXPERIENCE ★(we run 1000’s of jobs per hour in the background) Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 18
  29. 29. CLOUD ★DONT BELIEVE ALL THE HYPE ★PERFECT WHEN APPLIED TO RIGHT PROBLEMS ★NOT ALL CLOUDS ARE BUILT EQUAL ★HAVE AN ALTERNATIVE!!! Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 19
  30. 30. REPLICATE ★NEED TO CODE SO THAT YOU CAN! ★LOTS OF TOOLS TO HELP THIS ★LAST TO DO (BUT) YOU MUST Proprietary and Confidential Information Copyright © Fav.or.it Ltd. 2008 20
  31. 31. QUESTIONS?

×