Building distributed systems - PhpDay 2013

2,512 views

Published on

Published in: Technology
0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,512
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
20
Comments
0
Likes
6
Embeds 0
No embeds

No notes for slide

Building distributed systems - PhpDay 2013

  1. 1. BUILDING DISTRIBUTEDSYSTEMSJuozas Kaziukėnas // juokaz.com // @juokaz
  2. 2. 300’000’000 products/ 24 hours = 12’500’00 products/ 3600 seconds = 3’472 products/ 3000 nodes = 1.1 sec. per product
  3. 3. BUICNOSCNLKSANCLAS
  4. 4. Juozas Kaziukėnas, LithuanianYou can call me JoeMore info http://juokaz.com
  5. 5. ONE SERVER IS NOTENOUGH
  6. 6. SCALINGTO MULTIPLESERVERS
  7. 7. INDEPENDENTNODES
  8. 8. 1TO 2 SERVERS = HARD2TO 100 SERVERS = EASY .
  9. 9. TWO GENERALS PROBLEM
  10. 10. LOCKING... LOL
  11. 11. MYSQLTRANSACTIONS
  12. 12. STATELESS
  13. 13. USETIMEOUTS
  14. 14. ASYNCHRONOUSPROCESSING
  15. 15. MESSAGING AND QUEUES
  16. 16. COMMUNICATION BETWEENPROCESSES
  17. 17. MESSAGE SIZE
  18. 18. GEARMAN
  19. 19. NO RUNNING ORDER ORRELIABILITY
  20. 20. DATA
  21. 21. LOCATION
  22. 22. DE-NORMALIZATION
  23. 23. CAPTHEOREM
  24. 24. EVENTUAL CONSISTENCY
  25. 25. ATOMIC OPERATIONS
  26. 26. CACHE
  27. 27. SETTING SERVERS UP
  28. 28. CONFIGURATION
  29. 29. PUPPET FOR SERVERSMANAGEMENT
  30. 30. DYNAMIC SCALING
  31. 31. SELF DISCOVERY
  32. 32. AMAZON EC2 SPOTINSTANCES10x cheaper than normal on-demand instances
  33. 33. 24’000 CORE CLUSTER = $300/H
  34. 34. PROTOTYPING
  35. 35. START SMALL
  36. 36. VAGRANT FORVMSMANAGEMENT
  37. 37. WHAT IS GOING ON?
  38. 38. HARD
  39. 39. DEBUGGING DISTRIBUTEDSYSTEMS IS HARD
  40. 40. ALL STACK LEVELS FAIL
  41. 41. MONITORING
  42. 42. COUNT EVERYTHING
  43. 43. UPTIME,VMSTAT, NETSTAT,IOSTAT, MPSTAT,TCPDUMP,GDB,VALGRIND, ULIMIT,SYSCTL ETC...
  44. 44. THANKS!Juozas Kaziukėnas@juokaz

×