2013 05-18-building distributed systems-php day

727 views

Published on

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
727
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
7
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

2013 05-18-building distributed systems-php day

  1. 1. BUILDING DISTRIBUTED SYSTEMS Juozas Kaziukėnas // juokaz.com // @juokaz
  2. 2. 300’000’000 products / 24 hours = 12’500’00 products / 3600 seconds = 3’472 products / 3000 nodes = 1.1 sec. per product
  3. 3. BUICNOSCNLKSANCLAS
  4. 4. Juozas Kaziukėnas, Lithuanian You can call me Joe More info http://juokaz.com
  5. 5. ONE SERVER IS NOT ENOUGH
  6. 6. SCALINGTO MULTIPLE SERVERS
  7. 7. INDEPENDENT NODES
  8. 8. 1TO 2 SERVERS = HARD 2TO 100 SERVERS = EASY .
  9. 9. TWO GENERALS PROBLEM
  10. 10. LOCKING... LOL
  11. 11. MYSQLTRANSACTIONS
  12. 12. STATELESS
  13. 13. USETIMEOUTS
  14. 14. ASYNCHRONOUS PROCESSING
  15. 15. MESSAGING AND QUEUES
  16. 16. COMMUNICATION BETWEEN PROCESSES
  17. 17. MESSAGE SIZE
  18. 18. GEARMAN
  19. 19. NO RUNNING ORDER OR RELIABILITY
  20. 20. DATA
  21. 21. LOCATION
  22. 22. DE-NORMALIZATION
  23. 23. CAPTHEOREM
  24. 24. EVENTUAL CONSISTENCY
  25. 25. ATOMIC OPERATIONS
  26. 26. CACHE
  27. 27. SETTING SERVERS UP
  28. 28. CONFIGURATION
  29. 29. PUPPET FOR SERVERS MANAGEMENT
  30. 30. DYNAMIC SCALING
  31. 31. SELF DISCOVERY
  32. 32. AMAZON EC2 SPOT INSTANCES 10x cheaper than normal on-demand instances
  33. 33. 24’000 CORE CLUSTER = $300/H
  34. 34. PROTOTYPING
  35. 35. START SMALL
  36. 36. VAGRANT FORVMS MANAGEMENT
  37. 37. WHAT IS GOING ON?
  38. 38. HARD
  39. 39. DEBUGGING DISTRIBUTED SYSTEMS IS HARD
  40. 40. ALL STACK LEVELS FAIL
  41. 41. MONITORING
  42. 42. COUNT EVERYTHING
  43. 43. UPTIME,VMSTAT, NETSTAT, IOSTAT, MPSTAT,TCPDUMP, GDB,VALGRIND, ULIMIT, SYSCTL ETC...
  44. 44. THANKS! Juozas Kaziukėnas @juokaz

×