Downloaded 37 times
Uploaded byHelgi Þormar Þorbjörnsson
Think like an ant, distribute the workload - PhpDay, Italy, 2011
The document focuses on the benefits of distributing workloads in software engineering, likening application components to ants in a colony that work together to enhance efficiency, agility, and high availability. It discusses the importance of avoiding local dependencies and suggests solutions for better session management and file uploads using cloud services. Additionally, various tools for distributed systems, such as Gearman and RabbitMQ, are mentioned, alongside design principles for scalability and monitoring.
More Related Content
Similar to Think like an ant, distribute the workload - PhpDay, Italy, 2011
Think like an ant, distribute the workload - PhpDay, Italy, 2011
- 1. Distribute the workload Helgi Þormar Þorbjörnsson PhpDay, Italy, Verona, 13th May, 2011 Saturday, 14 May 2011
- 2. Who am I? Saturday,14 May 2011
- 3. Saturday, 14 May2011
- 4. VP of Engineeringat Orchestra.io Saturday, 14 May 2011
- 5. VP of Engineeringat Orchestra.io Developer at PEAR Saturday, 14 May 2011
- 6. VP of Engineeringat Orchestra.io Developer at PEAR From Iceland Saturday, 14 May 2011
- 7. VP of Engineeringat Orchestra.io Developer at PEAR From Iceland @h on Twitter Saturday, 14 May 2011
- 8. Why Distribute? Saturday, 14May 2011
- 9. Why Distribute? Saturday, 14May 2011
- 10. Why Distribute? Budget Saturday, 14 May 2011
- 11. Why Distribute? Budget Efficiency Saturday, 14 May 2011
- 12. Why Distribute? Budget Efficiency Perception Saturday, 14 May 2011
- 13.
- 14. Budget Spend wisely Saturday, 14 May 2011
- 15. Budget Spend wisely Commodity servers Saturday, 14 May 2011
- 16. Budget Spend wisely Commodity servers Low overhead, high yield Saturday, 14 May 2011
- 17. Budget Spend wisely Commodity servers Low overhead, high yield Cloud Computing (EC2) Saturday, 14 May 2011
- 18. Efficiency 10 small servers > 1 big Saturday, 14 May 2011
- 19. Venue Security Saturday, 14May 2011
- 20. 1000 people canexit quicker through 10 small doors than 1 big Saturday, 14 May 2011
- 21. 1000 people canexit quicker through 10 small doors than 1 big Saturday, 14 May 2011
- 22. 1000 people canexit quicker through 10 small doors than 1 big Saturday, 14 May 2011
- 23. 1000 people canexit quicker through 10 small doors than 1 big Saturday, 14 May 2011
- 24. Saturday, 14 May2011
- 25. Saturday, 14 May2011
- 26. Saturday, 14 May2011
- 27. Saturday, 14 May2011
- 28.
- 29. Perception Defer intensive processes Saturday, 14 May 2011
- 30. Perception Defer intensive processes Give instant feedback Saturday, 14 May 2011
- 31. Perception Defer intensive processes Give instant feedback Users keep on browsing Saturday, 14 May 2011
- 32. Perception Defer intensive processes Give instant feedback Users keep on browsing Saturday, 14 May 2011
- 33. Saturday, 14 May2011
- 34. Chapter from Nature Saturday,14 May 2011
- 35. Ant Colonies Saturday, 14May 2011
- 36.
- 37. Algorithms Scheduling Saturday, 14 May 2011
- 38. Algorithms Scheduling Vehicle Routing Saturday, 14 May 2011
- 39. Algorithms Scheduling Vehicle Routing Assignment Saturday, 14 May 2011
- 40. Algorithms Scheduling Vehicle Routing Assignment Sets Saturday, 14 May 2011
- 41. Algorithms Scheduling Vehicle Routing Assignment Sets Other Saturday, 14 May 2011
- 42. Algorithms Scheduling Vehicle Routing Assignment Sets Other Saturday, 14 May 2011
- 43. How do antsfit? Saturday, 14 May 2011
- 44. How do antsfit? Strength in numbers Saturday, 14 May 2011
- 45. How do antsfit? Strength in numbers Work together Saturday, 14 May 2011
- 46. How do antsfit? Strength in numbers Work together Size benefits them Saturday, 14 May 2011
- 47. Teamwork When faced with a problem they will solve the problem as one. Saturday, 14 May 2011
- 48. Saturday, 14 May2011
- 49. Saturday, 14 May2011
- 50. What if theywere bigger? Saturday, 14 May 2011
- 51. Types of Ants Saturday,14 May 2011
- 52. Types of Ants Military Saturday, 14 May 2011
- 53. Types of Ants Military Maids Saturday, 14 May 2011
- 54. Types of Ants Military Maids Tunnel diggers Saturday, 14 May 2011
- 55. Types of Ants Military Maids Tunnel diggers Food gatherers Saturday, 14 May 2011
- 56. How does thismap to my application? Saturday, 14 May 2011
- 57. Saturday, 14 May2011
- 58. Colony = Application Saturday,14 May 2011
- 59. Colony = Application Ants = Components Saturday, 14 May 2011
- 60. Colony = Application Ants = Components Ants do many different types of work to keep their colony running Saturday, 14 May 2011
- 61. Architect for Distribution Saturday, 14 May 2011
- 62.
- 63. Characteristics Decoupling Saturday, 14 May 2011
- 64. Characteristics Decoupling Elasticity Saturday, 14 May 2011
- 65. Characteristics Decoupling Elasticity High Availability Saturday, 14 May 2011
- 66. Characteristics Decoupling Elasticity High Availability Concurrency Saturday, 14 May 2011
- 67.
- 68. Application DB API Cache FE Saturday, 14 May 2011
- 69. Application DB API Cache FE Saturday, 14 May 2011
- 70. DB Application API Cache FE Saturday, 14 May 2011
- 71. DB Application API Cache FE Cache Saturday, 14 May 2011
- 72. API DB Application API Cache FE Cache Saturday, 14 May 2011
- 73. API DB Application API API Cache FE Cache Saturday, 14 May 2011
- 74.
- 75. Cloud Computing Saturday, 14May 2011
- 76. Load Balancing Saturday, 14May 2011
- 77. My Favourite HA Proxy Nginx Saturday, 14 May 2011
- 78.
- 79.
- 80. High Availability Saturday, 14May 2011
- 81.
- 82. Benefits Easy management Saturday, 14 May 2011
- 83. Benefits Easy management Ability to stop / start servers quickly Saturday, 14 May 2011
- 84. Benefits Easy management Ability to stop / start servers quickly Responsibilities are separate Saturday, 14 May 2011
- 85. Benefits Easy management Ability to stop / start servers quickly Responsibilities are separate Quickly move to a new cluster Saturday, 14 May 2011
- 86. Benefits Easy management Ability to stop / start servers quickly Responsibilities are separate Quickly move to a new cluster Reduced risk Saturday, 14 May 2011
- 87. What to avoid Saturday,14 May 2011
- 88. What to avoid Local: Saturday, 14 May 2011
- 89. What to avoid Local: Sessions Saturday, 14 May 2011
- 90. What to avoid Local: Sessions Files Saturday, 14 May 2011
- 91. What to avoid Local: Sessions Files Memory Saturday, 14 May 2011
- 92. What to avoid Local: Sessions Files Memory Uploads Saturday, 14 May 2011
- 93. What to avoid Local: Sessions Files Memory Uploads Writing to /tmp Saturday, 14 May 2011
- 94.
- 95. Solutions Store sessions in DB / Memcache Saturday, 14 May 2011
- 96. Solutions Store sessions in DB / Memcache Use S3 to store uploaded files Saturday, 14 May 2011
- 97. Solutions Store sessions in DB / Memcache Use S3 to store uploaded files Use networked Memcache Saturday, 14 May 2011
- 98. Solutions Store sessions in DB / Memcache Use S3 to store uploaded files Use networked Memcache Serve up static files from a CDN Saturday, 14 May 2011
- 99. Solutions Store sessions in DB / Memcache Use S3 to store uploaded files Use networked Memcache Serve up static files from a CDN Or... A multi domain solution Saturday, 14 May 2011
- 100. Internal APIs Saturday, 14May 2011
- 101. Application Internal Storage API Mongo MySQL FS Saturday, 14 May 2011
- 102.
- 103. Service Oriented Architecture Saturday, 14 May 2011
- 104. Sort of :-) Saturday,14 May 2011
- 105. Eventually Consistent Saturday, 14 May 2011
- 106. CAP Therom Saturday, 14May 2011
- 107. Consistency Availability Partition Tolerance Saturday, 14 May 2011
- 108. Queue Systems Saturday, 14May 2011
- 109. Good for Saturday, 14May 2011
- 110. Good for Image Processing Saturday, 14 May 2011
- 111. Good for Image Processing Distributed Logs Saturday, 14 May 2011
- 112. Good for Image Processing Distributed Logs Data Mining Saturday, 14 May 2011
- 113. Good for Image Processing Distributed Logs Data Mining Mass Emails Saturday, 14 May 2011
- 114. Good for Image Processing Distributed Logs Data Mining Mass Emails Intensive transformation Saturday, 14 May 2011
- 115. Good for Image Processing Distributed Logs Data Mining Mass Emails Intensive transformation Search Saturday, 14 May 2011
- 116. Common Tools Saturday, 14May 2011
- 117. Common Tools Gearman Saturday, 14 May 2011
- 118. Common Tools Gearman Hadoop Saturday, 14 May 2011
- 119. Common Tools Gearman Hadoop Zero MQ (0MQ) Saturday, 14 May 2011
- 120. Common Tools Gearman Hadoop Zero MQ (0MQ) RabbitMQ Saturday, 14 May 2011
- 121. Common Tools Gearman Hadoop Zero MQ (0MQ) RabbitMQ And many others! Saturday, 14 May 2011
- 122.
- 123. Your Client Code Gearman Client API (C, PHP, Perl, MySQL UDF, ...) Your App Gearman Job Server Gearman gearmand Gearman Worker API (C, PHP, Perl, Python, ...) Your Worker Code Saturday, 14 May 2011
- 124. Story time Saturday, 14May 2011
- 125. Story time Saturday, 14May 2011
- 126. Questions? helgi@orchestra.io Twitter: @h Joind.in: http://joind.in/3027 Saturday, 14 May 2011