The document discusses MySQL usage, limitations, and strategies for scaling databases, particularly through sharding. It highlights the performance capabilities of MySQL with large datasets and compares different sharding techniques. Additionally, it emphasizes the importance of adapting to growth in user demand and provides best practices for managing MySQL databases.

1. Moshe Kaplan Database2011, Jan 13 [email_address] http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com

2. Presentation Objectives Who is using MySQL? MySQL Limitations How to get over this? Sharding Case Studies Products

3. Who is Using MySQL?

4. MySQL Limitations 50-100M Records/Table 50 SELECT Statements/Second

5. 700 Inserts/Sec In Memory Engine 3000 Inserts/Sec InnoDB Engine 700 Inserts/Sec Amazon AWS Standard Large Instance

6. Why Do I Care? From 0 to 100 (US mass adaptation) Phone: 100 yrs Radio: 40 yrs TV: 30 yrs Mobile: 20 yrs Internet: 10 yrs Facebook: 2 yrs

7. 100K New Users/Week

8. The Network Effect

9. What Should I Do? Oracle SQL Server $$$

10. Sharding

11. Vertical Sharding

12. Horizontal Sharding Static Hashing Complex growth Simple Mod 10 = 0 Mod 10 = 1 Mod 10 = 2 Mod 10 = 3 Mod 10 = 4 Mod 10 = 5 Mod 10 = 6 Mod 10 = 7 Mod 10 = 8 Mod 10 = 9

13. Key locations are defined in a directory Simple growth Directory is SPOF Horizontal Sharding

14. Horizontal Sharding Static Hashing with Directory Mapping Simple Growth Small Directory still SPOF Mod 1000 = 4

15. Horizontal Sharding Each key signed by DB# generated on creation Simple growth New key generation is SPOF

16. Limitations: Reporting

17. Best Practices $connection = new_db_connection("customer://1234"); $statement = $connection->prepare( $sql_statement, $params ); $result = $statement->execute();

18. Lessons Vertical Sharding: User Actions, Users, Comments, Items Horizontal Sharding Denormalization MySQL Replication

19. ‘ s Path to Sharding Single Server Single Master with Multiple Read Slaves Partitioned Sharding

20. ‘ s Path Master-Master replication Each Shard is 50% loaded 40K queries/second

21. Ad Network Reference Architecture

22. Sharding Management http://dev.mysql.com/tech-resources/articles/mysql_5.0_psea1.html Storage Engine MySQL Proxy

23. Grizzard http://readwriteweb.com.br/search/scala-framework/

24. ScaleBase

25. The Bottom Line: Grow ∞

26. Startup your Engines Thank you Moshe Kaplan: mokplan@gmail.com http://top-performance.blogspot.com