Presentation by Peter Zaitsev, Founder & CEO - Percona, recorded at Distributed SQL Summit on Sept 20, 2019. https://vimeo.com/362362004 distributedsql.org/

1. © 2019 Percona.
1
Peter Zaitsev
MySQL Distributed Architectures
Past Present and the Future
CEO, Percona
Distributed SQL Summit
September 20, 2019

2. © 2019 Percona.
2
Presentation
Cover Some Basics
Review History of Distributed MySQL Architectures
Look at Current State of Technology
And what Future is likely to bring us

3. © 2019 Percona.
3
… In 30 Minutes
We will have to move
fast and gloss over some
details

4. © 2019 Percona.
4
Distributed ?
MySQL Deployment on More
than one System within same
Environment

5. © 2019 Percona.
5
Even more Modern MySQL Scalability

6. © 2019 Percona.
6
Single MySQL Instance Can Do
Hundreds of Thousands of Queries/Sec
Tens of Thousands of Updates/Sec
Traverse Tens of Millions of Rows/Sec
Comfortably Handle Several TB Database size

7. © 2019 Percona.
7
Lets Do Some Math
100.000 QPS
10 Queries per User Interaction
10.000 User Interactions/sec
864.000.000 User Interactions/Day
30 User Interactions/User Avg
28.000.000 Daily Active Users Possible
15M of Daily Active Users counting time of day skew

8. © 2019 Percona.
8
Distributed Systems Tend To be
More Complicated to Develop Against
More Complicated to Operate
Have Additional Performance Bottlenecks
Have Complicated Failure Modes

9. © 2019 Percona.
9
With All of this ?
Why “Go Distributed” ?

10. © 2019 Percona.
10
Reasons to “Go Distributed”
High
Availability
Scalability
Data
Distribution

11. © 2019 Percona.
11
Speed of Light Realities
•Synchronous – Slow
•Asynchronous –
Data Loss Can Occur
Data
Propagation
Can Be

12. © 2019 Percona.
12
Scalability
Scaling
Reads
Scaling
Writes
Scaling
Data Size

13. © 2019 Percona.
13
Data Distribution
•User Latency Reasons
•Legal and Compliance
Reasons
Some Data
Must be in
Specific
Geographic
Location

14. © 2019 Percona.
14
Distributed MySQL – Early Days

15. © 2019 Percona.
15
MySQL Classical Replication
Scaling Reads not so good with Writes
Multi-Tiered replications. Sometimes as many as 150
Replicas
Many,Many Copies of Data

16. © 2019 Percona.
16
Classical MySQL Replication

17. © 2019 Percona.
17
Advanced MySQL Replication Topologies

18. © 2019 Percona.
18
Brad Fitzpatrick illustrates this problem

19. © 2019 Percona.
19
Large number of copies do not scale well

20. © 2019 Percona.
20
Sharding in 2004 - LiveJournal

21. © 2019 Percona.
21
Other Problems Operating at Scale
Asynchronous Replication
Replication which is not Crash Safe
Non-Atomic DDL
Single Threaded Replication
Statement Based Replication
Automatic Failover

22. © 2019 Percona.
22
Sharding Complications
Query Routing is the first problem people think about
Multi-Shard Queries
Shard Re-Balancing (online)

23. © 2019 Percona.
23
MySQL is not good for Everything
• Elastic, Solr, SphinxFull Text Search
• Memcache, RedisCaching
• MongoDB, Cassandra, Couchbase etcNon-Relational Storage
• Hadoop, Spark, ClickHouse, RedShiftAnalytics

24. © 2019 Percona.
24
MySQL NDB Cluster
Mostly In-Memory Technology with Automatic Sharding
On Paper solves a lot of Problems
Very Limited Traction in Practice

25. © 2019 Percona.
25
Distributed MySQL Now

26. © 2019 Percona.
26
Sharding is Still the King
There is no way around it
for large scale
applications

27. © 2019 Percona.
27
How Sharding is Implemented
Many Organizations
Invested in their Own
Sharding Implementation
Technologies

28. © 2019 Percona.
28
Sharding Solutions
Vitess is leader in MySQL Sharding Space
Simple Sharding can be done with ProxySQL
You can find many project of unknown quality on GitHub

29. © 2019 Percona.
29
MySQL Replication
Can be configured to be Crash-Safe on Master and Slave
Semi-Synchronous Operation mode to limit data loss
Parallel Replication
Multi-Source Replication
Atomic DDL
Row Based Replication
Orchestrator

30. © 2019 Percona.
30
MySQL “Clustering”
Galera (and Percona XtraDB Cluster)
MySQL Group Replication/MySQL
InnoDB Cluster

31. © 2019 Percona.
31
Distributed MySQL – Future

32. © 2019 Percona.
32
Disclaimer

33. © 2019 Percona.
33
Desire for Scale
While Relatively Few Teams will really
need to operate their system at Scale
Most Teams Not Want Solution which will
not block them if/when they need to scale

34. © 2019 Percona.
34
Scalability and Efficiency
Theoretical Scalability
Beats Efficiency at the
early stage

35. © 2019 Percona.
35
New Technologies
Vitess has bright future
Oracle will need to have solution for MySQL
So Major Cloud Vendors

36. © 2019 Percona.
36
NewSQL
YugabyteDB
CockroachDB
TiDB (by PingCap)

37. © 2019 Percona.
37
Other Trends
Separation of Storage and Compute
Cloud Native (Kubernetes Based)
Solutions

38. © 2019 Percona.
38
DBaaS
How Many Solutions will
be OpenSource vs only
Available from Specific
Cloud ?

39. © 2019 Percona.
39

40. © 2019 Percona.
40
Thank You!
@peterzaitsev
https://www.linkedin.com/in/peterzaitsev/