Download as PDF, PPTX
![©Continuent 2014
Multi-Master Clusters in Action: Galera
8
Group
Ordering and
Delivery
Server A
Server B
Server C
foo
pk=1, v=5
foo
pk=6, v=25
foo
pk=1, v=6
[1] pk=1, v=6
[2] pk=1, v=5
[3] pk=6, v=25
[1] pk=1, v=6
[2] pk=1, v=5
[3] pk=6, v=25
[1] pk=1, v=6
[2] pk=1, v=5
[3] pk=6, v=25](https://image.slidesharecdn.com/tungstenwebinar07-10-14-140710105026-phpapp01/85/Harnessing-the-Power-of-Master-Slave-Clusters-to-Operate-Data-Driven-Businesses-on-MySQL-8-320.jpg)
![©Continuent 2014
Synchronous Optimistic Locking
9
Group
Ordering and
Delivery
Server A
Server B
Server C
foo
pk=1, v=5
foo
pk=6, v=25
foo
pk=1, v=6
[1] pk=1, v=6
[2] pk=1, v=5
[3] pk=6, v=25
[1] pk=1, v=6
[2] pk=1, v=5
[3] pk=6, v=25
[1] pk=1, v=6
[2] pk=1, v=5
[3] pk=6, v=25
COMMIT
COMMIT
DEADLOCK](https://image.slidesharecdn.com/tungstenwebinar07-10-14-140710105026-phpapp01/85/Harnessing-the-Power-of-Master-Slave-Clusters-to-Operate-Data-Driven-Businesses-on-MySQL-9-320.jpg)
Uploaded byContinuent
Harnessing the Power of Master/Slave Clusters to Operate Data-Driven Businesses on MySQL
This document discusses Continuent Tungsten, a product that provides high availability, performance scaling, and data management for MySQL database clusters. It introduces Continuent and describes how Tungsten uses master-slave replication across multiple database servers to provide high performance, high availability, and transparent read/write access to applications. The document also provides examples of how Tungsten handles transactions, load balancing, failover, and rolling upgrades without downtime.
More Related Content
Similar to Harnessing the Power of Master/Slave Clusters to Operate Data-Driven Businesses on MySQL
Harnessing the Power of Master/Slave Clusters to Operate Data-Driven Businesses on MySQL
- 1. ©Continuent 2014 Harnessing thePower of Master/Slave Clusters for Data- Driven Business on MySQL Robert Hodges, CEO Giuseppe Maxia, Director of QA
- 2. ©Continuent 2014 2 IntroducingContinuent
- 3. ©Continuent 2014 Introducing Continuent 3 •The leading provider of clustering and replication for open source DBMS • Our Product: Continuent Tungsten • Clustering - Commercial-grade HA, performance scaling and data management for MySQL • Replication - Flexible, high-performance data movement
- 4. ©Continuent 2014 Quick ContinuentFacts • Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data • Largest installation by transaction volume handles up to 8 billion transactions daily • Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop in production • Cross-site topologies widely deployed 4
- 5. ©Continuent 2014©Continuent 2014 ContinuentTungsten Customers 5 1
- 6. ©Continuent 2014 6 TooGood to Be True
- 7. ©Continuent 2014 The Dream:multiple, active DBMS servers with identical data 7 Server A Server B Server C Transparent read/write to any server Updates propagated immediately High Performance High Availability
- 8. ©Continuent 2014 Multi-Master Clustersin Action: Galera 8 Group Ordering and Delivery Server A Server B Server C foo pk=1, v=5 foo pk=6, v=25 foo pk=1, v=6 [1] pk=1, v=6 [2] pk=1, v=5 [3] pk=6, v=25 [1] pk=1, v=6 [2] pk=1, v=5 [3] pk=6, v=25 [1] pk=1, v=6 [2] pk=1, v=5 [3] pk=6, v=25
- 9. ©Continuent 2014 Synchronous OptimisticLocking 9 Group Ordering and Delivery Server A Server B Server C foo pk=1, v=5 foo pk=6, v=25 foo pk=1, v=6 [1] pk=1, v=6 [2] pk=1, v=5 [3] pk=6, v=25 [1] pk=1, v=6 [2] pk=1, v=5 [3] pk=6, v=25 [1] pk=1, v=6 [2] pk=1, v=5 [3] pk=6, v=25 COMMIT COMMIT DEADLOCK
- 10. ©Continuent 2014 Trouble inParadise • Transaction failures due to conflicts • Operations like SELECT FOR UPDATE not supported • Slow writes due to synchronous messaging • Large transactions lock system/cause failures • Unstable cross-site replication 10
- 11. ©Continuent 2014 Can Master/SlaveOffer Same Benefits? 11 Server A Server B Server C Updates propagated immediately? High Performance? High Availability? Transparent read/write to any server?
- 12. ©Continuent 2014 12 TungstenMaster/Slave Clusters
- 13. ©Continuent 2014 Tungsten Database-as-a-Service 13 Tungstenclusters combine off- the-shelf open source DBMS servers into data services with: ! • 24x7 data access • Scaling of load on replicas • Simple management commands ! ...without app changes or data migration Amazon US West apache /php GonzoPortal.com Connector Connector
- 14. ©Continuent 2014 Cluster Architecture 14 Application TungstenConnector Application Tungsten Connector Replicator Db2 Replicator Db3Db1 Replicator Slave SlaveMaster Manager Manager Manager MonitoringandControl MonitoringandControl Data Service: sjc
- 15. ©Continuent 2014 Tungsten ConnectorBasics • Any MySQL client can connect • Initiates connections using JDBC 15 App Native protocol ! COM_QUERY COM_INIT_DB COM_DROP_DB Connector
- 16. ©Continuent 2014 Tungsten ConnectorBasics • Pass-through operation after connection • Full transparency & low overhead for clients 16 App Protocol packet COM_QUERY select * from t Connector Protocol packet OK ResultSet Rows:1
- 17. ©Continuent 2014 SmartScale SessionLoad Balancing 17 App Connect/Write Connector Transaction History Log Slave replay position Session x Session y Slave DBMS Master DBMS Slave DBMS Initial Write
- 18. ©Continuent 2014 SmartScale SessionLoad Balancing 18 App Read Connector Transaction History Log Slave replay position Session x Session y Slave DBMS Master DBMS Slave DBMS Read from master NO read from slave!
- 19. ©Continuent 2014 SmartScale SessionLoad Balancing 19 App Read Connector Transaction History Log Slave replay position Session x Slave DBMS Master DBMS Slave DBMS Read from master Read from slave
- 20. ©Continuent 2014 Connectivity Example 20 TungstenConnector Tungsten Connector Db2 Db3Db1 SlaveMasterSlave (SmartScale) (Strict Consistency)
- 21. ©Continuent 2014 21 Demo:Transparent Connectivity to Replicas
- 22. ©Continuent 2014 22 TransactionScaling with Master/Slave Clusters
- 23. ©Continuent 2014 Understanding Replication 23 Master (Transactions+ Metadata) Slave THL DBMS Logs Replicator (Transactions + Metadata) THLReplicator Download transactions via network Apply using JDBC
- 24. ©Continuent 2014 Master ReplicationService 24 Extract Filter Apply Stage Extract Filter Apply Stage Pipeline MySQL Master Transaction History Log In-Memory Queue Slave ReplicatorsBinlog tcp/ip
- 25. ©Continuent 2014 Slave Servicewith Parallel Apply 25 Extract Filter Apply Stage Extract Filter Apply Stage Stage Pipeline Transaction History Log Parallel Queue Slave DBMS Extract Filter Apply Extract Filter Apply Extract Filter Apply Master Replicator tcp/ip
- 26. ©Continuent 2014 Understanding TransactionLoads 26 Large TransactionsSlow queries Reports Db2 Db3Db1 SlaveMasterSlave Small Transactions
- 27. ©Continuent 2014 27 Demo:Scalable Transaction Processing
- 28. ©Continuent 2014 28 Master/SlaveClustering Across Regions
- 29. ©Continuent 2014 Primary/Disaster RecoveryClustering 29 App Server + Connector App Server + Connector Master Slave San Jose NYC
- 30. ©Continuent 2014 Further Cross-SiteTopologies 30 Data Warehouse All Masters Fan-In
- 31. ©Continuent 2014 31 Failoverand Maintenance
- 32.
- 33. ©Continuent 2014 Automatic Failover 33 Application TungstenConnector 1. Detect non- responsive master 2. Halt master connections
- 34. ©Continuent 2014 Automatic Failover 34 Application TungstenConnector 3. Select most advanced slave and wait for pending transactions to apply
- 35. ©Continuent 2014 Automatic Failover 35 Application TungstenConnector 4. Promote to master, reconfigure slave(s), and re-enable connections
- 36. ©Continuent 2014 Automatic Failover 36 Application TungstenConnector 5. Recover failed master
- 37. ©Continuent 2014 Rolling MySQLmaintenance • Task: change the innodb log file size • Problem: it requires a database server restart • Constraint: we do not want to restart • Solution: rolling maintenance • shun node2 (slave) - do maintenance - put node online • shun node3 - do maintenance - put node online • promote node2 to master • shun node1 - do maintenance - put node online • promote again node1 to master 37
- 38. ©Continuent 2014 Rolling MySQLMaintenance 38 Final UpgradeSwitchSlave Upgrade Slave Upgrade • Shun slave 1, run upgrade, and return to cluster. Discard and recover on failure • Upgrade old master. Cluster schema is now fully upgraded • Repeat for additional slave(s) • Switch master to promote an upgraded slave
- 39. ©Continuent 2014 39 Demo:Zero-Downtime Upgrade and Failover
- 40.
- 41. ©Continuent 2014 Master/Slave PerformsVery Well! 41 Server A Server B Server C Updates propagated without cost to applications Very High Performance Very High Availability Transparent connectivity with full SQL semantics
- 42. ©Continuent 2014 In Conclusion:Tungsten Offers... • Transparent access to a highly available cluster of off-the-shelf MySQL replicas • High performance transaction processing regardless of cluster size or distance between nodes • Zero-downtime maintenance and upgrade of DBMS and applications 42
- 43. ©Continuent 2014 www.continuent.com Follow uson Twitter @continuent ! Tungsten Replicator: http://code.google.com/p/tungsten-replicator Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/ 560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: sales@continuent.com