Download as PDF, PPTX
Uploaded byGiuseppe Maxia
Advanced mysql replication for the masses
The document discusses advanced MySQL replication techniques, particularly through the use of Tungsten Replicator, which offers features such as easy failover, multiple masters, and parallel replication. It highlights various business scenarios where traditional MySQL couldn't meet demands, showcasing how Tungsten can effectively address those challenges. Additionally, the document provides installation instructions and operational details for running the Tungsten Replicator.
More Related Content
Similar to Advanced mysql replication for the masses
![Vibe Coding vs. Spec-Driven Development [Free Meetup]](https://cdn.slidesharecdn.com/ss_thumbnails/vibecodingvsspecdrivendevelopment-251209105622-43f455e7-thumbnail.jpg?width=640&height=640&fit=bounds)
Advanced mysql replication for the masses
- 1. Advanced MySQL Replication for the masses Giuseppe Maxia, QA Director, Continuent, Inc Facts. And Demos. Possibly fun 1
- 2. Once Upon ATime, In The Life Of A Database Consultant ... 2
- 3. The story ofa steel foundry • Used MySQL databases to store production monitoring data • Inserted a zillion records per second. • Slaves often lagged behind 3
- 4. transaction transaction MySQL transaction transaction transaction DBMS transaction transaction transaction transaction transaction transaction transaction BINARY LOG ns act act tio n tra ansio ns sac ntio ac ion ion n ac nr tr tra aniton tsa a n csio nts ct n rn a o taa scti r trnsa n n tio ct tra tra REPLICATION transaction transaction MySQL DBMS 4
- 5. The story ofa shoe maker • Had a successful business, spread to a dozen stores. • Needed to aggregate the data from the stores in his headquarters database. 5
- 6. MySQL MySQL DBMS MySQL DBMS DBMS store store store MySQL DBMS headquarters 6
- 7. The story ofa widgets seller • Had a successful business, designed for one server. • Products were created in several sites. • Needed to allow insertions from more than one master at the time 7
- 8. MySQL MySQL DBMS DBMS master master MySQL MySQL DBMS DBMS master master 8
- 9. All these storiestell us: Nice dream, but MySQL can’t do it 9
- 10.
- 11. Tungsten Replicator 2.0 •What is it? 11
- 12. http://code.google.com/p/tungsten-replicator Open Source 100% GPL v2 12
- 13. What can itdo? • Easy failover • Multiple masters • Multiple sources to a single slave • Parallel replication • Replicate to Oracle and PostgreSQL database 13
- 14. MySQL to foreignservices MySQL setup to run as MySQL master Master DB Data is applied to PostgreSQL or Oracle Bin Logs (Binlogs enabled) Slave DB © Continuent 2010 14
- 15. From the beginning... 15
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25. master/slave with anattitude 25
- 26. The steel foundrydream or parallel replication From here ... 26
- 27. The steel foundrydream or parallel replication To here. 27
- 28. Parallel replication facts •Sharded by database • Good choice for slave lag problems • Bad choice for single database projects 28
- 29. Slave Lagging: why? •Complex queries on the master • Long lasting DDL • Slave restart 29
- 30. Testing parallel replication 30
- 31. db0 preparation (1) db1 sysbench db2 sysbench db3 sysbench db4 sysbench db5 sysbench db6 sysbench db7 sysbench db8 sysbench db9 sysbench sysbench 31
- 32. preparation (2) db0 db1 db2 db3 db4 db5 db6 db7 db8 db9 32
- 33. before the test(1) db0 db1 db2 db3 db4 db5 db6 db7 db8 db9 33
- 34. before the test(2) SQL thread RELAY logs IO thread binary logs MySQL slave RELAY logs Tungsten slave direct: alpha (slave) replicator alpha 34
- 35. starting the test SQL thread RELAY logs IO thread binary logs MySQL slave RELAY logs Tungsten slave direct: alpha (slave) replicator alpha 35
- 36. MySQL native replication slave catch up in 00:59:30 36
- 37. Tungsten parallel replication slave catch up in 00:25:40 37
- 38. The widget seller dream,or multi masters • Tungsten Replicator recipe: use more services 38
- 39.
- 40. Bi-directional replication withslaves 40
- 41. True multiple master We’ll see that in a moment. But first 41
- 42. The shoe makerdream, or multiple sources • Tungsten Replicator recipe is still valid: use more services 42
- 43.
- 44. Multiple masters replication:3 nodes 44
- 45. Multiple masters replication:4 nodes 45
- 46. Updating 4 masters: 1 flow 46
- 47. Updating 4 masters: 2 flows 47
- 48. Updating 4 masters: 3 flows 48
- 49. Updating 4 masters: 4 flows 49
- 50. Tungsten in practice •installation 50
- 51. Installation • Get thebinaries • Expand the tarball • Run ./tools/tungsten-installer 51
- 52.
- 53. replicator • It’s theservice provider • You launch it once when you start • You may restart it when you change config 53
- 54. trepctl • Tungsten ReplicatorConTroLler • It’s the driving seat for your replication • You can start, update, and stop services • You can get specific info 54
- 55. thl • Transaction HistoryList • Gives you access to the Tungsten relay logs 55
- 56. ADVERTISING 56
- 57. WE ARE HIRING! QAand support engineers http://www.continuent.com/about/careers 57
- 58. Conclusion and Questions © Continuent 2011 58
- 59. Contact Information Worldwide 560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel (866) 998-3642 Fax (408) 668-1009 e-mail: sales@continuent.com Continuent Web Site: http://www.continuent.com Tungsten Project http://tungsten-replicator.org © Continuent 2011 59