Your SlideShare is downloading. ×
  • Like
MariaDB Galera Cluster presentation
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply

MariaDB Galera Cluster presentation

  • 1,325 views
Published

MariaDB Galera Cluster in a master-Master Sync Replication configuration.

MariaDB Galera Cluster in a master-Master Sync Replication configuration.

Published in Technology , Travel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,325
On SlideShare
0
From Embeds
0
Number of Embeds
3

Actions

Shares
Downloads
57
Comments
0
Likes
7

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. HA&Solu4ons&for&MySQL& Joffrey&Michaie& Consultant& SkySQL&AB&©&2013&Confiden4al&
  • 2. Agenda& • Introduc4on& • MySQL&Replica4on& • SemiHSynchronous&Replica4on& • MySQL&5.6& • MariaDB&10.0& • MHA& • Galera& • Shared&Disk& • DRBD& • MySQL&Cluster& SkySQL&AB&©&2013&Confiden4al&
  • 3. Introduc4on&to&HA& “High&availability&is&a&system&design&protocol&and& associated&implementa6on&that&ensures&a&certain& degree&of&opera6onal&con6nuity&during&a&given& measurement&period”& SkySQL&AB&©&2013&Confiden4al&
  • 4. Up4me,&Down4me,&9s& Availability&=&up4me&/&(up4me&+&down4me)& & &90%& & & & & &1&nine&& & & &36.5&days&/&year && & &99%& & & & & &2&nines& & & &3.65&days&/&year& & &99.9%&& & & & &3&nines& & & &8.76&hours&/&year& & &99.99%& & & & &4&nines& & & &52&minutes&/&year& & &99.999%& & & & &5&nines& & & &5&minutes&/&year& & &99.9999%&& & & &6&nines& & & &31&seconds&/&year& Availability&=&MTBF&/&(MTBF&+&MTTR)& SkySQL&AB&©&2013&Confiden4al&
  • 5. Terminology& • Synchronous&vs.&Asynchronous& • SharedHDisk&vs.&SharedHNothing&vs.&SharedHMemory& • Single&Point&Of&Failure&H&SPOF& • Failover&vs.&Switchover& • Split&Brain& • Node&Fencing,&STONITH,&Quorum& SkySQL&AB&©&2013&Confiden4al&
  • 6. Designing&for&HA& • Which&level&of&availability&do&I&need?& • How&many&nines?& • Do&I&require&no&loss&of&data?& • Could&I&loose&some&transac4ons?& • Will&my&users&no4ce&or&care?& • Do&I&need&automa4c&failover&or&is&manual&switchover&ok?& • How&do&I&test&this?& • Can&I&provide&a&reasonable&service&when&X&is&down?& • Replace&X&with&each&component&of&the&service& SkySQL&AB&©&2013&Confiden4al&
  • 7. Before&we&talk&about&solu4ons& • A&high&availability&setup&does&not& replace&backups& • Check&parameters& • flush_at_trx_commit& • sync_binlog& • expire_logs_day& • binlog_format& • sync_master_info&(on&slaves)& • ...& • Requirements&for&parameters&may& change&if&using&baieryHbacked&disk& cache& SkySQL&AB&©&2013&Confiden4al&
  • 8. MySQL&Replica4on&H&Asynchronous& • Asynchronous:&3&Phases& 1.  Commit&and&write&to&binlog&on&Master& 2.  Ship&changes&to&relay&log&on&slave& 3.  Apply&changes&on&slave&& • Master&H>&slave&rela4onship& • MonoHthreaded&on&slaves&un4l&MySQL&5.5& • MySQL&5.6&allows&mul4Hthreaded& • No&conflict&resolu4on& • MasterHmaster&replica4on&or&circular& replica4on&need&applica4on&logic& & SkySQL&AB&©&2013&Confiden4al& Slave(s)& Master&
  • 9. MySQL&Replica4on&–&SemiHSynchronous& • Added&as&a&plugin&in&MySQL®&5.5& • Ensures&that&changes&have&been&shipped&to& at&least&one&slave&(or&4meouts)&& • A&COMMIT&on&the&master&waits&for&ONE& Slave&to&acknowledge&the&transac4on& • Important:&The&Master&does&not&wait&for&the& Slave&to&execute&the&transac4on,&only&to&write& it&to&the&relay&log& • So&the&Slave&SQL&Thread&may&s4ll&lag&behind& the&Master&and&queries&to&the&Slave&may&s4ll& return&old&data& • Poten4ally&adds&latency&to&queries& SkySQL&AB&©&2013&Confiden4al& Slave(s)& Master&
  • 10. MySQL&Replica4on&for&HA& • Master&<H>&standby&master&H&manual&failover& • Minimal&down4me&for&changes&and&upgrades& • SemiHsynchronous&should&be&used& • Used&in&combina4on&with&other&HA&solu4ons& for&geographical&replica4on& SkySQL&AB&©&2013&Confiden4al&
  • 11. MySQL®&5.6&–&New&Replica4on&Features& • Global&Transac4on&ID&(GTID)& • Makes&it&easy&to&automate&failover&and&slave&promo4on& • Replica4on&failover&and&admin&u4li4es& • Mul4Hthreaded&slaves& • Replica4on&event&checksums& • TimeHdelayed&replica4on& SkySQL&AB&©&2013&Confiden4al&
  • 12. MariaDB&10.0&–&New&Replica4on&Features& • Mul4Hsource&replica4on& • Global&Transac4on&ID&(GTID)& • Different&implementa4on&from&MySQL&5.6& • GTID&per&domain&instead&of&server& SkySQL&AB&©&2013&Confiden4al&
  • 13. MHA& Master&High&Availability&Manager& • Automates&master&failover&and&slave& promo4on& • Monitors&the&master&or&can&integrate&with& Pacemaker/Heartbeat& • Failover&is&an&online&opera4on& • Also&allows&manual&switchover& • Short&down4me:&open&a&few&seconds& • MySQLHReplica4on&consistency& • No&performance&penalty& • Drop&in&solu4on&on&exis4ng&deployment& & SkySQL&AB&©&2013&Confiden4al&
  • 14. MHA& Failover&Process& 1.  Aiempt&to&contact&MySQL&master&server& by&SSH& 2.  If&master&server&is&alive&access&the&binary& log&and&recover&events& 3.  Find&the&slave&with&the&most&advanced& relay&log& 4.  Sync&all&slaves&to&the&latest&available& binlog&event& 5.  STONITH&master&if&necessary& 6.  Promote&slave&to&master& SkySQL&AB&©&2013&Confiden4al&
  • 15. Galera&/&MariaDB&Galera&Cluster& • Provides&“virtually”&synchronous& Clients replica4on& • Works&with&InnoDB& • No&slave&lag& • Transac4ons&are&validated&by&slaves& upon&commit& • Cer4fica4on&and&quorum& • Transac4ons&may&be&rolled&back& at&this&stage& • Mul4Hmaster&or&masterHslave&possible& SkySQL&AB&©&2013&Confiden4al& MySQL MySQL MySQL wsrep wsrep wsrep Galera Replication
  • 16. Galera&/&MariaDB&Galera&Cluster& • Provides&“virtually”&synchronous& Clients replica4on& • Works&with&InnoDB& • No&slave&lag& • Transac4ons&are&validated&by&slaves& upon&commit& • Cer4fica4on&and&quorum& • Transac4ons&may&be&rolled&back& at&this&stage& • Mul4Hmaster&or&masterHslave&possible& SkySQL&AB&©&2013&Confiden4al& MySQL MySQL MySQL wsrep wsrep wsrep Galera Replication
  • 17. Galera&–&Transac4on&Process& • Transac4on&is&processed& locally&up&to&commit&4me& Client trx MySQL MySQL MySQL wsrep wsrep wsrep Galera Replication SkySQL&AB&©&2013&Confiden4al&
  • 18. Galera&–&Transac4on&Process& • Transac4on&is&processed& locally&up&to&commit&4me& Client • Transac4on&is&replicated& to&whole&cluster& trx MySQL MySQL MySQL wsrep wsrep wsrep ws Galera Replication SkySQL&AB&©&2013&Confiden4al& ws
  • 19. Galera&–&Transac4on&Process& • Transac4on&is&processed& locally&up&to&commit&4me& Client • Transac4on&is&replicated& to&whole&cluster& • Client&gets&OK&status& trx MySQL MySQL MySQL wsrep wsrep wsrep Galera Replication SkySQL&AB&©&2013&Confiden4al&
  • 20. Galera&–&Transac4on&Process& • Transac4on&is&processed& locally&up&to&commit&4me& Client • Transac4on&is&replicated& to&whole&cluster& • Client&gets&OK&status& • Transac4on&is&applied&in& slaves& MySQL MySQL trx wsrep wsrep Galera Replication SkySQL&AB&©&2013&Confiden4al& MySQL trx wsrep
  • 21. SharedHdisk&Solu4on& • Ac4ve&–&Passive&replica4on& • Failover&requires&MySQL&crash&recovery&(and& open&file&system&crash&recovery)& • Combined&with&Pacemaker/Heartbeat&for& automa4c&failover& • Virtual&IP&most&open&used&to&fail&over& • In&theory&the&SAN&is&a&SPOF& SkySQL&AB&©&2013&Confiden4al&
  • 22. DRBD®&& • Synchronous&replica4on&(three&modes)& • Ac4ve&–&Passive&replica4on& • Failover&requires&MySQL&crash&recovery&(and& open&file&system&crash&recovery)& • Combined&with&Pacemaker/Heartbeat&for& automa4c&failover& • Virtual&IP&most&open&used&to&fail&over& • STONITH&or&other&fencing&mechanism& needed&to&avoid&splitHbrain&scenarios& • Available&on&Linux& SkySQL&AB&©&2013&Confiden4al&
  • 23. DRBD®&H&Architecture& SkySQL&AB&©&2013&Confiden4al&
  • 24. MySQL&Cluster&H&Features& • Synchronous&replica4on&between& nodes& • Through&TwoHPhase&Commit&Protocol& • ACID&transac4ons& • Row&level&locking& • Shared&nothing&architecture& • No&single&point&of&failure& • Automa4c&failover& SkySQL&AB&©&2013&Confiden4al& • InHmemory&storage& • Some&data&can&be&stored&on&disk& • Checkpoin4ng&to&disk&for&durability& • Two&types&of&indexes& • Ordered&THtrees& • Unique&hash&indexes& • Online&opera4ons& • Add&node&groups& • Sopware&upgrade& • Some&table&altera4ons&
  • 25. MySQL&Cluster&H&Architecture& SkySQL&AB&©&2013&Confiden4al&
  • 26. MySQL&Cluster&H&Par44oning& SkySQL&AB&©&2013&Confiden4al&
  • 27. MySQL&Cluster& Network&par44oning&protocol& Designed&to&avoid&splitHbrain& 1.  Is&at&least&one&node&from&each&node&group&present?&& • If&not&then&the&cluster&cannot&con4nue&H&shutdown& 2.  Are&all&nodes&present&from&any&node&group?& • If&so&then&this&is&the&only&viable&cluster&H&con4nue& 3.  Ask&the&arbitrator& • The&arbitrator&decides&which&”cluster”&con4nues& • If&the&arbitrator&is&not&available&the&cluster&will&shutdown& SkySQL&AB&©&2013&Confiden4al&
  • 28. Where&does&MySQL&Cluster&fit?& • High&demands&on&availability&(5&nines)& • You&need&write&scalability& • You&have&3&or&more&”machines”&available& • Where&the&queries&and&data&model&are&simple& • When&the&data&fits&in&memory& • When&you&have&skilled&people& SkySQL&AB&©&2013&Confiden4al&
  • 29. Geographical&Replica4on& • For&geographical&(mul4Hsite)&redundacy& synchronous&solu4ons&are&open&not& desirable& • Standard&Replica4on&can&be&combined& with&any&synchronous&solu4on&locally& • MySQL&Cluster& • DRBD&/&shared&disk& • Galera& SkySQL&AB&©&2013&Confiden4al&
  • 30. Geographical&Replica4on& MySQL&Cluster& • MySQL&Cluster&has&addi4onal&features& related&to&Geographical&replica4on& • Conflict&detec4on&and&automa4c& resolu4on& • Several&possible&resolu4on&methods&exist& • Mul4ple&replica4on&channels&possible& • Mul4Hsource&replica4on&possible& • Binlog&injec4on&ensures&the&consitency& of&binlogs& SkySQL&AB&©&2013&Confiden4al&
  • 31. Quick&Comparison&Chart& * SkySQL&AB&©&2013&Confiden4al&
  • 32. Quick&Comparison&Chart& SkySQL&AB&©&2013&Confiden4al&
  • 33. Ques4ons?& SkySQL&AB&©&2013&Confiden4al&
  • 34. Thank&you!& Joffrey&Michaie& Joffrey.michaie@skysql.com& SkySQL&Ab& www.skysql.com& www.facebook.com/skysql& www.linkedin.com/company/skysql& MySQL is a registered trademark of Oracle and/or its affiliates. MariaDB is a registered trademark of Monty Program Ab. SkySQL and the SkySQL logo are trademarks of SkySQL Inc. or SkySQL Ab. SkySQL is not affiliated with MySQL. All other company and product names may be trademarks or service marks of their respective owners. SkySQL&AB&©&2013&Confiden4al&