MySQL HA

Copyright © 2016, Oracleand/orits affiliates. Allrights reserved. |
MySQL High Availability
InnoDB Cluster and NDB Cluster
Ted Wennmark
ted.wennmark@oracle.com
Copyright © 2016, Oracleand/orits affiliates. Allrights reserved.

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitmentto deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionalitydescribed for Oracle’s products remains at the sole discretion of Oracle.
2

Almost all organizations require their most
critical systems to be highly available
3
100%

InnoDB Cluster
4
or
NDB Cluster

• MySQL InnoDB Cluster
– Easy HA built into MySQL 5.7+
– Write consistency
– Read Scalability
– App failover using MySQL Router
– Management via mysqlsh
– InnoDB storage engine
• MySQL NDB Cluster
– In memory database
– Automatic sharding
– Native access via several API
– Read/write consistency
– Read/write scalability
– NDB storage engine
How Do The Two Compare I

How Do The Two Compare II
MySQLInnoDBCluster MySQLNDBCluster
StorageEngine InnoDB NDBCLUSTER
DistributedArchitecture Sharednothing Sharednothing
ConsistencyModel Weak Consistency StrongConsistency
Sharding No Yes
Arbitration No Yes
LoadBalancing No Yes
NoSQLAPIs MySQLDocumentStore NativeNDB API
OperationalComplexity Medium High
Administration Standard(MySQL) Custom(MySQL+ NDB)

InnoDB Cluster
7

InnoDB Cluster
8
App Servers with
MySQLRouter
MySQLGroupReplication
MySQLShell
Setup,Manage,
Orchestrate
“High Availability becomes a core
first class feature of MySQL!”

Copyright © 2016, Oracleand/orits affiliates. Allrights reserved. | 9
MySQL InnoDB Cluster: Vision
“A single product — MySQL — with high availability and scaling
features baked in; providing an integrated end-to-end solution
that is easy to use.”

• One Product: MySQL
– All componentscreated together
– Tested together
– Packaged together
• Easy to Use
– One client: MySQL Shell
– Easy packaging
– Integrated orchestration
– Homogenousservers
• Flexible and Modern
– SQL and NoSQL together
– ProtocolBuffers
– Developer friendly
• Support Read/Write Scale Out
– Sharded clusters
– Federated system of N replica sets
– Each replica set manages a shard
10
MySQL InnoDB Cluster: Goals

MySQLConnector
Application
MySQL Router
MySQL Connector
Application
MySQL Router
MySQL Shell
MySQLConnector
Application
MySQL Router
MySQLConnector
Application
MySQL Router
MySQL InnoDB Cluster: High Level Architecture
MySQL
InnoDB
cluster
MySQL Enterprise Monitor
…

MySQL
Group Replication
Natively distributed and highly available replica sets

MySQL Group Replication: What Is It?
• Group Replication library
– Implementationof Replicated Database State Machine
theory
• MySQL GCS is based on Paxos (variant of Mencius)
– Providesvirtually synchronous replication for MySQL 5.7+
– Supported on all MySQL platforms
• Linux,Windows, Solaris, OSX, FreeBSD
“Multi-master update anywhere replication plugin for MySQL with
built-in conflict detection and resolution, automatic distributed
recovery, and group membership.”
13
App Servers with
MySQLRouter
MySQLShell
Setup,Manage,
Orchestrate

MySQL Group Replication: What Does It Provide?
• A highly available distributed MySQL database service
– Removes the need for manually handling server fail-over
– Providesdistributed fault tolerance
– Enables Active/Active update anywhere setups
– Automates reconfiguration (adding/removing nodes, crashes, failures)
– Automaticallydetects and handles conflicts
14

MySQL Group Replication: Architecture
Node Types
R: Trafficrouters/proxies:mysqlrouter,haproxy,sqlproxy,...
M:mysqld nodes participatingin Group Replication
15

MySQL Server: Full Stack

MySQL Router
Transparent application connection routing

MySQL Router: 2.1
• Nativesupport for InnoDB clusters
– Understands Group Replication topology
– Utilizes metadata schema stored on each member
• Bootstraps itself and sets up client routing for the InnoDB cluster
• Allows for intelligent client routing into the InnoDB cluster
• Supports multi-master and single primary modes
• Core improvements
– Logging
– Monitoring
– Performance
– Security
18
App Servers with
MySQLRouter
MySQLShell
Setup,Manage,
Orchestrate
labs.mysql.com

MySQL Shell
Single tool for development, setup,
management, orchestration, and monitoring

MySQL Shell
20
A single unified client for all administrative and operations tasks
App Servers with
MySQLRouter
MySQLShell
Setup,Manage,
Orchestrate
• Multi-Language: JavaScript, Python, and SQL
– Naturally scriptable
• Supports both Document and Relational models
• Exposes full Development and Admin API
”MySQL Shell provides the developer and DBA with a single intuitive,
flexible, and powerfull interface for all MySQL related tasks!”

MySQL Shell: Admin API
• mysql-js> dba.help()
• The global variable 'dba' is used to access the
MySQL AdminAPI
• Perform DBA operations
– Manage MySQL InnoDB clusters
• Create clusters
• Deploy MySQL instances
• Get cluster info
• Start/Stop MySQL Instances
• Validate MySQL instances …
Database Administration Interface
labs.mysql.com
App Servers with
MySQLRouter
MySQLShell
Setup,Manage,
Orchestrate

MySQL Shell – Deploy MySQL Instances
shell> mysqlsh
mysql-js> dba.deployLocalInstance(3306)
mysql-js> dba.deployInstance(‘hanode2:3306’)
mysql-js> dba.deployInstance(‘hanode3:3306’)
22

MySQL Shell – Create an InnoDB Cluster
mysql-js> connect root@hanode1:3306
mysql-js> cluster = dba.createCluster(‘NewAppCluster')
mysql-js> cluster.addInstance('root@hanode2:3306')
mysql-js> cluster.addInstance('root@hanode3:3306')
23

MySQL Shell – Add a MySQL Router
shell> mysqlrouter --bootstrap hanode1:3306
shell> mysqlrouter &
shell> mysqlsh --uri root@localhost:6446
24

MySQLDocumentStore
Relational & Document Models
MySQLHA
Out-Of-BoxHA
Read Scale-Out
Async Replication+ Auto Failover
Write Scale-Out
Sharding
S1
S2
S3
S4
* Download InnoDB Cluster Preview Release from labs.mysql.com
What’s Next

MySQL Enterprise Monitor
• Nativeholistic support for InnoDB clusters
– Topologyviews
– Detailed metrics and graphs
– Best Practice advice
• Monitoring of MySQL Routers
• Monitoring of Group Replication
26

NDB Cluster
27

Driving Database Requirements
9th April 2015 Copyright 2015,oracle and/or its affiliates. Allrights reserved 28
RockSolid
Availability
In-Memory
Real-Time
Performance
Extreme
Read & Write
Scalability
Elasticity

HLR/ HSS
Billing,AuC,VLR
AuC, Call
Routing,Billing
Location
Updates
Pre& PostPaid
• Massive volumes of write traffic
• < 3ms database response
• Downtime & lost transactions = lost $
• Extremly cost sensitive market
MySQL Cluster in Action: http://bit.ly/oRI5tF
No Trade-Offs: Cellular Network

UserSession
Session
management
Session
management
LocationUpdates,
Charactermovements,...
• Massive volumes of write traffic
• < 3ms database response
• Downtime & lost transactions = lost $
• Extremly sensitive crowd
No Trade-Offs: Massive Parallel Online Games

Copyright © 2016, Oracleand/orits affiliates. Allrights reserved. | Confidential –OracleInternal/Restricted/Highly Restricted 31
No Trade-offs: Hadoop
NameNodes
Leader
HDFS Client
DataNodes
Hops.io
MySQLNDB ClusterData Nodes
ClusterJ
NDB Cluster powering the
world‘s fastest and most
scalable Hadoop
filesystem.
Scaling Hadoop 20x!

MySQL Cluster Overview
• Memoryoptimizedtables with durability
• PredictableLow-Latency,BoundedAccessTime
REAL-TIME
• Auto-Sharding,Active-Active
• ACIDCompliant,OLTP+ Real-TimeAnalyticsHIGH SCALE, READS + WRITES
FULLYELASTIC
• Active-Active, Shared nothing, no Single Point of Failure
• Self Healing + On-Line Operations
99.999% AVAILABILITY
• Key/Value + Complex, Relational Queries
• SQL + Memcached + JavaScript + Java + HTTP/REST & C++
SQL + NoSQL
• Open Source + Commercial Editions, Easy to use and deploy
• Commodity hardware + Management, Monitoring Tools
LOW TCO
• Add and remove storage and performance capacity in seconds
• Fully cloud enabled

NoSQL Access to MySQL Cluster data
Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps
JPA
Cluster JPA
PHP Perl Python Ruby JDBC Cluster J JS Apache Memcached
MySQL JNI Node.JS mod_ndb ndb_eng
NDB API (C++)
MySQLCluster Data Nodes

MySQL Cluster Architecture
MySQLCluster DataNodes
Clients
ApplicationLayer
Data Layer

Data Partitioning / Auto-sharding
28/09/2016 Copyright 2015,oracle and/or its affiliates. Allrights reserved 35
User-id(PK) Service(PK) Data
1773467253 chat xxx
6257346892 chat xxx
1773467253 photos xxx
8235602099 reminders xxx
8437829249 location xxx
MySQLClusterDataNodes

1773467253 chat xxx
6257346892 chat xxx
Shard Key

NodeGroup
DataNode 1
• Datatransparently sharded between Node Groups
• Each fragment active in one Data Node with synchronous replication to
2nd Data Node in same Node Group
DataNode 2
NodeGroup
DataNode 3 DataNode 4

• DBA chooses which part of
Primary Key to use as shard
key
• Fragment for each row
decided by hashing the
sharding key
1773467253 chat xxx
6257346892 chat xxx
Shard Key
NodeGroup
NodeGroup

• Dataautomatically rearranged to use new capacity
• Designed to be a slow background process not impacting real-time
performance.
NodeGroup
Data Node 1 Data Node 2
NodeGroup
NodeGroup
On-line Scaling and Elasticity
Re-partioning

MySQL Cluster 7.2: 1.2 Billion UPDATEs per Minute
• NoSQL C++ API,
flexaSynch benchmark
• 30 x Intel E5-2600 Intel
Servers, 2 socket, 64GB
• ACID Transactions, with
Synchronous Replication
http://www.mysql.com/why-
mysql/white-papers/mysql-cluster-
benchmarks-1-billion-writes-per-minute/0
5
10
15
20
25
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30
MillionsofUPDATEsperSecond
MySQL Cluster Data Nodes

• Memory optimized tables
– Durable
– Mix with disk-based tables
• Massively concurrent OLTP
• Distributed Joins for analytics
• Parallel table scans for non-indexed
searches
• MySQL Cluster 7.4 FlexAsych
– 200M NoSQL Reads/Second
28/09/2016 42
MySQL Cluster 7.4 NoSQL Performance
200 Million NoSQL Reads/Second
Copyright 2015,oracle and/or its affiliates. Allrights reserved
-
50,000,000
100,000,000
150,000,000
200,000,000
250,000,000
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32
Readspersecond
Data Nodes
FlexAsync Reads

• Memory optimized tables
– Durable
– Mix with disk-based tables
• Massively concurrent OLTP
• Distributed Joins for analytics
• Parallel table scans for non-indexed
searches
• MySQL Cluster 7.4 DBT2 BM
– 2.5M SQL Statements/Second
28/09/2016 43
MySQL Cluster 7.4 SQL Performance
2.5M SQL Statements/Second
Copyright 2015,oracle and/or its affiliates. Allrights reserved
-
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
2 4 6 8 10 12 14 16
SQLStatements/sec
Data Nodes
DBT2 SQL Statements per Second

MySQL NDB Cluster 7.5
• Read Optimized
Tables
• Fully Replicated
Capacity and
Scale Out
• MySQL 5.7
• JSONData Type
• Generated Columns
• Records-Per-Key
Optimization
Improved
SQL
• Improved Reporting
• Improved Logging
• Improved Visibility
• Improved Restore
Management
RC

• Reading from backup allows to read
from any copy
• Previously all reads were directed
towards the primary fragment only
Confidential –OracleInternal/Restricted/Highly Restricted 45
MySQL NDB 7.5: Reading from backup
NodeGroup

MySQL NDB Cluster 7.5: Fully replicated
• Fully replicated allows a table to be read/written locally on any node
• Ideal for staticdata, faster join performance
Confidential –OracleInternal/Restricted/Highly Restricted 46
NodeGroup
NodeGroup

Next Steps
Learn More
• www.mysql.com/cluster
• https://dev.mysql.com/doc/mysql-innodb-cluster/en/
• Authentic MySQL Curriculum: http://oracle.com/education/mysql
Try it Out
• dev.mysql.com/downloads/cluster/
7.4 GA and 7.5 DMR 1
• https://labs.mysql.com/
Let us know what you think
• http://mysqlhighavailability.com/
• forums.mysql.com/list.php?25

Thank you!

MySQL HA

More Related Content

What's hot

Similar to MySQL HA

More from Ted Wennmark

Recently uploaded

MySQL HA