FC
Uploaded byFrazer Clement
1,969 views

200 million qps on commodity hardware : Getting started with MySQL Cluster 7.4

The document outlines the features and enhancements of MySQL Cluster 7.4, highlighting its ability to achieve 200 million queries per second on commodity hardware. It discusses the architecture, performance optimizations, and support for high availability and scalability. The content also includes details about key sessions and community receptions during the OpenWorld 2015 event.

Embed presentation

Downloaded 19 times
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | OpenWorld 2015 200 Million QPS on Commodity Hardware Getting Started with MySQL Cluster 7.4 Frazer Clement MySQL Cluster Technical Lead Bernd Ocklin Director, MySQL Cluster Engineering October 26th, 2015 Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 200 Million QPS on Commodity Hardware Getting started with MySQL Cluster 7.4 Users, Features and Releases1 2 3 4 3 Design for Availability and Scale Performance, getting to 200M queries/second How to get started with MySQL Cluster
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Keynote: Monday, 4.00-6.00 pm, YBCA Theater State of the Dolphin 5 • Rich Mason, SVP & General Manager MySQL GBU, Oracle • Tomas Ulin, VP MySQL Engineering, Oracle Customer Experiences Hari Tatrakal, Director of Database Services, Live Nation Olaniyi Oshinowo, MySQL & Open Source Technologies Leader, GE Ernie Souhrada & Rob Wultsch, Database Engineers, Pinterest
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster content @ OpenWorld Fully Elastic Real- Time Services with MySQL Cluster Bernd Ocklin, Oracle Conference Session Tuesday 11am. Moscone South, 262 MySQL Server and MySQL Cluster at India’s Financial Inclusion Gateway Service NEC et al Conference Session Tuesday 5.15pm Moscone South, 250 Get Started with MySQL Cluster Benedita Vasconcelos, Oracle Hands On Lab Thursday, 9.30am Hotel Nikko - Peninsula 6
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Community Reception @ OpenWorld Celebrate, Have Fun and Mingle with Oracle’s MySQL Engineers & Your Peers 7 • Tuesday, October 27th , 7 pm • Jillian’s at Metreon: 175 Fourth Street, San Francisco CA94103 At the corner of Howard and 4th st.; only 2-min walk from Moscone Center (same place as last year) Join us!
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster deployments 8 Web Telecoms High volume OLTP eCommerce On-Line Gaming Digital Marketing User Profile Management Session Management & Caching Service Delivery Platforms VAS: VoIP, IPTV & VoD Mobile Content Delivery Mobile Payments Other Online gaming : AAA + profile management Payment fraud detection Many more, some unknown DBMS research
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Who's using MySQL Cluster? 9
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster highlights 10 High Throughput Reads & Writes Carrier-Grade Availability Real-Time Responsiveness On-Line, Linear Scalability Low TCO, Open platform Distributed, Parallel architecture Transactional, ACID-compliant relational database Shared-nothing design, synchronous data replication Sub-second failover & self-healing recovery Data structures optimized for RAM. Real-time extensions Predictable low latency, bounded access times Incrementally scale out, scale up and scale on-line Linearly scale with distribution awareness GPL & Commercial editions, scale on COTS Flexible APIs: SQL, C++, Java, OpenJPA, LDAP & HTTP
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster highlights 11 SQL Joins, Foreign Keys, Transactions, Row locks, Triggers, Views, Stored procedures, Blobs, keyless tables, newSQL, MySQL compatible... connectors for most languages, ORMs etc... NoSQL Full C++ Api for best control and performance (MySQLD SE built on top), Other Apis : Java, JPA, Node.js, Memcache.... HA 99.999% uptime systems (five nines), No single point of failure (SPOF), Heartbeating, cluster membership, automatic failover + recovery, automatic client failover, transactional DDL, CP, async replication, advanced exception logging... Performance and parallelism High throughput, low bounded latency (200M read tx/s). Batching, optimised protocols, Intra and Inter query parallelism, pushed parallel filters, pushed parallel joins, non-blocking event driven multithreaded.... HA, High performance, Relational, Transactional, Distributed, Parallel, SQL, NoSQL, Shared-Nothing, Commodity ...
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster highlights 12 Scalability Scale-out nodegroups or stateless API clients online, Scale-up data nodes and clients online with multithreading, scale up hardware online Replication Synchronous two phase commit internally, Transactional HA async replication between clusters, conflict detection+resolution... Storage Data transparently distributed and balanced by hash, Indexed columns in memory, others on disk or memory, Secondary unique and ordered indexes, Redundant Redo logs and periodic checkpoints... Manageability Online add + drop (index, column), Online consistent backup, Online upgrade, Online OS or hardware upgrade, consolidated cluster logs, C management Api for tooling... Shared nothing, Commodity No need for shared storage, In-memory data uses disk frugally, TCP over Ethernet / Infiniband etc, No special layer 2 requirements. Open source. HA, High performance, Relational, Transactional, Distributed, Parallel, SQL, NoSQL, Shared-Nothing, Commodity ...
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 7.3 MySQL Cluster Releases 13 7.2 7.4 - Distributed parallel joins - Multi-TC - Active-Active - Memcached - MySQL Server 5.5 - Foreign keys - Client lib performance - node.js - MySQL Server 5.6 - Restart performance - Active-Active - Internal reporting - MySQL Server 5.6 Regular fixes and improvements 2012 2013 2014 2015 ... MySQL Cluster is built on top of and tracks GA MySQL Server releases, gaining their features, optimisations and bug fixes.
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 7.4 Active-Active replication enhancements 1 System restart and maintenance activities parallelised Improved observability and manageability 14 Performance optimisations in the data node kernel More detail and download links at dev.mysql.com
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture 15 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 NdbApi protocol Tables and Indices are horizontally partitioned, distributed across and replicated within the NodeGroups. Application Nodes including MySQLD, use NdbApi to perform transactional operations and queries on data. Most Application Nodes are themselves Servers for various client protocols
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Availability 16 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Redundancy for availability - All nodes in each nodegroup store the same data - Can survive data node failures so long as one node per nodegroup is available. - Load balanced, Synchronous 2PC, heartbeating, automatic failover, recovery P C A Redundant components MySQL Cluster is a CP system in that consistency is favoured over availability. Async replication between clusters gives AP properties NdbApi protocol
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Availability 17 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Redundancy for availability - Two (or more) management servers. - Used for configuration, node startup/shutdown, triggering backups, logging + 'split-brain' arbitration - Not critical – not involved in transaction processing / querying Redundant components Management nodes act as lightweight arbitrators, avoiding the cost of odd-sized data node quorums to cope with single failures. NdbApi protocol
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Availability 18 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Redundancy for availability - API nodes are stateless and consistent, can use n + m sparing with simple front end load balancing. - NdbApi automatically balances, fails over and back on data node failures. - Network needs no SPOF too – no single failure takes out > 1 cluster member. Redundant components NdbApi protocol Availability also comes from support for online operations : Schema changes, Hardware and OS upgrades, Software upgrades, Cluster scaling
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Out 19 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Performance + Capacity Online scale out of back end by adding whole node groups (Read + Write scaling) Data Nodes can be added online, while transactions and queries are running. Existing data is rebalanced across all nodegroups. NdbApi protocol
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Out 20 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Performance + Capacity Online scale out of back end by adding whole node groups (Read + Write scaling) Application Nodes can be added and removed online, all have equal, consistent access to the data stored by the data nodes. Performance + HA Online scale out of front end / Api nodes NdbApi protocol
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 21 Replication thread Main thread LDM instances Shared nothing TC instances Shared nothing Send threads Request processing threads TC and LDM threads do most work, must be well fed by Send + Receive threads Receive threads IO threads Connect threads Watchdog ndbmtdTC Transaction coordinator LDM Local data manager (Table + Index partitions) Generally no more than one request processing thread per [HT] core Data node
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 22 Replication thread Main thread LDM instances Shared nothing TC instances Shared nothing Send threads Request processing threads TC and LDM threads do most work, must be well fed by Send + Receive threads Receive threads IO threads Connect threads Watchdog ndbmtd Data node Configurable parallelism within a Data node TC Transaction coordinator LDM Local data manager (Table + Index partitions)
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 23 Application node Database / Persistence layer Business logic / State machines Protocol decoding Many* threads NdbApi API conn Clients Clients Clients libndbclient NdbApi calls Client protocol (mysql, memcached, ldap...) 'Protocol 6' API conn API conn Mysqld Memcached Node.js* Java Slapd ... - Can scale the number of threads to meet demand - Can scale the number of NdbApi connections to avoid bottlenecks
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 24 Application node Database / Persistence layer Business logic / State machines Protocol decoding Many* threads NdbApi API conn Clients Clients Clients libndbclient NdbApi calls Client protocol (mysql, memcached, ldap...) 'Protocol 6' API conn API conn Mysqld Memcached Node.js* Java Slapd ... - Can scale the number of threads to meet demand - Can scale the number of NdbApi connections to avoid bottlenecks
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 25 Distributed efficiency Protocol design, optimisation, packing, multiplexing. Data Distribution awareness Locality - Pushed down filtering and joining Coordination avoidance Non blocking reads Parallel commit Balance Hash partitioning Local efficiency OS call amortisation Non blocking execution Cache friendly data structures Lock free shared data structures Local data structures Multi granularity pools Scale Out Scale Up See MySQL Connect 2012 session 'Breakthrough performance with MySQL Cluster'
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 26 SQL joins, aggregates Optimisations build in layers NoSQL R/W of single rows NoSQL R/W of multi rows SQL R/W of multi rows MySQL Server SQL optimisations Distributed parallel filter + join Batching hints, distribution awareness, read removal Optimised 2PC, async APIs. Low level efficiency, Coordination avoidance Lower volume, more complex, bigger footprint Higher volume, simpler, smaller footprint
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 27 7.2 7.3 7.4 Feb 2012 1 billion NoSQL reads per minute Jun 2013 8.5x better performance per NdbApi connection Feb 2015 200 million NoSQL reads per second 50% better Sysbench read performance Jul 2012 1 billion writes per minute 2.5 million SQL statements per second
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 7.3 MySQL Cluster Performance 28 7.2 7.4 Data node Multiple Transaction Coordinator (TC) threads NdbApi Connection thread contention reduction Data node Scan + PK lookup optimisations, Send + Recv optimisations Regular improvements compound over releases ...
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 29 NoSQL Bulk benchmarks - Getting to millions of requests per second on a distributed system is often a matter of efficient multiplexing and demultiplexing of individual requests - Modern hardware is very capable and so it is important to keep out of the way, avoiding context switches, threads, lock contention, small messages, extra hops, and unnecessary communication or coordination. - Many small requests must be gathered together and handled in bulk, without adversely affecting latency or application semantics.
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 30 - Delivered as part of source distribution - Multithreaded C++ NdbApi application - Uses the asynchronous features of NdbApi which allow a single thread to participate in multiple concurrent database transactions. - Row operations using the full primary key - Can make use of NdbApi Distribution Awareness hints to minimise communication - Parameters : Number of API connections, Number of threads,  Number of parallel transactions per thread, Number of rows  per transaction, Number of columns, Size of each column,  Lockmode, Distribution Awareness, Thread partitioning … NoSQL benchmark tool flexAsynch Unlike e.g. MySQLD / Memcached, has no upstream clients to serve, so simpler Details : http://mikaelronstrom.blogspot.co.uk/2013/11/how-to-make-efficient-scalable-key.html
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 31 72 API client machines running flexAsynch 32 Data node machines running ndbmtd 1 Management node - 100 bytes data / read - 19 GB/s aggregate data read rate - 6.4 M reads/s per data node - 612 MB/s data node read rate - 2.86 M reads/s per client - 272 MB/s read per client
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 32 72 API client machines running flexAsynch 32 Data node machines running ndbmtd 1 Management node - 100 bytes data / read - 19 GB/s aggregate data read rate - 6.4 M reads/s per data node - 612 MB/s data node read rate - 2.86 M reads/s per client - 272 MB/s read per client 216 NdbApi connections 18,432 client threads > 10 million concurrent reads 384 TC threads 384 LDM threads
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 33 The Infiniband CloudTM 10 million conc. reads 72 x 256 threads 72 x 3 API connections flexAsynch ndbmtd 32 x 12 TC + LDM threads > 100 GB data
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 34 The Infiniband CloudTM flexAsynch ndbmtd Not distribution aware, extra hop to data
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 35 The Infiniband CloudTM flexAsynch ndbmtd Distribution aware, minimal hops
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 36 The Infiniband CloudTM flexAsynch ndbmtd Distribution aware, minimal hops Batching of requests
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 37 The Infiniband CloudTM flexAsynch ndbmtd Distribution aware, minimal hops Batching of requests Partitioned client threads
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 38 Intel hardware lab (Thanks!) 105 machines, each with 28 cores (56 HT threads) - 2 sockets Intel Xeon 'Haswell' E5- 2697 v3 processors Each socket : - 14 cores (28 HT threads) - 2.6GHz base, 3.6GHz turbo - 35MB LLC - 64GB DDR4 memory - Infiniband + Gig Ethernet 56 Gbps switched Infiniband network. ~1 Tbps bisection bandwidth Software configuration Data nodes : - 12 LDM threads (non-HT) - 12 TC threads (HT) - 2 Send threads (non-HT) - 8 Receive threads (HT) - MaxSendDelay config API nodes : - 3 NdbApi connections per client machine - 256 flexAsynch threads per client machine Scripts : https://dev.mysql.com/downloads/benchmarks.html
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster NoSQL Scale Out 39 0 5 10 15 20 25 30 35 0 50 100 150 200 250 Data node throughput scaling Million NoSQL reads/s as number of data nodes scales Number of Data nodes Millionreads/s 0 20 40 60 80 100 120 140 160 180 0 20 40 60 80 100 120 140 160 180 API connection scaling Million NoSQL reads/s as API connections scale @ 24 data nodes Number of Api connections Millionreads/s API node scaling saturates Data nodes with Infiniband interrupts Near-linear scaling, 92% efficiency at 32 nodes Infiniband adapters configred for latency rather than throughput, but benchmarks reached within 10% of maximum throughput in any case
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Getting started with MySQL Cluster 40 Try Cluster at OOW! Benedita's Hands-on Lab on Thursday morning Getting started video on YouTube https://www.youtube.com/watch?v=4OixfzhOJoA QuickStart whitepaper http://downloads.mysql.com/tutorials/cluster/mysql_wp_cluster_quickstart.pdf MySQL Cluster 'Getting Started' page https://www.mysql.com/products/cluster/start.html education.oracle.com MySQL Cluster courses
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Getting started with MySQL Cluster 41 Tips Start small and simple - Minimal nodes + configuration - (< 10M concurrent reads!) - Start on localhost to rule out firewall issues Get it up and running, then add complexity Experiment with mysql / mysqld, node failures, applications Consider using MySQL Cluster Manager (https://edelivery.oracle.com) Ask for help : forums.mysql.com F1 F4 F4 F1 My laptop
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 42 Classroom Training Learning Subscription Live Virtual Class Training On Demand Keep Learning with Oracle University education.oracle.com Cloud Technology Applications Industries
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Keynote: Monday, 4.00-6.00 pm, YBCA Theater State of the Dolphin 43 • Rich Mason, SVP & General Manager MySQL GBU, Oracle • Tomas Ulin, VP MySQL Engineering, Oracle Customer Experiences Hari Tatrakal, Director of Database Services, Live Nation Olaniyi Oshinowo, MySQL & Open Source Technologies Leader, GE Ernie Souhrada & Rob Wultsch, Database Engineers, Pinterest
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance Gains 44 Synchronous API - Operation definition and execution are separated. - Single user thread can define a batch of operations, then execute them together, with only one API ↔ DB round trip - A transaction can contain one or more batches of operations. - 1 user thread : 1 executing transaction Asynchronous API adds : - Single user thread can define, execute and wait for the results of multiple independent transactions. - 1 user thread : n executing transactions Async Api allows the number of client threads to be reduced giving efficiency gains.

More Related Content

PPTX
مقدمة الحاسب للاطفال
byhessah_8s
 
PDF
Cümlənin quruluşca növləri
bymimio_azerbaijan
 
PDF
Qoşma
bymimio_azerbaijan
 
PPTX
Monetizing Big Data at Telecom Service Providers
byDataWorks Summit
 
PDF
MySQL Cluster overview + development slides (2014)
byFrazer Clement
 
PDF
MySQL Cluster
byMario Beck
 
PPTX
What's new in MySQL Cluster 7.4 webinar charts
byAndrew Morgan
 
PDF
MySQL Cluster as Transactional NoSQL (KVS)
byRyusuke Kajiyama
 
مقدمة الحاسب للاطفال
byhessah_8s
 
Cümlənin quruluşca növləri
bymimio_azerbaijan
 
Qoşma
bymimio_azerbaijan
 
Monetizing Big Data at Telecom Service Providers
byDataWorks Summit
 
MySQL Cluster overview + development slides (2014)
byFrazer Clement
 
MySQL Cluster
byMario Beck
 
What's new in MySQL Cluster 7.4 webinar charts
byAndrew Morgan
 
MySQL Cluster as Transactional NoSQL (KVS)
byRyusuke Kajiyama
 

Similar to 200 million qps on commodity hardware : Getting started with MySQL Cluster 7.4

PDF
NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013
byAndrew Morgan
 
PDF
NoSQL and MySQL
byTed Wennmark
 
PDF
20141011 my sql clusterv01pptx
byIvan Ma
 
PPTX
MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)
byAndrew Morgan
 
PDF
MySQL InnoDB Cluster - A complete High Availability solution for MySQL
byOlivier DASINI
 
PDF
MySQL cluster 7.4
byMark Swarbrick
 
PDF
Netherlands Tech Tour 03 - MySQL Cluster
byMark Swarbrick
 
PDF
Mysql wp cluster_evalguide
byKaizenlogcom
 
PPT
2010 12 mysql_clusteroverview
byDimas Prasetyo
 
PDF
MySQL Day Paris 2016 - MySQL HA: InnoDB Cluster and NDB Cluster
byOlivier DASINI
 
PPTX
OUG Scotland 2014 - NoSQL and MySQL - The best of both worlds
byAndrew Morgan
 
PDF
Mysql NDB Cluster's Asynchronous Parallel Design for High Performance
byBernd Ocklin
 
PDF
Introduction to MySQL
byTed Wennmark
 
PDF
MySQL 5.7 InnoDB Cluster (Jan 2018)
byOlivier DASINI
 
PDF
MySQL InnoDB Cluster and NDB Cluster
byMario Beck
 
PDF
MySQL InnoDB Cluster - Meetup Oracle MySQL / AFUP Paris
byOlivier DASINI
 
PDF
Exploring mysql cluster 7.4
byIvan Ma
 
ODP
MySQL Cluster
byAbel Flórez
 
PDF
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
bySanto Leto
 
PDF
2_MySQL_Cluster_Introduction.pdf
byHaiping Li
 
NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013
byAndrew Morgan
 
NoSQL and MySQL
byTed Wennmark
 
20141011 my sql clusterv01pptx
byIvan Ma
 
MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)
byAndrew Morgan
 
MySQL InnoDB Cluster - A complete High Availability solution for MySQL
byOlivier DASINI
 
MySQL cluster 7.4
byMark Swarbrick
 
Netherlands Tech Tour 03 - MySQL Cluster
byMark Swarbrick
 
Mysql wp cluster_evalguide
byKaizenlogcom
 
2010 12 mysql_clusteroverview
byDimas Prasetyo
 
MySQL Day Paris 2016 - MySQL HA: InnoDB Cluster and NDB Cluster
byOlivier DASINI
 
OUG Scotland 2014 - NoSQL and MySQL - The best of both worlds
byAndrew Morgan
 
Mysql NDB Cluster's Asynchronous Parallel Design for High Performance
byBernd Ocklin
 
Introduction to MySQL
byTed Wennmark
 
MySQL 5.7 InnoDB Cluster (Jan 2018)
byOlivier DASINI
 
MySQL InnoDB Cluster and NDB Cluster
byMario Beck
 
MySQL InnoDB Cluster - Meetup Oracle MySQL / AFUP Paris
byOlivier DASINI
 
Exploring mysql cluster 7.4
byIvan Ma
 
MySQL Cluster
byAbel Flórez
 
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
bySanto Leto
 
2_MySQL_Cluster_Introduction.pdf
byHaiping Li
 

More from Frazer Clement

PDF
MySQL Cluster Local Checkpoint (LCP) evolution in 7.6 (2019)
byFrazer Clement
 
PDF
MySQL Cluster Schema management (2014)
byFrazer Clement
 
PDF
MySQL Cluster page management (2014)
byFrazer Clement
 
PDF
MySQL Cluster Asynchronous replication (2014)
byFrazer Clement
 
PDF
Breakthrough performance with MySQL Cluster (2012)
byFrazer Clement
 
PDF
MySQL Cluster 8.0 tutorial text
byFrazer Clement
 
PDF
MySQL Cluster 8.0 tutorial
byFrazer Clement
 
MySQL Cluster Local Checkpoint (LCP) evolution in 7.6 (2019)
byFrazer Clement
 
MySQL Cluster Schema management (2014)
byFrazer Clement
 
MySQL Cluster page management (2014)
byFrazer Clement
 
MySQL Cluster Asynchronous replication (2014)
byFrazer Clement
 
Breakthrough performance with MySQL Cluster (2012)
byFrazer Clement
 
MySQL Cluster 8.0 tutorial text
byFrazer Clement
 
MySQL Cluster 8.0 tutorial
byFrazer Clement
 

Recently uploaded

PDF
apidays Australia 2025 | Build Your First MCP Server with Postman Flows
byapidays
 
PDF
Image and video processing: From Mars to Hollywood with a stop at the hospita...
byHarinath Palavalli
 
PDF
Build a Scalable On-Demand Courier Service App
byV3CUBE TECHNOLABS
 
PPTX
SAP S4 HANA Conversion and Migration .pptx
bysabeenakouser
 
PDF
Monitoring your MySQL Server's Health Trends
byIgor Donchovski
 
PDF
JFokus 2026 - Please pass the salt- Serve up passwords with a side of entropy...
byOrtus Solutions, Corp
 
PDF
Azure DevOps Services: Complete Guide to DevOps Tools, Automation & End-to-En...
byjohncarterjn
 
PDF
Track Phone Location Free by Number (2026)_ What’s Real, What’s a Scam, and t...
byRachel Green
 
PDF
software architecture for busy developers
byMuhammadAwaisQaisran
 
PPTX
Edison MuleSoft Meetup : Vibe Coding | MuleSoft Meetups
bySravan Lingam
 
PDF
Track Phone Location Android (2026)_ What Actually Works, What’s New, and the...
byRachel Green
 
PPTX
Device Repair and Maintenance Management
byAxisTechnolabs
 
PDF
On Demand Grocery Delivery App Development
byV3CUBE TECHNOLABS
 
PDF
Artificial Intelligence Planning (Harinath Palavalli)
byHarinath Palavalli
 
PPTX
Best Digital Marketing Company in Lucknow
bydigitallearning9277
 
PDF
apidays Amsterdam 2025 | Making AI work for you as an API Product Manager
byapidays
 
PPTX
BUSY Software Business Management Solution.pptx
byMoving Cloud
 
PDF
apidays Amsterdam 2025 | APIs with a Purpose
byapidays
 
PDF
Animated Safety Induction: A Smarter Way to Onboard for Workplace Safety
byTECH EHS Solution
 
PDF
20260201 [FOSDEM] gomodjail - library sandboxing for Go modules.pdf
byAkihiro Suda
 
apidays Australia 2025 | Build Your First MCP Server with Postman Flows
byapidays
 
Image and video processing: From Mars to Hollywood with a stop at the hospita...
byHarinath Palavalli
 
Build a Scalable On-Demand Courier Service App
byV3CUBE TECHNOLABS
 
SAP S4 HANA Conversion and Migration .pptx
bysabeenakouser
 
Monitoring your MySQL Server's Health Trends
byIgor Donchovski
 
JFokus 2026 - Please pass the salt- Serve up passwords with a side of entropy...
byOrtus Solutions, Corp
 
Azure DevOps Services: Complete Guide to DevOps Tools, Automation & End-to-En...
byjohncarterjn
 
Track Phone Location Free by Number (2026)_ What’s Real, What’s a Scam, and t...
byRachel Green
 
software architecture for busy developers
byMuhammadAwaisQaisran
 
Edison MuleSoft Meetup : Vibe Coding | MuleSoft Meetups
bySravan Lingam
 
Track Phone Location Android (2026)_ What Actually Works, What’s New, and the...
byRachel Green
 
Device Repair and Maintenance Management
byAxisTechnolabs
 
On Demand Grocery Delivery App Development
byV3CUBE TECHNOLABS
 
Artificial Intelligence Planning (Harinath Palavalli)
byHarinath Palavalli
 
Best Digital Marketing Company in Lucknow
bydigitallearning9277
 
apidays Amsterdam 2025 | Making AI work for you as an API Product Manager
byapidays
 
BUSY Software Business Management Solution.pptx
byMoving Cloud
 
apidays Amsterdam 2025 | APIs with a Purpose
byapidays
 
Animated Safety Induction: A Smarter Way to Onboard for Workplace Safety
byTECH EHS Solution
 
20260201 [FOSDEM] gomodjail - library sandboxing for Go modules.pdf
byAkihiro Suda
 

200 million qps on commodity hardware : Getting started with MySQL Cluster 7.4

  • 1.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. |
  • 2.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. |Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | OpenWorld 2015 200 Million QPS on Commodity Hardware Getting Started with MySQL Cluster 7.4 Frazer Clement MySQL Cluster Technical Lead Bernd Ocklin Director, MySQL Cluster Engineering October 26th, 2015 Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
  • 3.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | 200 Million QPS on Commodity Hardware Getting started with MySQL Cluster 7.4 Users, Features and Releases1 2 3 4 3 Design for Availability and Scale Performance, getting to 200M queries/second How to get started with MySQL Cluster
  • 4.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
  • 5.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | Keynote: Monday, 4.00-6.00 pm, YBCA Theater State of the Dolphin 5 • Rich Mason, SVP & General Manager MySQL GBU, Oracle • Tomas Ulin, VP MySQL Engineering, Oracle Customer Experiences Hari Tatrakal, Director of Database Services, Live Nation Olaniyi Oshinowo, MySQL & Open Source Technologies Leader, GE Ernie Souhrada & Rob Wultsch, Database Engineers, Pinterest
  • 6.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster content @ OpenWorld Fully Elastic Real- Time Services with MySQL Cluster Bernd Ocklin, Oracle Conference Session Tuesday 11am. Moscone South, 262 MySQL Server and MySQL Cluster at India’s Financial Inclusion Gateway Service NEC et al Conference Session Tuesday 5.15pm Moscone South, 250 Get Started with MySQL Cluster Benedita Vasconcelos, Oracle Hands On Lab Thursday, 9.30am Hotel Nikko - Peninsula 6
  • 7.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Community Reception @ OpenWorld Celebrate, Have Fun and Mingle with Oracle’s MySQL Engineers & Your Peers 7 • Tuesday, October 27th , 7 pm • Jillian’s at Metreon: 175 Fourth Street, San Francisco CA94103 At the corner of Howard and 4th st.; only 2-min walk from Moscone Center (same place as last year) Join us!
  • 8.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster deployments 8 Web Telecoms High volume OLTP eCommerce On-Line Gaming Digital Marketing User Profile Management Session Management & Caching Service Delivery Platforms VAS: VoIP, IPTV & VoD Mobile Content Delivery Mobile Payments Other Online gaming : AAA + profile management Payment fraud detection Many more, some unknown DBMS research
  • 9.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | Who's using MySQL Cluster? 9
  • 10.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster highlights 10 High Throughput Reads & Writes Carrier-Grade Availability Real-Time Responsiveness On-Line, Linear Scalability Low TCO, Open platform Distributed, Parallel architecture Transactional, ACID-compliant relational database Shared-nothing design, synchronous data replication Sub-second failover & self-healing recovery Data structures optimized for RAM. Real-time extensions Predictable low latency, bounded access times Incrementally scale out, scale up and scale on-line Linearly scale with distribution awareness GPL & Commercial editions, scale on COTS Flexible APIs: SQL, C++, Java, OpenJPA, LDAP & HTTP
  • 11.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster highlights 11 SQL Joins, Foreign Keys, Transactions, Row locks, Triggers, Views, Stored procedures, Blobs, keyless tables, newSQL, MySQL compatible... connectors for most languages, ORMs etc... NoSQL Full C++ Api for best control and performance (MySQLD SE built on top), Other Apis : Java, JPA, Node.js, Memcache.... HA 99.999% uptime systems (five nines), No single point of failure (SPOF), Heartbeating, cluster membership, automatic failover + recovery, automatic client failover, transactional DDL, CP, async replication, advanced exception logging... Performance and parallelism High throughput, low bounded latency (200M read tx/s). Batching, optimised protocols, Intra and Inter query parallelism, pushed parallel filters, pushed parallel joins, non-blocking event driven multithreaded.... HA, High performance, Relational, Transactional, Distributed, Parallel, SQL, NoSQL, Shared-Nothing, Commodity ...
  • 12.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster highlights 12 Scalability Scale-out nodegroups or stateless API clients online, Scale-up data nodes and clients online with multithreading, scale up hardware online Replication Synchronous two phase commit internally, Transactional HA async replication between clusters, conflict detection+resolution... Storage Data transparently distributed and balanced by hash, Indexed columns in memory, others on disk or memory, Secondary unique and ordered indexes, Redundant Redo logs and periodic checkpoints... Manageability Online add + drop (index, column), Online consistent backup, Online upgrade, Online OS or hardware upgrade, consolidated cluster logs, C management Api for tooling... Shared nothing, Commodity No need for shared storage, In-memory data uses disk frugally, TCP over Ethernet / Infiniband etc, No special layer 2 requirements. Open source. HA, High performance, Relational, Transactional, Distributed, Parallel, SQL, NoSQL, Shared-Nothing, Commodity ...
  • 13.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | 7.3 MySQL Cluster Releases 13 7.2 7.4 - Distributed parallel joins - Multi-TC - Active-Active - Memcached - MySQL Server 5.5 - Foreign keys - Client lib performance - node.js - MySQL Server 5.6 - Restart performance - Active-Active - Internal reporting - MySQL Server 5.6 Regular fixes and improvements 2012 2013 2014 2015 ... MySQL Cluster is built on top of and tracks GA MySQL Server releases, gaining their features, optimisations and bug fixes.
  • 14.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 7.4 Active-Active replication enhancements 1 System restart and maintenance activities parallelised Improved observability and manageability 14 Performance optimisations in the data node kernel More detail and download links at dev.mysql.com
  • 15.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture 15 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 NdbApi protocol Tables and Indices are horizontally partitioned, distributed across and replicated within the NodeGroups. Application Nodes including MySQLD, use NdbApi to perform transactional operations and queries on data. Most Application Nodes are themselves Servers for various client protocols
  • 16.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Availability 16 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Redundancy for availability - All nodes in each nodegroup store the same data - Can survive data node failures so long as one node per nodegroup is available. - Load balanced, Synchronous 2PC, heartbeating, automatic failover, recovery P C A Redundant components MySQL Cluster is a CP system in that consistency is favoured over availability. Async replication between clusters gives AP properties NdbApi protocol
  • 17.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Availability 17 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Redundancy for availability - Two (or more) management servers. - Used for configuration, node startup/shutdown, triggering backups, logging + 'split-brain' arbitration - Not critical – not involved in transaction processing / querying Redundant components Management nodes act as lightweight arbitrators, avoiding the cost of odd-sized data node quorums to cope with single failures. NdbApi protocol
  • 18.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Availability 18 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Redundancy for availability - API nodes are stateless and consistent, can use n + m sparing with simple front end load balancing. - NdbApi automatically balances, fails over and back on data node failures. - Network needs no SPOF too – no single failure takes out > 1 cluster member. Redundant components NdbApi protocol Availability also comes from support for online operations : Schema changes, Hardware and OS upgrades, Software upgrades, Cluster scaling
  • 19.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Out 19 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Performance + Capacity Online scale out of back end by adding whole node groups (Read + Write scaling) Data Nodes can be added online, while transactions and queries are running. Existing data is rebalanced across all nodegroups. NdbApi protocol
  • 20.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Out 20 Data Nodes Node Group 1 F1 F4 F4 F1 Node Group 2 F2 F5 F5 F2 Application Nodes Cluster Mgmt Cluster Mgmt RESTJPA Node Group 3 F3 F6 F6 F3 F1 F2 F3 F4 F5 F6 Table 1 Performance + Capacity Online scale out of back end by adding whole node groups (Read + Write scaling) Application Nodes can be added and removed online, all have equal, consistent access to the data stored by the data nodes. Performance + HA Online scale out of front end / Api nodes NdbApi protocol
  • 21.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 21 Replication thread Main thread LDM instances Shared nothing TC instances Shared nothing Send threads Request processing threads TC and LDM threads do most work, must be well fed by Send + Receive threads Receive threads IO threads Connect threads Watchdog ndbmtdTC Transaction coordinator LDM Local data manager (Table + Index partitions) Generally no more than one request processing thread per [HT] core Data node
  • 22.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 22 Replication thread Main thread LDM instances Shared nothing TC instances Shared nothing Send threads Request processing threads TC and LDM threads do most work, must be well fed by Send + Receive threads Receive threads IO threads Connect threads Watchdog ndbmtd Data node Configurable parallelism within a Data node TC Transaction coordinator LDM Local data manager (Table + Index partitions)
  • 23.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 23 Application node Database / Persistence layer Business logic / State machines Protocol decoding Many* threads NdbApi API conn Clients Clients Clients libndbclient NdbApi calls Client protocol (mysql, memcached, ldap...) 'Protocol 6' API conn API conn Mysqld Memcached Node.js* Java Slapd ... - Can scale the number of threads to meet demand - Can scale the number of NdbApi connections to avoid bottlenecks
  • 24.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Architecture for Scale Up 24 Application node Database / Persistence layer Business logic / State machines Protocol decoding Many* threads NdbApi API conn Clients Clients Clients libndbclient NdbApi calls Client protocol (mysql, memcached, ldap...) 'Protocol 6' API conn API conn Mysqld Memcached Node.js* Java Slapd ... - Can scale the number of threads to meet demand - Can scale the number of NdbApi connections to avoid bottlenecks
  • 25.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 25 Distributed efficiency Protocol design, optimisation, packing, multiplexing. Data Distribution awareness Locality - Pushed down filtering and joining Coordination avoidance Non blocking reads Parallel commit Balance Hash partitioning Local efficiency OS call amortisation Non blocking execution Cache friendly data structures Lock free shared data structures Local data structures Multi granularity pools Scale Out Scale Up See MySQL Connect 2012 session 'Breakthrough performance with MySQL Cluster'
  • 26.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 26 SQL joins, aggregates Optimisations build in layers NoSQL R/W of single rows NoSQL R/W of multi rows SQL R/W of multi rows MySQL Server SQL optimisations Distributed parallel filter + join Batching hints, distribution awareness, read removal Optimised 2PC, async APIs. Low level efficiency, Coordination avoidance Lower volume, more complex, bigger footprint Higher volume, simpler, smaller footprint
  • 27.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 27 7.2 7.3 7.4 Feb 2012 1 billion NoSQL reads per minute Jun 2013 8.5x better performance per NdbApi connection Feb 2015 200 million NoSQL reads per second 50% better Sysbench read performance Jul 2012 1 billion writes per minute 2.5 million SQL statements per second
  • 28.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | 7.3 MySQL Cluster Performance 28 7.2 7.4 Data node Multiple Transaction Coordinator (TC) threads NdbApi Connection thread contention reduction Data node Scan + PK lookup optimisations, Send + Recv optimisations Regular improvements compound over releases ...
  • 29.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 29 NoSQL Bulk benchmarks - Getting to millions of requests per second on a distributed system is often a matter of efficient multiplexing and demultiplexing of individual requests - Modern hardware is very capable and so it is important to keep out of the way, avoiding context switches, threads, lock contention, small messages, extra hops, and unnecessary communication or coordination. - Many small requests must be gathered together and handled in bulk, without adversely affecting latency or application semantics.
  • 30.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance 30 - Delivered as part of source distribution - Multithreaded C++ NdbApi application - Uses the asynchronous features of NdbApi which allow a single thread to participate in multiple concurrent database transactions. - Row operations using the full primary key - Can make use of NdbApi Distribution Awareness hints to minimise communication - Parameters : Number of API connections, Number of threads,  Number of parallel transactions per thread, Number of rows  per transaction, Number of columns, Size of each column,  Lockmode, Distribution Awareness, Thread partitioning … NoSQL benchmark tool flexAsynch Unlike e.g. MySQLD / Memcached, has no upstream clients to serve, so simpler Details : http://mikaelronstrom.blogspot.co.uk/2013/11/how-to-make-efficient-scalable-key.html
  • 31.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 31 72 API client machines running flexAsynch 32 Data node machines running ndbmtd 1 Management node - 100 bytes data / read - 19 GB/s aggregate data read rate - 6.4 M reads/s per data node - 612 MB/s data node read rate - 2.86 M reads/s per client - 272 MB/s read per client
  • 32.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 32 72 API client machines running flexAsynch 32 Data node machines running ndbmtd 1 Management node - 100 bytes data / read - 19 GB/s aggregate data read rate - 6.4 M reads/s per data node - 612 MB/s data node read rate - 2.86 M reads/s per client - 272 MB/s read per client 216 NdbApi connections 18,432 client threads > 10 million concurrent reads 384 TC threads 384 LDM threads
  • 33.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 33 The Infiniband CloudTM 10 million conc. reads 72 x 256 threads 72 x 3 API connections flexAsynch ndbmtd 32 x 12 TC + LDM threads > 100 GB data
  • 34.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 34 The Infiniband CloudTM flexAsynch ndbmtd Not distribution aware, extra hop to data
  • 35.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 35 The Infiniband CloudTM flexAsynch ndbmtd Distribution aware, minimal hops
  • 36.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 36 The Infiniband CloudTM flexAsynch ndbmtd Distribution aware, minimal hops Batching of requests
  • 37.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 37 The Infiniband CloudTM flexAsynch ndbmtd Distribution aware, minimal hops Batching of requests Partitioned client threads
  • 38.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster 200 million NoSQL reads/s 38 Intel hardware lab (Thanks!) 105 machines, each with 28 cores (56 HT threads) - 2 sockets Intel Xeon 'Haswell' E5- 2697 v3 processors Each socket : - 14 cores (28 HT threads) - 2.6GHz base, 3.6GHz turbo - 35MB LLC - 64GB DDR4 memory - Infiniband + Gig Ethernet 56 Gbps switched Infiniband network. ~1 Tbps bisection bandwidth Software configuration Data nodes : - 12 LDM threads (non-HT) - 12 TC threads (HT) - 2 Send threads (non-HT) - 8 Receive threads (HT) - MaxSendDelay config API nodes : - 3 NdbApi connections per client machine - 256 flexAsynch threads per client machine Scripts : https://dev.mysql.com/downloads/benchmarks.html
  • 39.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster NoSQL Scale Out 39 0 5 10 15 20 25 30 35 0 50 100 150 200 250 Data node throughput scaling Million NoSQL reads/s as number of data nodes scales Number of Data nodes Millionreads/s 0 20 40 60 80 100 120 140 160 180 0 20 40 60 80 100 120 140 160 180 API connection scaling Million NoSQL reads/s as API connections scale @ 24 data nodes Number of Api connections Millionreads/s API node scaling saturates Data nodes with Infiniband interrupts Near-linear scaling, 92% efficiency at 32 nodes Infiniband adapters configred for latency rather than throughput, but benchmarks reached within 10% of maximum throughput in any case
  • 40.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | Getting started with MySQL Cluster 40 Try Cluster at OOW! Benedita's Hands-on Lab on Thursday morning Getting started video on YouTube https://www.youtube.com/watch?v=4OixfzhOJoA QuickStart whitepaper http://downloads.mysql.com/tutorials/cluster/mysql_wp_cluster_quickstart.pdf MySQL Cluster 'Getting Started' page https://www.mysql.com/products/cluster/start.html education.oracle.com MySQL Cluster courses
  • 41.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | Getting started with MySQL Cluster 41 Tips Start small and simple - Minimal nodes + configuration - (< 10M concurrent reads!) - Start on localhost to rule out firewall issues Get it up and running, then add complexity Experiment with mysql / mysqld, node failures, applications Consider using MySQL Cluster Manager (https://edelivery.oracle.com) Ask for help : forums.mysql.com F1 F4 F4 F1 My laptop
  • 42.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | 42 Classroom Training Learning Subscription Live Virtual Class Training On Demand Keep Learning with Oracle University education.oracle.com Cloud Technology Applications Industries
  • 43.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | Keynote: Monday, 4.00-6.00 pm, YBCA Theater State of the Dolphin 43 • Rich Mason, SVP & General Manager MySQL GBU, Oracle • Tomas Ulin, VP MySQL Engineering, Oracle Customer Experiences Hari Tatrakal, Director of Database Services, Live Nation Olaniyi Oshinowo, MySQL & Open Source Technologies Leader, GE Ernie Souhrada & Rob Wultsch, Database Engineers, Pinterest
  • 44.
    Copyright © 2015,Oracle and/or its affiliates. All rights reserved. | MySQL Cluster Performance Gains 44 Synchronous API - Operation definition and execution are separated. - Single user thread can define a batch of operations, then execute them together, with only one API ↔ DB round trip - A transaction can contain one or more batches of operations. - 1 user thread : 1 executing transaction Asynchronous API adds : - Single user thread can define, execute and wait for the results of multiple independent transactions. - 1 user thread : n executing transactions Async Api allows the number of client threads to be reduced giving efficiency gains.