MySQL Cluster Introduction& UpdateAndrew MorganMySQL High Availability – Product Management@andrewmorganwww.clusterdb.com1...
Safe Harbour Statement     The following is intended to outline our general product direction. It is     intended for info...
Table of Contents        MySQL Cluster – Introduction        Customer case studies        Architecture        MySQL Cl...
MySQL Cluster introduction               Carrier Grade                                                           • Shared-...
NoSQL – Why the demand?                                                                                                   ...
What NoSQL must deliver                                                                                                Ma...
Still a role for the RDBMS?       No best single solution        fits all                                                ...
Scalability                                                                                      a                        ...
Who’s Using MySQL Cluster?9   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | ...
10   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right...
CUSTOMER PERSPECTIVE COMPANY OVERVIEW                                                                                     ...
PLAYFUL PLAY OVERVIEW                                                                                                     ...
Playful Play Architecture                                                                                                 ...
USER PERSPECTIVE                                                                                                          ...
15   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right...
MySQL Cluster Architecture                                                                                                ...
MySQL Cluster Architecture                                                                                                ...
MySQL Cluster Architecture                                                                                                ...
On-line Scheduled Maintenance                                                     Scale                                   ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
Automatic Data Partitioning                                                                                               ...
writes35   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the...
MySQL Cluster 7.2 GA                   Enabling Next Generation Web Services                   • 70x Higher Complex Query ...
Comparing MySQL Cluster Performance           8x Higher Performance per Node                                              ...
1.2 Billion UPDATEs per Minute                                                                                            ...
Adaptive Query Localization                                                                                               ...
MySQL Cluster 7.2 AQL Test Query         Web-Based Content Management System40   Copyright © 2012, Oracle and/or its affil...
Web-Based CMS                                                                                                             ...
NoSQL Access to MySQL Cluster data     Apps           Apps               Apps               Apps               Apps       ...
MySQL Cluster 7.1: ClusterJ/JPA                                                                                       •   ...
MySQL Cluster 7.2: Memcached                                                                                       •      ...
Traditional Memcached Architecture       Two levels of hashing        httpd                                               ...
Memcache Protocol Elements• Key                                                             Up to 250 characters• Expire T...
Memcache Protocol Commands (1)• get key                 Fetch value for this key•    set key value        Store this data•...
Memcache Protocol Commands (2)• append key value                                                                          ...
NDB & Memcache Architecture:      Memcache protocol + NDB storage                                                         ...
Goals     • Access stored data directly from memcache client               • Memcached perspective:                       ...
Memcached/MySQL Cluster latency                                                                                           ...
Cluster & Memcached – Schema-Free                                                                                         ...
Cluster & Memcached – Configured Schema                                                                                   ...
54   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right...
Multi-Site Clustering                                                                                                     ...
Active/Active Geographic Replication                                                                                      ...
57   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right...
Simplified Provisioning & Maintenance       User Privilege Consolidation58   Copyright © 2012, Oracle and/or its affiliate...
59   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right...
DMR160   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the r...
EA61   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the rig...
EA62   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the rig...
63   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right...
MySQL Cluster 7.3 DMR1: Foreign Keys Brings MySQL Cluster to a broader range of workloads       – Packaged apps, custom p...
MySQL Cluster 7.3 DMR1: Foreign Keys Implementation goal: compatibility with InnoDB       – Easy migration of solutions a...
MySQL Cluster 7.3 DMR1: Foreign Keys66   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h Octo...
Downloading MySQL Cluster 7.3 DMR                                                                                         ...
MySQL Cluster 7.3 EA: Node.js NoSQL API                                                                                   ...
MySQL Cluster 7.3 EA: Auto-Installer Fast configuration                                                                  ...
Define Hosts  70   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle rese...
Auto-Discovery  71   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle re...
Modify hosts  72   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle rese...
Define nodes  73   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle rese...
Refine config  74   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle res...
Deploy  75   Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves t...
Downloading MySQL Cluster EA                                                                                              ...
MySQL Cluster Manager            Enhancing DevOps Agility, Reducing Downtime               Automated                      ...
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
MySQL Cluster 7.2 e 7.3 - por Andrew Morgan
Upcoming SlideShare
Loading in...5
×

MySQL Cluster 7.2 e 7.3 - por Andrew Morgan

1,176

Published on

Uma visão geral dada por Andrew Morgan, gerente de produto do MySQL Cluster. Aborada a versão atual 7.2 (GA) e na próxima versão 7.3 (Development Milestone Release), além do roadmap para versões futuras.

Published in: Art & Photos
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,176
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
26
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

MySQL Cluster 7.2 e 7.3 - por Andrew Morgan

  1. 1. MySQL Cluster Introduction& UpdateAndrew MorganMySQL High Availability – Product Management@andrewmorganwww.clusterdb.com17th October 2012
  2. 2. Safe Harbour Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.2 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  3. 3. Table of Contents  MySQL Cluster – Introduction  Customer case studies  Architecture  MySQL Cluster 7.2 (GA)  MySQL Cluster 7.3 (DMR & labs)  Commercial additions  The future3 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  4. 4. MySQL Cluster introduction Carrier Grade • Shared-nothing in-memory parallel database server Database • ACID compliant relational database • Five nines (99.999%) availability Highly Available • Self-healing, sub-second failover Real-time • High load, real-time performance Performance • Predictable low latency, bounded access times • Incrementally grow out with application demands Linearly Scalable • Linearly scale with distribution awareness • Open Source, multiple data access Open Development • High performance APIs (C++, Java, SQL, LDAP)4 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  5. 5. NoSQL – Why the demand? 2.1BN USERS Web applications 8X DATA GROWTH IN 5 YRS 900M USERS demanding: 40% DATA 70+ NEW DOMAINS EVERY 60 SECONDS 20M APPS PER DAY  Development velocity: GROWTH PER YEAR 60 HOURS Simplicity & flexibility of UPLOADED EVERY MINUTE data model & APIs  Scalability & $1TR BY 2014 350m TWEETS performance: high write PER DAY $700BN IN 2011 throughput and Key/Value access  Support for “Big Data” 5.9BN MOBILE SUBS IN 2011 1 BILLION iOS & ANDROID 85% HANDSETS SHIPPED WITH A APPS DOWNLOADED PER WEEK BROWSER 5 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  6. 6. What NoSQL must deliver  Massive scalability  No application-level sharding  Performance Scalability  High Availability/Fault Tolerance Performance  Ease of use HA  Simple operations/administration Ease of use  Simple APIs  Quickly evolve application & schema6 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  7. 7. Still a role for the RDBMS? No best single solution fits all NoSQL RDBMS Mix and match Simple access patterns Complex queries with joins Scalability Compromise on consistency Performance ACID transactions for performance HA Ad-hoc data format Well defined schemas Ease of use SQL/Joins Simple operation Rich set of tools ACID Transactions 7 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  8. 8. Scalability a Performance a HA a Ease of use a SQL/Joins a ACID Transactions a8 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  9. 9. Who’s Using MySQL Cluster?9 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  10. 10. 10 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  11. 11. CUSTOMER PERSPECTIVE COMPANY OVERVIEW “MySQL Cluster won the performance test  Leading provider of communications hands-down, and it fitted our needs perfectly. platforms, solutions & services We evaluated shared-disk clustered  €15.2bn Revenues (2009), 77k employees databases, but the cost would have been at across 130 countries least 10x more.” -- François Leygues, Systems Manager CHALLENGES / OPPORTUNITIES  Converged services driving migration to next generation HLR / HSS systems Results  New IMS platforms for Unified  Scale out on standard ATCA hardware to support 60m+ subscribers on a single Communications platform  Reduce cost per subscriber and accelerate  Low latency, high throughput with 99.999%+ time to value availability  Enabled customers to reduce cost per SOLUTION subscriber and improve margins  MySQL Cluster Carrier Grade Edition  Delivered data management solution at 10x  MySQL Support & Consulting Services less cost than alternativeshttp://www.mysql.com/why-mysql/case-studies/mysql-alcatel-casestudy.php 11 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release 11
  12. 12. PLAYFUL PLAY OVERVIEW CUSTOMER PERSPECTIVE Developer of Latin America’s most popular FaceBook game "The MySQL support service has been essential in Based on El Chavo, massive success in LatAM, US and Spain helping us for troubleshooting and giving recommendations for the production cluster, Thanks"CHALLENGES / OPPORTUNITIES Carlos Morales – DBA, Playfulplay.com México 2m users in 4 months, growing at 30k per day Targeting 50m users in 5 years SOLUTIONS • MySQL Cluster Carrier Grade Edition Massive scale, especially of database writes • MySQL Cluster Manager 99.999% uptime • MySQL Support & Consulting Services Data integrityDATABASE REQUIREMENTS RESULTS 10k TPS on commodity hardware, in the cloud • 45% improvement in performance Managing user avatars and sessions • 80% reduction in DBA overhead In-App Purchases • 99.999% uptime Digital marketing + user response datahttps://blogs.oracle.com/MySQL/entry/mysql_cluster_powers_el_chavo 12 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  13. 13. Playful Play Architecture MySQL Cluster Co-Located MySQL Servers + Data Nodeshttps://apps.facebook.com/lavecindaddeelchavo/ 13 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  14. 14. USER PERSPECTIVE “MySQL Cluster exceeds our requirements for low latency, high throughput performance with COMPANY OVERVIEW continuous availability, in a single solution that  Division of Docudesk minimizes complexity and overall cost.”  Deliver Document Management SaaS -- Casey Brown, Manager of Dev & DBA Services, CHALLENGES / OPPORTUNITIES Docudesk  Provide a single repository for customers to manage, archive, and distribute documents Results  Implement scalable, fault tolerant, real time data  Successfully deployed document management back-end management solution, eliminating paper  PHP session state cached for in-service trails from legal processes personalization  Integrate caching and database into one  Store document meta-data, text (as BLOBs), layer, reducing complexity & cost ACL, job queues and billing data  Support workload with 50:50 read/write ratio  Data volumes growing at 2% per day  Low latency for real-time user experience and document time-stamping SOLUTION  Continuous database availability  MySQL Cluster deployed on EC2http://www.mysql.com/customers/view/?id=1160 14 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release 14
  15. 15. 15 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  16. 16. MySQL Cluster Architecture Clients Application Layer Data LayerManagement MySQL Cluster Data Nodes 16 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  17. 17. MySQL Cluster Architecture Clients Application Layer Data LayerManagement Management MySQL Cluster Data Nodes 17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  18. 18. MySQL Cluster Architecture Clients Application Layer Data LayerManagement Management MySQL Cluster Data Nodes 18 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  19. 19. On-line Scheduled Maintenance Scale Backup Evolve Upgrade19 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  20. 20. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 Px Partition P1 Data Node 2 P2 P3 Data Node 3 P4 Data Node 4 A fragment is a copy of a partitionNumber of fragments = # of partitions * # of replicas20 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  21. 21. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 Px Partition P1 Data Node 2 P2 P3 Data Node 3 P4 Fx Primary Fragment Data Node 4 Fx Secondary Fragment21 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  22. 22. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 Px Partition P1 Data Node 2 P2 F1 P3 Data Node 3 P4 Fx Primary Fragment Data Node 4 Fx Secondary Fragment22 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  23. 23. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 Px Partition P1 Data Node 2 P2 F3 F1 P3 Data Node 3 P4 Fx Primary Fragment Data Node 4 Fx Secondary Fragment23 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  24. 24. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Data Node 2 P2 F3 F1 P3 Data Node 3 P4 Fx Primary Fragment Data Node 4 Fx Secondary Fragment24 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  25. 25. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 P4 Fx Primary Fragment Data Node 4 Fx Secondary Fragment25 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  26. 26. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 P4 Fx Primary Fragment Data Node 4 F2 Fx Secondary Fragment26 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  27. 27. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 P4 Fx Primary Fragment Data Node 4 F4 F2 Fx Secondary Fragment27 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  28. 28. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 F4 P4 Fx Primary Fragment Data Node 4 F4 F2 Fx Secondary Fragment28 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  29. 29. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Node Group 1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 F4 P4 Fx Primary Fragment Data Node 4 F4 F2 Fx Secondary Fragment29 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  30. 30. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Node Group 1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 F4 P4 Node Group 2 Fx Primary Fragment Data Node 4- Node groups are created automatically F4 F2 Fx Secondary Fragment - # of groups = # of data nodes / # of replicas 30 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  31. 31. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Node Group 1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 F4 P4 Node Group 2 Fx Primary Fragment Data Node 4 As long as one data node in each F4 F2 node group Fx Secondary Fragmentis running we have a complete copy of the data 31 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  32. 32. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Node Group 1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 F4 P4 Node Group 2 Fx Primary Fragment Data Node 4 As long as one data node in each F4 F2 node group Fx Secondary Fragmentis running we have a complete copy of the data 32 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  33. 33. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Node Group 1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 F4 P4 Node Group 2 Fx Primary Fragment Data Node 4 As long as one data node in each F4 F2 node group Fx Secondary Fragmentis running we have a complete copy of the data 33 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  34. 34. Automatic Data Partitioning 4 Partitions * 2 Replicas = 8 Fragments Table T1 Data Node 1 F1 F3 Px Partition P1 Node Group 1 Data Node 2 P2 F3 F1 P3 Data Node 3 F2 F4 P4 Node Group 2- No complete copy of the Fx Primary Fragment Data Node 4 data F4 F2 Fx Secondary Fragment - Cluster shutdowns automatically 34 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  35. 35. writes35 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  36. 36. MySQL Cluster 7.2 GA Enabling Next Generation Web Services • 70x Higher Complex Query Performance: Adaptive Query Localization • Native Memcached API • MySQL 5.5 Server Integration • Multi-Threaded Data Node Extensions • VM Support Enhancing Cross Data Center Scalability • Multi-Site Clustering • Simplified Active / Active Replication Ease of Use • MySQL Cluster Manager 1.1 • Consolidated Privileges36 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  37. 37. Comparing MySQL Cluster Performance 8x Higher Performance per Node 20• 1 Billion+ Reads per 18 Minute, 8 node Intel Reads per Second (Millions) 16 Xeon cluster 14 12• Multi-Threaded Data 10 Node Extensions 8 6• NoSQL C++ API, 4 flexaSynch benchmark 2 0 MySQL Cluster 7.1 MySQL Cluster 7.2 37 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  38. 38. 1.2 Billion UPDATEs per Minute 25 Millions of UPDATEs per Second 20• 30 x Intel E5-2600 Intel Servers 15• NoSQL C++ API, flexaSynch benchmark 10• ACID Transactions, with 5 Synchronous Replication 0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 MySQL Cluster Data Nodes 38 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  39. 39. Adaptive Query Localization 70x Scaling Distributed Joins More Performance• Perform Complex Queries across Shards • JOINs pushed down to data nodes mysqld • Executed in parallel Data Nodes A • Returns single result set Q to MySQL L• Opens Up New Use-Cases • Real-time analytics • Recommendations engines mysqld • Analyze click-streams Data Nodes 39 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  40. 40. MySQL Cluster 7.2 AQL Test Query Web-Based Content Management System40 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  41. 41. Web-Based CMS 70x Query Execution Time Seconds More 100 Performance 90 80 87.23 seconds 70 60 50 40 30 20 10 1.26 seconds 0 MySQL Cluster 7.1 MySQL Cluster 7.2Must Analyze tables for best resultsmysql> ANALYZE TABLE <tab-name>; 41 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  42. 42. NoSQL Access to MySQL Cluster data Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps JPA ClusterJPA PHP PERL Python Ruby JDBC ClusterJ JSON Apache Memcached MySQL JNI Node.js mod-ndb ndb-eng NDB API (C++) MySQL Cluster Data Nodes42 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  43. 43. MySQL Cluster 7.1: ClusterJ/JPA • Domain Object Model Persistence API (ClusterJ): • Java API • High performance, low latency • Feature rich • JPA interface built upon this new Java layer: • Java Persistence API compliant • Implemented as an OpenJPA plugin • Uses ClusterJ where possible, reverts to JDBC for some operations • Higher performance than JDBC • More natural for most Java designers • Easier Cluster adoption for web applications43 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  44. 44. MySQL Cluster 7.2: Memcached • Memcached is a distributed memory based hash- key/value store with no persistence to disk • NoSQL, simple API, popular with developers • MySQL Cluster already provides scalable, in- memory performance with NoSQL (hashed) access as well as persistence • Provide the Memcached API but map to NDB API calls • Writes-in-place, so no need to invalidate cache • Simplifies architecture as caching & database integrated into 1 tier • Access data from existing relational tables44 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  45. 45. Traditional Memcached Architecture Two levels of hashing httpd memcached hash key PHP/Perl memcached to find data Memcache friends:12389 memcached memcache key45 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  46. 46. Memcache Protocol Elements• Key Up to 250 characters• Expire Time A number in seconds, up to 30 days• Flags 32-bit number for application use• CAS ID 64-bit incrementing version number on value• Value Value stored for key; traditionally up to 1 MB.46 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  47. 47. Memcache Protocol Commands (1)• get key Fetch value for this key• set key value Store this data• add key value Store this data (strict insert)• replace key value Store this data (strict update)• cas key value cas-id Update with version number check 47 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  48. 48. Memcache Protocol Commands (2)• append key value Append text to current value• prepend key value Insert text before current value• incr key amount Add to current stored integer value• decr key amount Subtract from current stored value• delete key Delete a key and value• flush_all Delete all stored values on the server• stats stat-name Fetch server statistics48 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  49. 49. NDB & Memcache Architecture: Memcache protocol + NDB storage MySQLApplication Cluster memcached Data Node Memcache NDB Engine MySQL Client Cluster Data Node49 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  50. 50. Goals • Access stored data directly from memcache client • Memcached perspective: • MySQL Cluster is a write-scalable, replicated data store • with reliable in-memory storage, • plus on-disk storage when data is too big for memory. • MySQL Cluster perspective: • memcache is a high performance API • providing easy access to in-memory data, • plus an extra layer of caching when data is on disk.50 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  51. 51. Memcached/MySQL Cluster latency memcachetest -t 2 -M 7000 -c 2500051 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  52. 52. Cluster & Memcached – Schema-Free key value <town:maidenhead,SL6> Application view SQL view key value <town:maidenhead,SL6> Key Value town:maidenhead SL6 generic table52 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  53. 53. Cluster & Memcached – Configured Schema key value <town:maidenhead,SL6> Application view SQL view prefix key value <town:maidenhead,SL6> Prefix Table Key-col Val-col policy town ... code ... town: map.zip town code cluster maidenhead ... SL6 ... Config tables map.zip53 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  54. 54. 54 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  55. 55. Multi-Site Clustering  Split data nodes across data centers Node Group 1 – Synchronous replication Data Node 1 Data Node 2 and auto-failover between Synchronous sites Replication – Improved heartbeating to Node Group 2 handle network partitions Data Node 3 Data Node 4  Extends HA Options  Active/Active with no need for conflict handling55 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  56. 56. Active/Active Geographic Replication  Replicating complete clusters across data centers – DR & data locality – No passive resources Geographic  Simplified Active / Active Replication Replication – Eliminates requirement for application & schema changes – Transaction-level rollback56 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  57. 57. 57 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  58. 58. Simplified Provisioning & Maintenance User Privilege Consolidation58 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  59. 59. 59 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  60. 60. DMR160 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  61. 61. EA61 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  62. 62. EA62 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  63. 63. 63 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  64. 64. MySQL Cluster 7.3 DMR1: Foreign Keys Brings MySQL Cluster to a broader range of workloads – Packaged apps, custom projects Adds powerful functionality while reducing complexity – App logic & data model Enabled by default Enforced for SQL & NoSQL APIs On-line add and drop64 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  65. 65. MySQL Cluster 7.3 DMR1: Foreign Keys Implementation goal: compatibility with InnoDB – Easy migration of solutions already working with InnoDB Foreign keys are natively implemented in the storage engine Created in SQL Enforced in SQL & NoSQL (C++, ClusterJ, memcached, node.js)65 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  66. 66. MySQL Cluster 7.3 DMR1: Foreign Keys66 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  67. 67. Downloading MySQL Cluster 7.3 DMR Development Release Tab http://dev.mysql.com/downloads/cluster/67 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  68. 68. MySQL Cluster 7.3 EA: Node.js NoSQL API  Native JavaScript access to MySQL Cluster – End-to-End JavaScript: browser to the app and Clients database – Storing and retrieving JavaScript objects directly in MySQL Cluster – Eliminate SQL transformation V8 JavaScript Engine  Implemented as a module for node.js MySQL Cluster Node.js Module – Integrates full Cluster API library within the web app  Couple high performance, distributed apps, with high performance distributed database MySQL Cluster Data Nodes68 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  69. 69. MySQL Cluster 7.3 EA: Auto-Installer Fast configuration Specify Auto- Workload Discover Auto-discovery Workload optimized Repeatable best practices For MySQL Cluster Define Deploy Topology 7.2 + 7.369 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  70. 70. Define Hosts 70 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  71. 71. Auto-Discovery 71 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  72. 72. Modify hosts 72 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  73. 73. Define nodes 73 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  74. 74. Refine config 74 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  75. 75. Deploy 75 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  76. 76. Downloading MySQL Cluster EA http://labs.mysql.com/76 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  77. 77. MySQL Cluster Manager Enhancing DevOps Agility, Reducing Downtime Automated Self-Healing HA Operations Management• Start / Stop node or • Node monitoring • Cluster-wide whole cluster configuration • Auto-recovery• On-Line Scaling extended to SQL consistency• On-Line + mgmt nodes • Persistent Reconfiguration configurations• On-Line Upgrades • HA Agents77 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. | 17t h October 2012 | Oracle reserves the right to change the timing and content of any future release
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×