Your SlideShare is downloading. ×
0
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
MYSQL
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

MYSQL

3,480

Published on

MySQL Cluster Carrier Grade Edition

MySQL Cluster Carrier Grade Edition

Published in: Business, Technology
0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,480
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
223
Comments
0
Likes
5
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. MySQL Cluster Carrier Grade Edition
  • 2. MySQL Cluster Carrier Grade Edition <ul><li>Provides the telecom industry with a true real-time database with the flexibility of a relational database plus the cost savings of open source </li></ul><ul><li>Designed by telecom for telecom </li></ul><ul><li>Ideally suited for the telecom industry's top carriers, operators and equipment manufactures </li></ul><ul><li>Used by industry leaders for real-time, scalable data management </li></ul>
  • 3. Basic Cluster Architecture Application Nodes (NDB API and/or MySQL Server) ‏ Data Nodes Management Nodes Clients NDB API NDB Storage Engine
  • 4. Geographic Redundancy For more information on MySQL Cluster and Replication visit: http://dev.mysql.com/doc/refman/5.1/en/mysql-cluster-replication.html <ul><li>Asynchronous MySQL Replication between Clusters </li></ul><ul><li>Enables a higher degree of availability and continuity </li></ul>Replication Cluster 1 Cluster 2
  • 5. Carrier Grade Edition Overview Geographic Replication Scalability Performance High Availability Requirement <ul><li>Increase availability/scalability across geographies & data centers </li></ul><ul><li>Mitigate potential network or site failures </li></ul><ul><li>Enables Scale-Out </li></ul><ul><li>Asynchronous data replication </li></ul><ul><li>Incrementally “scale-out” for increased capacity, performance & scalability </li></ul><ul><li>Linear scalability with user-defined partitioning </li></ul><ul><li>Support for disk-based data and large objects </li></ul><ul><li>In-memory and disk-based data storage </li></ul><ul><li>Fast, native data access via NDB API </li></ul><ul><li>Distributed, synchronous, “shared-nothing” data storage </li></ul><ul><li>Automated fail-over in under a second </li></ul><ul><li>Automatic data resynchronization in the event of a failure </li></ul><ul><li>Online backups </li></ul><ul><li>Rolling upgrades </li></ul>Feature Set
  • 6. Carrier Grade Edition Overview Lower TCO Rapid Development Interoperability Reliability Requirement <ul><li>Runs on commodity, Advanced TCA hardware </li></ul><ul><li>Lower cost licensing model </li></ul><ul><li>Minimized design complexity and associated maintenance costs </li></ul><ul><li>Based on open source and open standards </li></ul><ul><li>SQL, Java and NDB API data access </li></ul><ul><li>Automatic and user-defined partitioning </li></ul><ul><li>Professional consulting and customized application development from MySQL </li></ul><ul><li>Leverage telecom specific features </li></ul><ul><li>Most popular open source database in the world </li></ul><ul><li>Runs on popular open source and proprietary technology stacks </li></ul><ul><li>Support for ACID transactions </li></ul><ul><li>Synchronous intra-cluster data replication </li></ul><ul><li>Local and Global checkpoints </li></ul><ul><li>24x7 Technical Support </li></ul><ul><li>Professional training and certification </li></ul>Feature Set
  • 7. What’s Different? Adaptability Performance Scalability Quality & Reliability Stability Characteristic <ul><li>Online Add Column </li></ul><ul><li>Support for mixed (x86, SPARC, PowerPC) environments </li></ul><ul><li>Optimizations to communication protocol enabling API to Data Node over WAN </li></ul><ul><li>More efficient Client/Server data handling and transfers </li></ul><ul><li>Other optimizations (Memory, BLOBs, Disk-based data, etc.) ‏ </li></ul><ul><li>Support for larger clusters, up to 255 Nodes </li></ul><ul><li>Conflict detection support in replication </li></ul><ul><li>Circular replication support </li></ul><ul><li>Support for user-defined partitioning </li></ul><ul><li>Developed & tested with major TEMs </li></ul><ul><li>Separate development tree from MySQL Server </li></ul><ul><li>Permits prioritized bug fixes & enhancements for customers </li></ul>Benefits
  • 8. System Requirements COTS – Advanced TCA 32 & 64-bit x86, PowerPC & SPARC Hardware Varies on size of database, # of hosts, # of replicas Memory Linux (Red Hat, SuSE), Solaris, HP-UX, Mac OSX, others… Operating System 100 Mbps or better (Gigabit recommended, SCI supported) ‏ Network Shared-Nothing - Memory & Disk Data SCSI or RAID for I/O performance Storage Maximum of 255 total nodes (48 Data Nodes) ‏ Hosts Requirement System Component
  • 9. NDB Storage Engine <ul><li>Memory and disk-based </li></ul><ul><li>ACID Transactions </li></ul><ul><li>Row-Level Locks </li></ul><ul><li>Synchronous replication across Data Nodes </li></ul><ul><ul><li>Linear Two Phase Commit </li></ul></ul><ul><li>Data automatically or user partitioned </li></ul><ul><li>Local & Global Checkpoints to disk for persistence </li></ul><ul><li>Automatic fail over and data resynchronization </li></ul><ul><li>Data can be accessed via SQL or NDB API </li></ul><ul><li>Online Backups </li></ul>Currently not supported: - Foreign Keys - Full-text Search - Microsoft Windows
  • 10. Data Distribution & Partitioning P1 - Primary P2 - Replica P1 - Replica P2 - Primary data data data data col2 data data 4 data data 3 data data 2 data data 1 col3 col1 PK Two Data Nodes * Complete copy of database on each node Two Replicas * Two copies of each partition One Node Group * One set of identical Data Nodes Partitions - Automatic or User-Defined - Horizontal - MD5 hash of Primary Key Node Group
  • 11. Data Distribution & Partitioning P1 - Primary P2 - Replica P1 - Replica P2 - Primary P3 - Primary P4 - Replica P3 - Replica P4 - Primary Four Data Nodes * Half of database on each node Two Replicas * Two copies of each partition Two Node Groups * Two sets of identical Data Nodes Node Group 0 Node Group 1 data data data data col2 data data 4 data data 3 data data 2 data data 1 col3 col1 PK
  • 12. Design Considerations <ul><li>Number of Replicas </li></ul><ul><ul><li>Up to 4 supported, 2 is most common </li></ul></ul><ul><ul><li>NoOfReplicas parameter in config.ini </li></ul></ul><ul><li>Partitions </li></ul><ul><ul><li>Automatic </li></ul></ul><ul><ul><li>Horizontal </li></ul></ul><ul><ul><li>MD5 hash of primary key </li></ul></ul><ul><li>Memory Sizing </li></ul><ul><ul><li>Leverage ndb_size.pl script </li></ul></ul><ul><ul><li>Data Size * Replicas * 1.1 = Total Memory </li></ul></ul><ul><ul><li>Example: 2 GB * 2 * 1.1 = 4.4 GB </li></ul></ul><ul><ul><li>(Data Size * Replicas * 1.1)/Nodes = RAM Per Node </li></ul></ul><ul><ul><li>Example: (2 GB * 2 * 1.1)/4 = 1.1 GB </li></ul></ul><ul><li>Disk Storage </li></ul><ul><ul><li>Used for data, backups, checkpoints and logs </li></ul></ul><ul><ul><li>SCSI or RAID for faster backups or write-heavy apps </li></ul></ul>
  • 13. Detecting Lost Connections - Heartbeats
  • 14. Data Node Failure & Recovery <ul><li>Server 3 failure is detected </li></ul><ul><li>Server 4 handles Server 3 requests </li></ul>P1 - Primary P2 - Replica P1 - Replica P2 - Primary P3 - Primary P4 - Replica P3 - Replica P4 - Primary 1 3 2 4 Node Group 0 Node Group 1
  • 15. Data Node Failure & Recovery <ul><li>Server 3 begins copying data from Server 4 </li></ul><ul><li>Complete or just changes since failure </li></ul>P1 - Primary P2 - Replica P1 - Replica P2 - Primary P3 - Primary P4 - Replica P3 - Replica P4 - Primary 1 3 2 4 Node Group 0 Node Group 1
  • 16. Data Node Failure & Recovery <ul><li>Data is available as it is restored </li></ul><ul><li>Server 3 rejoins the Cluster </li></ul>P1 - Primary P2 - Replica P1 - Replica P2 - Primary P3 - Primary P4 - Replica P3 - Replica P4 - Primary 1 3 2 4 Node Group 0 Node Group 1
  • 17. Network Partitioning – Avoiding “Split Brain” <ul><li>By default, the Management Node acts as arbitrator </li></ul><ul><li>In the event of a network failure, arbitration determines which set of nodes should continue while shutting down the rest </li></ul>X Application Nodes (NDB API and/or MySQL Server) ‏ Data Nodes Management Nodes NDB API
  • 18. Queries and Transactions <ul><li>MySQL Server is a SQL interface for the NDB storage engine </li></ul><ul><li>NDB API for fast, native data access </li></ul><ul><li>Data Node answers query or with other Nodes in the Node Group </li></ul><ul><ul><li>Round-robin by default </li></ul></ul><ul><ul><li>Transaction Coordinator </li></ul></ul><ul><ul><li>Local Query Handler </li></ul></ul><ul><li>With write or updates, a Data Node initiates the transaction on all Nodes in the Node Group </li></ul><ul><li>Linear two-phase commit </li></ul><ul><ul><li>Ensures all Data Nodes have received and acted on a “write” before committing </li></ul></ul>
  • 19. MySQL Cluster NDB API <ul><li>High performance C++ API for NDB storage engine </li></ul><ul><li>Implements indexes, scans, transactions & events </li></ul><ul><li>ACID-compliant </li></ul><ul><li>Object-oriented error-handling </li></ul><ul><li>Also, MGM API for administrative tasks </li></ul>For more information about the NDB API Developers’ Guide visit: http://dev.mysql.com/doc/ndbapi/en/index.html
  • 20. Linear Scalability <ul><li>Primary Key look-ups are very efficient </li></ul><ul><ul><li>Increase the number of PK operations in a transaction, batch size </li></ul></ul><ul><ul><li>Yields linear improvements in performance </li></ul></ul><ul><li>Multiple-record look-ups benefit from user-defined partitioning </li></ul><ul><li>Limit full table scans and use of JOINs </li></ul>
  • 21. Linear Scalability Benefits
  • 22. Reliability: Checkpoints <ul><li>Process of writing data and logs from memory to disk </li></ul><ul><li>Local Checkpoint (LCP) ‏ </li></ul><ul><ul><li>Take place for all Data Nodes in the cluster concurrently </li></ul></ul><ul><ul><li>Persists all of a Data Node's data to disk </li></ul></ul><ul><ul><li>Interval varies by amount of data and level of cluster activity </li></ul></ul><ul><ul><li>UNDO Log used to create consistent copy without any locks </li></ul></ul><ul><ul><li>LCP allows Data Node to remove old REDO Logs </li></ul></ul>LCP UNDO Log
  • 23. Reliability: Checkpoints <ul><li>Global Checkpoint (GCP) ‏ </li></ul><ul><ul><li>Transactions on all nodes are synchronized </li></ul></ul><ul><ul><li>Recent transactions stored in REDO Log flushed to disk </li></ul></ul><ul><ul><li>Frequency controlled by TimeBetweenGlobalCheckpoints </li></ul></ul><ul><ul><li>Performance vs. durability </li></ul></ul>GCP REDO Log GCP Transactions Synchronized
  • 24. Where is MySQL Cluster CGE used <ul><li>Subscriber Databases Management </li></ul><ul><li>Web Session Management </li></ul><ul><li>Service Delivery Platforms </li></ul><ul><ul><li>Messaging </li></ul></ul><ul><ul><li>Presence </li></ul></ul><ul><li>VoIP Infrastructure </li></ul><ul><li>Intelligent Networks </li></ul><ul><li>Value Added Services </li></ul><ul><li>IPTV </li></ul><ul><li>Mobile Content Delivery </li></ul><ul><li>Gaming </li></ul><ul><li>DNS/DHCP for Broadband </li></ul><ul><li>Payment Gateways </li></ul><ul><li>Directory Services (LDAP) </li></ul>http://www.mysql.com/industry/telecom/
  • 25. <ul><li>Nokia Siemens Networks, Alcatel Lucent, Ericsson, Nortel, HP OpenCall, Cisco, Motorola </li></ul><ul><ul><li>Areas include subscriber repositories, SIP infrastructure, Service Delivery Platforms, Prepaid </li></ul></ul><ul><li>Vodafone UK, Deutsche Telekom, Orange/FT, Telenor, Telekom Austria </li></ul><ul><ul><li>Areas include subscriber directories, “modern” IN platforms (SEPs), new services (VoIP, Video/IP), DHCP infrastructure for Broadband Networks, Payment Gateways, Mediation </li></ul></ul>Customer Snapshots
  • 26. Thank You

×