20140722 Taiwan MySQL User Group Meeting Tech Updates
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

20140722 Taiwan MySQL User Group Meeting Tech Updates

on

  • 450 views

Technology update presentation used at 1st Taiwan MySQL User Group Meeting on 民国103年7月22日

Technology update presentation used at 1st Taiwan MySQL User Group Meeting on 民国103年7月22日

Statistics

Views

Total Views
450
Views on SlideShare
449
Embed Views
1

Actions

Likes
3
Downloads
15
Comments
0

1 Embed 1

https://twitter.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Since the acquisition, Oracle has delivered <br /> more products, <br /> at a higher quality, <br /> than at any time in MySQL history.
  • MySQL 5.6 delivers across the board improvements designed to enable innovative DBAs and Developers to create and deploy the next generation of web, embedded and Cloud/SaaS/DaaS applications on the latest generation of development frameworks and hardware platforms. <br /> <br /> At a glance, MySQL 5.6 is simply a better MySQL with improvements that enhance every functional area of the database kernel, including: <br />   <br /> Improved Performance Scalability <br /> 5.6 scales up 48 CPU threads which enables users to leverage the full processing power of modern architectures <br /> 5.6 performs up to 230% faster over 5.5 on transactional work loads. <br /> Improved InnoDB <br /> Allow 5.6 to provide better transactional throughput and availability over previous versions. <br /> Improved Optimizer <br /> Provides better query execution times and more diagnostics for monitoring, tuning and debugging <br /> Impoved Replication <br /> Provides higher performance, availability and data integrity <br /> Improved Performance Schema <br /> Provides better instrumentation and user/application level statistics and monitoring <br /> New! NoSQL Access to InnoDB <br /> Provides fast, Key Value access with full ACID compliance, better developer agility <br /> <br /> Improved InnoDB storage engine for better transactional throughput <br /> Improved Optimizer for better query execution times and diagnostics <br /> Better Application Availability with Online DDL/Schema changes <br /> Better Developer Agility with NoSQL Access with Memcached API to InnoDB <br /> Improved Replication for high performance, self-healing distributed deployments <br /> Improved Performance Schema for better instrumentation <br /> Improved Security for worry-free application deployments <br /> And other Important Enhancements <br />
  • Ability to get MySQL components not yet packaged by their Linux distro. <br /> Access to the latest and greatest versions of MySQL, even if they have not yet been adopted by their Linux distro. <br /> Packages of MySQL products supported by Oracle. <br /> Easy early access to pre-GA product releases, such as MySQL 5.7 Development Milestone Releases. <br />
  • And let me give you some figures to illustrate our efforts <br /> <br /> The 1667 number is bugfixes on 5.6 only. The 2909 number is bugfixes since time of 5.5 GA, but for all releases 5.0/5.1/5.5/5.6 <br />
  • And as we can see in this example of MySQL 5.6, we’re developing the products releasing ‘early and often’, with predictable DMRs allowing the MySQL Community, i.e. you, to provide us with feedback and input during the development. <br /> <br /> And we’re also delivering early access features via labs.mysql.com to allow you to provide feedback very early on in the process. <br /> <br /> <br />
  • 14
  • Good to refer that we are integrating MySQL with all relevant Oracle products to make it easier to use for Oracle customers (Oracle Secure Backup, Oracle Database Firewall, Oracle Enterprise Manager…etc).
  • MySQL is in an incredibly favorable position, and the platform of choice for next generation Web, mobile and cloud applications. <br /> <br /> It is....(the 4 key points) <br /> <br /> We’re also seeing great momentum for MySQL: talk about 3 points on the side <br /> <br /> We want to ensure that MySQL remains the platform of choice for next gen web apps, and we are evolving the database by developing new features, enhancements and integrating in it new capabilities useful for modern apps. Give example of the 2 other points in orange (NoSQL and new languages)
  • Oracle/MySQL has the answers you need in MySQL Enterprise Edition.
  • Real-time MySQL Performance and Availability Monitoring <br /> Visual Dashboad for Better Visibility <br /> Visually Find and Fix Problem Queries <br /> Pinpoint SQL code that causing a slowdown <br /> Visual Capacity Planning <br /> Forecasting using Projections and Trend Analysis <br /> Agentless, Cloud Friendly Architecture <br /> Remotely Monitor MySQL without agents <br /> Start Monitoring MySQL in 10 minutes <br /> Easy to use with zero configuration <br />
  • Just a quick intro at this point – all of this is covered in more details later in the presentation. <br /> <br /> It’s intent is to simplify life by providing automation around High Availability and scaling out through horizontal sharding. <br /> <br /> Fabric maintains a set of mappings from shard key to shards; the connectors cache that information and use it to route SQL transactions directly to the correct MySQL Server using a shard key provided by the application – no extra hop is needed and so latency is kept to a minimum. Initially, Fabric-aware connectors are provided for Python, PHP and Java. We are also providing patches for Hibernate and Doctrine. <br /> <br /> We recognize that in many cases it is undesirable or impossible for the application or middleware code to be updated to provide a shard key and so the addition of transparent sharding is a development priority. <br /> <br /> Within a shard (or Master Group), there are one or more MySQL Servers that are capable of being the replication master and then also a set of replication slaves that can be used to scale out reads *within* the shard. This is based on MySQL 5.6 Global Transaction ID based replication. <br /> <br /> Shards can be split and moved; the window of unavailability is kept to a minimum but it is not yet a fully on-line operation. <br /> <br /> Global updates are supported and allow, for example, schema changes to propagate to all shards. This feature allow you to have global tables that are common to all shards and can be updated globally. <br /> <br /> Can download it from labs.mysql.com today and try it out – we’re releasing this early version because we really want to hear your feedback.
  • Through geo-replication, had the ability to replicate entire cluster across data centers – for DR and data locality <br /> <br /> Active/active, so both clusters can accept writes, then replication mechanisms detect and handle conflicts, so no passive resources <br /> Within the 7.2DMR, also have the ability to split a single cluster across data centers
  • 48-core (96 CPU threads) HW. <br /> Table scans speed up more than PK access <br /> 8 LDM’s <br /> 8 Sysbench Tables <br /> 8 Partitions per table <br /> 6 Cluster connections
  • 「本物ならでは」 <br /> アンケート

20140722 Taiwan MySQL User Group Meeting Tech Updates Presentation Transcript

  • 1. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.1 The State of The Dolphin “Real innovation and advantage of MySQL” Ryusuke Kajiyama MySQL Sales Consulting Senior Manager MySQL Global Business Unit
  • 2. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.2 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
  • 3. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.3 The world's most popular open source database
  • 4. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.4 MySQL is No.1 open source database – Discussion – Mentions – Interests – Job & Specialist http://db-engines.com/en/ The world's most popular open source database According to DB-Engines
  • 5. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.5 MySQL Enterprise Monitor 2.2 MySQL Cluster 7.1 MySQL Cluster Manager 1.0 MySQL Workbench 5.2 MySQL Database 5.5 MySQL Enterprise Backup 3.5 MySQL Enterprise Monitor 2.3 MySQL Cluster Manager 1.1 MySQL Enterprise Backup 3.7 All GA! Oracle VM Template for MySQL Oracle Products Certifications MySQL Windows Installer MySQL Enterprise Security MySQL Enterprise Scalability MySQL Cluster 7.2 MySQL Cluster Manager 1.3 MySQL Utilities 1.0.6 MySQL Workbench 6.0 All GA! MySQL Enterprise Backup 3.10 MySQL Enterprise Audit MySQL Windows Tools MySQL Database 5.6 MySQL Cluster 7.3 MySQL Workbench 6.1 MySQL Fabric 1.4 MySQL Database 5.7 DMR *Development Milestone Release All GA! Available Now! Driving MySQL Innovation: 2010 - 2014
  • 6. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.6 • Scales to 48 CPU Threads • Up to 230% performance gain over MySQL 5.5 IMPROVED PERFORMANCE AND SCALABILITY • Better transactional throughput and availability IMPROVED INNODB • Faster query execution and diagnostics for query tuning and debugging IMPROVED OPTIMIZER • Higher performance, availability and data integrity IMPROVED REPLICATION • Better Instrumentation, User/Application level statistics and monitoring IMPROVED PERFORMANCE SCHEMA • Fast, Key Value access with full ACID compliance, better developer agility New! NoSQL ACCESS TO INNODB MySQL 5.6: GA 15 Months Ago – Best GA Ever
  • 7. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.7 MySQL 5.6 - InnoDB NoSQL API Best of Both Worlds Clients and Applications MySQL Server Memcached Plug-in innodb_ memcached local cache (optional) Handler API InnoDB API InnoDB Storage Engine mysqld process SQL Memcached Protocol 0 10000 20000 30000 40000 50000 60000 70000 80000 8 32 128 512 TPS Client Connections MySQL 5.6: NoSQL Benchmarking Memcached API SQL Up to 9x Higher “SET / INSERT” Throughput
  • 8. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.8 The largest MySQL websites APPLICATION Facebook is a social networking site that connects people with friends and others who work, study and live around them. KEY BUSINESS BENEFIT MySQL has enabled facebook to grow to 1 billion users. WHY MySQL? “We are one of the largest MySQL web sites in production. MySQL has been a revolution for young entrepreneurs.”
  • 9. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.9 Welcome, WebScaleSQL!  Investment to improve MySQL for Web Scale  Great news for the MySQL Community & new developers  Even easier for Oracle to continue close cooperation Thank You, Facebook, Google, LinkedIn & Twitter!
  • 10. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.10 From FAQ of WebScaleSQL
  • 11. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.11 MySQL Repositories: Yum  Simple and convenient way to install & update MySQL products  Supports the following distributions – RedHat Enterprise/Oracle Linux – Fedora – Upcoming: Debian/Ubuntu  Includes the latest packages – MySQL Database – MySQL Workbench – MySQL Connector/ ODBC – MySQL Connector/Python – MySQL Utilities Benefits both End Users and Linux Distributions And now also on NuGet for Windows Devs http://www.nuget.org/profiles/MySQL/ Over 50% of downloads for Fedora/RedHat already from the repositories
  • 12. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.13 The Open Road to MySQL 5.6 Optimizer: MRR, ICP, File Sort InnoDB: Split Kernel Mutex, MT Purge Replication: Crash-Safe, Multi-Thread Slave, Checksums Memcached API New P_S Partitioning Improvements *Development Milestone Release RC Nov 2012 DMR1* April 2011 DMR2 Oct 2011 Optimizer: BKA, New EXPLAIN, Traces InnoDB: Dump/Restore Buffer Pool More P_S DMR3 Dec 2011 Optimizer: Sub-Queries InnoDB: Full Text Index, Read-Only Optimizations Condition Handling Fractional Seconds DMR4 April 2012 Optimizer: JSON EXPLAIN, Sub-Queries Replication: GTIDs TIMESTAMP & DATESTAMP More P_S DMR5 Aug 2012 InnoDB: TT, Online DDL, Memcached API Replication: Binary Log Group Commit Password Mgmt More Partitioning New Server Defaults More Partitioning More GTID, TT Predictable Releases for the MySQL Community, Allowing Feedback
  • 13. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.14 MySQL Makes Sense for Oracle  Complete Solutions  Best of Breed at Every Level  On Premise and in the Cloud  MySQL: Web, Mobile & Embedded Confidential - Oracle Internal Use Only
  • 14. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.16 MySQL: Everywhere and Growing Platform for Next Generation Web, Cloud & Embedded Applications World’s Most Popular Open Source Database Database Platform for Next Gen Web Apps Leading Database for Web Applications Leading Database in the Cloud Integrated with Hadoop in majority of Big Data platforms
  • 15. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.20 MySQL Technology Updates
  • 16. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.21 DMRs: Development Milestone Releases  Fully Functional Release Candidate Quality  Two to Four per Year  Early Community Testing, Use, & Feedback  Accelerates Rate of Enhancements  Improves Quality
  • 17. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.22 MySQL 5.7: DMR 4  InnoDB for better transactional throughput, availability, IO  Replication for better scalability and availability  Utilities for dev/ops automation  Performance Schema for better performance metrics  Optimizer for better EXPLAINing, query performance, enhanced buffering and partition optimization  Connecting at higher rates, improve session efficiency Available Now! Get it here: dev.mysql.com/downloads/mysql/ MySQL 5.7 builds on MySQL 5.6 by improving:
  • 18. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.23 MySQL 5.7 Sysbench Benchmark Sysbench Point Select Intel(R) Xeon(R) CPU X7560 x86_64 5 sockets x 8 cores-HT (80 CPU threads) 2.27GHz, 256G RAM Oracle Linux 6.5 2X Faster than MySQL 5.6 Over 3X Faster than MySQL 5.5 630,000 QPS
  • 19. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.25 RO In-Memory @MySQL 5.7  Sysbench OLTP_RO 8-tables, 32cores-HT :
  • 20. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.26 Benchmark test MySQL 5.7 MySQL 5.7 is the fastest, MySQL 5.6 is the best option of today http://dimitrik.free.fr/blog/archives/2014/04/mysql-57-just-rocks.html
  • 21. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.27 MySQL 5.7.2: Optimizer Expanded JSON EXPLAIN output
  • 22. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.28  MySQL Database IDE  Millions of Downloads MySQL Workbench Design, Develop, Administer, Migrate Windows, Linux, Mac OS X
  • 23. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.29 New! MySQL Workbench 6.1  Performance Dashboard – Network, Server, InnoDB  Performance Reports – Analyze hotspots – Costly SQL statements – Wait times, locks – InnoDB stats, and more Performance and Status Dashboards
  • 24. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.30 MySQL Utilities Python scripts for DevOps, GPL License Database Management Database Operations Replication Management Configuration Management MySQL Utilities
  • 25. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.33 MySQL Cluster Shared Nothing Active-Active Cluster & Transactional NoSQL MySQL Cluster Data Nodes Data Layer Clients Management Nodes Management Nodes Application Layer
  • 26. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.34 MULTI-REGION AVAILABILITY  DR and Global Scale  Replicate complete clusters across regions – Fully active/active – No passive resources  Split individual clusters across availability zones – Synchronous replication & auto-failover between sites Geographic Replication
  • 27. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.35 SQL and NoSQL Best of both world with ACID Transactions MySQL Cluster Data Nodes Data Layer Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps Apps JPA Cluster JPA PHP Perl Python Ruby JDBC Cluster J JS Apache Memcache d MySQL JNI Node.JS mod_ndb ndb_eng NDB API (C++)
  • 28. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.36 Protecting $100BN+ Transactions https://blogs.oracle.com/mysql/entry/with_its_mysql_database_as KEY BUSINESS BENEFIT MySQL Cluster deployed across 5 AWS regions gives global latency of <1/3rd of a second, enabling real-time fraud detection WHY MySQL? “MySQL Cluster enables users to get the best of both world’s… agility of NoSQL systems with the trust, maturity & reliability of the SQL model " CUSTOMER One of largest payment providers on the internet, 30% year-on-year growth CHALLENGES Protect financial transactions with fraud detection system. Must be real-time with global reach servicing 100m+ users
  • 29. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.37 MySQL Cluster 7.4  Performance gain over 7.3 – 47% (Read-Only) – 38% (Read-Write) Better performance and operational simplicity labs.mysql.com  Faster node restarts – Recovering nodes rejoin the cluster faster
  • 30. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.38 5.6 MySQL Server - GA The best release ever with high quality and performance InnoDB NoSQL API and improved replication durability MySQL Cluster - GA Integration with MySQL 5.6 Node.jp NoSQL API, Foreign key support 7.3 5.7 MySQL Server - DMR Refactoring and adding more pluggable components Faster performance and easier management
  • 31. Copyright © 2014, Oracle and/or its affiliates. All rights reserved.39 The world's most popular open source database