1 my sql20151219-kaji_ivan

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
善用新世代MySQL
開拓成功新契機
梶山隆輔，杜修文

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
2

A Year of Anniversaries!
20Years: MySQL
10Years: Oracle stewardship of InnoDB
5Years: Oracle stewardship of MySQL
Thank You, MySQL Community, for 20 years of
Contributions to MySQL!
3

Further developed
MySQL according to
the same values...
...while ensuring
secure behavior
The Road to Adulthood...
4

新世代MySQL為您帶來的價值
• 更好的性能
• 更好的擴充力
• 更高的可用度
• 更高的安全性
• 更豐富的功能
– Performance_Schame/SYS, Online Explain, JSON, GIS, Query Rewrite, Windows,
GitHub, InnoDB Compression, Server Statement Timeout,中文全文檢索 …
• 結論
5

• 更好的性能
• 結論
6

0
100,000
200,000
300,000
400,000
500,000
600,000
700,000
8 16 32 64 128 256 512 1,024
QueriesperSecond
Connections
MySQL 5.7: Sysbench Read Only (Point Select)
MySQL 5.7
MySQL 5.6
MySQL 5.5
MySQL 5.7: Sysbench: Read Only
Intel(R) Xeon(R) CPU E7-4860 x86_64
4 sockets x 10 cores-HT (80 CPU threads)
2.3 GHz, 512 GB RAM
Oracle Linux 6.5
2x Faster than MySQL 5.6
645,000 QPS
7

MySQL 5.7: InnoDB, NoSQL With Memcached
Thank you, Facebook
0
200,000
400,000
600,000
800,000
1,000,000
1,200,000
8 16 32 64 128 256 512 1,024
QueriesperSecond
Connections
MySQL 5.7 vs 5.6 - InnoDB & Memcached
MySQL 5.7
MySQL 5.6
1 Million QPS
Intel(R) Xeon(R) CPU E7-4860 x86_64
4 sockets x 10 cores-HT (80 CPU threads)
2.3 GHz, 512 GB RAM
Oracle Linux 6.5
8

• 重構Optimizer和Parser
– 改進可讀性,維護性和穩定性
– 乾淨的分離parsing, optimizing, 和execution
階段
– 讓新功能更容易加入,同時降低風險
• 新的 hint 架構
– 更容易管理
– 支持更多的新 hints
• 改良的JSON EXPLAIN
• EXPLAIN 其他的連線/線程
• 新的Cost based 優化器
• Generated Columns
• 支援InnoDB為基礎的temp tables
• 更好的ONLY_FULL_GROUP_BY mode
• 更好的支援InnoDB 和 GIS
• 許多新的優化功能
查詢更快,同時用更少的CPU和磁碟空間!
MySQL 5.7: 優化器的改進
9

• 更好的性能
• 結論
10

MySQL 5.7: InnoDB – 始終處於線上開機
• 線上調整InnoDB Buffer Pool
– DBA們可以線上調整buffer size不需關資料庫
– 適應線上變更資料庫的使用型態
• 分開UNDO tablespace
– 可自動線上 truncation
• 支援更多的線上ALTER TABLE
– 擴大VARCHAR, Rename Index
• 動態設定配置
– 使現有的設定能動態變更
– 是新功能和設定的設計原則
11

• 更好的性能
• 結論
12

Copyright 2011 Oracle Corporation 13
MySQL Database
High Availability with MySQL

Slave
Database
• Session thread: 處理來自應用的查詢 – 將資料
寫到master database 和相關的 binary log
• Dump thread: 自 binary log讀取資料且送到
slave
• I/O thread: 接收複製的事件且存於slave的
relay log
• SQL thread: 自的 relay log讀複製事件且作用
於 slave database
MySQL Replication 的流程
SessionSession
Binary
Log
Master
Database
DumpDump I/O
Relay
Log
SQL
19th February 2015 14Copyright 2015, Oracle and/or its affiliates. All rights reserved

複製的效益?
• a 由“master” 複製資料庫到“slave”
– 資料的冗餘帶來高可用
– 將查詢分散到多個伺服器達到橫向擴充
Master
Slaves
Web / App Servers
Writes & Reads Reads
19th February 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 15

• 匯總來自多個主的更新於單一從
– Consolidated view of all shards
– More flexible topologies
– Centralized point for backups
• 和半同步複製相容且加強了多線
程從
• 各主可定篩選
多源複製
BinlogBinlog
Master 1Master 1
BinlogBinlog
Master 2Master 2
……
…
BinlogBinlog
Master NMaster N
IO 1IO 1
Relay 1Relay 1
CoordinatorCoordinator
W1W1 W2W2 … WXWX
IO 2IO 2
Relay 2Relay 2
W1W1 W2W2 … WXWX
……
……
W1W1 W2W2 … WXWX
IO NIO N
Relay NRelay N
W1W1 W2W2 … WXWX
Slave

• 無共用之實質上的同步資料庫
• 任何一處多主更新
– 衝突偵測和解決 (transaction rollback)
– Optimistic State Machine Replication
• 自動群組成員管理和失敗偵測
– 不需資料庫層的故障移轉
– 彈性的scale out/in
– 無單點故障
– 自動重配置
• 和以下完全整合
– InnoDB
– GTID-based replication
– PERFORMANCE_SCHEMA
MySQL Group Replication
Application
MySQL Masters ReplicationReplication
Plugin
APIAPI
MySQL
Server
Group CommsGroup Comms
(Corosync)

MySQL Fabric 1.6
• 高可用
– 監看資料庫,並且在故障發生時應用端透通
的自動固障移轉
• 可透過資料分片達成橫向擴張
– 應用提供shard key
– Range 或Hash
– Tools for resharding
– Global updates & tables
• 應用端輔以Fabric-aware connectors 或
MySQL Router: Python, Java, PHP, .NET,
C (labs)
– Lower latency, bottleneck-free
• 可用 OpenStack開通/加上新資料庫
High Availability + Sharding-Based Scale-out
MySQL Fabric
Connector
Application
Read-slaves
SQL
HA group
Read-slaves
HA group
Connector
Application

• Oracle Clusterware unifies servers
in a server farm to form a cluster
– At the core of Oracle RAC
• Oracle Cluster 12c includes MySQL
Server 5.6 agent
• 計劃性的遷移和故障移轉MySQL
database
– 對應用層是透通的
19th February 2015
MySQL 在 Oracle Clusterware上
19Copyright 2015, Oracle and/or its affiliates. All rights reserved

MySQL Cluster
MySQL Cluster Data Nodes
Clients
Application Layer
Data Layer

引進MySQL Router
Oracle Confidential – Internal/Restricted/Highly Restricted 21
MySQL Router
MySQL Router
Read-slaves
HA group
Read-slaves
HA group
MySQL Fabric
Group Replication-主主复制
MySQL Cluster Clusterware为
基础的主备架构
主从复制
寫操作的
負載均衡
故障移转
讀寫分離
Fabric管理的Server Farm資料分片讀寫
提供Fabric 所管理
的Server Farm之
配置资讯
故障移轉
By DNS
應用程式

• 更好的性能
• 結論
22

Block Threats
Auditing
Regulatory Compliance
Login and Query Activities
SSL/TLS
Public Key
Private Key
Digital Signatures
Privilege Management
Administration
Database & Objects
Proxy Users
MySQL
Linux / LDAP
Windows AD
Custom
Oracle Confidential – Internal 23
MySQL 安控概觀
AuthorizationAuthentication
Firewall &
Auditing
Encryption
Security

MySQL 5.7: 安控- Encryption, Passwords, Installation
• AES 256 Encryption
– 在MySQL 5.7 為預設
• 密碼輪用政策
– 可為全面的或個別使用者
• 佈署: 安裝時預設就是開啟的
– 隨機產第一次密碼
– 移除無名帳戶
– 沒有test 帳號和schema及demo file
• 更容易初始化和配置一個instance: mysqld --initialize
24

MySQL 5.7: Security - SSL
• 預設為開啟
• 自動偵測現有的密鑰和證書
• 必要時自動產密鑰和證書
• 新的協助工具: mysql_ssl_rsa_setup
25

安控-企業功能
•MySQL 企業監看
–資料庫配置變更,用户權限,資料庫架
構密碼變更都能發通知
•MySQL企業安控認證
–外部認證模組 (Microsoft AD, Linux
PAMs)
•MySQL企業稽核
–留下使用記錄
–用户活動稽核, 遵循法規
26
•MySQL企業防火牆
–查詢監看,比對白名单
–防SQL Injection
•MySQL企業加密
–公/私鑰加密
–非對稱式加密
–數位簽章, 資料驗證

• 更好的性能
GitHub, InnoDB Compression, Server Statement Timeout, 中文全文檢索 …
• 結論
27

• 更好的性能
• 結論
28

總結
• MySQL和Internet共生共榮
– MySQL促成Internet的發展
– Internet彰顯MySQL的成功
• Oracle為MySQL所做的努力,以及所規劃的路線更能切中企業的需要
– 代代性能雙倍以上的提升
– 不斷推出更多更好的高可用方案
– 朝向安全的MySQL發展以滿足企業及大型應用的需要
• Oracle MySQL 全球事務部願意成為您成功的幫手
– 免費的MySQL數據庫健診 (郵箱: mysql-sales_cn_grp@oracle.com)
– 免費的MySQL技朮研討會
– 對台灣MySQL使用者社群的支持
Oracle Confidential – Internal/Restricted/Highly Restricted 29

• GTID enhancements
– On-line, phased deployment of GTIDs
– No need for binary logging on slave
• Enhanced Semi-synchronous replication
– Write guaranteed to be received by slave
before being observed by clients of the master
– Option to wait on acks from multiple slaves
• Multi-Source Replication
– Consolidate updates from multiple Masters
into one Slave
• Dynamic filters
• 8x Faster slave throughput
– Removes slave as a bottleneck
– Keep pace with master with 8+ slave threads
– Option to preserve Commit order
– Automatic slave transaction retries
MySQL 5.7: Replication Improvements
41
0%
50%
100%
150%
200%
250%
1 8 24 48
Slave Threads
Slave throughput vs. 96 Thread Master

Oracle MySQL HA & Scaling Solutions
MySQL
Replication
MySQL
Fabric
Oracle VM
Template
Oracle
Clusterware
Solaris
Cluster
Windows
Cluster
DRBD
MySQL
Cluster
App Auto-Failover ✖ ✔ ✔ ✔ ✔ ✔ ✔ ✔
Data Layer Auto-Failover ✖ ✔ ✔ ✔ ✔ ✔ ✔ ✔
Zero Data Loss MySQL 5.7 MySQL 5.7 ✔ ✔ ✔ ✔ ✔ ✔
Platform Support All All Linux Linux Solaris Windows Linux All
Clustering Mode
Master +
Slaves
Master +
Slaves
Active/Pas
sive
Active/Passi
ve
Active/P
assive
Active/Pas
sive
Active/P
assive
Multi-
Master
Failover Time N/A Secs Secs + Secs + Secs + Secs + Secs + < 1 Sec
Scale-out Reads ✔ ✖ ✖ ✖ ✖ ✖ ✔
Cross-shard operations N/A ✖ N/A N/A N/A N/A N/A ✔
Transparent routing ✖ For HA ✔ ✔ ✔ ✔ ✔ ✔
Shared Nothing ✔ ✔ ✖ ✖ ✖ ✖ ✔ ✔
Storage Engine InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ NDB
Single Vendor Support ✔ ✔ ✔ ✔ ✔ ✖ ✔ ✔

1 my sql20151219-kaji_ivan

More Related Content

What's hot

Viewers also liked

Similar to 1 my sql20151219-kaji_ivan

Recently uploaded

1 my sql20151219-kaji_ivan