The document discusses new features in MySQL 5.6 replication including: 1) Crash-safe slaves that store replication information in database tables to prevent data loss if slaves crash. 2) Multi-threaded slaves that improve performance by distributing the replication workload across multiple threads. 3) Time-delayed replication that allows replication to be delayed by a configurable number of seconds. 4) Optimized row-based replication that reduces the size of binary logs by only replicating changed columns where possible.

1. MySQL 5.6 Replication New feature
데이터기술팀 운영파트
조민

2. INDEX
1.
2.
3.
4.
5.
6.
New
New
New
New
New
New
Crash-Safe Slaves
Multi-threaded Slaves
Time-delayed Replication
Optimized Row-based Replication
Replication Checksums
Global Transactions Identifiers (GTIDs)

3. INDEX
1.
2.
3.
4.
5.
6.
New
New
New
New
New
New
Crash-Safe Slaves
Multi-threaded Slaves
Time-delayed Replication
Optimized Row-based Replication
Replication Checksums
Global Transactions Identifiers (GTIDs)

4. 1. New Crash-Safe Slaves (설정)
my.cnf
relay-log-info-repository=TABLE
master-info-repository=TABLE
# default FILE
==============================================================
mysql> stop slave;
Query OK, 0 rows affected, 1 warning (0.00 sec)
mysql> set global master_info_repository='TABLE';
Query OK, 0 rows affected (0.02 sec)
mysql> set global relay_log_info_repository='TABLE';
Query OK, 0 rows affected (0.02 sec)
mysql> start slave;
Query OK, 0 rows affected, 1 warning (0.09 sec)

5. 1. New Crash-Safe Slaves
mysql> select * from mysql.slave_master_infoG
*************************** 1. row ***************************
Number_of_lines: 23
Master_log_name: mysql-bin.000005
Master_log_pos: 2396
Host: 10.98.98.115
User_name: mig
User_password: mig
Port: 7979
Connect_retry: 60
Enabled_ssl: 0
Ssl_ca:
Ssl_capath:
Ssl_cert:
Ssl_cipher:
Ssl_key:
Ssl_verify_server_cert: 0
Heartbeat: 1800
Bind:
Ignored_server_ids: 0
Uuid: c35b769a-8fac-11e2-a667-00a0d1e293e2
Retry_count: 86400
Ssl_crl:
Ssl_crlpath:
Enabled_auto_position: 0
1 row in set (0.00 sec)

6. 1. New Crash-Safe Slaves
mysql> select * from mysql.slave_relay_log_infoG
*************************** 1. row ***************************
Number_of_lines: 7
Relay_log_name: ./db-ha-db2-relay-bin.000011
Relay_log_pos: 1770
Master_log_name: mysql-bin.000005
Master_log_pos: 2396
Sql_delay: 60
Number_of_workers: 0
Id: 1
1 row in set (0.00 sec)
장애 시 Duplication 제거
Query 이용 !!! (DIS)
느리다!!!

7. 2. New Multi-threaded Slaves
1.
2.
3.
4.
5.
6.
New
New
New
New
New
New
Crash-Safe Slaves
Multi-threaded Slaves
Time-delayed Replication
Optimized Row-based Replication
Replication Checksums
Global Transactions Identifiers (GTIDs)

8. 2. New Multi-threaded Slaves (설정)
my.cnf
relay-log-info-repository=TABLE
master-info-repository=TABLE
slave-parallel-workers=3
=============================================
mysql> stop slave;
Query OK, 0 rows affected, 1 warning (0.09 sec)
mysql> set global slave_parallel_workers=3;
Query OK, 0 rows affected (0.00 sec)
mysql> start slave;
Query OK, 0 rows affected, 1 warning (0.09 sec)

9. 2. New Multi-threaded Slaves
MASTER
mysql> show processlist;
+-----+------+--------------------------+------+-------------+------+-----------------------------------------------------------------------+------------------+
| Id | User | Host
| db
| Command
| Time | State
| Info
|
+-----+------+--------------------------+------+-------------+------+-----------------------------------------------------------------------+------------------+
| 146 | root | localhost
| NULL | Sleep
| 362 |
| NULL
|
| 147 | mig | db-ha-db2.daum.net:34782 | NULL | Binlog Dump | 269 | Master has sent all binlog to slave; waiting for binlog to be updated | NULL
|
| 148 | root | localhost
| NULL | Query
|
0 | init
| show processlist |
+-----+------+--------------------------+------+-------------+------+-----------------------------------------------------------------------+------------------+
3 rows in set (0.00 sec)
SLAVE
+-----+-------------+-----------+-------+---------+------+-----------------------------------------------------------------------------+------------------+
| Id | User
| Host
| db
| Command | Time | State
| Info
|
+-----+-------------+-----------+-------+---------+------+-----------------------------------------------------------------------------+------------------+
|
1 | system user |
| NULL | Connect | 1692 | Waiting for master to send event
| NULL
|
| 12 | root
| localhost | mysql | Query
|
0 | init
| show processlist |
| 602 | system user |
| NULL | Connect |
17 | Slave has read all relay log; waiting for the slave I/O thread to update it | NULL
|
| 603 | system user |
| NULL | Connect |
98 | Waiting for an event from Coordinator
| NULL
|
| 604 | system user |
| NULL | Connect |
79 | Waiting for an event from Coordinator
| NULL
|
| 605 | system user |
| NULL | Connect |
85 | Waiting for an event from Coordinator
| NULL
|
+-----+-------------+-----------+-------+---------+------+-----------------------------------------------------------------------------+------------------+

10. 2. New Multi-threaded Slaves
mysql> select * from slave_worker_infoG
*************************** 1. row ***************************
Id: 1
Relay_log_name:
Relay_log_pos: 0
Master_log_name:
Master_log_pos: 0
Checkpoint_relay_log_name:
Checkpoint_relay_log_pos: 0
Checkpoint_master_log_name:
Checkpoint_master_log_pos: 0
Checkpoint_seqno: 0
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
*************************** 2. row ***************************
Id: 2
Relay_log_name:
Relay_log_pos: 0
Master_log_name:
Master_log_pos: 0
Checkpoint_relay_log_name:
Checkpoint_relay_log_pos: 0
Checkpoint_master_log_name:
Checkpoint_master_log_pos: 0
Checkpoint_seqno: 0
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
*************************** 3. row ***************************
Id: 3
Relay_log_name:
Relay_log_pos: 0
Master_log_name:
Master_log_pos: 0
Checkpoint_relay_log_name:
Checkpoint_relay_log_pos: 0
Checkpoint_master_log_name:
Checkpoint_master_log_pos: 0
Checkpoint_seqno: 0
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
3 rows in set (0.00 sec)

11. 2. New Multi-threaded Slaves (thread 1)
MASTER
mysql> show processlist;
+----+------+--------------------------+-------+-------------+------+-----------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+
| Id | User | Host
| db
| Command
| Time | State
| Info
|
+----+------+--------------------------+-------+-------------+------+-----------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+
| 5 | root | localhost
| mysql | Query
|
0 | init
| show processlist
|
| 7 | mig | db-ha-db2.daum.net:58746 | NULL | Binlog Dump | 208 | Master has sent all binlog to slave; waiting for binlog to be updated | NULL
|
| 9 | root | localhost
| test | Query
|
1 | query end
| INSERT INTO sbtest(k, c, pad)
VALUES (0,' ','qqqqqqqqqqwwwwwwwwwweeeeeeeeeerrrrrrrrrrtttttttttt'),(0 |
+----+------+--------------------------+-------+-------------+------+-----------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------+
3 rows in set (0.00 sec)

12. 2. New Multi-threaded Slaves
mysql> select * from slave_worker_infoG
*************************** 1. row ***************************
Id: 1
Relay_log_name:
Relay_log_pos: 0
Master_log_name:
Master_log_pos: 0
Checkpoint_relay_log_name:
Checkpoint_relay_log_pos: 0
Checkpoint_master_log_name:
Checkpoint_master_log_pos: 0
Checkpoint_seqno: 0
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
*************************** 2. row ***************************
Id: 2
Relay_log_name:
Relay_log_pos: 0
Master_log_name:
Master_log_pos: 0
Checkpoint_relay_log_name:
Checkpoint_relay_log_pos: 0
Checkpoint_master_log_name:
Checkpoint_master_log_pos: 0
Checkpoint_seqno: 0
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
*************************** 3. row ***************************
Id: 3
Relay_log_name: ./db-ha-db2-relay-bin.000013
Relay_log_pos: 34788107
Master_log_name: mysql-bin.000003
Master_log_pos: 95818597
Checkpoint_relay_log_name: ./db-ha-db2-relay-bin.000013
Checkpoint_relay_log_pos: 33567507
Checkpoint_master_log_name: mysql-bin.000003
Checkpoint_master_log_pos: 94597997
Checkpoint_seqno: 1
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
3 rows in set (0.00 sec)

13. 2. New Multi-threaded Slaves
mysql> select * from slave_worker_info G
*************************** 1. row ***************************
Id: 1
Relay_log_name:
Relay_log_pos: 0
Master_log_name:
Master_log_pos: 0
Checkpoint_relay_log_name:
Checkpoint_relay_log_pos: 0
Checkpoint_master_log_name:
Checkpoint_master_log_pos: 0
Checkpoint_seqno: 0
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
*************************** 2. row ***************************
Id: 2
Relay_log_name: ./db-ha-db2-relay-bin.000013
Relay_log_pos: 182013734
Master_log_name: mysql-bin.000003
Master_log_pos: 243044224
Checkpoint_relay_log_name: ./db-ha-db2-relay-bin.000013
Checkpoint_relay_log_pos: 178351946
Checkpoint_master_log_name: mysql-bin.000003
Checkpoint_master_log_pos: 239382436
Checkpoint_seqno: 5
Checkpoint_group_size: 64
Checkpoint_group_bitmap: *
*************************** 3. row ***************************
Id: 3
Relay_log_name: ./db-ha-db2-relay-bin.000013
Relay_log_pos: 181403434
Master_log_name: mysql-bin.000003
Master_log_pos: 242433924
Checkpoint_relay_log_name: ./db-ha-db2-relay-bin.000013
Checkpoint_relay_log_pos: 178351946
Checkpoint_master_log_name: mysql-bin.000003
Checkpoint_master_log_pos: 239382436
Checkpoint_seqno: 4
Checkpoint_group_size: 64
Checkpoint_group_bitmap:
3 rows in set (0.00 sec)

14. 2. New Multi-threaded Slaves
-
CPU: 2 sockets, 6 cores with hyper-threading, 2930 MHz.
OS: 64-bit Oracle Enterprise Linux 6.1
Memory: 48 GB
sysbench unit test with multiple schema
빠르다!!!
Database 단위.... -_-;
Distribution ???

15. INDEX
1.
2.
3.
4.
5.
6.
New
New
New
New
New
New
Crash-Safe Slaves
Multi-threaded Slaves
Time-delayed Replication
Optimized Row-based Replication
Replication Checksums
Global Transactions Identifiers (GTIDs)

16. 3. New Time-delayed Replication
mysql> stop slave;
Query OK, 0 rows affected (0.04 sec)
mysql> CHANGE MASTER TO MASTER_DELAY =60;
Query OK, 0 rows affected (0.06 sec)
mysql> start slave;
Query OK, 0 rows affected, 1 warning (0.06 sec)

17. 3. New Time-delayed Replication
mysql> show slave statusG
*************************** 1. row ***************************
Master_Log_File: mysql-bin.000005
Read_Master_Log_Pos: 2652
Relay_Log_File: db-ha-db2-relay-bin.000002
Relay_Log_Pos: 314
Relay_Master_Log_File: mysql-bin.000005
Slave_IO_Running: Yes
Slave_SQL_Running: Yes
Exec_Master_Log_Pos: 2396
SQL_Delay: 60
SQL_Remaining_Delay: 33
Slave_SQL_Running_State: Waiting until MASTER_DELAY seconds after master
executed event
1 row in set (0.00 sec)

18. 3. New Time-delayed Replication
Drop 을 막을 수 있다…
서비스 이용에는... -_-;

19. INDEX
1.
2.
3.
4.
5.
6.
New
New
New
New
New
New
Crash-Safe Slaves
Multi-threaded Slaves
Time-delayed Replication
Optimized Row-based Replication
Replication Checksums
Global Transactions Identifiers (GTIDs)

20. 4. New Optimized Row-based Replication
my.cnf
binlog_row_image=MINMAL
#
#
#
#
default FULL
full : Log all columns
minimal : Log only changed columns, and columns needed to identify rows
noblob : Log all columns, except for unneeded BLOB and TEXT columns

21. 4. New Optimized Row-based Replication
mysql> reset master;
Query OK, 0 rows affected (0.08 sec)
mysql> show master status;
+------------------+----------+--------------+------------------+-------------------+
| File
| Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+------------------+----------+--------------+------------------+-------------------+
| mysql-bin.000001 |
151 |
|
|
|
+------------------+----------+--------------+------------------+-------------------+
1 row in set (0.00 sec)
mysql> show session variables like 'binlog_row_image';
+------------------+-------+
| Variable_name
| Value |
+------------------+-------+
| binlog_row_image | FULL |
+------------------+-------+
1 row in set (0.00 sec)
mysql> update sss set k=10 where id=1;
Query OK, 1 row affected (0.01 sec)
Rows matched: 1 Changed: 1 Warnings: 0
mysql> show master status;
+------------------+----------+--------------+------------------+----------------------------------------+
| File
| Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set
|
+------------------+----------+--------------+------------------+----------------------------------------+
| mysql-bin.000001 |
511 |
|
| c35b769a-8fac-11e2-a667-00a0d1e293e2:1 |
+------------------+----------+--------------+------------------+----------------------------------------+
1 row in set (0.00 sec)

22. 4. New Optimized Row-based Replication
mysql> set session binlog_row_image='MINIMAL';
Query OK, 0 rows affected (0.00 sec)
mysql> reset master;
Query OK, 0 rows affected (0.01 sec)
mysql> show master status;
+------------------+----------+--------------+------------------+-------------------+
| File
| Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
+------------------+----------+--------------+------------------+-------------------+
| mysql-bin.000001 |
151 |
|
|
|
+------------------+----------+--------------+------------------+-------------------+
1 row in set (0.00 sec)
mysql> update sss set k=11 where id=1;
Query OK, 1 row affected (0.02 sec)
Rows matched: 1 Changed: 1 Warnings: 0
mysql> show master status;
+------------------+----------+--------------+------------------+----------------------------------------+
| File
| Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set
|
+------------------+----------+--------------+------------------+----------------------------------------+
| mysql-bin.000001 |
399 |
|
| c35b769a-8fac-11e2-a667-00a0d1e293e2:1 |
+------------------+----------+--------------+------------------+----------------------------------------+
1 row in set (0.00 sec)

23. 4. New Optimized Row-based Replication
mysql> show session variables like 'binlog_row_image';
+------------------+-------+
| Variable_name
| Value |
+------------------+-------+
| binlog_row_image | FULL |
+------------------+-------+
1 row in set (0.00 sec)mysql> update sss set k=12 where
id=1;
Query OK, 1 row affected (0.01 sec)
Rows matched: 1 Changed: 1 Warnings: 0
mysql> show session variables like 'binlog_row_image';
+------------------+---------+
| Variable_name
| Value
|
+------------------+---------+
| binlog_row_image | MINIMAL |
+------------------+---------+
1 row in set (0.00 sec)mysql> update sss set k=11 where
id=1;
Query OK, 1 row affected (0.02 sec)
Rows matched: 1 Changed: 1 Warnings: 0
### UPDATE `ttt`.`sss`
### WHERE
###
@1=1
###
@2=11
###
@3=''
###
@4='qqqqqqqqqqwwwwwwwwwweeeeeeeeeerrrrrrrrrrtttttttttt
'
### SET
###
@1=1
###
@2=12
###
@3=''
###
@4='qqqqqqqqqqwwwwwwwwwweeeeeeeeeerrrrrrrrrrtttttttttt
'
# at 728
### UPDATE `ttt`.`sss`
### WHERE
###
@1=1
### SET
###
@2=11
# at 368

24. 4. New Optimized Row-based Replication
CREATE TABLE `t1` (
`a` int(11) NOT NULL DEFAULT '0',
`b` int(11) DEFAULT NULL,
`c` char(10) DEFAULT NULL,
PRIMARY KEY (`a`)
)
update t1 set b=10 where a=1;
### UPDATE `ttt`.`t1`
### WHERE
###
@1=1
### SET
###
@2=10
CREATE TABLE `t2` (
`a` int(11) NOT NULL DEFAULT '0',
`b` int(11) DEFAULT NULL,
`c` char(10) DEFAULT NULL,
PRIMARY KEY (`a`),
KEY `b` (`b`)
)
update t2 set b=10 where b=1;
### UPDATE `ttt`.`t2`
### WHERE
###
@1=101
### SET
###
@2=10
CREATE TABLE `t3` (
`a` int(11) DEFAULT NULL,
`b` int(11) DEFAULT NULL,
`c` char(10) DEFAULT NULL
)
update t3 set b=10 where a=1;
### UPDATE `ttt`.`t3`
### WHERE
###
@1=1
###
@2=100
###
@3='aaaaa'
### SET
###
@2=10

25. 4. New Optimized Row-based Replication
스마트해진 ROW format
PK가 필요함 !!!

26. INDEX
1.
2.
3.
4.
5.
6.
New
New
New
New
New
New
Crash-Safe Slaves
Multi-threaded Slaves
Time-delayed Replication
Optimized Row-based Replication
Replication Checksums
Global Transactions Identifiers (GTIDs)

27. 5. New Replication Checksums
MASTER
SLAVE
SQL thread
Dump thread
I/O thread
relay log
binary log
binlog_checksum
Default:CRC32 {NONE|CRC32}
master_verify_checksum Default:OFF {0|1}
slave_sql_verify_checksum Default:0 {0|1}

28. 5. New Replication Checksums
mysql> show binlog events in 'mysql-bin.000007' from 191;
+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+
| Log_name
| Pos | Event_type | Server_id | End_log_pos | Info
|
+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+
| mysql-bin.000007 | 191 | Gtid
|
1234 |
239 | SET @@SESSION.GTID_NEXT= 'c35b769a-8fac-11e2-a667-00a0d1e293e2:39' |
| mysql-bin.000007 | 239 | Query
|
1234 |
316 | BEGIN
|
| mysql-bin.000007 | 316 | Query
|
1234 |
418 | use `ttt`; insert into ttt values (12345)
|
| mysql-bin.000007 | 418 | Xid
|
1234 |
449 | COMMIT /* xid=1053612 */
|
+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+
4 rows in set (0.00 sec)
Binlog 수정
mysql> show binlog events in 'mysql-bin.000007' from 191;
+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+
| Log_name
| Pos | Event_type | Server_id | End_log_pos | Info
|
+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+
| mysql-bin.000007 | 191 | Gtid
|
1234 |
239 | SET @@SESSION.GTID_NEXT= 'c35b769a-8fac-11e2-a667-00a0d1e293e2:39' |
| mysql-bin.000007 | 239 | Query
|
1234 |
316 | BEGIN
|
| mysql-bin.000007 | 316 | Query
|
1234 |
418 | use `ttt`; insert into ttt values (12341)
|
| mysql-bin.000007 | 418 | Xid
|
1234 |
449 | COMMIT /* xid=1053612 */
|
+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+
4 rows in set (0.00 sec)
mysql> SET GLOBAL MASTER_VERIFY_CHECKSUM=1;
Query OK, 0 rows affected (0.00 sec)
mysql> show binlog events in 'mysql-bin.000007' from 191;
ERROR 1220 (HY000): Error when executing command SHOW BINLOG EVENTS: Wrong offset or I/O error
#130327 20:59:04 server id 1234
use `ttt`/*!*/;
SET TIMESTAMP=1364385544/*!*/;
insert into ttt values (12645)
/*!*/;
# at 418
end_log_pos 418 CRC32 0x171597fb
Query
thread_id=148
exec_time=0
error_code=0

29. 5. New Replication Checksums
MASTER
SLAVE
Dump thread
SQL
thread
I/O
thread
relay log
binary log
장애부분 최소화
느려요~

30. INDEX
1.
2.
3.
4.
5.
6.
New
New
New
New
New
New
Crash-Safe Slaves
Multi-threaded Slaves
Time-delayed Replication
Optimized Row-based Replication
Replication Checksums
Global Transactions Identifiers (GTIDs)

31. 6. New Global Transactions Identifiers (GTIDs)
my.cnf
log-bin
log-slave-updates
gtid-mode=ON
disable-gtid-unsafe-statements
mysql> show master statusG
*************************** 1. row ***************************
File: mysql-bin.000007
Position: 449
Binlog_Do_DB:
Binlog_Ignore_DB:
Executed_Gtid_Set: c35b769a-8fac-11e2-a667-00a0d1e293e2:1-39
1 row in set (0.00 sec)
mysql> show slave statusG
Retrieved_Gtid_Set: c35b769a-8fac-11e2-a667-00a0d1e293e2:38-45
Executed_Gtid_Set: 6873760e-8fb3-11e2-a693-00a0d1e291dc:1-2,
c35b769a-8fac-11e2-a667-00a0d1e293e2:1-61152

32. 6. New Global Transactions Identifiers (GTIDs)

33. 6. New Global Transactions Identifiers (GTIDs)

35. 고맙습니다