I Goo Lee, profile picture
Uploaded byI Goo Lee
510 views

Spider Setup with AWS/sandbox

This document discusses the setup and architecture of a MySQL Spider configuration. It describes installing multiple MySQL instances on a single server, including 4 MariaDB 10.1 nodes and 6 MySQL 5.7 nodes. It then configures the Spider storage engine to partition tables across these nodes for both data sharding and high availability. Examples are provided of creating servers, tables, and inserting/selecting data to demonstrate the federated and sharded architecture.

Embed presentation

Download to read offline
café.naver.com/mysqlpg 1 Spider Architecture 날짜 : 2016.03.21 Ver. 1.0 작성 : DB실 전수진
café.naver.com/mysqlpg  Spider Setup  Architecture  Topology Agenda
café.naver.com/mysqlpg  Spider Setup  Architecture  Topology Agenda
café.naver.com/mysqlpg Setup
café.naver.com/mysqlpg Setup
café.naver.com/mysqlpg Setup ■ Server Spec
café.naver.com/mysqlpg Setup ■ MySQL Install Sandbox : http://mysqlsandbox.net/
café.naver.com/mysqlpg Setup ■ MySQL Install Step 1. 사전 요구 프로그램 설치 sudo su - yum install -y gcc automake autoconf libtool make cpan libstdc* yum install -y perl-CPAN yum install -y --skip-broken perl* cpan YAML
café.naver.com/mysqlpg Setup ■ MySQL Install Step 2. 그룹(mysql)/계정(maria) 생성 sudo su - mkdir -p /usr1/program mkdir -p /usr1/mysql/dba/tools groupadd -g 900 mysql cat /etc/group | grep -E 'mysql|maria' useradd maria -g mysql -d /home/maria -u 901 -c mysql_user echo 'maria:oracle' | chpasswd cat /etc/passwd | grep -E 'mysql|maria' chown -R maria:mysql /usr1 ls -l /usr1
café.naver.com/mysqlpg Setup ■ MySQL Install Step 3. Sandbox Download & Compile sudo su - cd /usr1/program wget http://search.cpan.org/CPAN/authors/id/G/GM/GMAX/MySQL-Sandbox-3.1.05.tar.gz ls -l MySQL-Sandbox* tar xvfz MySQL-Sandbox-3.1.05.tar.gz cd MySQL-Sandbox-3.1.05 perl Makefile.PL make && make test make install
café.naver.com/mysqlpg Setup ■ MySQL Install Step 4. MariaDB 10.1 (SpiderNode) / MySQL 5.7 (DataNode) Binary Download su - maria cd /usr1/program/ wget http://ftp.kaist.ac.kr/mariadb//mariadb-10.1.12/bintar-linux-glibc_214-x86_64/mariadb-10.1.12-linux-glibc_214-x86_64.tar.gz tar xvfz mariadb-10.1.12-linux-glibc_214-x86_64.tar.gz mv mariadb-10.1.12-linux-glibc_214-x86_64 /usr1/mysql/10.1.12 wget https://downloads.mariadb.com/archives/mysql-5.7/mysql-5.7.11-linux-glibc2.5-x86_64.tar.gz tar zxvf mysql-5.7.11-linux-glibc2.5-x86_64.tar.gz mv mysql-5.7.11-linux-glibc2.5-x86_64 /usr1/mysql/5.7.11 ls -l /usr1/mysql chown -R maria:mysql /usr1
café.naver.com/mysqlpg Setup ■ MySQL Install Step 5. Multi Instance Install (Spider : 4, Data : 6) su - maria cd /usr1/mysql mkdir -p /usr1/mysql/sandboxes make_multiple_sandbox -r spider_node 10.1.12 --upper_directory=/usr1/mysql/sandboxes --how_many_nodes=4 make_multiple_sandbox -r data_node 5.7.11 --upper_directory=/usr1/mysql/sandboxes --how_many_nodes=6 ps -ef | awk -F ' ' '{print $2, $9;}' | grep mysqld_safe 6479 /usr1/mysql/10.1.12/bin/mysqld_safe … 7604 /usr1/mysql/5.7.11/bin/mysqld_safe … netstat -nap | grep LISTEN | grep mysql
café.naver.com/mysqlpg Setup ■ MySQL Install Step 5. Multi Instance Install # Port 변경 (Spider Node) cd /usr1/mysql/sandboxes/spider_node && ./stop_all cd /usr1/mysql/sandboxes/spider_node/node1 && ./change_ports 3306 cd /usr1/mysql/sandboxes/spider_node/node2 && ./change_ports 3307 cd /usr1/mysql/sandboxes/spider_node/node3 && ./change_ports 9906 cd /usr1/mysql/sandboxes/spider_node/node4 && ./change_ports 9907 cd /usr1/mysql/sandboxes/spider_node && ./start_all cd /usr1/mysql/sandboxes/spider_node && ./status_all cd /usr1/mysql/sandboxes/spider_node && ./use_all -e " select version()" netstat -nap | grep LISTEN | grep mysql 3306 10001 10002 10003
café.naver.com/mysqlpg Setup ■ MySQL Install Step 5. Multi Instance Install # Port 변경 (Data Node) cd /usr1/mysql/sandboxes/data_node && ./stop_all cd /usr1/mysql/sandboxes/data_node/node1 && ./change_ports 10001 cd /usr1/mysql/sandboxes/data_node/node2 && ./change_ports 10002 cd /usr1/mysql/sandboxes/data_node/node3 && ./change_ports 10003 cd /usr1/mysql/sandboxes/data_node/node4 && ./change_ports 20001 cd /usr1/mysql/sandboxes/data_node/node5 && ./change_ports 20002 cd /usr1/mysql/sandboxes/data_node/node6 && ./change_ports 20003 cd /usr1/mysql/sandboxes/data_node && ./start_all cd /usr1/mysql/sandboxes/data_node && ./status_all cd /usr1/mysql/sandboxes/data_node && ./use_all -e " select version()" netstat -nap | grep LISTEN | grep mysql 3306 10001 10002 10003
café.naver.com/mysqlpg Setup ■ MySQL Install Step 6. Define an easy way to access the nodes from the MariaDB or MySQL client su - maria alias spider1='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=3306 --socket=/tmp/mysql_sandbox3306.sock' alias spider2='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=3307 --socket=/tmp/mysql_sandbox3307.sock' alias spider3='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=9906 --socket=/tmp/mysql_sandbox9906.sock' alias spider4='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=9907 --socket=/tmp/mysql_sandbox9907.sock' alias backend1='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=10001 --socket=/tmp/mysql_sandbox10001.sock alias backend2='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=10002 --socket=/tmp/mysql_sandbox10002.sock alias backend3='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=10003 --socket=/tmp/mysql_sandbox10003.sock alias backend11='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=20001 --socket=/tmp/mysql_sandbox20001.sock' alias backend12='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=20002 --socket=/tmp/mysql_sandbox20002.sock' alias backend13='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=20003 --socket=/tmp/mysql_sandbox20003.sock' $ spider1 -e "select version()" +-----------------+ | version() | +-----------------+ | 10.1.12-MariaDB | +-----------------+ $ backend1 -e "select version()" +------------+ | version() | +------------+ | 5.7.11-log | +------------+
café.naver.com/mysqlpg Setup ■ MySQL Install Step 6. Define an easy way to access the nodes from the MariaDB or MySQL client su – maria cd /usr1/mysql/dba
café.naver.com/mysqlpg Setup Spider_node general_log data_node1 general_log data_node2 general_log
café.naver.com/mysqlpg Setup
café.naver.com/mysqlpg  Spider Setup  Architecture  Topology Agenda
café.naver.com/mysqlpg Architecture ■ Type Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ # Federation # Sharding # High Availability
café.naver.com/mysqlpg Architecture ■ Federation Without connection pool or MariaDB thread pool, HaProxy and Spider have been protecting the tcp socket overflow without specific TCP tuning. Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1 << EOF DROP DATABASE IF EXISTS backend ; CREATE DATABASE backend; CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; DESC backend.sbtest; EOF ①
café.naver.com/mysqlpg Architecture ■ Federation Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF DROP SERVER IF EXISTS backend1; CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10001); EOF②
café.naver.com/mysqlpg Architecture ■ Federation Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE DATABASE IF NOT EXISTS test; DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql",srv "backend1"'; SELECT * FROM test.sbtest LIMIT 10; EOF ③
café.naver.com/mysqlpg Architecture ■ Federation & HA Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF backend2 << EOF … EOF backend3 << EOF … EOF ①①
café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10001); CREATE SERVER backend2 FOREIGN DATA WRAPPER mysql … CREATE SERVER backend3 FOREIGN DATA WRAPPER mysql … EOF ■ Federation & HA ②
café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE DATABASE IF NOT EXISTS test; DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql",srv "backend1 backend2 backend3"'; SELECT * FROM test.sbtest LIMIT 10; EOF ■ Federation & HA ③
café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF TRUNCATE TABLE test.sbtest; Insert into test.sbtest values (1, 100, 'A', 'A1'); Insert into test.sbtest values (2, 200, 'A', 'A1'); Insert into test.sbtest values (3, 300, 'A', 'A1'); Insert into test.sbtest values (4, 400, 'A', 'A1'); Insert into test.sbtest values (5, 500, 'A', 'A1'); SELECT * FROM test.sbtest; EOF backend1 -e"select count(*) from backend.sbtest;" backend2 -e"select count(*) from backend.sbtest;" backend3 -e"select count(*) from backend.sbtest;" +----------+ | count(*) | +----------+ | 5 | +----------+ ■ Federation & HA ④ 동일한 데이터를 확인할 수 있음 !
café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ cd /usr1/mysql/sandboxes/data_node/node2 && ./stop spider1 -e "Insert into test.sbtest values (11, 1100, 'A', 'A1');" -- ERROR 1429 (HY000) at line 1: Unable to connect to foreign data source: backend2 backend1 -e"select count(*) from backend.sbtest;" -- 5 backend2 -e"select count(*) from backend.sbtest;" -- ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql_sandbox100 backend3 -e"select count(*) from backend.sbtest;" -- 5 ■ Federation & HA Datanode2 장애유발!
café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ ■ Federation & HA spider1 << EOF DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql",srv "backend1 backend3"'; EOF spider1 -e "Insert into test.sbtest values (11, 1100, 'A', 'A1');" backend1 -e"select count(*) from backend.sbtest;" backend3 -e"select count(*) from backend.sbtest;" -- 6 -- 6 복구방법 : 테이블의 정의를 변경함 으로써 빠르게 복구 가능
café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF backend2 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF ■ Sharding Data Sharding ②①
café.naver.com/mysqlpg Architecture ■ Sharding Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10001); CREATE SERVER backend2 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10002); EOF ③ ④
café.naver.com/mysqlpg Architecture ■ Sharding Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE DATABASE IF NOT EXISTS test; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1"' , PARTITION pt2 COMMENT = 'srv "backend2"' ); SELECT count(*) FROM test.sbtest LIMIT 10; EOF ⑤
café.naver.com/mysqlpg Architecture ■ Sharding Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF TRUNCATE TABLE test.sbtest; Insert into test.sbtest values (1, 100, 'A', 'A1'); Insert into test.sbtest values (2, 200, 'A', 'A1'); Insert into test.sbtest values (3, 300, 'A', 'A1'); Insert into test.sbtest values (4, 400, 'A', 'A1'); Insert into test.sbtest values (5, 500, 'A', 'A1'); SELECT * FROM test.sbtest; EOF backend1 -e"select count(*) from backend.sbtest;" -- 3 backend2 -e"select count(*) from backend.sbtest;" -- 2 ⑥
café.naver.com/mysqlpg Architecture ■ High Availability Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; CREATE TABLE backend_rpl.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF backend2 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; CREATE TABLE backend_rpl.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF ②① back1 back1_rpl back2 back2_rpl
café.naver.com/mysqlpg Architecture ■ High Availability Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend‘ , … , PORT 10001); CREATE SERVER backend1_rpl FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend_rpl‘, … , PORT 10001); CREATE SERVER backend2 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend‘ , … , PORT 10002); CREATE SERVER backend2_rpl FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend_rpl‘, … , PORT 10002); EOF back1 back1_rpl back2 back2_rpl ④③
café.naver.com/mysqlpg Architecture ■ High Availability Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 << EOF CREATE DATABASE IF NOT EXISTS test; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl"' ); INSERT INTO test.sbtest select 10000001, 0, '' ,'replicas test'; EOF ⑤
café.naver.com/mysqlpg Architecture ■ High Availability Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl backend1 -e "SELECT * FROM backend.sbtest WHERE id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ backend2 -e "SELECT * FROM backend.sbtest where id=10000001"; backend2 -e "SELECT * FROM backend_rpl.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ ⑥
café.naver.com/mysqlpg Architecture ■ High Availability Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 << EOF insert into test.sbtest values (1, 100, 'A', 'A1'); insert into test.sbtest values (2, 200, 'A', 'A1'); insert into test.sbtest values (3, 300, 'A', 'A1'); insert into test.sbtest values (4, 400, 'A', 'A1'); insert into test.sbtest values (5, 500, 'A', 'A1'); EOF backend1 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 4 | 2 | +------+------+ backend2 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 2 | 4 | +------+------+ ⑦ ⑧ 4 42 2
café.naver.com/mysqlpg Architecture ■ High Availability What is happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ cd /usr1/mysql/sandboxes/data_node/node1 && ./stop backend1 -e "SELECT * FROM backend.sbtest where id=10000001" -- ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql_sandbox10001.sock' spider1 -e "SELECT * FROM test.sbtest where id=10000001"; -- ERROR 1429 (HY000): Unable to connect to foreign data source: backend1_rpl spider1 -e "SELECT * from mysql.spider_tables order by link_id, server"; cd /usr1/mysql/sandboxes/data_node/node1 && ./start spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ ⑨ ⑩ 4 42 2
café.naver.com/mysqlpg Architecture ■ High Availability What is happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl -- Data Node Replica 모니터링 등록 spider1 << EOF DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT … ) ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl", mbk "2", mkd "2", msi "1", link_status "0 0"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl", mbk "2", mkd "2", msi "1", link_status "0 0"' ); CREATE SERVER mon FOREIGN DATA WRAPPER mysql OPTIONS ( HOST '127.0.0.1', DATABASE 'test', … , PORT 3306); INSERT INTO mysql.spider_link_mon_servers VALUES ('%','%','%',1,'mon‘ ,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,0,NULL,NULL); SELECT * FROM mysql.spider_link_mon_servers; SELECT spider_flush_table_mon_cache(); EOF HA 모니터링을 관장할 서버의 @@Service_ID - Spider_Node : 1, 2 - Data_Node : 101, 102 Node Status 1 : 정상, 3 : 중지 2 : 관리 작업 중 @@server_id = 1 @@server_id = 101 @@server_id = 102 ⑪
café.naver.com/mysqlpg Architecture ■ High Availability What is happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ cd /usr1/mysql/sandboxes/data_node/node1 && ./stop backend1 -e "SELECT * FROM backend.sbtest where id=10000001" -- ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql_sandbox10001.sock' spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ spider1 -e "SELECT * from mysql.spider_tables order by link_id, server"; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 3 | | 1 | backend1_rpl | sbtest#P#pt2 | 3 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ 데이터 조회는 되었지만, 실제는 fail 상태로 존재함 ⑫
café.naver.com/mysqlpg Architecture ■ High Availability What is happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl cd /usr1/mysql/sandboxes/data_node/node1 && ./start spider1 << EOF select * from mysql.spider_tables order by link_id, server, table_name; -- link status 변경 : fail -> maintenance ALTER TABLE test.sbtest ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl", mbk "2", mkd "2", msi "1", link_status "2 0"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl", mbk "2", mkd "2", msi "1", link_status "0 2"' ); select * from mysql.spider_tables order by link_id, server, table_name; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 2 | | 1 | backend1_rpl | sbtest#P#pt2 | 2 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ ⑬
café.naver.com/mysqlpg Architecture ■ High Availability What is happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl select * from mysql.spider_tables order by link_id, server, table_name; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 2 | | 1 | backend1_rpl | sbtest#P#pt2 | 2 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ select spider_copy_tables('test.sbtest#P#pt1','1','0'); -- 1 select spider_copy_tables('test.sbtest#P#pt2','0','1'); -- 1 ⑭
café.naver.com/mysqlpg Architecture ■ High Availability What is happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl -- link status 변경 : maintenance -> live ALTER TABLE test.sbtest ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl", mbk "2", mkd "2", msi "1", link_status "1 0"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl", mbk "2", mkd "2", msi "1", link_status "0 1"' ); select * from mysql.spider_tables order by link_id, server, table_name; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 1 | | 1 | backend1_rpl | sbtest#P#pt2 | 1 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ ⑮
café.naver.com/mysqlpg Architecture ■ High Availability Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 << EOF insert into test.sbtest values (1, 100, 'A', 'A1'); insert into test.sbtest values (2, 200, 'A', 'A1'); insert into test.sbtest values (3, 300, 'A', 'A1'); insert into test.sbtest values (4, 400, 'A', 'A1'); insert into test.sbtest values (5, 500, 'A', 'A1'); EOF backend1 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 4 | 2 | +------+------+ backend2 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 2 | 4 | +------+------+
café.naver.com/mysqlpg Architecture ■ High Availability Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ select link_id, server, table_name, link_status from mysql.spider_tables order by link_id, server, table_name
café.naver.com/mysqlpg Architecture ■ High Availability
café.naver.com/mysqlpg Architecture
café.naver.com/mysqlpg  Spider Setup  Architecture  Topology Agenda
café.naver.com/mysqlpg Topology FrontDB Master1 Slave1 Master2 Slave2 Master3 Slave3
café.naver.com/mysqlpg Topology FrontDB Master1 Slave1 Master2 Slave2 Master3 Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 CollectDB (ETL)
café.naver.com/mysqlpg Topology Master1 Slave1 Master2 Slave2 Master3 Slave3 FrontDB1 FrontDB2 CollectDB1 (admintool) CollectDB2 (ETL)
café.naver.com/mysqlpg Topology Master3 Master3a Master1 Master1a Master2 Master2a FrontDB1 FrontDB2 CollectDB FrontDB Master1 Slave1 Master2 Slave2 Master3 Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 CollectDB (ETL) Master1 Slave1 Master2 Slave2 Master3 Slave3 FrontDB1 FrontDB2 CollectDB1 (admintool) CollectDB2 (ETL)
café.naver.com/mysqlpg Topology FrontDB Master1 Slave1 Master2 Slave2 Master3 Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 FrontDB1 FrontDB2 Master1 Master1a Master2 MAster2a Master3 Master3a FrontDB1 FrontDB2 & CollectDB CollectDB (ETL) CollectDB1 (admintool) CollectDB2 (ETL) Master3 Master3a Master1 Master1a Master2 Master2a FrontDB1 FrontDB2
café.naver.com/mysqlpg Topology FrontShard1 FrontShard2 Master1 Master1a Master2 MAster2a Spec : 12Core / 32GB  Spider : 1GB  Data1 : 6GB  Data2 : 6GB  DB Connection 수에 주의 !!! Dev, QA Live 1단계 FrontShard1 FrontShard2 Master1 Master1a Master2 MAster2a DB 부하 및 서비스 오픈 전략에 맞춰 서버 배치 진행 Live 2단계
café.naver.com/mysqlpg

More Related Content

PDF
Deep Dive Spider Engine
byI Goo Lee
 
PPT
SnortReport Presentation
bywebhostingguy
 
PPT
Intrusion Detection System using Snort
bywebhostingguy
 
ODP
Proxy arp
byMarian Marinov
 
DOCX
Nginx 0.8.x 安装手册
byYiwei Ma
 
DOCX
Nginx 0.9.x 安装手册
byYiwei Ma
 
PPTX
Creating "Secure" PHP applications, Part 2, Server Hardening
byarchwisp
 
PDF
Control hypervisor via libvirt
bySean Chang
 
Deep Dive Spider Engine
byI Goo Lee
 
SnortReport Presentation
bywebhostingguy
 
Intrusion Detection System using Snort
bywebhostingguy
 
Proxy arp
byMarian Marinov
 
Nginx 0.8.x 安装手册
byYiwei Ma
 
Nginx 0.9.x 安装手册
byYiwei Ma
 
Creating "Secure" PHP applications, Part 2, Server Hardening
byarchwisp
 
Control hypervisor via libvirt
bySean Chang
 

What's hot

PDF
DBA だってもっと効率化したい！〜最近の自動化事情とOracle Database〜
byMichitoshi Yoshida
 
PDF
Tested install-isp config3-ubuntu-16-04
bySANTIAGO HERNÁNDEZ
 
PDF
Setting up a HADOOP 2.2 cluster on CentOS 6
byManish Chopra
 
ODP
Linux Kernel Crashdump
byMarian Marinov
 
PDF
The true story_of_hello_world
byfantasy zheng
 
PDF
SSH: Seguranca no Acesso Remoto
byTiago Cruz
 
DOCX
Cacti安装手册
byYiwei Ma
 
PDF
How to train your L3DSR with PBR - MEMO -
byNaoto MATSUMOTO
 
PDF
MQTTS mosquitto - cheat sheet -
byNaoto MATSUMOTO
 
PDF
OSMC 2019 | Use Cloud services & features in your redundant Icinga2 Environme...
byNETWAYS
 
PDF
Hdf installing-hdf
bynmrrsc
 
PPSX
Linux configer
byMD. AL AMIN
 
PDF
R-House (LSRC)
byFernand Galiana
 
PDF
Web Server Free Bsd
byKwanchai Charoennet
 
ODP
Monitoring at/with SUSE 2015
byLars Vogdt
 
PPTX
MySQL InnoDB Cluster 미리보기 (remote cluster test)
bySeungmin Yu
 
PDF
Jvm的最小使用内存测试
byZianed Hou
 
ODP
Triangle OpenStack meetup 09 2013
byDan Radez
 
PDF
How to twist a IPv6 over Bluetooth (6lowpan)
byNaoto MATSUMOTO
 
PDF
NoSQL атакует: JSON функции в MySQL сервере.
bySveta Smirnova
 
DBA だってもっと効率化したい！〜最近の自動化事情とOracle Database〜
byMichitoshi Yoshida
 
Tested install-isp config3-ubuntu-16-04
bySANTIAGO HERNÁNDEZ
 
Setting up a HADOOP 2.2 cluster on CentOS 6
byManish Chopra
 
Linux Kernel Crashdump
byMarian Marinov
 
The true story_of_hello_world
byfantasy zheng
 
SSH: Seguranca no Acesso Remoto
byTiago Cruz
 
Cacti安装手册
byYiwei Ma
 
How to train your L3DSR with PBR - MEMO -
byNaoto MATSUMOTO
 
MQTTS mosquitto - cheat sheet -
byNaoto MATSUMOTO
 
OSMC 2019 | Use Cloud services & features in your redundant Icinga2 Environme...
byNETWAYS
 
Hdf installing-hdf
bynmrrsc
 
Linux configer
byMD. AL AMIN
 
R-House (LSRC)
byFernand Galiana
 
Web Server Free Bsd
byKwanchai Charoennet
 
Monitoring at/with SUSE 2015
byLars Vogdt
 
MySQL InnoDB Cluster 미리보기 (remote cluster test)
bySeungmin Yu
 
Jvm的最小使用内存测试
byZianed Hou
 
Triangle OpenStack meetup 09 2013
byDan Radez
 
How to twist a IPv6 over Bluetooth (6lowpan)
byNaoto MATSUMOTO
 
NoSQL атакует: JSON функции в MySQL сервере.
bySveta Smirnova
 

Similar to Spider Setup with AWS/sandbox

PDF
Intro ProxySQL
byI Goo Lee
 
PDF
MariaDB 10.5 binary install (바이너리 설치)
byNeoClova
 
PDF
MySQL for Beginners - part 1
byIvan Zoratti
 
PPTX
ProxySQL for MySQL
byMydbops
 
PDF
Multiple instances on linux
byVasudeva Rao
 
PDF
Percona Live 2012PPT： introduction-to-mysql-replication
bymysqlops
 
DOCX
MariaDB10.7_install_Ubuntu.docx
byNeoClova
 
PPTX
Postgres-BDR with Google Cloud Platform
bySungJae Yun
 
PDF
MySQL Fabric Tutorial, October 2014
byLars Thalmann
 
PDF
My sql cluster case study apr16
bySumi Ryu
 
PDF
Proxy SQL 2.0 with PXC
byVinicius M Grippa
 
PDF
Lab 1 my sql tutorial
byManuel Contreras
 
DOCX
Multiple instances second method
byVasudeva Rao
 
PDF
Get mysql clusterrunning-windows
byJoeSg
 
PDF
Percona XtraDB 集群安装与配置
byYUCHENG HU
 
PDF
Thijs Feryn - Leverage HTTP to deliver cacheable websites - Codemotion Milan ...
byCodemotion
 
PDF
MySQL Webinar 2/4 Performance tuning, hardware, optimisation
byMark Swarbrick
 
PDF
Highly Available MySQL/PHP Applications with mysqlnd
byJervin Real
 
PDF
Amazed by aws 1st session
byAmazon Web Services Korea
 
PDF
NOSQL Meets Relational - The MySQL Ecosystem Gains More Flexibility
byIvan Zoratti
 
Intro ProxySQL
byI Goo Lee
 
MariaDB 10.5 binary install (바이너리 설치)
byNeoClova
 
MySQL for Beginners - part 1
byIvan Zoratti
 
ProxySQL for MySQL
byMydbops
 
Multiple instances on linux
byVasudeva Rao
 
Percona Live 2012PPT： introduction-to-mysql-replication
bymysqlops
 
MariaDB10.7_install_Ubuntu.docx
byNeoClova
 
Postgres-BDR with Google Cloud Platform
bySungJae Yun
 
MySQL Fabric Tutorial, October 2014
byLars Thalmann
 
My sql cluster case study apr16
bySumi Ryu
 
Proxy SQL 2.0 with PXC
byVinicius M Grippa
 
Lab 1 my sql tutorial
byManuel Contreras
 
Multiple instances second method
byVasudeva Rao
 
Get mysql clusterrunning-windows
byJoeSg
 
Percona XtraDB 集群安装与配置
byYUCHENG HU
 
Thijs Feryn - Leverage HTTP to deliver cacheable websites - Codemotion Milan ...
byCodemotion
 
MySQL Webinar 2/4 Performance tuning, hardware, optimisation
byMark Swarbrick
 
Highly Available MySQL/PHP Applications with mysqlnd
byJervin Real
 
Amazed by aws 1st session
byAmazon Web Services Korea
 
NOSQL Meets Relational - The MySQL Ecosystem Gains More Flexibility
byIvan Zoratti
 

More from I Goo Lee

PDF
MySQL Deep dive with FusionIO
byI Goo Lee
 
PDF
AWS 환경에서 MySQL BMT
byI Goo Lee
 
PDF
AWS Aurora 100% 활용하기
byI Goo Lee
 
PDF
AWS 환경에서 MySQL Infra 설계하기-2본론
byI Goo Lee
 
PDF
MySQL 상태 메시지 분석 및 활용
byI Goo Lee
 
PDF
MySQL Audit using Percona audit plugin and ELK
byI Goo Lee
 
PDF
From MSSQL to MySQL
byI Goo Lee
 
PDF
텔레그램을 이용한 양방향 모니터링 시스템 구축
byI Goo Lee
 
PDF
PostgreSQL 이야기
byI Goo Lee
 
PDF
From MSSQL to MariaDB
byI Goo Lee
 
PDF
Federated Engine 실무적용사례
byI Goo Lee
 
PDF
MySQL Slow Query log Monitoring using Beats & ELK
byI Goo Lee
 
PDF
MS 빅데이터 서비스 및 게임사 PoC 사례 소개
byI Goo Lee
 
PDF
MySQL_Fabric_운영시유의사항
byI Goo Lee
 
PDF
Intro KaKao ADT (Almighty Data Transmitter)
byI Goo Lee
 
PDF
Backup automation in KAKAO
byI Goo Lee
 
PDF
Intro KaKao MRTE (MySQL Realtime Traffic Emulator)
byI Goo Lee
 
PDF
MySQL 5.7 NF – JSON Datatype 활용
byI Goo Lee
 
PDF
AWS 환경에서 MySQL Infra 설계하기-1도입부분
byI Goo Lee
 
PDF
MySQL 5.7 NF – Optimizer Improvement
byI Goo Lee
 
MySQL Deep dive with FusionIO
byI Goo Lee
 
AWS 환경에서 MySQL BMT
byI Goo Lee
 
AWS Aurora 100% 활용하기
byI Goo Lee
 
AWS 환경에서 MySQL Infra 설계하기-2본론
byI Goo Lee
 
MySQL 상태 메시지 분석 및 활용
byI Goo Lee
 
MySQL Audit using Percona audit plugin and ELK
byI Goo Lee
 
From MSSQL to MySQL
byI Goo Lee
 
텔레그램을 이용한 양방향 모니터링 시스템 구축
byI Goo Lee
 
PostgreSQL 이야기
byI Goo Lee
 
From MSSQL to MariaDB
byI Goo Lee
 
Federated Engine 실무적용사례
byI Goo Lee
 
MySQL Slow Query log Monitoring using Beats & ELK
byI Goo Lee
 
MS 빅데이터 서비스 및 게임사 PoC 사례 소개
byI Goo Lee
 
MySQL_Fabric_운영시유의사항
byI Goo Lee
 
Intro KaKao ADT (Almighty Data Transmitter)
byI Goo Lee
 
Backup automation in KAKAO
byI Goo Lee
 
Intro KaKao MRTE (MySQL Realtime Traffic Emulator)
byI Goo Lee
 
MySQL 5.7 NF – JSON Datatype 활용
byI Goo Lee
 
AWS 환경에서 MySQL Infra 설계하기-1도입부분
byI Goo Lee
 
MySQL 5.7 NF – Optimizer Improvement
byI Goo Lee
 

Recently uploaded

PDF
ENVIRONMENTAL ENGINEERING LABORATORY MANUAL UG Lab Manual - Dept of ESE.pdf
byChemical Engineering Dept. NIT Rourkela-769008, Odisha, India
 
PDF
Addressing GPU Bottlenecks: Out of Order Scheduling | Prayag Mohanty | IIT Bo...
byPrayag Mohanty
 
PDF
Non-Deterministic Finite Automata (NFA) to Deterministic Finite Automata (DFA...
byNileshPardeshi28
 
PPTX
Unit I – Introduction to Devops Deployment Pipeline & Design Options Deploym...
byvenkadeshr123
 
PPT
5.1 Basic concept and hierarchy.ppt1234564
byChetansingh768231
 
PDF
Damped Oscillations through different mediums
byandysoccer530
 
PDF
lecture notes digital_design_examples.pdf
bygeekcooder2020
 
PDF
A wire harness (also called a wiring harness or cable harness)
byabhinandankondekar2
 
PDF
Engineering Mindset for Everyday Leadership — James Afful [Emerging Leaders o...
byJames Afful
 
PDF
Diode Applications Theory For Fundamentals of Electronics
byKarlGrimson
 
PPTX
low power design COURSE PREREQUISITES Digital System Design, VLSI Design & El...
byshivannapraveen88
 
PPTX
Basics_of_Electronics_Simplebysreeragsr.pptx
bysreeragsr2006
 
PPT
software-security-intro Secure software Design and Development
bysahar62648
 
PDF
-الشهادة وعتماد 2.pdf كلريوس الهندسة المدنية والعمارية تخصص هندسة المساحة
byqp123qp12320
 
PPTX
Why Hydraulic Flushing Should Never Be Skipped Before Commissioning
byNeometrix_Engineering_Pvt_Ltd
 
PPT
Lock out Tag Out Training for Safe Maintenance activity
byBalakrishnanRamasamy14
 
PPTX
Solar PV An Essential Requirement in renewable energy based sources Industria...
byshilpashukla2025
 
PDF
How to Write Research Papers NCBP D3.pdf
byDr. Rahul Pandya
 
PPTX
Amperes Circuital Law and its appliocations
byKasiselvanathanMarim1
 
PPT
Smart waste management using internet of things 2025.ppt
byJeganKalaimani
 
ENVIRONMENTAL ENGINEERING LABORATORY MANUAL UG Lab Manual - Dept of ESE.pdf
byChemical Engineering Dept. NIT Rourkela-769008, Odisha, India
 
Addressing GPU Bottlenecks: Out of Order Scheduling | Prayag Mohanty | IIT Bo...
byPrayag Mohanty
 
Non-Deterministic Finite Automata (NFA) to Deterministic Finite Automata (DFA...
byNileshPardeshi28
 
Unit I – Introduction to Devops Deployment Pipeline & Design Options Deploym...
byvenkadeshr123
 
5.1 Basic concept and hierarchy.ppt1234564
byChetansingh768231
 
Damped Oscillations through different mediums
byandysoccer530
 
lecture notes digital_design_examples.pdf
bygeekcooder2020
 
A wire harness (also called a wiring harness or cable harness)
byabhinandankondekar2
 
Engineering Mindset for Everyday Leadership — James Afful [Emerging Leaders o...
byJames Afful
 
Diode Applications Theory For Fundamentals of Electronics
byKarlGrimson
 
low power design COURSE PREREQUISITES Digital System Design, VLSI Design & El...
byshivannapraveen88
 
Basics_of_Electronics_Simplebysreeragsr.pptx
bysreeragsr2006
 
software-security-intro Secure software Design and Development
bysahar62648
 
-الشهادة وعتماد 2.pdf كلريوس الهندسة المدنية والعمارية تخصص هندسة المساحة
byqp123qp12320
 
Why Hydraulic Flushing Should Never Be Skipped Before Commissioning
byNeometrix_Engineering_Pvt_Ltd
 
Lock out Tag Out Training for Safe Maintenance activity
byBalakrishnanRamasamy14
 
Solar PV An Essential Requirement in renewable energy based sources Industria...
byshilpashukla2025
 
How to Write Research Papers NCBP D3.pdf
byDr. Rahul Pandya
 
Amperes Circuital Law and its appliocations
byKasiselvanathanMarim1
 
Smart waste management using internet of things 2025.ppt
byJeganKalaimani
 

Spider Setup with AWS/sandbox

  • 1.
    café.naver.com/mysqlpg 1 Spider Architecture 날짜 :2016.03.21 Ver. 1.0 작성 : DB실 전수진
  • 2.
    café.naver.com/mysqlpg  Spider Setup Architecture  Topology Agenda
  • 3.
    café.naver.com/mysqlpg  Spider Setup Architecture  Topology Agenda
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step1. 사전 요구 프로그램 설치 sudo su - yum install -y gcc automake autoconf libtool make cpan libstdc* yum install -y perl-CPAN yum install -y --skip-broken perl* cpan YAML
  • 9.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step2. 그룹(mysql)/계정(maria) 생성 sudo su - mkdir -p /usr1/program mkdir -p /usr1/mysql/dba/tools groupadd -g 900 mysql cat /etc/group | grep -E 'mysql|maria' useradd maria -g mysql -d /home/maria -u 901 -c mysql_user echo 'maria:oracle' | chpasswd cat /etc/passwd | grep -E 'mysql|maria' chown -R maria:mysql /usr1 ls -l /usr1
  • 10.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step3. Sandbox Download & Compile sudo su - cd /usr1/program wget http://search.cpan.org/CPAN/authors/id/G/GM/GMAX/MySQL-Sandbox-3.1.05.tar.gz ls -l MySQL-Sandbox* tar xvfz MySQL-Sandbox-3.1.05.tar.gz cd MySQL-Sandbox-3.1.05 perl Makefile.PL make && make test make install
  • 11.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step4. MariaDB 10.1 (SpiderNode) / MySQL 5.7 (DataNode) Binary Download su - maria cd /usr1/program/ wget http://ftp.kaist.ac.kr/mariadb//mariadb-10.1.12/bintar-linux-glibc_214-x86_64/mariadb-10.1.12-linux-glibc_214-x86_64.tar.gz tar xvfz mariadb-10.1.12-linux-glibc_214-x86_64.tar.gz mv mariadb-10.1.12-linux-glibc_214-x86_64 /usr1/mysql/10.1.12 wget https://downloads.mariadb.com/archives/mysql-5.7/mysql-5.7.11-linux-glibc2.5-x86_64.tar.gz tar zxvf mysql-5.7.11-linux-glibc2.5-x86_64.tar.gz mv mysql-5.7.11-linux-glibc2.5-x86_64 /usr1/mysql/5.7.11 ls -l /usr1/mysql chown -R maria:mysql /usr1
  • 12.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step5. Multi Instance Install (Spider : 4, Data : 6) su - maria cd /usr1/mysql mkdir -p /usr1/mysql/sandboxes make_multiple_sandbox -r spider_node 10.1.12 --upper_directory=/usr1/mysql/sandboxes --how_many_nodes=4 make_multiple_sandbox -r data_node 5.7.11 --upper_directory=/usr1/mysql/sandboxes --how_many_nodes=6 ps -ef | awk -F ' ' '{print $2, $9;}' | grep mysqld_safe 6479 /usr1/mysql/10.1.12/bin/mysqld_safe … 7604 /usr1/mysql/5.7.11/bin/mysqld_safe … netstat -nap | grep LISTEN | grep mysql
  • 13.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step5. Multi Instance Install # Port 변경 (Spider Node) cd /usr1/mysql/sandboxes/spider_node && ./stop_all cd /usr1/mysql/sandboxes/spider_node/node1 && ./change_ports 3306 cd /usr1/mysql/sandboxes/spider_node/node2 && ./change_ports 3307 cd /usr1/mysql/sandboxes/spider_node/node3 && ./change_ports 9906 cd /usr1/mysql/sandboxes/spider_node/node4 && ./change_ports 9907 cd /usr1/mysql/sandboxes/spider_node && ./start_all cd /usr1/mysql/sandboxes/spider_node && ./status_all cd /usr1/mysql/sandboxes/spider_node && ./use_all -e " select version()" netstat -nap | grep LISTEN | grep mysql 3306 10001 10002 10003
  • 14.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step5. Multi Instance Install # Port 변경 (Data Node) cd /usr1/mysql/sandboxes/data_node && ./stop_all cd /usr1/mysql/sandboxes/data_node/node1 && ./change_ports 10001 cd /usr1/mysql/sandboxes/data_node/node2 && ./change_ports 10002 cd /usr1/mysql/sandboxes/data_node/node3 && ./change_ports 10003 cd /usr1/mysql/sandboxes/data_node/node4 && ./change_ports 20001 cd /usr1/mysql/sandboxes/data_node/node5 && ./change_ports 20002 cd /usr1/mysql/sandboxes/data_node/node6 && ./change_ports 20003 cd /usr1/mysql/sandboxes/data_node && ./start_all cd /usr1/mysql/sandboxes/data_node && ./status_all cd /usr1/mysql/sandboxes/data_node && ./use_all -e " select version()" netstat -nap | grep LISTEN | grep mysql 3306 10001 10002 10003
  • 15.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step6. Define an easy way to access the nodes from the MariaDB or MySQL client su - maria alias spider1='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=3306 --socket=/tmp/mysql_sandbox3306.sock' alias spider2='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=3307 --socket=/tmp/mysql_sandbox3307.sock' alias spider3='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=9906 --socket=/tmp/mysql_sandbox9906.sock' alias spider4='/usr1/mysql/10.1.12/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=9907 --socket=/tmp/mysql_sandbox9907.sock' alias backend1='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=10001 --socket=/tmp/mysql_sandbox10001.sock alias backend2='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=10002 --socket=/tmp/mysql_sandbox10002.sock alias backend3='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=10003 --socket=/tmp/mysql_sandbox10003.sock alias backend11='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=20001 --socket=/tmp/mysql_sandbox20001.sock' alias backend12='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=20002 --socket=/tmp/mysql_sandbox20002.sock' alias backend13='/usr1/mysql/5.7.11/bin/mysql --user=msandbox --password=msandbox --host=localhost --port=20003 --socket=/tmp/mysql_sandbox20003.sock' $ spider1 -e "select version()" +-----------------+ | version() | +-----------------+ | 10.1.12-MariaDB | +-----------------+ $ backend1 -e "select version()" +------------+ | version() | +------------+ | 5.7.11-log | +------------+
  • 16.
    café.naver.com/mysqlpg Setup ■ MySQL Install Step6. Define an easy way to access the nodes from the MariaDB or MySQL client su – maria cd /usr1/mysql/dba
  • 17.
  • 18.
  • 19.
    café.naver.com/mysqlpg  Spider Setup Architecture  Topology Agenda
  • 20.
    café.naver.com/mysqlpg Architecture ■ Type Reference :https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ # Federation # Sharding # High Availability
  • 21.
    café.naver.com/mysqlpg Architecture ■ Federation Without connectionpool or MariaDB thread pool, HaProxy and Spider have been protecting the tcp socket overflow without specific TCP tuning. Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1 << EOF DROP DATABASE IF EXISTS backend ; CREATE DATABASE backend; CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; DESC backend.sbtest; EOF ①
  • 22.
    café.naver.com/mysqlpg Architecture ■ Federation Reference :https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF DROP SERVER IF EXISTS backend1; CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10001); EOF②
  • 23.
    café.naver.com/mysqlpg Architecture ■ Federation Reference :https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE DATABASE IF NOT EXISTS test; DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql",srv "backend1"'; SELECT * FROM test.sbtest LIMIT 10; EOF ③
  • 24.
    café.naver.com/mysqlpg Architecture ■ Federation &HA Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF backend2 << EOF … EOF backend3 << EOF … EOF ①①
  • 25.
    café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1<< EOF CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10001); CREATE SERVER backend2 FOREIGN DATA WRAPPER mysql … CREATE SERVER backend3 FOREIGN DATA WRAPPER mysql … EOF ■ Federation & HA ②
  • 26.
    café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1<< EOF CREATE DATABASE IF NOT EXISTS test; DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql",srv "backend1 backend2 backend3"'; SELECT * FROM test.sbtest LIMIT 10; EOF ■ Federation & HA ③
  • 27.
    café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1<< EOF TRUNCATE TABLE test.sbtest; Insert into test.sbtest values (1, 100, 'A', 'A1'); Insert into test.sbtest values (2, 200, 'A', 'A1'); Insert into test.sbtest values (3, 300, 'A', 'A1'); Insert into test.sbtest values (4, 400, 'A', 'A1'); Insert into test.sbtest values (5, 500, 'A', 'A1'); SELECT * FROM test.sbtest; EOF backend1 -e"select count(*) from backend.sbtest;" backend2 -e"select count(*) from backend.sbtest;" backend3 -e"select count(*) from backend.sbtest;" +----------+ | count(*) | +----------+ | 5 | +----------+ ■ Federation & HA ④ 동일한 데이터를 확인할 수 있음 !
  • 28.
    café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ cd/usr1/mysql/sandboxes/data_node/node2 && ./stop spider1 -e "Insert into test.sbtest values (11, 1100, 'A', 'A1');" -- ERROR 1429 (HY000) at line 1: Unable to connect to foreign data source: backend2 backend1 -e"select count(*) from backend.sbtest;" -- 5 backend2 -e"select count(*) from backend.sbtest;" -- ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql_sandbox100 backend3 -e"select count(*) from backend.sbtest;" -- 5 ■ Federation & HA Datanode2 장애유발!
  • 29.
    café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ ■Federation & HA spider1 << EOF DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql",srv "backend1 backend3"'; EOF spider1 -e "Insert into test.sbtest values (11, 1100, 'A', 'A1');" backend1 -e"select count(*) from backend.sbtest;" backend3 -e"select count(*) from backend.sbtest;" -- 6 -- 6 복구방법 : 테이블의 정의를 변경함 으로써 빠르게 복구 가능
  • 30.
    café.naver.com/mysqlpg Architecture Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1<< EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF backend2 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF ■ Sharding Data Sharding ②①
  • 31.
    café.naver.com/mysqlpg Architecture ■ Sharding Reference :https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10001); CREATE SERVER backend2 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘ , DATABASE 'backend‘ , USER 'msandbox‘ , PASSWORD 'msandbox‘ , PORT 10002); EOF ③ ④
  • 32.
    café.naver.com/mysqlpg Architecture ■ Sharding Reference :https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE DATABASE IF NOT EXISTS test; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1"' , PARTITION pt2 COMMENT = 'srv "backend2"' ); SELECT count(*) FROM test.sbtest LIMIT 10; EOF ⑤
  • 33.
    café.naver.com/mysqlpg Architecture ■ Sharding Reference :https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF TRUNCATE TABLE test.sbtest; Insert into test.sbtest values (1, 100, 'A', 'A1'); Insert into test.sbtest values (2, 200, 'A', 'A1'); Insert into test.sbtest values (3, 300, 'A', 'A1'); Insert into test.sbtest values (4, 400, 'A', 'A1'); Insert into test.sbtest values (5, 500, 'A', 'A1'); SELECT * FROM test.sbtest; EOF backend1 -e"select count(*) from backend.sbtest;" -- 3 backend2 -e"select count(*) from backend.sbtest;" -- 2 ⑥
  • 34.
    café.naver.com/mysqlpg Architecture ■ High Availability Reference: https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ backend1 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; CREATE TABLE backend_rpl.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF backend2 << EOF CREATE TABLE backend.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; CREATE TABLE backend_rpl.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=InnoDB; EOF ②① back1 back1_rpl back2 back2_rpl
  • 35.
    café.naver.com/mysqlpg Architecture ■ High Availability Reference: https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ spider1 << EOF CREATE SERVER backend1 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend‘ , … , PORT 10001); CREATE SERVER backend1_rpl FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend_rpl‘, … , PORT 10001); CREATE SERVER backend2 FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend‘ , … , PORT 10002); CREATE SERVER backend2_rpl FOREIGN DATA WRAPPER mysql OPTIONS( HOST '127.0.0.1‘, DATABASE 'backend_rpl‘, … , PORT 10002); EOF back1 back1_rpl back2 back2_rpl ④③
  • 36.
    café.naver.com/mysqlpg Architecture ■ High Availability Reference: https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 << EOF CREATE DATABASE IF NOT EXISTS test; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT , k int unsigned NOT NULL DEFAULT '0' , c char(100) NOT NULL DEFAULT '' , pad char(60) NOT NULL DEFAULT '' , PRIMARY KEY (id) , KEY k (k) ) ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl"' ); INSERT INTO test.sbtest select 10000001, 0, '' ,'replicas test'; EOF ⑤
  • 37.
    café.naver.com/mysqlpg Architecture ■ High Availability Reference: https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl backend1 -e "SELECT * FROM backend.sbtest WHERE id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ backend2 -e "SELECT * FROM backend.sbtest where id=10000001"; backend2 -e "SELECT * FROM backend_rpl.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ ⑥
  • 38.
    café.naver.com/mysqlpg Architecture ■ High Availability Reference: https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 << EOF insert into test.sbtest values (1, 100, 'A', 'A1'); insert into test.sbtest values (2, 200, 'A', 'A1'); insert into test.sbtest values (3, 300, 'A', 'A1'); insert into test.sbtest values (4, 400, 'A', 'A1'); insert into test.sbtest values (5, 500, 'A', 'A1'); EOF backend1 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 4 | 2 | +------+------+ backend2 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 2 | 4 | +------+------+ ⑦ ⑧ 4 42 2
  • 39.
    café.naver.com/mysqlpg Architecture ■ High Availability Whatis happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ cd /usr1/mysql/sandboxes/data_node/node1 && ./stop backend1 -e "SELECT * FROM backend.sbtest where id=10000001" -- ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql_sandbox10001.sock' spider1 -e "SELECT * FROM test.sbtest where id=10000001"; -- ERROR 1429 (HY000): Unable to connect to foreign data source: backend1_rpl spider1 -e "SELECT * from mysql.spider_tables order by link_id, server"; cd /usr1/mysql/sandboxes/data_node/node1 && ./start spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ ⑨ ⑩ 4 42 2
  • 40.
    café.naver.com/mysqlpg Architecture ■ High Availability Whatis happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl -- Data Node Replica 모니터링 등록 spider1 << EOF DROP TABLE IF EXISTS test.sbtest; CREATE TABLE test.sbtest ( id int unsigned NOT NULL AUTO_INCREMENT … ) ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl", mbk "2", mkd "2", msi "1", link_status "0 0"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl", mbk "2", mkd "2", msi "1", link_status "0 0"' ); CREATE SERVER mon FOREIGN DATA WRAPPER mysql OPTIONS ( HOST '127.0.0.1', DATABASE 'test', … , PORT 3306); INSERT INTO mysql.spider_link_mon_servers VALUES ('%','%','%',1,'mon‘ ,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,0,NULL,NULL); SELECT * FROM mysql.spider_link_mon_servers; SELECT spider_flush_table_mon_cache(); EOF HA 모니터링을 관장할 서버의 @@Service_ID - Spider_Node : 1, 2 - Data_Node : 101, 102 Node Status 1 : 정상, 3 : 중지 2 : 관리 작업 중 @@server_id = 1 @@server_id = 101 @@server_id = 102 ⑪
  • 41.
    café.naver.com/mysqlpg Architecture ■ High Availability Whatis happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ cd /usr1/mysql/sandboxes/data_node/node1 && ./stop backend1 -e "SELECT * FROM backend.sbtest where id=10000001" -- ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql_sandbox10001.sock' spider1 -e "SELECT * FROM test.sbtest where id=10000001"; +----------+---+---+---------------+ | id | k | c | pad | +----------+---+---+---------------+ | 10000001 | 0 | | replicas test | +----------+---+---+---------------+ spider1 -e "SELECT * from mysql.spider_tables order by link_id, server"; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 3 | | 1 | backend1_rpl | sbtest#P#pt2 | 3 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ 데이터 조회는 되었지만, 실제는 fail 상태로 존재함 ⑫
  • 42.
    café.naver.com/mysqlpg Architecture ■ High Availability Whatis happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl cd /usr1/mysql/sandboxes/data_node/node1 && ./start spider1 << EOF select * from mysql.spider_tables order by link_id, server, table_name; -- link status 변경 : fail -> maintenance ALTER TABLE test.sbtest ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl", mbk "2", mkd "2", msi "1", link_status "2 0"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl", mbk "2", mkd "2", msi "1", link_status "0 2"' ); select * from mysql.spider_tables order by link_id, server, table_name; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 2 | | 1 | backend1_rpl | sbtest#P#pt2 | 2 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ ⑬
  • 43.
    café.naver.com/mysqlpg Architecture ■ High Availability Whatis happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl select * from mysql.spider_tables order by link_id, server, table_name; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 2 | | 1 | backend1_rpl | sbtest#P#pt2 | 2 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ select spider_copy_tables('test.sbtest#P#pt1','1','0'); -- 1 select spider_copy_tables('test.sbtest#P#pt2','0','1'); -- 1 ⑭
  • 44.
    café.naver.com/mysqlpg Architecture ■ High Availability Whatis happening if we stop one backend? Reference : https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl -- link status 변경 : maintenance -> live ALTER TABLE test.sbtest ENGINE=spider COMMENT='wrapper "mysql", table "sbtest"' PARTITION BY KEY (id) ( PARTITION pt1 COMMENT = 'srv "backend1 backend2_rpl", mbk "2", mkd "2", msi "1", link_status "1 0"' , PARTITION pt2 COMMENT = 'srv "backend2 backend1_rpl", mbk "2", mkd "2", msi "1", link_status "0 1"' ); select * from mysql.spider_tables order by link_id, server, table_name; +---------+--------------+--------------+-------------+ | link_id | server | table_name | link_status | +---------+--------------+--------------+-------------+ | 0 | backend1 | sbtest#P#pt1 | 1 | | 1 | backend1_rpl | sbtest#P#pt2 | 1 | | 0 | backend2 | sbtest#P#pt2 | 1 | | 1 | backend2_rpl | sbtest#P#pt1 | 1 | +---------+--------------+--------------+-------------+ ⑮
  • 45.
    café.naver.com/mysqlpg Architecture ■ High Availability Reference: https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ back1 back1_rpl back2 back2_rpl spider1 << EOF insert into test.sbtest values (1, 100, 'A', 'A1'); insert into test.sbtest values (2, 200, 'A', 'A1'); insert into test.sbtest values (3, 300, 'A', 'A1'); insert into test.sbtest values (4, 400, 'A', 'A1'); insert into test.sbtest values (5, 500, 'A', 'A1'); EOF backend1 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 4 | 2 | +------+------+ backend2 -e "select (select count(*) from backend.sbtest) as cnt1 , (select count(*) from backend_rpl.sbtest) as cnt2" +------+------+ | cnt1 | cnt2 | +------+------+ | 2 | 4 | +------+------+
  • 46.
    café.naver.com/mysqlpg Architecture ■ High Availability Reference: https://mariadb.com/kb/en/mariadb/spider-storage-engine-overview/ select link_id, server, table_name, link_status from mysql.spider_tables order by link_id, server, table_name
  • 47.
  • 48.
  • 49.
    café.naver.com/mysqlpg  Spider Setup Architecture  Topology Agenda
  • 50.
  • 51.
    café.naver.com/mysqlpg Topology FrontDB Master1 Slave1 Master2 Slave2 Master3Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 CollectDB (ETL)
  • 52.
    café.naver.com/mysqlpg Topology Master1 Slave1 Master2 Slave2 Master3Slave3 FrontDB1 FrontDB2 CollectDB1 (admintool) CollectDB2 (ETL)
  • 53.
    café.naver.com/mysqlpg Topology Master3 Master3a Master1 Master1a Master2 Master2a FrontDB1 FrontDB2 CollectDB FrontDB Master1 Slave1 Master2 Slave2 Master3Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 CollectDB (ETL) Master1 Slave1 Master2 Slave2 Master3 Slave3 FrontDB1 FrontDB2 CollectDB1 (admintool) CollectDB2 (ETL)
  • 54.
    café.naver.com/mysqlpg Topology FrontDB Master1 Slave1 Master2 Slave2 Master3Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 Master1 Slave1 Master2 Slave2 Master3 Slave3 FrontDB1 FrontDB2 Master1 Master1a Master2 MAster2a Master3 Master3a FrontDB1 FrontDB2 & CollectDB CollectDB (ETL) CollectDB1 (admintool) CollectDB2 (ETL) Master3 Master3a Master1 Master1a Master2 Master2a FrontDB1 FrontDB2
  • 55.
    café.naver.com/mysqlpg Topology FrontShard1 FrontShard2 Master1 Master1a Master2MAster2a Spec : 12Core / 32GB  Spider : 1GB  Data1 : 6GB  Data2 : 6GB  DB Connection 수에 주의 !!! Dev, QA Live 1단계 FrontShard1 FrontShard2 Master1 Master1a Master2 MAster2a DB 부하 및 서비스 오픈 전략에 맞춰 서버 배치 진행 Live 2단계
  • 56.