A work demonstration on benchmark AWS instances for MySQL RDBMS

1. Benchmarking AWS instance
for Mysql Database Server
kiran.vt@Samsung.com

2. Echo system and system

3. System with respect to Virtualization

4. Mysql Database system

5. Benchmarking Complexity

6. AWS gives …..
MachineType
CPU
Memory
Network
IOBandwidth
IOThroughput
MaxIOPS
Parallel
r4.2xl 8 61 10 Gbps 1700 212 12000 32
i3.2xl 8 61 10 Gbps 1700 212 12000 32
c4.4xl 16 30 High 2000 250 16000 64
d2.4xl 16 122 High 2000 250 16000 64
m4.4xl 16 64 High 2000 250 16000 64
m5.xl 4 16 High 2120 265 16000 16
m5.2xl 8 32 High 2120 265 16000 32
m5.4xl 16 64 High 2120 265 16000 64
c5.xl 4 8 10 Gbps 2,250 281.25 16,000 16
c5.2xl 8 16 10 Gbps 2,250 281.25 16,000 32
c5.4xl 16 32 10 Gbps 2,250 281.25 16,000 64
h1.4xl 16 64 10 Gbps 3,500 437.5 20,000 64
i3.4xl 16 122 10 Gbps 3,500 437.5 16,000 64
r4.4xl 16 122 10 Gbps 3,500 437.5 18,750 64
c4.8xl 36 60 10 Gbps 4,000 500 32,000 144
d2.8xl 36 244 10 Gbps 4,000 500 32,000 144
m4.10xl 40 160 10 Gbps 4,000 500 32,000 160

7. What we used….
Machine Type AWS M5.* EC2
Operating System Linux
Provisioned IOPS GP2, EBS
MySQL version 5.7.22
Total Virtual Machines Tested 27
Tables/Row Count 20/1000000
Client Machine Type M5-4xLarge
Client OS Ubuntu - 16.04.4 LTS (Xenial Xerus)
Load Generator Sysbench-1.0.13

8. Read Behavior…
M5* series
C5* series

9. Write Behavior…
M5* series
C5* series

10. Mixed Load Behavior
M5* series
C5* series

11. What’s More…????

12. Detailed Analysis….

13. Some interesting observations…

14. Relationship between QPS, IO
throughput and Used CPU

15. What we tweaked……….
Parameters
fs.file-max
fs.file-nr
fs.inode-nr
fs.nr_open
net.core.rmem_max
net.core.somaxconn
net.core.wmem_max
net.ipv4.tcp_mem
net.ipv4.tcp_max_syn_backlog
net.ipv4.tcp_rmem
net.ipv4.tcp_wmem
vm.dirty_background_ratio
vm.dirty_ratio
vm.overcommit_ratio
vm.swappiness
Parameters
tmp-table-size
max-tmp-tables
max-heap-table-size
open-files-limit
table-open-cache
join-buffer-size
sort-buffer-size
read-buffer-size
innodb-log-file-size
innodb-log-buffer-size
innodb-file-per-table
innodb-buffer-pool-size
innodb-buffer-pool-instances
innodb-io-capacity
innodb-io-capacity-max
innodb-thread-concurrency
innodb-write-io-threads
innodb-read-io-threads
max-allowed-packet
max-connections
max_prepared_stmt_count
innodb_purge_threads
innodb_open_files
innodb_log_write_ahead_size

16. Final Outcome ……

17. Machine Type CPU IO
Throughput
Max IOPS CPU
SPEED
CPU
Capacity
CPU For
Read(95%
GHz)
Usable CPU
Speed for
write
Usable IO
Throughput
for write
Write WRT
CPU
Write WRT
Throuput
Anticipated
Write QPS
Anticipated
Read QPS
Approximate
capacity
c4.4xlarge 16 250 16000 2.9 46.4 44.08 26.64 250 67506 55359 55359 61808 58584
c4.8xlarge 36 500 32000 2.9 104 99.18 36.00 362 78584 97202 78584 88429 83507
c5.xlarge 4 281.3 16000 3 12 11.4 11.03 220 35062 44151 35062 17412 26237
c5.2xlarge* 8 281.3 16000 3 24 22.8 19.03 266 55130 61337 55130 40166 47648
c5.4xlarge* 16 281.3 16000 3 48 45.6 27.03 281.25 68042 67034 67034 62921 64978
c5.9xlarge* 36 562.5 32000 3 108 102.6 36.39 365 78982 98323 78982 89542 84262
c5.18xlarge 72 1125 64000 3 216 205.2 44.39 400 86294 111399 86294 112297 99296
d2.4xlarge 16 250 16000 2.4 38.4 36.48 24.45 250 64358 55359 55359 55596 55478
d2.8xlarge 36 500 32000 2.4 86.4 82.08 33.81 350 76281 92719 76281 82217 79249
f1.2xlarge 8 212.5 12000 2.3 18.4 17.48 15.96 212.5 48664 41349 41349 31444 36397
f1.16xlarge 64 1750 75000 2.3 147 139.8 39.96 385 82429 105795 82429 99708 91069
h1.2xlarge 8 218.8 12000 2.3 18.4 17.48 15.96 218.75 48664 43684 43684 31444 37564
h1.4xlarge 16 437.5 20000 2.3 36.8 34.96 23.96 294 63611 71797 63611 54198 58905
h1.8xlarge 32 875 40000 2.3 73.6 69.92 31.96 339 74210 88609 74210 76953 75582
h1.16xlarge 64 1750 80000 2.3 147 139.8 39.96 385 82429 105795 82429 99708 91069
i3.2xlarge 8 212.5 12000 2.3 18.4 17.48 15.96 212.5 48664 41349 41349 31444 36397
i3.4xlarge 16 437.5 16000 2.3 36.8 34.96 23.96 294 63611 71797 63611 54198 58905
i3.8xlarge 32 875 32500 2.3 73.6 69.92 31.96 339 74210 88609 74210 76953 75582
i3.16xlarge 64 1750 65000 2.3 147 139.8 39.96 385 82429 105795 82429 99708 91069
m4.4xlarge 16 250 16000 2.4 38.4 36.48 24.45 250 64358 55359 55359 55596 55478
m4.10xlarge 40 500 32000 2.4 96 91.2 35.03 357 77581 95334 77581 85676 81629
m4.16xlarge 64 1250 65000 2.3 147 139.8 39.96 385 82429 105795 82429 99708 91069
m5.xlarge* 4 265 16000 2.5 10 9.5 8.93 208 27273 39668 27273 11426 19350
m5.2xlarge* 8 265 16000 2.5 20 19 16.93 254 50818 56853 50818 34181 42500
m5.4xlarge* 16 265 16000 2.5 40 38 24.93 265 65060 60963 60963 56936 58950
m5.12xlarge 48 625 32500 2.5 120 114 37.61 372 80191 100938 80191 93001 86596
m5.24xlarge 96 1250 65000 2.5 240 228 45.61 400 87288 111399 87288 115756 101522
r4.2xlarge 8 212.5 12000 2.3 18.4 17.48 15.96 212.5 48664 41349 41349 31444 36397
r4.4xlarge 16 437.5 18750 2.3 36.8 34.96 23.96 294 63611 71797 63611 54198 58905
r4.8xlarge 32 875 37500 2.3 73.6 69.92 31.96 339 74210 88609 74210 76953 75582
r4.16xlarge 64 1750 75000 2.3 147 139.8 39.96 385 82429 105795 82429 99708 91069