The document discusses installing and configuring MySQL. It explains that option files list specific startup options for MySQL and are commonly located in the MySQL installation directory or /etc/mysql directory. It also provides a generic layout of MySQL binary files on Unix/Linux systems, with client programs and the mysqld server located in the bin and scripts directories.

1. Copyright
©
2014,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Sunday, October 16, 16

2. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
A
MySQL
DBA
Primer
Ligaya
Turmelle
Principal
Technical
Support
Engineer
-­‐
MySQL
ligaya.turmelle@oracle.com
@lig
,
Oracle
and/or
its
affiliates.
All
rights
reserved.
| 2
Sunday, October 16, 16

3. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Safe
Harbor
Statement
The
following
is
intended
to
outline
our
general
product
direc@on.
It
is
intended
for
informa@on
purposes
only,
and
may
not
be
incorporated
into
any
contract.
It
is
not
a
commitment
to
deliver
any
material,
code,
or
func@onality,
and
should
not
be
relied
upon
in
making
purchasing
decisions.
The
development,
release,
and
@ming
of
any
features
or
func@onality
described
for
Oracle’s
products
remains
at
the
sole
discre@on
of
Oracle.
3
Sunday, October 16, 16

4. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Agenda
-­‐
First
Half
• Founda@on
• Installa@on
• Talking
to
MySQL
• Architecture
• Log
Files
1
2
3
4
5
4
Sunday, October 16, 16

5. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Agenda
-­‐
Second
Half
• Log
Files
(con’t)
• Security
• Backup
• Monitoring
• Basic
Troubleshoo@ng
5
6
7
8
9
5
Sunday, October 16, 16

6. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
FoundaNon
6
Sunday, October 16, 16

7. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
FoundaNon
• Basics
• Commercial
1
2
7
Sunday, October 16, 16

8. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL
in
a
Nutshell
• Worlds
most
popular
open
source
database
• “M”
of
LAMP
• Main
site:
mysql.com
8
Sunday, October 16, 16

9. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL.com
• mysql.com
- Commercial site
9
Sunday, October 16, 16

10. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL.com
• mysql.com
- Commercial site
• dev.mysql.com (AKA mysql.org)
- Developer Zone
10
Sunday, October 16, 16

11. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL.com
• mysql.com
- Commercial site
• dev.mysql.com (AKA mysql.org)
- Developer Zone
• downloads.mysql.com
11
Sunday, October 16, 16

12. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL.com
• mysql.com
- Commercial site
• dev.mysql.com (AKA mysql.org)
- Developer Zone
• downloads.mysql.com
• dev.mysql.com/doc/
- Documentation
12
Sunday, October 16, 16

13. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL.com
• mysql.com
- Commercial site
• dev.mysql.com (AKA mysql.org)
- Developer Zone
• downloads.mysql.com
• dev.mysql.com/doc/
- Documentation
• bugs.mysql.com
13
Sunday, October 16, 16

14. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
GeQng
Help
• Manual
14
Sunday, October 16, 16

15. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
GeQng
Help
• Manual
• MySQL
Support
15
Sunday, October 16, 16

16. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
GeQng
Help
• Manual
• MySQL
Support
• MySQL
Forums
(forums.mysql.com)
16
Sunday, October 16, 16

17. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
GeQng
Help
• Manual
• MySQL
Support
• MySQL
Forums
(forums.mysql.com)
• Mailing
Lists
(lists.mysql.com)
17
Sunday, October 16, 16

18. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
GeQng
Help
• Manual
• MySQL
Support
• MySQL
Forums
(forums.mysql.com)
• Mailing
Lists
(lists.mysql.com)
• Search
the
Web
18
Sunday, October 16, 16

19. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
GeQng
Help
• Manual
• MySQL
Support
• MySQL
Forums
(forums.mysql.com)
• Mailing
Lists
(lists.mysql.com)
• Search
the
Web
• IRC
on
freenode
-­‐
#mysql
19
Sunday, October 16, 16

20. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Main
Features
• Works
on
mul@ple
pla^orms
• Mul@-­‐layered
server
design
• Pluggable
architecture
-­‐ Storage
engine
-­‐ Misc
plugins
(Ex:
validate_password,
SHA256_password)
• Mul@-­‐threaded
• “Plays
well”
with
most
programming
languages
20
Sunday, October 16, 16

21. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
FoundaNon
• Basics
• Commercial22
1
21
Sunday, October 16, 16

22. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Enterprise
EdiNon
Add-­‐Ons
• MySQL
Enterprise
Backup
(MEB)
• MySQL
Enterprise
Monitor
(MEM)
• Workbench
• Plugins
• Threadpool,
Audit,
Firewall,
TDE,
Encryp@on,
PAM,
etc
• Oracle
Enterprise
Manager
for
MySQL
22
Sunday, October 16, 16

23. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
InstallaNon
23
Sunday, October 16, 16

24. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
InstallaNon
• Files
• Installa@on
1
2
24
Sunday, October 16, 16

25. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
OpNon
Files
• AKA
configura@on
files
• Lists
specific
startup
op@ons
# The following options will be passed to all
MySQL clients
[client]
#password! = your_password
port! ! = 3626
socket!! = /tmp/mysql.5.6.26.sock
# Here follows entries for some specific
programs
# The MySQL server
[mysqld]
port! = 3626
socket!= /tmp/mysql.5.6.26.sock
log-error = /Users/ligaya/mysql_installs/
mysql-5.6.26-osx10.9-x86_64/data/error.log
server-id! = 1
table_open_cache = 4000
25
Sunday, October 16, 16

26. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Common
LocaNons
of
OpNon
File
• Windows
-INSTALLDIRmy.ini
-INSTALLDIRmy.cnf
• Linux
&
Mac
-/etc/my.cnf
-/etc/mysql/my.cnf
26
Sunday, October 16, 16

27. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Generic
Unix/Linux
Binary
File
Layout
Directory Contents
bin, scripts Client
programs,
mysqld
server
and
u@lity
programs
data Log
files
and
databases
docs Manual
in
Info
format
man Unix
manual
pages
include Include
(header)
files
lib Libraries
share
Misc
support
files
including
error
messages,
sample
op@on
files
and
SQL
for
database
installa@on
27
Sunday, October 16, 16

28. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Linux
RPM
File
Layout
Directory Contents
/usr/bin Client
programs
and
scripts
/usr/sbin mysqld
server
/var/lib/mysql log
files
and
databases
/usr/share/info Manual
in
Info
format
/usr/share/man Unix
manual
pages
/usr/include/mysql Include
(header)
files
/usr/lib/mysql Libraries
/usr/share/mysql
Misc
support
files
including
error
messages,
character
set
files,
sample
op@on
files
and
SQL
for
database
installa@on
28
Sunday, October 16, 16

29. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Windows
File
Layout
Directory Contents Notes
bin, scripts Client
programs,
mysqld
server
and
u@li@es
scripts
%ALLUSERSPROFILE%
MySQLMySQL
Server 5.7
Log
files
and
databases
(Windows
XP,
Windows
Server
2003)
The Windows system variable
%ALLUSERSPROFILE% defaults to
C:Documents and Settings
All UsersApplication Data
%PROGRAMDATA%
MySQLMySQL
Server 5.7
Log
files
and
databases
(Vista,
Windows
7,
Windows
Server
2008
and
newer)
The Windows system variable
%PROGRAMDATA% defaults to C:
ProgramData
examples Example
programs
and
scripts
include include
(header)
files
lib Libraries
share
Misc
support
files
including
error
messages,
character
set
files,
sample
op@on
files
and
SQL
for
database
installa@on
29
Sunday, October 16, 16

30. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
InstallaNon
• Files
• Installa@on22
1
30
Sunday, October 16, 16

31. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
InstallaNon
• Well
documented
in
the
Manual
• Each
OS
is
documented
-­‐
some
with
mul@ple
ways
to
do
it
-­‐ Unix/Linux
Generic
Binaries
-­‐ Windows
-­‐ Mac
-­‐ Various
Linux
(MySQL
Repositories,
RPM,
Na@ve
Repositories)
-­‐ Solaris
-­‐ Source
31
Sunday, October 16, 16

32. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Generic
Binary
InstallaNon
shell> groupadd mysql
shell> useradd -r -g mysql mysql
shell> cd /usr/local
shell> tar zxvf /path/to/mysql-VERSION-OS.tar.gz
shell> ln -s full-path-to-mysql-VERSION-OS mysql
shell> cd mysql
shell> mkdir mysql-files
shell> chmod 770 mysql-files
shell> chown -R mysql .
shell> chgrp -R mysql .
shell> bin/mysql_install_db --user=mysql # Before 5.7.6
shell> bin/mysqld --initialize --user=mysql # 5.7.6 and up
shell> bin/mysql_ssl_rsa_setup # 5.7.6 and up
shell> chown -R root .
shell> chown -R mysql data mysql-files
shell> bin/mysqld_safe --user=mysql & # optionally start the server
# Next command is optional
shell> cp support-files/mysql.server /etc/init.d/mysql.server
32
Sunday, October 16, 16

33. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
StarNng
it
up
• Various
methods
-mysqld_safe
-mysqld
-mysql.server
-service mysqld start
-­‐ Windows
Service
• Unix/Linux
-­‐
run
as
a
non-­‐root
account
• Windows
-­‐
admin
rights
33
Sunday, October 16, 16

34. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
ShuQng
it
down
• Manually
-mysqladmin shutdown
-/etc/init.d/mysql stop
-service mysqld stop
-NET STOP MySQL
-Services
Manager
-SHUTDOWN
(5.7)
34
Sunday, October 16, 16

35. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Talking
to
MySQL
35
Sunday, October 16, 16

36. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
CLI
-­‐
mysql
client
• Easy
to
use
• Simple
SQL
shell
• Server
side
help
• Many
op@ons
-­‐ Example:
--i-am-a-
dummy
• Has
its
own
commands
mysql> select count(*) from inventory;
+----------+
| count(*) |
+----------+
| 4581 |
+----------+
1 row in set (0.08 sec)
mysql> ALTER TABLE rental DROP FOREIGN KEY
`fk_rental_inventory`;
Query OK, 0 rows affected (0.25 sec)
Records: 0 Duplicates: 0 Warnings: 0
mysql> SELECT rental_id from rental order by RAND() LIMIT
10;
+-----------+
| rental_id |
+-----------+
| 12539 |
| 8592 |
| 15699 |
36
Sunday, October 16, 16

37. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Workbench
• GUI
-­‐ SQL
Development
-­‐ Data
Modeling
-­‐ Server
Administra@on
-­‐ Data
Migra@on
-­‐ Performance
Tools
and
Reports
-­‐ Integrated
with
MEB
and
Audit
-­‐ MySQL
U@li@es
37
Sunday, October 16, 16

38. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Main
Screen
in
Linux
38
Sunday, October 16, 16

39. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
SQL
Editor
in
Windows
39
Sunday, October 16, 16

40. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Data
Modeling
in
Mac
40
Sunday, October 16, 16

41. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Performance
Dashboard
in
Linux
41
Sunday, October 16, 16

42. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Architecture
42
Sunday, October 16, 16

43. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Architecture
• High
Level
• Storage
Engines
1
2
43
Sunday, October 16, 16

44. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
High
Level
44
Sunday, October 16, 16

45. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Architecture
• High
Level
• Storage
Engines22
1
45
Sunday, October 16, 16

46. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
InnoDB
• General-­‐purpose
storage
engine
• As
of
5.5,
is
the
default
engine
• Features:
-­‐ ACID
compliant
-­‐ Row
level
locking
with
consistent
reads
-­‐ Foreign
keys
-­‐ Clustered
primary
key
index
-­‐ FullText
Indexes
(5.6)
&
Geospa@al
data
and
indexes
(5.7)
46
Sunday, October 16, 16

47. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
InnoDB
(con’t)
• Features
Con@nued:
-­‐ Tablespaces
• file
per
table
-­‐ transportable
-­‐ encrypted
• undo
logs
• general
-­‐ Compressed
Data
47
Sunday, October 16, 16

48. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MyISAM
• Default
storage
engine
prior
to
5.5
• Stored
on
disk
as
3
files
• Features
-­‐ FullText
indexes
-­‐ Geospa@al
datatypes
support
•Legacy
-­‐
Not
recommended
with
new
systems
48
Sunday, October 16, 16

49. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Others
• Memory
• CSV
• Archive
• Blackhole
• 3rd
Party
49
Sunday, October 16, 16

50. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Log
Files
50
Sunday, October 16, 16

51. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Error
Log
• --log-error[=file_name]
• Default
loca@on:
host_name.err
in
datadir
• Examples
of
stuff
logged
-­‐ Start
and
stops
&
Cri@cal
errors
-­‐ MyISAM
tables
that
need
to
be
checked
or
repaired
-­‐ some
OS’s
-­‐
stack
trace
if
mysqld
crashes
• (5.7)
log_syslog
to
send
MySQL
error
log
to
syslog
• (5.7)
log_error_verbosity
51
Sunday, October 16, 16

52. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Slow
Query
Log
• First
line
of
offense
for
tuning
queries
• Why?
-­‐ Performance
usually
• Enable
dynamically
or
with
--slow-query-log
-­‐ Default
file
loca@on:
host_name-slow.log
in
the
datadir
-­‐ Can
also
go
to
a
table
• Mul@ple
op@ons
for
controlling
it
• Aggregate
its
data
with
mysqldumpslow
u@lity
52
Sunday, October 16, 16

53. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
mysqldumpslow
• Parses
slow
query
log
and
aggregates
the
data
• Default
-­‐
groups
queries
that
are
similar
-­‐ “abstracts”
out
specific
string
and
number
data
values
• Op@ons
for
sor@ng:
-­‐ t, at
-­‐
sort
by
query
@me
or
average
query
@me
-­‐ l, al
-­‐
sort
by
lock
@me
or
average
lock
@me
-­‐ r, ar
-­‐
sort
by
rows
or
average
rows
sent
-­‐ c
-­‐
sort
by
count
53
Sunday, October 16, 16

54. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Example
mysqldumpslow
output
Count: 6 Time=0.36s (2s) Lock=0.00s (0s) Rows=1.0 (6), agent[agent]@localhost
SELECT @@version NOT LIKE "S" AND (SELECT COUNT(*) < N FROM INFORMATION_SCHEMA.TABLES WHERE
TABLE_SCHEMA != 'S') AND (SELECT COUNT(*) = N FROM INFORMATION_SCHEMA.TABLES WHERE CREATE_OPTIONS LIKE
'S')
Count: 2 Time=0.24s (0s) Lock=0.10s (0s) Rows=1.0 (2), agent[agent]@localhost
SELECT ROUND(SUM(sum_timer_wait)/N) total_wait_time_ms, SUM(count_star) total_statements,
ROUND(MAX(max_timer_wait)/N) max_wait_time_ms, SUM(sum_errors) total_errors, SUM(sum_warnings)
total_warnings, SUM(sum_rows_sent) total_rows_returned, ROUND(SUM(sum_lock_time)/N) total_lock_time_ms
FROM performance_schema.events_statements_summary_by_digest
Count: 100 Time=0.22s (22s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@localhost
CREATE TABLE `t1` (id serial,id0 varchar(N) unique key,intcol1 INT(N) ,intcol2 INT(N) ,intcol3
INT(N) ,intcol4 INT(N) ,intcol5 INT(N) ,charcol1 VARCHAR(N),charcol2 VARCHAR(N),charcol3
VARCHAR(N),charcol4 VARCHAR(N),charcol5 VARCHAR(N),charcol6 VARCHAR(N),charcol7 VARCHAR(N),charcol8
VARCHAR(N),charcol9 VARCHAR(N),charcol10 VARCHAR(N))
Count: 300 Time=0.20s (60s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@localhost
CREATE TABLE `t1` (id serial,id0 varchar(N) unique key,intcol1 INT(N) ,intcol2 INT(N) ,intcol3
INT(N) ,intcol4 INT(N) ,intcol5 INT(N) ,intcol6 INT(N) ,intcol7 INT(N) ,intcol8 INT(N) ,intcol9
INT(N) ,intcol10 INT(N) ,charcol1 VARCHAR(N),charcol2 VARCHAR(N),charcol3 VARCHAR(N),charcol4
VARCHAR(N),charcol5 VARCHAR(N),charcol6 VARCHAR(N),charcol7 VARCHAR(N),charcol8 VARCHAR(N),charcol9
VARCHAR(N),charcol10 VARCHAR(N))
54
Sunday, October 16, 16

55. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
55
Sunday, October 16, 16

56. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
EXPLAIN
• Displays
query
execu@on
plan
• Syntax:
-­‐ Prior
to
5.6:
• EXPLAIN [explain_type] SELECT select_options
-­‐ 5.6:
• EXPLAIN [explain_type] explainable_stmt
56
Sunday, October 16, 16

57. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
EXPLAIN
• Talk
all
by
itself
• 1
row
==
1
table
• Order
mapers
• EXTENDED
+
SHOW WARNINGS
=
rewripen
query
• Columns:
-­‐ id,
select_type,
table,
par@@ons,
type,
possible_keys,
key,
key_length,
ref,
rows,
filtered,
Extra
(con’t)
57
Sunday, October 16, 16

58. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Example
CLI
EXPLAIN
mysql> EXPLAIN EXTENDED SELECT ci.Name,
-> co.Name,
-> cl.IsOfficial
-> FROM City ci
-> INNER JOIN Country co
-> ON ci.CountryCode = co.Code
-> INNER JOIN CountryLanguage cl
-> ON co.Code = cl.CountryCode
-> WHERE cl.Language = 'ENGLISH'
-> LIMIT 100;
+----+-------------+-------+------------+--------+---------------------+-------------+---------+----------------------+------+----------+-------------+
| id | select_type | table | partitions | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+-------+------------+--------+---------------------+-------------+---------+----------------------+------+----------+-------------+
| 1 | SIMPLE | cl | NULL | ALL | PRIMARY,CountryCode | NULL | NULL | NULL | 984 | 10.00 | Using where |
| 1 | SIMPLE | co | NULL | eq_ref | PRIMARY | PRIMARY | 3 | world.cl.CountryCode | 1 | 100.00 | NULL |
| 1 | SIMPLE | ci | NULL | ref | CountryCode | CountryCode | 3 | world.cl.CountryCode | 1 | 100.00 | NULL |
+----+-------------+-------+------------+--------+---------------------+-------------+---------+----------------------+------+----------+-------------+
3 rows in set, 2 warnings (0.00 sec)
58
Sunday, October 16, 16

59. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Workbench
Visual
EXPLAIN
-­‐
Mac
59
Sunday, October 16, 16

60. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
60
Sunday, October 16, 16

61. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
General
Query
Log
• General
Record
• Why:
-­‐ Order
is
important
-­‐ Exact
query
that
came
in
-­‐ minimal
audit
of
what
a
connec@on
did
• Enable
Dynamically
or
with
--general-log
-­‐ Default
loca@on:
host-name.log
in
datadir
• Mul@ple
op@ons
for
controlling
it
61
Sunday, October 16, 16

62. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Binary
Log
• Logs
database
*change*
events
• Why?
-­‐ Replica@on
or
Data
Recovery
• Enable
with
--log-bin
• A
LOT
of
op@ons
• “Read”
with
mysqlbinlog
• To
disable
binary
logging
for
the
current
session,
use
sql_log_bin
62
Sunday, October 16, 16

63. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
mysqlbinlog
• Display
binary/relay
logs
in
text
format
• Syntax:
mysqlbinlog [options] logfile
• Can
work
with
any
replica@on
format
-­‐ Reading
Row
Based
Replica@on
• --verbose --base64-output=DECODE-ROWS
• Can
backup
binary
logs
to
remote
server
-­‐ Sta@c
or
streaming
• --read-from-remote-server
63
Sunday, October 16, 16

64. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Example
mysqlbinlog
output
# at 316
#130512 20:22:57 server id 1 end_log_pos 364 CRC32 0xa7a9fe8c !GTID [commit=yes]
SET @@SESSION.GTID_NEXT= '6e521de8-bb62-11e2-836e-821afda5425c:2'/*!*/;
# at 364
#130512 20:22:57 server id 1 end_log_pos 443 CRC32 0xf9bf1aaa !Query! thread_id=3
! exec_time=0!error_code=0
SET TIMESTAMP=1368404577/*!*/;
BEGIN
/*!*/;
# at 443
#130512 20:22:57 server id 1 end_log_pos 542 CRC32 0x1b82a82c !Query! thread_id=3
! exec_time=0!error_code=0
SET TIMESTAMP=1368404577/*!*/;
insert into t1 values (1)
/*!*/;
# at 542
#130512 20:22:57 server id 1 end_log_pos 573 CRC32 0x22965d3b !Xid = 29
COMMIT/*!*/;
# at 573
#130512 20:23:01 server id 1 end_log_pos 621 CRC32 0x89e5d253 !GTID [commit=yes]
SET @@SESSION.GTID_NEXT= '6e521de8-bb62-11e2-836e-821afda5425c:3'/*!*/;
64
Sunday, October 16, 16

65. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Security
65
Sunday, October 16, 16

66. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Securing
a
New
InstallaNon
Prior
to
5.7
• Ini@al
user
accounts
-­‐ Superuser
(root)
-­‐ Anonymous
(“”)
66
Sunday, October 16, 16

67. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
User
Account
• 2
parts
-­‐ username
-­‐ hostname
-­‐ Ex:
• ‘root’@‘localhost’
• ‘’@‘127.0.0.1’
• ‘root’@‘192.168.1.%’
• ‘lig’@’%’
67
Sunday, October 16, 16

68. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Securing
a
New
InstallaNon
Prior
to
5.7
• Ini@al
accounts
-­‐ Superuser
(root)
-­‐ Anonymous
(“”)
• test
database
(con’t)
68
Sunday, October 16, 16

69. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Securing
a
New
InstallaNon
Prior
to
5.7
• Ini@al
accounts
-­‐ Superuser
(root)
-­‐ Anonymous
(“”)
• test
database
• Securing
the
easy
way
-mysql_secure_installation
(con’t)
69
Sunday, October 16, 16

70. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Securing
a
New
InstallaNon
Prior
to
5.7
• Ini@al
accounts
-­‐ Superuser
(root)
-­‐ Anonymous
(“”)
• test
database
• Securing
the
easy
way
-mysql_secure_installation
• Hard way
(con’t)
70
Sunday, October 16, 16

71. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Securing
a
New
InstallaNon
in
5.7
71
• Done
during
data
directory
installa@on
• mysqld --initialize
-­‐ Secure
by
default
• Generate
random
password
for
`root`@`localhost`
account
and
writes
message
with
it
• Password
marked
as
expired
• mysqld --initialize-insecure
-­‐ Empty
password
for
`root`@`localhost`
account
-­‐ Does
*NOT*
mark
password
as
expired
Sunday, October 16, 16

72. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Securing
a
New
InstallaNon
in
5.7
72
• Assigning
a
new
`root`@localhost`
password
(con’t)
mysql> ALTER USER ‘root’@‘localhost’ IDENTIFIED BY ‘new-password’;
Sunday, October 16, 16

73. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Access
Control
• 2
stages
73
Sunday, October 16, 16

74. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Access
Control
• 2
stages
-­‐ Stage
1:
Connec@ng
• Who
are
you?
-­‐ host
-­‐ username
74
Sunday, October 16, 16

75. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
User
Accounts
• CREATE
USER
• ALTER
USER
(5.6)
75
mysql> CREATE USER ‘lig’@‘localhost’ IDENTIFIED BY ‘S3cr3t’;
mysql> ALTER USER ‘lig’@‘localhost’ IDENTIFIED BY ‘new-password’;
Sunday, October 16, 16

76. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Access
Control
• 2
stages
-­‐ Stage
1:
Connec@ng
• Who
are
you?
-­‐ host
-­‐ username
• Prove
it!
76
Sunday, October 16, 16

77. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Passwords
• Expira@on
-­‐ Manually
(5.6)
or
with
a
Policy
(5.7)
• Hashing
-­‐ Mul@ple
authen@ca@on
plugins
available
• Policy
-­‐ Use
Password
Valida@on
plugin
(validate_password)
• cleartext
supplied
password
checked
against
password
policy
• 3
levels
of
password
checking
which
can
be
modified
77
Sunday, October 16, 16

78. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Access
Control
• 2
stages
-­‐ Stage
1:
Connec@ng
• Who
are
you?
-­‐ host
-­‐ username
• Prove
it!
-­‐ Stage
2:
Request
• For
each
request
-­‐ What
are
you
doing
and
are
you
allowed
to
do
that?
78
Sunday, October 16, 16

79. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
GRANT
• Defines
privileges
and
account
characteris@cs
• Mul@ple
privileges
-­‐ Ex:
SUPER, CREATE, ALTER, SELECT, INSERT
• Mul@ple
levels
-­‐ Ex:
Global,
Database,
Table,
Column
• Account
characteris@cs
-­‐ Ex:
REQUIRE SSL or
MAX_QUERIES_PER_HOUR
79
Sunday, October 16, 16

80. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Sample
GRANTS
mysql> SHOW GRANTS;
+---------------------------------------------------------------------+
| Grants for root@localhost |
+---------------------------------------------------------------------+
| GRANT ALL PRIVILEGES ON *.* TO 'root'@'localhost' WITH GRANT OPTION |
| GRANT ALL PRIVILEGES ON `mysql`.* TO 'root'@'localhost' |
| GRANT PROXY ON ''@'' TO 'root'@'localhost' WITH GRANT OPTION |
+---------------------------------------------------------------------+
3 rows in set (0.00 sec)
mysql> SHOW GRANTS FOR 'test'@'localhost';
+--------------------------------------------------------+
| Grants for test@localhost |
+--------------------------------------------------------+
| GRANT USAGE ON *.* TO 'test'@'localhost' |
| GRANT ALL PRIVILEGES ON `test`.* TO 'test'@'localhost' |
+--------------------------------------------------------+
2 rows in set (0.00 sec)
80
Sunday, October 16, 16

81. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
REVOKE
• Removes
the
privileges
GRANTed
-­‐ Does
not
extrapolate
• Does
not
remove
the
user
• If
no
host
is
given
-­‐ %
is
used
-­‐ Again
-­‐
Does
not
extrapolate
81
Sunday, October 16, 16

82. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
REVOKE
mysql> SHOW GRANTS FOR 'test'@'localhost';
+--------------------------------------------------------+
| Grants for test@localhost |
+--------------------------------------------------------+
| GRANT USAGE ON *.* TO 'test'@'localhost' |
| GRANT ALL PRIVILEGES ON `test`.* TO 'test'@'localhost' |
+--------------------------------------------------------+
2 rows in set (0.00 sec)
mysql> REVOKE DELETE ON test.t1 FROM 'test'@'localhost';
ERROR 1147 (42000): There is no such grant defined for user 'test' on host
'localhost' on table 't1'
mysql> REVOKE USAGE ON *.* FROM 'test'@'localhost';
Query OK, 0 rows affected (0.02 sec)
82
Sunday, October 16, 16

83. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Backups
83
Sunday, October 16, 16

84. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Backups
Types
• Logical
• Physical
1
2
84
Sunday, October 16, 16

85. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Logical
Backups
• Saved
-­‐ Logical
structure
-­‐ Content
• Machine
Independent
• Slower
• Server
Up/Warm
• Full
Granularity
85
Sunday, October 16, 16

86. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
mysqldump
• Logical
• Commonly
used
• Editable
text
files
• Very
flexible
• Ques@onable
scalability
86
Sunday, October 16, 16

87. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
mysqlpump
• Logical
• Similar
to
mysqldump
• Parallel
processing
to
speed
up
dump
process
• Dump
user
accounts
with
CREATE USER/GRANT
• Default:
I_S, P_S, ndbinfo
and
SYS
not
included
• Reloading:
faster
secondary
index
crea@on
for
InnoDB
87
Sunday, October 16, 16

88. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
SELECT
...
INTO
OUTFILE
and
LOAD
DATA
INFILE
• Logical
• Data
only
• Be
careful!
You
want
a
consistent
backup
• Column
and
line
terminators
can
be
specified
• Lots
of
details
-­‐
see
the
manual
88
Sunday, October 16, 16

89. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Backup
Types
• Logical
• Physical22
1
89
Sunday, October 16, 16

90. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Physical
Backup
• Raw
copies
• Faster
then
logical
(orders
of
magnitude)
• Compact
• File
based
granularity
• Usually
server
is
down
or
locked
90
Sunday, October 16, 16

91. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Filesystem
Snapshot
• Physical
• OS
Dependent
• Basic
Steps
-FLUSH TABLES WITH READ LOCK
-­‐ Take
the
snapshot
-UNLOCK TABLES
-­‐ Copy
files
from
snapshot
91
Sunday, October 16, 16

92. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL
Enterprise
Backup
• Official
physical
backup
solu@on
-­‐ MySQL
5.0
to
5.7
-­‐ Can
handle
all
official
MySQL
supported
storage
engines
• Mul@-­‐pla^orm
• Binlog
and
Relay
log
backup
• Fast
Recovery
92
Sunday, October 16, 16

93. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
3rd
Party
Backup
• Xtra
Backup
-­‐ Percona
backup
solu@on
-­‐ Open
source
-­‐ Backs
up
• InnoDB,
XtraDB
and
MyISAM
• MySQL
5.1,
5.5
and
5.6
93
Sunday, October 16, 16

94. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Don’t
Forget
Your
Binary
Logs
•Incremental
backup
-­‐ Holds
changes
since
the
full
backup
-­‐
roll
it
forward
•Physical
file
copy
-­‐ Rotate
binary
log
with
FLUSH
LOGS
-­‐ Copy
the
file
•Logical
copy
to
remote
server
-­‐ Sta@c
or
streaming
• mysqlbinlog --read-from-remote-server
94
Sunday, October 16, 16

95. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Monitoring
95
Sunday, October 16, 16

96. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
SHOW
• MySQL
specific
command
• Commands
for
-­‐ Metadata
-­‐ Status
informa@on
• Metric
crap-­‐ton
96
Sunday, October 16, 16

97. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Examples
Metadata
SHOW DATABASES SHOW TRIGGERS SHOW PLUGINS
SHOW CREATE PROCEDURE SHOW ENGINES SHOW VARIABLES
SHOW INDEXES SHOW GRANTS SHOW BINARY LOGS
Status
SHOW SLAVE STATUS SHOW OPEN TABLES SHOW RELAYLOG EVENTS
SHOW ENGINE INNODB
STATUS
SHOW FULL PROCESSLIST SHOW GLOBAL STATUS
97
Sunday, October 16, 16

98. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
INFORMATION_SCHEMA
• Mostly
metadata
-PROCESSLIST
-GLOBAL_VARIABLES / GLOBAL_STATUS
-FILES / INNODB_SYS_TABLESPACES / INNODB_SYS_DATAFILES
• But
-INNODB_TRX / INNODB_LOCKS / INNODB_LOCK_WAITS
-INNODB_TEMP_TABLE_INFO
98
Sunday, October 16, 16

99. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
SYS
SCHEMA
•Included
in
5.7.7
-­‐ Installed
by
default
with
--initialize
•Originally
known
as
ps_helper
-­‐ Originally
created
by
Mark
Leith
-­‐ hpp://www.markleith.co.uk/ps_helper
-­‐ Can
work
with
5.6
-­‐
download
from
Github
• hpps://github.com/mysql/mysql-­‐sys
• Easy,
human
readable
access
to
P_S
and
I_S
info
for
typical
use
cases
99
Sunday, October 16, 16

100. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
SYS
SCHEMA
•Pair
views
-­‐ Ex:
host_summary_by_file_io
and
x$host_summary_by_file_io
•Example
views
-­‐
statements_with_full_table_scans
-­‐
statements_with_runtimes_in_95th_percentile
-­‐
io_by_thread_by_latency
-­‐
memory_by_user_by_current_bytes
-­‐
schema_redundent_indexes
-­‐
100
Sunday, October 16, 16

101. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
PERFORMANCE_SCHEMA
• Monitors
at
a
low
level
• Uses
PERFORMANCE_SCHEMA
storage
engine
• Available
-­‐ Current
events
-­‐ Event
histories
/
Event
summa@ons
• Configura@on
is
dynamic
• Query
using
SQL
101
Sunday, October 16, 16

102. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
PERFORMANCE_SCHEMA
• Using
the
PERFORMANCE_SCHEMA
-­‐ Manual
• Diagnose
Problems
-­‐
hpps://dev.mysql.com/doc/en/performance-­‐schema-­‐examples.html
• Query
Profiling
-­‐
hpps://dev.mysql.com/doc/en/performance-­‐schema-­‐query-­‐profiling.html
-­‐ Blog
posts
• Marc
Alff’s
blog
-­‐
hpp://marcalff.blogspot.com
• Mark
Leith’s
blog
-­‐
hpp://www.markleith.co.uk/
-­‐ Many
Presenta@ons/Webinars
(con’t)
102
Sunday, October 16, 16

103. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
MySQL
Enterprise
Monitor
-­‐
MEM
• Real
@me
monitoring
-­‐ Performance
-­‐ Replica@on
-­‐ Query
analysis
-­‐ InnoDB
-­‐ Backup
-­‐ Disk
and
OS
103
Sunday, October 16, 16

104. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
104
MEM
-­‐
Dashboard
Sunday, October 16, 16

105. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
105
MEM
-­‐
Query
Analysis
Sunday, October 16, 16

106. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
106
MEM
-­‐
File
IO
Sunday, October 16, 16

107. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
107
MEM
-­‐
ReplicaNon
Sunday, October 16, 16

108. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Oracle
Enterprise
Manager
for
MySQL
• Monitoring
of
MySQL
servers
in
familiar
OEM
interface
• Real
@me
monitoring
-­‐ Performance
-­‐ Replica@on
-­‐ InnoDB
-­‐ Metric
Collec@on
•Won’t
lie
-­‐
doesn’t
do
everything
MEM
does
108
Sunday, October 16, 16

109. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
109
OEM
MySQL
-­‐
Performance
Monitoring
Sunday, October 16, 16

110. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
110
OEM
MySQL
-­‐
Performance
Reports
Sunday, October 16, 16

111. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
111
OEM
MySQL
-­‐
Metric
&
CollecNon
Sunday, October 16, 16

112. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Basic
TroubleshooNng
112
Sunday, October 16, 16

113. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Step
1
• Define
the
problem
• Must
know
what
is
“normal”,
so
you
know
when
it
is
not
-­‐
and
how
much
• Be
exact!
• Read
and
understand
the
manual
for
the
area
that
is
problema@c
113
Sunday, October 16, 16

114. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Step
2
• Collect
the
diagnos@c
data
-­‐ OS
data
-­‐ MySQL
data
• May
need
to
collect
the
diagnos@c
data
during
the
problem
-­‐ Monitoring
-­‐ Maybe
pt-stalk
114
Sunday, October 16, 16

115. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Error
Log
• First
place
to
look
• Can
give
history
and
context
to
any
problem.
• Error
message(s)
115
Sunday, October 16, 16

116. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Server
Crash
• Error
log
-­‐ Stack
trace
and
error
message(s)
• OS
error
log
around
the
crash
@me
• Any
and
all
diagnos@c
data
available
-­‐ MySQL
and
OS
monitoring
data
(graphs
or
raw
data)
-­‐ core
file?
• Any
informa@on
about
what
was
happening
before
and
during
the
crash
-­‐ External
Scripts
running
/
Applica@ons
/
Cronjobs
/
Backups
/
Etc.
116
Sunday, October 16, 16

117. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
ReplicaNon
Issues
• Error
log
• SHOW MASTER STATUS
• my.cnf
/
my.ini
• SHOW GLOBAL VARIABLES
• SHOW SLAVE STATUS
117
Sunday, October 16, 16

118. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Performance
Issues
• Error
log
• OS
data
(Ex:
IO,
CPU,
Memory,
NUMA,
etc.)
• SHOW GLOBAL VARIABLES
• SHOW GLOBAL STATUS
• SHOW FULL PROCESSLIST
• SHOW ENGINE INNODB STATUS
• Informa@on
from
PERFORMANCE_SCHEMA
118
Sunday, October 16, 16

119. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Query
Performance
Issues
• Error
log
• Slow
Query
Log
• EXPLAIN
• SHOW CREATE TABLE
• SHOW TABLE STATUS
• SHOW INDEXES
• Profile
the
query
119
Sunday, October 16, 16

120. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
QuesNons?
120
Sunday, October 16, 16

121. Copyright
©
2016,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
A
MySQL
DBA
Primer
Ligaya
Turmelle
Principal
Technical
Support
Engineer
-­‐
MySQL
ligaya.turmelle@oracle.com
@lig
,
Oracle
and/or
its
affiliates.
All
rights
reserved.
| 121
Sunday, October 16, 16

122. Copyright
©
2014,
Oracle
and/or
its
affiliates.
All
rights
reserved.
|
Sunday, October 16, 16