OOW2016 DBA Tutorial Final

Oracle

Support Stars
Bar
• Ask the Experts your
toughest product
quesCons.
• View My Oracle
Support and Product
DemonstraCons.
• Learn what’s new and
more!
9/6/16 Copyright © 2016, Oracle and/or its affiliates. All rights reserved.
Oracle Confiden1al – 9
Monday, September 19, 16 Internal/Restricted/Highly
A MySQL DBA Primer
Ligaya Turmelle
Principal Technical Support Engineer -‐ MySQL
ligaya.turmelle@oracle.com
@lig
Copyright © 2016, , Oracle and/or its affiliates. All rights reserved. | 2

Monday, September 19, 16
Safe Harbor Statement
The following is intended to outline our general product direc1on. It is intended for
informa1on purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or func1onality, and should not be relied upon
in making purchasing decisions. The development, release, and 1ming of any features or
func1onality described for Oracle’s products remains at the sole discre1on of Oracle.
Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |

3
Agenda -‐ First Half
1 • Founda1on
2 • Installa1on
3 • Talking to MySQL
4 • Architecture
5 • Log Files

4
Agenda -‐ Second Half
5 • Log Files (con’t)

6 • Security
7 • Backup
8 • Monitoring
9 • Basic Troubleshoo1ng

5
FoundaCon

6
FoundaCon
1 • Basics
2 • Commercial

7
MySQL in a Nutshell
• Worlds most popular open source database

• “M” of LAMP
• Main site: mysql.com

8
MySQL.com
• mysql.com
- Commercial site
• dev.mysql.com (AKA mysql.org)
- Developer Zone
• downloads.mysql.com
• dev.mysql.com/doc/
- Documentation
• bugs.mysql.com
9
GeXng Help
• Manual
• MySQL Support
• MySQL Forums (forums.mysql.com)
• Mailing Lists (lists.mysql.com)
• Search the Web
• IRC on freenode -‐ #mysql

10
Main Features
• Works on mul1ple plaborms

• Mul1-‐layered server design
• Pluggable architecture
-‐ Storage engine
-‐ Misc plugins (Ex: validate_password, SHA256_password)
• Mul1-‐threaded
• “Plays well” with most programming languages

11
FoundaCon
1 • Basics
2 • Commercial

12
Enterprise EdiCon Add-‐Ons
• MySQL Enterprise Backup (MEB)

• MySQL Enterprise Monitor (MEM)
• Workbench
• Plugins
• Threadpool, Audit, Firewall, TDE, Encryp1on, PAM, etc
• Oracle Enterprise Manager for MySQL

13
InstallaCon

14
InstallaCon
1 • Files
2 • Installa1on

15
OpCon Files # The following options will be passed to all
MySQL clients
• AKA configura1on files [client]

#password! = your_password
port! ! = 3626
• Lists specific startup op1ons socket!! = /tmp/mysql.5.6.26.sock
# Here follows entries for some specific

programs
# The MySQL server

[mysqld]
port! = 3626
socket!= /tmp/mysql.5.6.26.sock
log-error = /Users/ligaya/mysql_installs/
mysql-5.6.26-osx10.9-x86_64/data/error.log
server-id! = 1
table_open_cache = 4000
Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 16

Common LocaCons of OpCon File
• Windows
- INSTALLDIR\my.ini
- INSTALLDIR\my.cnf
• Linux & Mac
- /etc/my.cnf
- /etc/mysql/my.cnf

17
Generic Unix/Linux Binary File Layout
Directory Contents
bin, scripts Client programs, mysqld server and u1lity programs
data Log files and databases
docs Manual in Info format
man Unix manual pages
include Include (header) files
lib Libraries
Misc support files including error messages, sample op1on files and SQL for database
share
installa1on

18
Linux RPM File Layout
Directory Contents
/usr/bin Client programs and scripts
/usr/sbin mysqld server
/var/lib/mysql log files and databases
/usr/share/info Manual in Info format
/usr/share/man Unix manual pages
/usr/include/mysql Include (header) files
/usr/lib/mysql Libraries
Misc support files including error messages, character set files, sample op1on files and
/usr/share/mysql
SQL for database installa1on

19
Windows File Layout
Directory Contents Notes
bin, scripts Client programs, mysqld server and u1li1es scripts
The Windows system variable
%ALLUSERSPROFILE% Log files and databases (Windows XP, Windows Server %ALLUSERSPROFILE% defaults to
\MySQL\MySQL
Server 5.7\ 2003) C:\Documents and Settings
\All Users\Application Data
%PROGRAMDATA% The Windows system variable
\MySQL\MySQL
Log files and databases (Vista, Windows 7, Windows %PROGRAMDATA% defaults to C:
Server 2008 and newer) \ProgramData
Server 5.7\
examples Example programs and scripts
include include (header) files
lib Libraries
Misc support files including error messages, character set
share
files, sample op1on files and SQL for database installa1on

20
InstallaCon
1 • Files
2 • Installa1on

21
InstallaCon
• Well documented in the Manual

• Each OS is documented -‐ some with mul1ple ways to do it
-‐ Unix/Linux Generic Binaries
-‐ Windows
-‐ Mac
-‐ Various Linux (MySQL Repositories, RPM, Na1ve Repositories)
-‐ Solaris
-‐ Source

22
Generic Binary InstallaCon
shell> groupadd mysql
shell> useradd -r -g mysql mysql
shell> cd /usr/local
shell> tar zxvf /path/to/mysql-VERSION-OS.tar.gz
shell> ln -s full-path-to-mysql-VERSION-OS mysql
shell> cd mysql
shell> mkdir mysql-files
shell> chmod 770 mysql-files
shell> chown -R mysql .
shell> chgrp -R mysql .
shell> bin/mysql_install_db --user=mysql # Before 5.7.6
shell> bin/mysqld --initialize --user=mysql # 5.7.6 and up
shell> bin/mysql_ssl_rsa_setup # 5.7.6 and up
shell> chown -R root .
shell> chown -R mysql data mysql-files
shell> bin/mysqld_safe --user=mysql & # optionally start the server
# Next command is optional
shell> cp support-files/mysql.server /etc/init.d/mysql.server

23
StarCng it up
• Various methods
- mysqld_safe
- mysqld
- mysql.server
- service mysqld start
-‐ Windows Service
• Unix/Linux -‐ run as a non-‐root account
• Windows -‐ admin rights
24
ShuXng it down
• Manually
- mysqladmin shutdown
- /etc/init.d/mysql stop
- service mysqld stop
- NET STOP MySQL
- Services Manager
- SHUTDOWN (5.7)

25
Talking to MySQL

26
CLI -‐ mysql client
mysql> select count(*) from inventory;
+----------+
• Easy to use | count(*) |
+----------+
• Simple SQL shell

| 4581 |
+----------+
1 row in set (0.08 sec)
• Server side help mysql> ALTER TABLE rental DROP FOREIGN KEY
`fk_rental_inventory`;
• Many op1ons Query OK, 0 rows affected (0.25 sec)
Records: 0 Duplicates: 0 Warnings: 0
-‐ Example: --i-am-a-
mysql> SELECT rental_id from rental order by RAND() LIMIT
dummy 10;
+-----------+
• Has its own commands | rental_id |
+-----------+
| 12539 |
| 8592 |
| 15699 |

Workbench
• GUI
-‐ SQL Development
-‐ Data Modeling
-‐ Server Administra1on
-‐ Data Migra1on
-‐ Performance Tools and Reports
-‐ Integrated with MEB and Audit
-‐ MySQL U1li1es

28
SQL Editor
in Windows

29
Data
Modeling
in Mac

30
Performance Dashboard in Linux

31
Architecture

32
Architecture
1 • High Level
2 • Storage Engines

33
High Level

34
Architecture
1 • High Level
2 • Storage Engines

35
InnoDB
• General-‐purpose storage engine

• As of 5.5, is the default engine
• Features:
-‐ ACID compliant
-‐ Row level locking with consistent reads
-‐ Foreign keys
-‐ Clustered primary key index
-‐ FullText Indexes (5.6) & Geospa1al data and indexes (5.7)
36
InnoDB
(con’t)
• Features Con1nued:
-‐ Tablespaces
• file per table
-‐ transportable
-‐ encrypted
• undo logs
• general
-‐ Compressed Data

37
Others
• MyISAM
• Memory
• CSV
• Archive
• Blackhole
• 3rd Party

38
Log Files

39
Error Log
• --log-error[=file_name]
• Default loca1on: host_name.err in datadir
• Examples of stuff logged
-‐ Start and stops & Cri1cal errors
-‐ MyISAM tables that need to be checked or repaired
-‐ some OS’s -‐ stack trace if mysqld crashes
• (5.7) log_syslog to send MySQL error log to syslog
• (5.7) log_error_verbosity
40
Slow Query Log
• First line of offense for tuning queries

• Why?
-‐ Performance usually
• Enable dynamically or with --slow-query-log
-‐ Default file loca1on: host_name-slow.log in the datadir
-‐ Can also go to a table
• Mul1ple op1ons for controlling it
• Aggregate its data with mysqldumpslow u1lity
41
EXPLAIN
• Displays query execu1on plan

• Syntax:
-‐ Prior to 5.6:
• EXPLAIN [explain_type] SELECT select_options
-‐ 5.6:
• EXPLAIN [explain_type] explainable_stmt

42
EXPLAIN
(con’t)
• Talk all by itself

• 1 row == 1 table
• Order maqers
• EXTENDED + SHOW WARNINGS = rewriqen query
• Columns:
-‐ id, select_type, table, par11ons, type, possible_keys, key, key_length, ref, rows,
filtered, Extra

43
Example CLI EXPLAIN
mysql> EXPLAIN EXTENDED SELECT ci.Name,

-> co.Name,
-> cl.IsOfficial
-> FROM City ci
-> INNER JOIN Country co
-> ON ci.CountryCode = co.Code
-> INNER JOIN CountryLanguage cl
-> ON co.Code = cl.CountryCode
-> WHERE cl.Language = 'ENGLISH'
-> LIMIT 100;
+----+-------------+-------+------------+--------+---------------------+-------------+---------+----------------------+------+----------+-------------+
| id | select_type | table | partitions | type | possible_keys | key | key_len | ref | rows | filtered | Extra |
+----+-------------+-------+------------+--------+---------------------+-------------+---------+----------------------+------+----------+-------------+
| 1 | SIMPLE | cl | NULL | ALL | PRIMARY,CountryCode | NULL | NULL | NULL | 984 | 10.00 | Using where |
| 1 | SIMPLE | co | NULL | eq_ref | PRIMARY | PRIMARY | 3 | world.cl.CountryCode | 1 | 100.00 | NULL |
| 1 | SIMPLE | ci | NULL | ref | CountryCode | CountryCode | 3 | world.cl.CountryCode | 1 | 100.00 | NULL |
+----+-------------+-------+------------+--------+---------------------+-------------+---------+----------------------+------+----------+-------------+
3 rows in set, 2 warnings (0.00 sec)

44
Workbench Visual EXPLAIN -‐ Mac

45
mysqldumpslow
• Parses slow query log and aggregates the data

• Default -‐ groups queries that are similar
-‐ “abstracts” out specific string and number data values
• Op1ons for sor1ng:
-‐ t, at -‐ sort by query 1me or average query 1me
-‐ l, al -‐ sort by lock 1me or average lock 1me
-‐ r, ar -‐ sort by rows or average rows sent
-‐ c -‐ sort by count
46
Example mysqldumpslow output
Count: 6 Time=0.36s (2s) Lock=0.00s (0s) Rows=1.0 (6), agent[agent]@localhost
SELECT @@version NOT LIKE "S" AND (SELECT COUNT(*) < N FROM INFORMATION_SCHEMA.TABLES WHERE
TABLE_SCHEMA != 'S') AND (SELECT COUNT(*) = N FROM INFORMATION_SCHEMA.TABLES WHERE CREATE_OPTIONS LIKE
'S')
Count: 2 Time=0.24s (0s) Lock=0.10s (0s) Rows=1.0 (2), agent[agent]@localhost

SELECT ROUND(SUM(sum_timer_wait)/N) total_wait_time_ms, SUM(count_star) total_statements,
ROUND(MAX(max_timer_wait)/N) max_wait_time_ms, SUM(sum_errors) total_errors, SUM(sum_warnings)
total_warnings, SUM(sum_rows_sent) total_rows_returned, ROUND(SUM(sum_lock_time)/N) total_lock_time_ms
FROM performance_schema.events_statements_summary_by_digest
Count: 100 Time=0.22s (22s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@localhost

CREATE TABLE `t1` (id serial,id0 varchar(N) unique key,intcol1 INT(N) ,intcol2 INT(N) ,intcol3
INT(N) ,intcol4 INT(N) ,intcol5 INT(N) ,charcol1 VARCHAR(N),charcol2 VARCHAR(N),charcol3
VARCHAR(N),charcol4 VARCHAR(N),charcol5 VARCHAR(N),charcol6 VARCHAR(N),charcol7 VARCHAR(N),charcol8
VARCHAR(N),charcol9 VARCHAR(N),charcol10 VARCHAR(N))
Count: 300 Time=0.20s (60s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@localhost

CREATE TABLE `t1` (id serial,id0 varchar(N) unique key,intcol1 INT(N) ,intcol2 INT(N) ,intcol3
INT(N) ,intcol4 INT(N) ,intcol5 INT(N) ,intcol6 INT(N) ,intcol7 INT(N) ,intcol8 INT(N) ,intcol9
INT(N) ,intcol10 INT(N) ,charcol1 VARCHAR(N),charcol2 VARCHAR(N),charcol3 VARCHAR(N),charcol4
VARCHAR(N),charcol5 VARCHAR(N),charcol6 VARCHAR(N),charcol7 VARCHAR(N),charcol8 VARCHAR(N),charcol9
VARCHAR(N),charcol10 VARCHAR(N))

47
General Query Log
• General Record
• Why:
-‐ Order is important
-‐ Exact query that came in
-‐ minimal audit of what a connec1on did
• Enable Dynamically or with --general-log
-‐ Default loca1on: host-name.log in datadir
• Mul1ple op1ons for controlling it
48
Binary Log
• Logs database *change* events

• Why?
-‐ Replica1on or Data Recovery
• Enable with --log-bin
• A LOT of op1ons
• “Read” with mysqlbinlog
• To disable binary logging for the current session, use sql_log_bin

49
mysqlbinlog
• Display binary/relay logs in text format

• Syntax: mysqlbinlog [options] logfile
• Can work with any replica1on format
-‐ Reading Row Based Replica1on
• --verbose --base64-output=DECODE-ROWS
• Can backup binary logs to remote server

-‐ Sta1c or streaming
• --read-from-remote-server

50
Example mysqlbinlog output
# at 316
#130512 20:22:57 server id 1 end_log_pos 364 CRC32 0xa7a9fe8c !GTID [commit=yes]
SET @@SESSION.GTID_NEXT= '6e521de8-bb62-11e2-836e-821afda5425c:2'/*!*/;
# at 364
#130512 20:22:57 server id 1 end_log_pos 443 CRC32 0xf9bf1aaa !Query! thread_id=3
! exec_time=0!error_code=0
SET TIMESTAMP=1368404577/*!*/;
BEGIN
/*!*/;
# at 443
#130512 20:22:57 server id 1 end_log_pos 542 CRC32 0x1b82a82c !Query! thread_id=3
! exec_time=0!error_code=0
SET TIMESTAMP=1368404577/*!*/;
insert into t1 values (1)
/*!*/;
# at 542
#130512 20:22:57 server id 1 end_log_pos 573 CRC32 0x22965d3b !Xid = 29
COMMIT/*!*/;
# at 573
#130512 20:23:01 server id 1 end_log_pos 621 CRC32 0x89e5d253 !GTID [commit=yes]
SET @@SESSION.GTID_NEXT= '6e521de8-bb62-11e2-836e-821afda5425c:3'/*!*/;

51
Security

52
Securing a New InstallaCon Prior to 5.7
• Ini1al user accounts

-‐ Superuser (root)
-‐ Anonymous (“”)

53
User Account
• 2 parts
-‐ username
-‐ hostname
-‐ Ex:
• ‘root’@‘localhost’
• ‘’@‘127.0.0.1’
• ‘root’@‘192.168.1.%’
• ‘lig’@’%’

54
(con’t)
• Ini1al accounts
• test database

55
(con’t)
• Ini1al accounts
• test database
• Securing the easy way
- mysql_secure_installation

56
(con’t)
• Ini1al accounts
• test database
• Securing the easy way
- mysql_secure_installation
• Hard way

57
Securing a New InstallaCon in 5.7
• Done during data directory installa1on

• mysqld --initialize
-‐ Secure by default
• Generate random password for `root`@`localhost` account and writes message with it
• Password marked as expired
• mysqld --initialize-insecure
-‐ Empty password for `root`@`localhost` account
-‐ Does *NOT* mark password as expired

58
Securing a New InstallaCon in 5.7
(con’t)
• Assigning a new `root`@localhost` password
mysql> ALTER USER ‘root’@‘localhost’ IDENTIFIED BY ‘new-password’;

59
Access Control
• 2 stages

60
Access Control
• 2 stages
-‐ Stage 1: Connec1ng
• Who are you?
-‐ host
-‐ username

61
User Accounts
• CREATE USER
mysql> CREATE USER ‘lig’@‘localhost’ IDENTIFIED BY ‘S3cr3t’;
• ALTER USER (5.6)
mysql> ALTER USER ‘lig’@‘localhost’ IDENTIFIED BY ‘new-password’;

62
Access Control
• 2 stages
• Who are you?
-‐ host
-‐ username
• Prove it!

63
Passwords
• Expira1on
-‐ Manually (5.6) or with a Policy (5.7)
• Hashing
-‐ Mul1ple authen1ca1on plugins available
• Policy
-‐ Use Password Valida1on plugin (validate_password)
• cleartext supplied password checked against password policy
• 3 levels of password checking which can be modified

64
Access Control
• 2 stages
• Who are you?
-‐ host
-‐ username
• Prove it!
-‐ Stage 2: Request
• For each request
-‐ What are you doing and are you allowed to do that?

65
GRANT
• Defines privileges and account characteris1cs

• Mul1ple privileges
-‐ Ex: SUPER, CREATE, ALTER, SELECT, INSERT
• Mul1ple levels
-‐ Ex: Global, Database, Table, Column
• Account characteris1cs
-‐ Ex: REQUIRE SSL or MAX_QUERIES_PER_HOUR

66
Sample GRANTS
mysql> SHOW GRANTS;
+---------------------------------------------------------------------+
| Grants for root@localhost |
+---------------------------------------------------------------------+
| GRANT ALL PRIVILEGES ON *.* TO 'root'@'localhost' WITH GRANT OPTION |
| GRANT ALL PRIVILEGES ON `mysql`.* TO 'root'@'localhost' |
| GRANT PROXY ON ''@'' TO 'root'@'localhost' WITH GRANT OPTION |
+---------------------------------------------------------------------+
3 rows in set (0.00 sec)
mysql> SHOW GRANTS FOR 'test'@'localhost';

+--------------------------------------------------------+
| Grants for test@localhost |
+--------------------------------------------------------+
| GRANT USAGE ON *.* TO 'test'@'localhost' |
| GRANT ALL PRIVILEGES ON `test`.* TO 'test'@'localhost' |
+--------------------------------------------------------+

67
REVOKE
• Removes the privileges GRANTed

-‐ Does not extrapolate
• Does not remove the user
• If no host is given
-‐ % is used
-‐ Again -‐ Does not extrapolate

68
REVOKE
mysql> SHOW GRANTS FOR 'test'@'localhost';
+--------------------------------------------------------+
| Grants for test@localhost |
+--------------------------------------------------------+
| GRANT USAGE ON *.* TO 'test'@'localhost' |
| GRANT ALL PRIVILEGES ON `test`.* TO 'test'@'localhost' |
+--------------------------------------------------------+
mysql> REVOKE DELETE ON test.t1 FROM 'test'@'localhost';

ERROR 1147 (42000): There is no such grant defined for user 'test' on host
'localhost' on table 't1'
mysql> REVOKE USAGE ON *.* FROM 'test'@'localhost';

Query OK, 0 rows affected (0.02 sec)

69
Backups

70
Backups Types
1 • Logical
2 • Physical

71
Logical Backups
• Saved
-‐ Logical structure
-‐ Content
• Machine Independent
• Slower
• Server Up/Warm
• Full Granularity

72
mysqldump
• Logical
• Commonly used
• Editable text files
• Very flexible
• Ques1onable scalability

73
mysqlpump
• Logical
• Similar to mysqldump
• Parallel processing to speed up dump process
• Dump user accounts with CREATE USER/GRANT
• Default: I_S, P_S, ndbinfo and SYS not included
• Reloading: faster secondary index crea1on for InnoDB

74
Backup Types
1 • Logical
2 • Physical

75
Physical Backup
• Raw copies
• Faster then logical (orders of magnitude)
• Compact
• File based granularity
• Usually server is down or locked

76
Filesystem Snapshot
• Physical
• OS Dependent
• Basic Steps
- FLUSH TABLES WITH READ LOCK
-‐ Take the snapshot
- UNLOCK TABLES
-‐ Copy files from snapshot

77
MySQL Enterprise Backup
• Official physical backup solu1on

• Mul1-‐plaborm
• “Hot” InnoDB backup
• “Warm” backup for other storage engines
• Binlog and Relay log backup
• Fast Recovery

78
MySQL Enterprise Backup
• Features:
-‐ Par1al and incremental backups
-‐ Streaming, direct to tape and single file backup
-‐ Throqling and Parallel backup opera1ons
-‐ Compression
-‐ Encryp1on
-‐ Valida1on
-‐ Supports TDE

79
Monitoring

80
SHOW
• MySQL specific command

• Commands for
-‐ Metadata
-‐ Status informa1on
• Metric crap-‐ton

81
Examples
Metadata
SHOW DATABASES SHOW TRIGGERS SHOW PLUGINS
SHOW CREATE PROCEDURE SHOW ENGINES SHOW VARIABLES
SHOW INDEXES SHOW GRANTS SHOW BINARY LOGS
Status
SHOW SLAVE STATUS SHOW OPEN TABLES SHOW RELAYLOG EVENTS
SHOW ENGINE INNODB SHOW FULL PROCESSLIST SHOW GLOBAL STATUS

STATUS

82
INFORMATION_SCHEMA
• Mostly metadata
- PROCESSLIST
- GLOBAL_VARIABLES / GLOBAL_STATUS
- FILES / INNODB_SYS_TABLESPACES / INNODB_SYS_DATAFILES
• But
- INNODB_TRX / INNODB_LOCKS / INNODB_LOCK_WAITS
- INNODB_TEMP_TABLE_INFO

83
SYS SCHEMA
• Included in 5.7.7

-‐ Installed by default with --initialize
• Originally known as ps_helper
-‐ Originally created by Mark Leith
-‐ hqp://www.markleith.co.uk/ps_helper
-‐ Can work with 5.6 -‐ download from Github
• hqps://github.com/mysql/mysql-‐sys
• Easy, human readable access to P_S and I_S info for typical use cases
84
SYS SCHEMA
• Pair views
-‐ Ex: host_summary_by_file_io and x$host_summary_by_file_io
• Example views
-‐ statements_with_full_table_scans
-‐ statements_with_runtimes_in_95th_percentile
-‐ io_by_thread_by_latency
-‐ memory_by_user_by_current_bytes
-‐ schema_redundent_indexes
-‐

85
PERFORMANCE_SCHEMA
• Monitors at a low level

• Uses PERFORMANCE_SCHEMA storage engine
• Available
-‐ Current events
-‐ Event histories / Event summa1ons
• Configura1on is dynamic
• Query using SQL

86
PERFORMANCE_SCHEMA
(con’t)
• Using the PERFORMANCE_SCHEMA

-‐ Manual
• Diagnose Problems -‐ hqps://dev.mysql.com/doc/en/performance-‐schema-‐examples.html
• Query Profiling -‐ hqps://dev.mysql.com/doc/en/performance-‐schema-‐query-‐profiling.html
-‐ Blog posts
• Marc Alff’s blog -‐ hqp://marcalff.blogspot.com
• Mark Leith’s blog -‐ hqp://www.markleith.co.uk/
-‐ Many Presenta1ons/Webinars

87
MySQL Enterprise Monitor -‐ MEM
• Real 1me monitoring

-‐ Performance
-‐ Replica1on
-‐ Query analysis
-‐ InnoDB
-‐ Backup
-‐ Disk and OS

88
MEM -‐ Dashboard

89
MEM -‐ Query Analysis

90
MEM -‐ ReplicaCon

91
Oracle Enterprise Manager for MySQL
• Monitoring of MySQL servers in familiar OEM interface

• Real 1me monitoring
-‐ Performance
-‐ Replica1on
-‐ InnoDB
-‐ Metric Collec1on
• Won’t lie -‐ doesn’t do everything MEM does

92
OEM MySQL -‐ Performance Monitoring

93
OEM MySQL -‐ Performance Reports

94
Basic TroubleshooCng

95
Step 1
• Define the problem

• Must know what is “normal”, so you know when it is not -‐ and how much
• Be exact!
• Read and understand the manual for the area that is problema1c

96
Step 2
• Collect the diagnos1c data

-‐ OS data
-‐ MySQL data
• May need to collect the diagnos1c data during the problem
-‐ Monitoring
-‐ Maybe pt-stalk

97
Error Log
• First place to look

• Can give history and context to any problem.
• Error message(s)

98
Server Crash
• Error log
-‐ Stack trace and error message(s)
• OS error log around the crash 1me
• Any and all diagnos1c data available
-‐ MySQL and OS monitoring data (graphs or raw data)
-‐ core file?
• Any informa1on about what was happening before and during the crash
-‐ External Scripts running / Applica1ons / Cronjobs / Backups / Etc.
99
ReplicaCon Issues
• Error log
• SHOW MASTER STATUS
• my.cnf / my.ini
• SHOW GLOBAL VARIABLES
• SHOW SLAVE STATUS

100
Performance Issues
• Error log
• OS data (Ex: IO, CPU, Memory, NUMA, etc.)
• SHOW GLOBAL VARIABLES
• SHOW GLOBAL STATUS
• SHOW FULL PROCESSLIST
• SHOW ENGINE INNODB STATUS
• Informa1on from PERFORMANCE_SCHEMA

101
Query Performance Issues
• Error log
• Slow Query Log
• EXPLAIN
• SHOW CREATE TABLE
• SHOW TABLE STATUS
• SHOW INDEXES
• Profile the query

102
QuesCons?

103
A MySQL DBA Primer
Ligaya Turmelle
Principal Technical Support Engineer -‐ MySQL
ligaya.turmelle@oracle.com
@lig
Copyright © 2016, , Oracle and/or its affiliates. All rights reserved. | 106

OOW2016 DBA Tutorial Final

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

OOW2016 DBA Tutorial Final

Uploaded by

Copyright:

Available Formats

Oracle

Copyright © 2016, , Oracle and/or its aﬃliates. All rights reserved. | 2

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

3 • Talking to MySQL

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

5 • Log Files (con’t)

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Worlds most popular open source database

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Works on mul1ple plaborms

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• MySQL Enterprise Backup (MEB)

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• AKA conﬁgura1on ﬁles [client]

# Here follows entries for some specific

# The MySQL server

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. | 16

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Well documented in the Manual

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Simple SQL shell

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. | 27

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• General-­‐purpose storage engine

-­‐ Compressed Data

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• First line of oﬀense for tuning queries

• Displays query execu1on plan

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Talk all by itself

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

mysql> EXPLAIN EXTENDED SELECT ci.Name,

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Parses slow query log and aggregates the data

Count: 2 Time=0.24s (0s) Lock=0.10s (0s) Rows=1.0 (2), agent[agent]@localhost

Count: 100 Time=0.22s (22s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@localhost

Count: 300 Time=0.20s (60s) Lock=0.00s (0s) Rows=0.0 (0), root[root]@localhost

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Logs database *change* events

Copyright © 2016, Oracle and/or its aﬃliates. All rights reserved. |

• Display binary/relay logs in text format

• General-‐purpose storage engine

-‐ Compressed Data

• Logs database change events

mysql> REVOKE USAGE ON . FROM 'test'@'localhost';