Saturday, February 9, 2013 - Khan Kennels › presentations › pdf ›...

Saturday, February 9, 2013

Replication With MySQLLigaya Turmelle Principle Technical Support Engineer - MySQL https://joind.in/8017

ligaya.turmelle@oracle.comMySQL Support Engineer

MySQL ACE~8 years

About Me

TODO List

• Foundation• Overview• Asynchronous and Semi-Synchronous• Setup• Monitoring

Foundation

Baby Steps

Network

Why would you want to do that?

• Scale Out

• Scale Out• Data Redundancy

• Scale Out• Data Redundancy• Analytics

• Scale Out• Data Redundancy• Analytics• Long distance data distribution

MySQL Terminology

• Method of Sending the Data

Terminology

• Method of Sending the Data• Asynchronous Replication - since 3.23

Terminology

• Method of Sending the Data• Asynchronous Replication - since 3.23• Semi-Synchronous Replication - 5.5+

Terminology

• Where to Store the Changes

Terminology

• Where to Store the Changes• Binary Log - Master

Terminology

• Where to Store the Changes• Binary Log - Master• Relay Log - Slave

Terminology

• Method of Replication

Terminology

• Method of Replication• SBR - Statement Based Replication

Terminology

• Method of Replication• SBR - Statement Based Replication• RBR - Row Based Replication

Terminology

• Method of Replication• SBR - Statement Based Replication• RBR - Row Based Replication• Mixed Mode

• http://dev.mysql.com/doc/refman/5.5/en/binary-log-mixed.html

Terminology

• Replication Threads

Terminology

• Replication Threads • Slave Server

• IO Thread

Terminology

• Replication Threads • Slave Server

• IO Thread• SQL Thread

Terminology

• Replication Threads • Master Server

• Binlog Dump Thread

Terminology

Overviews

MySQL Replication

Highlevel Replication Overview

1Master

Binarylog

Master

RelayLog

Binarylog

Master

RelayLog

Binarylog

Master

Asynchronous vsSemi-Synchronous

Asynchronous Replication

Asynchronous

Master Slave

Asynchronous

Master SlaveIO Thread (3)

Binlog DumpThread created

Asynchronous

Master Slave

Binarylog

IO Thread (3)

Binlog DumpProcess

Asynchronous

Master Slave

RelayLog

Binarylog

IO Thread (3)

Binlog DumpProcess

IO Thread (3)

• Pros• Fast• slave can be disconnected

• Cons• Potential loss of transactions and data integrity

Asynchronous

Semi-Synchronous Replication

Semi-Synchronous

Master Slave

semi-synccapable

Semi-Synchronous

Master SlaveIO Thread (3)

Binlog DumpThread created

semi-sync capablesemi-synccapable

semi-synccapable

Semi-Synchronous(optimal)

Master SlaveIO Thread

Binlog DumpThreadCreated

semi-synccapable

Master Slave

RelayLog

Binarylog

IO Thread

Binlog DumpProcess

IO Thread (save)

semi-synccapable

Master SlaveIO Thread semi-synccapable

semi-synccapable

RelayLog

Binarylog

Binlog DumpProcess

IO Thread (ack)

Semi-Synchronous(timeout)

Master SlaveIO Thread

Binlog DumpThreadCreated

semi-synccapable

Master Slave

Binarylog

IO Thread

Binlog DumpProcess

semi-synccapable IO Thread (save)

semi-synccapable

xNetwork

Master Slave

Binarylog

IO Thread

Binlog DumpProcess

semi-synccapable IO Thread (save)

semi-synccapable

xNetwork

TIMEOUT

Master Slave

Binarylog

IO Thread

Binlog DumpProcess

async semi-synccapable

Master Slave

RelayLog

Binarylog

IO Thread

Binlog DumpProcess

IO Thread (save)

Master Slave

RelayLog

Binarylog

IO Thread

Binlog DumpProcess

IO Thread (save)

resync

Master Slave

RelayLog

Binarylog

IO Thread (synced)

Binlog DumpProcess

resync

Master Slave

RelayLog

Binarylog

Binlog DumpProcess

semi-synccapable

IO Thread semi-synccapable

• Pros• Tries to improve data integrity

• Cons• Performance Implications

Semi-Synchronous

Setting it Up

Asynchronous -Master

• Config/Option file• my.cnf/my.ini

Asynchronous - Master

log-bin=mysql_binserver_id=1

Asynchronous - Mastermysql> CREATE USER 'repl'@'%.mydomain.com' IDENTIFIED BY 'slavepass';

mysql> GRANT REPLICATION SLAVE ON *.* TO 'repl'@'%.mydomain.com';

• Create replication user• requires

REPLICATION SLAVE privilege

Asynchronous - Mastermysql> FLUSH TABLES WITH READ LOCK;

mysql> SHOW MASTER STATUS; • Master server binary log coordinates• requires

REPLICATION SLAVE privilege

• While the tables are locked• if you need a copy of the master, this is the time to make it

• Once you have a copy, release the locks

Asynchronous - Master

mysql> UNLOCK TABLES;

Asynchronous -Slave

Asynchronous - Slave

server_id=2read-only

• Load in the copy/backup from the master• always verify that the backup works

Asynchronous - Slave

Asynchronous - Slavemysql> CHANGE MASTER TO

MASTER_HOST = 'master.mycompany.com', MASTER_USER = 'repl', MASTER_PASSWORD='slavepass', MASTER_PORT=3306, MASTER_LOG_FILE='master-bin. 001', MASTER_LOG_POS=4;

mysql> START SLAVE;

• Issue CHANGE MASTER command• info from MASTER

STATUS

Semi-Synchronous -Master

Semi-Synchronous - Mastermysql> INSTALL PLUGIN rpl_semi_sync_master SONAME 'semisync_master.so';

mysql> SHOW PLUGINS;• Install PLUGIN

• Server must support dynamic loading (see have_dynamic_loading)

Semi-Synchronous - Mastermysql> SET GLOBAL rpl_semi_sync_master_enabled = 1;

mysql> SET GLOBAL rpl_semi_sync_master_timeout = N;

• Enable PLUGIN• default is off

Semi-Synchronous - Master

log-bin=mysql_binserver_id=1

# semi-sync replrpl_semi_sync_master_enabled = 1rpl_semi_sync_master_timeout = 1000 # 1 sec

Semi-Synchronous -Slave

Semi-Synchronous - Slavemysql> INSTALL PLUGIN rpl_semi_sync_slave SONAME 'semisync_slave.so';

mysql> SHOW PLUGINS;• Install PLUGIN

• Server must support dynamic loading (see have_dynamic_loading)

Semi-Synchronous - Slavemysql> SET GLOBAL rpl_semi_sync_slave_enabled = 1;

• Enable PLUGIN• Default is Off

Semi-Synchronous - Slavemysql> STOP SLAVE IO_THREAD;

mysql> START SLAVE IO THREAD;• Runtime

Semi-Synchronous - Slave

server_id=2read-only

# semi-sync replrpl_semi_sync_slave_enabled=1

Monitoring

Monitoring -Master

• Gives file name and position• Lists filtering done on Master

Master Status

• Gives the binary logs on the server

Binary Logs

mysql> SHOW BINARY LOGS;+---------------+-----------+| Log_name | File_size |+---------------+-----------+| binlog.000015 | 724935 || binlog.000016 | 733481 |+---------------+-----------+

Monitoring -Slave

Slave Statusmysql> SHOW SLAVE STATUS\G*************************** 1. row *************************** Slave_IO_State: Waiting for master to send event Master_Host: localhost Master_User: root Master_Port: 3306 Connect_Retry: 3 Master_Log_File: mysql-bin.003 Read_Master_Log_Pos: 73 Relay_Log_File: mysql-relay-bin.005 Relay_Log_Pos: 548 Relay_Master_Log_File: mysql-bin.003 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table:

Slave Status Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 73 Relay_Log_Space: 552 Until_Condition: None Until_Log_File: Last_SQL_Error: Until_Log_Pos: 0 Master_SSL_Allowed: No Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 8Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error:

• State Slave_IO_State: Waiting for master to send event

• Running Slave_IO_Running: Yes

Slave_SQL_Running: Yes

• Last Error Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error:

Slave Status - Basic Stuff

• Where everything is• IO Thread

Master_Log_File: mysql-bin.003 Read_Master_Log_Pos: 73

Slave Status - Important Stuff

• Where everything is• SQL Thread

• Relay Log Relay_Log_File: mysql-relay-bin.005 Relay_Log_Pos: 548

• Binary Log Relay_Master_Log_File: mysql-bin.003 .... Exec_Master_Log_Pos: 73

Slave Status - Important Stuff

• Show Caution

Seconds_Behind_Master: 8

Slave Status - Caution

• Lot of changes• Global Transaction ID• Binary Log Group Commit• Parallel execution of transactions on the slave• Crash-safe Replication• And more

MySQL 5.6

Questions?

Saturday, February 9, 2013 - Khan Kennels › presentations › pdf ›...

Documents

Transcript of Saturday, February 9, 2013 - Khan Kennels › presentations › pdf ›...

MySQL Strategy - itreegroup.eu · MySQL Strategy Morten Andersen, MySQL Enterprise Sales . ... MySQL Workbench 6.2 MySQL Database 5.7 DMRs * MySQL Cluster 7.4 DMR *Development Milestone

MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)

MySQL Administration The Mysql Data Directory

MySQL Replication: Latest Developments · MySQL 5.1.30 row-based replication MySQL 4.0.12 MySQL 4.1.7 MySQL 5.5.8 semi-sync replication MySQL 5.6.10 crash-safe replication metadata

Managing Backup and Recovery - MySQL Toolsmysql-tools.com/.../31-managing-backup-and-recovery.pdf · Managing Backup and Recovery Saturday, ... mysql40, postgresql, oracle, mssql,

Upstream Downstream - FOSDEM · HA Audit MySQL 5.6 MySQL Workbench 6.1 MySQL Utilities MySQL Applier for Hadoop MySQL Workbench 5.2 & 6.0 MySQL Enterprise Oracle Certifications Windows

MySQL Whitepaper MySQL HA Solutions

MySQL開発最新動向 Oracle MySQL Cloud Serviceの最新情報もご … · 2019-08-06 · MySQL InnoDB Cluster (GA) - MySQL Group Replication - MySQL Router - MySQL Shell MySQL

MySQLのNoSQL機能 - MySQL JSON & HTTP Plugin for MySQL

Using MySQL for Big Data Advantage - · PDF fileUsing MySQL for Big Data Advantage Integrate for Insight ... MySQL Cluster 7.2 MySQL Cluster Manager 1.4 MySQL Utilities 1.0.6 MySQL

Jean-François Gagné - Saturday, February 4, 2017 FOSDEM ... · Autopsy of an automation disaster Jean-François Gagné - Saturday, February 4, 2017 FOSDEM MySQL & Friends Devroom

MySQL Enterprise Monitor€¦ · mysql-monitor.log MySQL log file. Replication 1.dot The calculated MySQL server replication structure preferences.properties MySQL Enterprise Monitor

Getting Started with MySQL...Getting Started with MySQL Ligaya Turmelle Principal Technical Support Engineer, MySQL Tuesday, February 26, 2013

Securing your MySQL/MariaDB Data - MySQL Expert - AWS ...ronaldbradford.com/presentations/Securing-your-MySQL-MariaDB-data... · Securing your MySQL/MariaDB Data Ronald ... MySQL

MySQL Tutorial - carme.pld-linux.orgcarme.pld-linux.org/~evil/.../MySQL/mysql-tutorial... · MySQL Tutorial Abstract This is the MySQL Tutorial from the MySQL 5.1 Reference Manual.

Databases MySQL PHPMyAdmin PHP and MySQL

Administrar MySQL Server con MySQL Workbench, crear ...yolandaam.com.es/images/mysql/02-Administrar MySQL Server con M… · Administrar MySQL Server con MySQL Workbench, crear usuarios,

MySQL 5.5 and Scalability Ligaya Turmelle Senior Technical Support Engineer - MySQL ligaya.turmelle@oracle.com .

MySQL InnoDB Cluster · Linux High Availability Cluster with DRBD and MySQL. MySQL NDB Cluster. Oracle MySQL Cloud Service. MySQL with Solaris Cluster. Galera Cluster for MySQL. Amazon

MySQL Introduction to the MySQL products. Agenda Company Overview Open Source & MySQL Momentum Why MySQL? MySQL OEM, Community & Enterprise offerings.