Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL...

22
Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO www.percona.com cloud.percona.com www.MySQLPerformanceBlog.com

Transcript of Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL...

Page 1: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Monitoring All (Yes, All!) MySQL Metrics with

Percona Cloud Tools

Vadim Tkachenko Percona, Co-founder /CTO

www.percona.com cloud.percona.com

www.MySQLPerformanceBlog.com

Page 2: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

This webinar

Why metrics monitoring

Installation and setup

Work with metrics

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 2

Page 3: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

This webinar is 2nd in series

1st: Analyze MySQL Query Performance with Percona Cloud Tools

• http://www.percona.com/resources/mysql-webinars/analyze-mysql-query-performance-percona-cloud-tools

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 3

Page 4: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Why metrics monitoring?

Understanding Queries is good, but…

• On queries diagnostic see my 1st webinar

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 4

Page 5: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Why metrics monitoring?

But, we need a way to look into an inside of the system

Traditional way:

• vmstat

• iostat

• mysqladmin ext -i15 -r

• (demo on a live system)

What about history or charts?

• There should be a better way

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 5

Page 6: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Popular solutions

Cacti

• http://www.percona.com/doc/percona-monitoring-plugins/1.1/cacti/index.html

Zabbix

• http://www.percona.com/doc/percona-monitoring-plugins/1.1/zabbix/index.html

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 6

Page 7: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Limitations of popular solutions

Cacti graph

Cacti installation

• http://www.percona.com/doc/percona-monitoring-plugins/1.1/cacti/installing-templates.html

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 7

Page 8: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

There must be a better way!

3-minutes install

High resolution in data collection

Real time

Look back into past

Gather ALL metrics

• You never know what is ahead

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 8

Page 9: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Percona Cloud Tools

Metrics monitor & percona-agent

• Account on https://cloud.percona.com/

• http://www.percona.com/downloads/percona-agent/LATEST/

• (demo of install)

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 9

Page 10: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Percona Cloud Tools

Metrics monitor – Why ?

• To Make DBAs or MySQL users more efficient

• Not to automatically predict a behavior 1000+ servers, but:

• To give a comprehensive overview of the system that a DBA works with, so:

• They can make an educated, based on data, decision

• That is an incredibly useful even a DBA has only a couple of servers

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 10

Page 11: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Demo details

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 11

Amazon EC2 m3.large

Percona Server 5.6

Percona-agent

Linkbench benchmark

Amazon RDS 5.6 m3.large

Page 12: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

percona-agent: some details

OpenSource project

• Sources https://github.com/percona/percona-agent

• AGPLv3 license

WebSocket technology

• https connections, 443 port (firewall friendly)

• Bi-directional real-time communication

• If used through Proxy – it must support WebSockets (ngnix known to support it, but not tested yet with PCT)

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 12

Page 13: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

percona-agent

What do we collect

• All MySQL Metrics from SHOW GLOBAL STATUS

• All MySQL Variables from SHOW GLOBAL VARIABLES

• All InnoDB Metrics from INFORMATION_SCHEMA.INNODB_METRICS

• Disabled by default

• System metrics (CPU, IO, Memory)

• Not on Amazon RDS

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 13

Page 14: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Components

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 14

Page 15: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

percona-agent

How do we collect

• System metrics: collect every 10 sec

• MySQL Status/InnoDB metrics: collect every 1 sec

• MySQL Variables: collect every 1 hour

• Data aggregated and send every 1 min:

• Min, max, 5%, 95%, median, avg values

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 15

Page 16: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

percona-agent

How to see min/max/avg

• Turn on/off dynamically (demo)

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 16

Page 17: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

percona-agent

Default dashboard walkthrough

• CPU

• MySQL Throughput

• MySQL Threads

• MySQL Connections

• MySQL Network

• MySQL Commands

• MySQL Sorts

• MySQL Temporary Objects

• InnoDB I/O

• InnoDB Buffer Pool

• InnoDB rows

• Loadavg

• … (see demo)

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 17

Page 18: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Add new chart

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 18

Page 19: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Trends

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 19

Page 20: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Percona Cloud Tools / Metrics Monitor

Helps to Gain Insight into system

Easy installation

Trends / History

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 20

Page 21: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Percona Cloud Tools

Beta status

Free level forever

Everyone can register and try

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 21

Page 22: Monitoring All (Yes, All!) MySQL Metrics with Percona ... · Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO cloud.percona.com

Roadmap

Coming soon

• Even simplier installation (no question asked)

• RPM, DEB, Puppet friendly

• Analyze queries from Performance Schema Amazon RDS/5.6

• Multiple Dashboards

• Query Advises

• You tell us!

• Your feedback is extremely valuable

Monitoring All (Yes, All!) MySQL Metrics with Percona Cloud Tools 22