Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2...

24
Introducing The New PMM 2! Michael Coburn Percona

Transcript of Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2...

Page 1: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Introducing The New PMM 2!

Michael CoburnPercona

Page 2: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

2

Michael Coburn

● Product Manager for PMM (and Percona Toolkit)● At Percona for six years across multiple MySQL roles

○ Principal Architect, Managing Consultant, Technical Account Manager

Page 3: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

PMM 1Where it all began

Page 4: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

What is PMM?

● A free, Open Source database troubleshooting and performance optimization platform for MySQL, MongoDB, and PostgreSQL

● Additional technologies supported include ProxySQL, Amazon RDS MySQL and PostgreSQL, and Aurora MySQL and PostgreSQL

● Runs in your secure environment (this is not a SaaS product!) and on your equipment

● Actively developed for 3+ years

Page 5: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

5

PMM Distribution Methods

1. docker○ docker pull percona/pmm-server:1

2. Virtual Appliance○ Supports VMware, RedHat Virtualization, Microsoft Systems Center○ … and VirtualBox!

3. AWS Marketplace○ Production-ready AMI running in EC2

Page 6: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

6

AWS Marketplace

● Deploy directly to EC2● Running CentOS 7

Search for "pmm" or "Percona Monitoring and Management"https://aws.amazon.com/marketplace/pp/B077J7FYGX

Page 7: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

7

PMM Architecture

● pmm-client (eg. MySQL host)○ mysqld_exporter - MySQL metrics○ node_exporter - Linux/OS metrics○ qan-agent - Query Analytics

● PMM Server○ Query Analytics

■ QAN API and QAN Application○ Metrics Monitor

■ Prometheus■ Grafana

Page 8: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Metrics Monitor

Page 9: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

9

Query Analytics

Page 10: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

10

MySQL Slow Log - *Percona Server Only

Page 11: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

11

EXPLAIN

Page 12: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

12

CREATE TABLE, TABLE STATUS, and INDEXES

Page 13: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

PMM 2Where we are today

Page 14: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

What's New and Exciting?

● Query Analytics○ Support for large environments○ Filtering using query metadata and labels○ Sorting and additional columns○ Support for PostgreSQL

● pmm-agent● Standard and Custom labels● Inventory Overview● Multiple scraping intervals

Page 15: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Support for Large Environments

● MySQL out - ClickHouse in● Columnar datastore, wicked fast● Tested up to 1,000 nodes against one

PMM Server

Page 16: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Standard and Custom Labels

● Labels, when set, will appear in Query Analytics and can be used to filter● Standard label examples

○ environment○ replication_set○ cluster○ region○ node_model (auto-detected)

● Custom labels are any arbitrary key-value pairpmm-admin add … --environment=production --cluster=MyCluster7 \

--custom-labels="dataCentre=downtown,rack=T3B"

Page 17: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Filtering

● Standard and Custom labels can be used as filter conditions● Additional filters include:

○ Client Host○ Schema○ Client Username○ Database Server

Page 18: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Sorting

● Sort by any column

Page 19: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Add Additional Columns

● Add more columns based on query metadata

● Examples:○ Rows Examined○ Temporary Tables○ Filesort

Page 20: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

pmm-agent

● Master daemon on your clients● Runs as root by default● Launches exporters and Query

Analytics agents

Page 21: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Inventory Overview

● View lists of Services, Agents, and Nodes configured

Page 22: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

Multiple Collection Intervals

● Collecting metrics aggressively provides the highest level of visibility of events, but at highest storage space cost + disk I/O

● Challenge is to collect highly variable data frequently, or expensive to collect less frequently

● 1s, 5s, 60s are default collection intervals (High, Medium, Low)● Examples:

○ High - Threads_running○ Medium - MySQL Information Schema Thread States○ Low - MySQL Version

Page 24: Introducing The New PMM 2! - Percona · Introducing The New PMM 2! Michael Coburn Percona. 2 Michael Coburn Product Manager for PMM (and Percona Toolkit) At Percona for six years

24

Rate My Session