Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland...

28
BASLE BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH Backup Methods from Practice Optimized and Intelligent Roland Stirnimann Robert Kruzynski

Transcript of Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland...

Page 1: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

BASLE BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA

HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH

Backup Methods from PracticeOptimized and Intelligent

Roland StirnimannRobert Kruzynski

Page 2: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Backup Methods from Practice2 2016-09-09

DATA LOSS – Does it happen?

Page 3: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Agenda

Backup Methods from Practice3 2016-09-09

1. Introduction

2. Present Backup Situation

3. Trivadis Backup ApproachInitial IdeaTrivadis Intelligent BackupAdded Value

Page 4: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Backup Methods from Practice4 2016-09-09

Introduction

Page 5: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Reasons that argue for a Backup

Backup Methods from Practice5 2016-09-09

Top causes of data loss

– Human errors

– Hardware or system malfunctions

– Software corruptions

– Computer viruses and malware

– Natural disasters

Murphy’s Law

– Concatenation of circumstances

– Backup as a very last stopgap

Page 6: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

High Availability and Backup

Backup Methods from Practice6 2016-09-09

Do we need a backup? We have Data Guard for Oracle and

AlwaysOn for Microsoft SQL Server!

High Availability does not replace the backup!

Restore can help for:

– Disaster restore (Murphy’s Law)

– Logical Corruption (unexpected feature)

– Restore for error analysis (system malfunction)

– Reverse mistakes that happened between the backrest and the keyboard

Page 7: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Backup Methods from Practice7 2016-09-09

Present Backup Situation

Page 8: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Backup Load Peaks

Backup Methods from Practice8 2016-09-09

Source: http://emgn.com/entertainment/23-ridiculously-overloaded-vehicles-from-all-around-the-world/

Page 9: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Backup Management Pains

Backup Methods from Practice9 2016-09-09

Fixed scheduling plans

– Redundancy of backed up data

– No adaption of the plan because of a changed situation

– Overlapping of backup jobs

– Different SLA requirements in terms of backup

Decentral backup configuration

– Maintenance windows per server/database

– Difficult handling of different database categories

Manual restore tests

Backup monitoring

Page 10: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Reporting

Backup Methods from Practice10 2016-09-09

Current, past and future situation

– Only visible in the log files

– What is going on right now?

– Planned jobs in the near future

Backup output (volume) and input (read i/o)

– Source of performance peaks

Multi-client and central reporting

Summary reports for the management/clients

Page 11: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Backup Methods from Practice11 2016-09-09

Trivadis Backup Approach

Page 12: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Initial Position

Backup Methods from Practice12 2016-09-09

Big customers have often serious backup issues

– Several hundreds of databases

– Lost tracking of backups

– Capacity problems during backup

One customer asked Trivadis to solve theses issues about 4 years ago

Our smart approach is in place for years

Since release 16.05 part of TVD-Backup Enterprise Edition

Customer statement: “We do not have to care about database backups anymore!”

Page 13: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Trivadis Intelligent Backup (TIB)

Backup Methods from Practice13 2016-09-09

Uniqueness in the market because of the intelligent scheduling

TIB is part of TVD-BackupTM Enterprise Edition

Interacts with the existing backup component (rman_exec)

Lean and stable solution, based on Perl and PL/SQL (decision algorithm)

TIB knows the situation

– of all running database instances

– of all backups

TIB decides policy-based if a backup is necessary

Page 14: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Trivadis Intelligent Backup (TIB)

Backup Methods from Practice14 2016-09-09

Page 15: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Resource Savings from a real Customer Case

Backup Methods from Practice15 2016-09-09

I/O reduction thanks to

TIB

– TIB operating since

August 2012

DB188

– TVD-CapMan chart

shows RMAN I/O

(blue) and DB size

(brown)

– I/O reduction by

over 80%

– 15 TB less I/O per

month!

Page 16: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

TIB Features (1)

Backup Methods from Practice16 2016-09-09

Intelligent backup scheduling from central repository

– Policy-based decision algorithm

– Demand-oriented scheduling plan, no fix intervals

– Even load distribution thanks to foresighted backup planning

– Situation, rating and decision data is kept (forever)

Automatic detection and backup of new databases

Central backup management (e.g. maintenance windows)

Corrective actions in case of failures

Emergency mode for the backup agent in case of repository disconnect

Page 17: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

TIB Features (2)

Backup Methods from Practice17 2016-09-09

One policy/configuration for many databases

– SLA parameters (retention, RTO, transaction volume, frequency periods)

– Backup call definitions

– Backup windows

Backup reporting

– On the command line

– Starting with 16.11 in TVD-ReportService (PDF, Word, etc.)

Page 18: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Decision Algorithm Features

Backup Methods from Practice18 2016-09-09

Interval ranges and time windows

Recovery time target

Archive destination free time target

Redo volume percentage

Current database role

Current backup load (per database, per server, per pool)

Can use RAC instance with lowest load (CPU or I/O)

Error handling

Forecasts next backup duration from previous runs and current redo volume

and much more…

Page 19: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Trivadis Intelligent Backup Control Utility – tibctl

Backup Methods from Practice19 2016-09-09

oracle@lsrv01:~/ [rdbms12102ee] tibctl.ksh --help

Trivadis Intelligent Backup Control Utility

Usage:

tibctl <function> <options>

Functions:

list|overview|running|unknown|last|failed

db-config|agent|situation|rating

plan|plan-list

db-report|monthly-report|daily-report

print-week|print-12h

modify|enable|disable

register|unregister

windows|configs|calls|rman-configs

create-decision-job|start-decision-job|drop-decision-job

Page 20: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

tibctl – Database Configuration / Maitenance Mode

Backup Methods from Practice20 2016-09-09

Page 21: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

tibctl – Listing Backups

Backup Methods from Practice21 2016-09-09

Page 22: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

tibctl – Configuration Profiles

Backup Methods from Practice22 2016-09-09

Page 23: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

tibctl – Monthly Report

Backup Methods from Practice23 2016-09-09

Page 24: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

tibctl – DB Specific Reports

Backup Methods from Practice24 2016-09-09

Page 25: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

tibctl – Backup Job Distribution Report

Backup Methods from Practice25 2016-09-09

Page 26: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Added Value

Backup Methods from Practice27 2016-09-09

Cost savings by reducing the volume

Increased efficiency by preserving system/human resources

Reducing risks thanks to a reliable backup scheduling

Transparency with our comprehensive reports

Standardization and automation leads to quality improvements

Page 27: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

TIBSimu – Get your potential Savings in a nutshell

Backup Methods from Practice28 2016-09-09

TIBSimu calculates your potential savings in minutes

– Simulates backup runs based on existing RMAN catalog metadata

– Accepts several input parameters as backup policy

Customer # Databases Output Reduction

(Backup Volume)

Input Reduction (I/O)

Bank 1 64 -55% (160 TB) -60-70% (250-350 TB)

Bank 2 32 -76% (27 TB)

Backup compression

-73% (70 TB)

Retailer 37 -30% (21 TB) -27% (25 TB)

Page 28: Trivadis TechEvent 2016 Backup Methods from Practice - optimized and intelligent by Roland Stirnimann and Robert Kruzynski

Questions & AnswersRoland Stirnimann

Business Development Manager

[email protected]

Phone +41 58 459 52 47

2016-09-09 Backup Methods from Practice29

Robert Kruzynski

Principal Consultant / Partner

[email protected]

Phone +49 89 99 27 59 30