Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC...

28

Transcript of Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC...

Page 1: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.
Page 2: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Oracle Database 10g RMAN and ATA Storage in Action

Paul Tsien

Oracle Corporation

Bob Ng

EMC Corporation

Session id: 36675

Page 3: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Agenda Oracle, EMC, and the New Disk

Economics Oracle Recovery Manager (RMAN) 10g

Overview Automatic Disk Based Backup and

Recovery Incrementally Updated Backups EMC ATA technology offering Testing with Oracle 10g and EMC ATA Summary and Q&A

Page 4: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Disk Dollar Per Megabyte Trend For The Last 20 Years

$300.00

$35.00

$2.00

$0.04

$0.01$0.01

$0.10

$1.00

$10.00

$100.00

$1,000.00

1983 1988 1993 1998 2003

Do

llars

pe

r M

eg

ab

yte

$/MB

Page 5: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Oracle, EMC and the New Disk Economics

Oracle and EMC both are leveraging the new disk economics to deliver superior value propositions to our customers

Oracle disk based backup and recovery is faster, simpler and more reliable

EMC ATA storage technology is right answer to support Oracle disk based backup/recovery

Page 6: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

New World: Disk Based Data Recovery

Disk economics are close to tape

Disk is better than tape– Random access to any data

We rearchitected our recovery strategy to take advantage of these economics

– Random access allows us to backup and recover just the changes to the database

Backup and Recovery goes from hours to minutes

2000’s - 200 GB

1980’s - 200 MB

1000x increase

Trade cheap disk space for expensive down time

Page 7: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Recovery Manager: Oracle’s Backup & Recovery Utility

Over 25 Man Years of Engineering Technology provides:

– Intimate knowledge of database file formats and recovery procedures

– Manages and automates the backup, restore, and recovery process

– Creates and maintains backup policies

– Catalogs all backup and recovery activities

– Operates on-line and in parallel for fast processing

– Corrupt block detection during backup and restore and the ability to validate backups

– Integrated with Enterprise Manager & 3rd party network backup products

Media Management Layer

Enterprise ManagerEnterprise Manager& 3& 3rdrd Party Tools Party Tools

Network

RecoveryRecoveryManagerManager

Page 8: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Flash Recovery Area Unified storage location for all recovery files and recovery related activities

in an Oracle Database.– Centralized location for control files, online redo logs, archive logs,

flashback logs, backups– A flash recovery area can be defined as a directory, file system, or ASM

disk group – A single recovery area can be shared by more than one database

Minimize the number of initialization parameters to set when you create a database

– Define a database area and flash recovery area location– Oracle creates and manages all files using OMF

Database Area Flash Recovery Area

Page 9: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Flash Recovery Area Space Management

Disk limit is reached and a new file needs to be written

into the Flash Recovery Area

Backup Files

to be deleted

Archive Logs &Database File

Backups

Warning Issued to user

Space Pressure occurs

RMAN updates

list of files that

may be deleted

12

Oracle

delete files that

are no longer

required on

disk.

Flash Recovery

Area

Page 10: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Benefits to Using a Flash Recovery Area

Unifies the storage location of related recovery files

Manages the disk space allocated for recovery files automatically

Simplifies database administrator tasks Much faster backup Much faster restore Much more reliable due to inherent reliability of

disks

Page 11: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Incrementally Updated Backups

Eliminates the need to perform a whole database backup. Reduces the time required for media recovery since the image

copy is updated with the latest block changes.

RMAN

RECOVER COPY OF DATAFILE

RMANincremental

backup

Initiate Merge

IncrementallyUpdated Backups

Page 12: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Eliminate Shrinking Backup Windows Syndrome!

Fully automatic disk based backup and recovery

– Set it and Forget it

Nightly incremental backup rolls forward recovery area backup

– Changed blocks are tracked in production DB

Full scan is never needed– Dramatically faster (20x)– Blocks validated to prevent

corruption of backup copy

Use low cost ATA disk array for recovery area

Two Independent Disk Systems

Flash RecoveryArea

Nightly ApplyValidatedIncremental

WeeklyArchiveTo Tape

DatabaseArea

Much Faster & Easier

Page 13: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Disk Based Backup/Recovery Benefits

Much faster backup– Just propagate changes to recovery area– Dramatic difference for large databases

Much faster restore – Copy backup files from Recovery Area– Or simply use the copy in the Recovery Area

Much more reliable due to inherent reliability of disks– Tapes not needed for normal backup/recovery,

only for archiving

Page 14: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

EMC ATA Storage Technology Ideal for satisfying the added storage space need

to support Oracle Database 10g backup-to-disk model

– Reliable– Satisfactory performance– Capacity, Ease of expansion– Manageability– Cost effective– Interoperability– Investment Protection

Page 15: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

240 drives

per storage system

SP Fibre x 4

Mirrored Cache

FC FC

LCC

LCC

LCC LCC

StorageProcessor

FanFan FanFanFanFan

Power SupplyPower Supply

Power supplyPower supplySPSSPS SPSSPS

SP Fibre x 4

Mirrored Cache

FC FC

StorageProcessor

LCC

LCC

CPU CPUCPU CPU

A T A D I S K S

EMC CLARiiON HA Architecture

Page 16: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

KatanaKatana

Klondike

KatanaKatana

KlondikeKlondike

Katana

KatanaKlondike

KatanaKatana

KlondikeKlondike

Katana

KatanaKlondike

KatanaKatana

KlondikeKlondikeKatanaKatanaFibre

20-250 GB ATA Drives ATA

15-73 GB Fibre Drives

CX600 SPE Assembly

Fibre 15-15k rpm Fibre drives

ATA15-250 GB ATA Drives15-146 GB Fibre

DrivesFibre

ATAATA25-250 GB ATA Drives

30-73 GB Fibre DrivesFibreFibre

15 ATA Drives ATA

Flexibility…. Mix and Match

Page 17: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

EMC ATA Technology Meeting the NeedReliability Delivered with time proven CLARiiON HA architecture. Disk

storage RAID protection of your choice

Performance CLARiiON 6th generation storage system driven with dual Intel 2GHz processors and sophisticated caching technology

Capacity Up to 200+ ATA drives at 250GB (and higher). Modular expansion and flexibility to accommodate growth

Manageability Web Based Management from anywhere of one or more CLARiiON systems with EMC CC Navisphere Manager

Cost effectiveness ATA storage cost per MB approach point of matching tapes with significantly faster read/write efficiency

Interoperability EMC SAN Copy capability allow block storage data to be exchanged between CLARiiON and other storage on SAN

Investment Protection

EMC CLARiiON CX family supports upgrade path from low end entry system to high end to accommodate your growth

Page 18: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Testing RMAN 10g Backup to ATA Flash Recovery Area

Test configuration– Server : Dell 2650

2x2.8Ghz CPUs, 4GB RAM

– OS : SuSE SLES 8.0 kernel 2.4.19

– Oracle Software : 10g beta for Linux 10.0.1.0

– Host I/O Adapters : QLOGIC 2340 (two)

– FC SAN DB storage

RMAN

10gDB

files

ATA area 1

DLT tape drive 1

DLT tape drive 2

ATA area 2

Page 19: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Testing Objectives

Compare RMAN full backup to ATA based disk recovery area versus tape type channel

Compare RMAN restore and recover from ATA disk vs. tape

Page 20: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Note: RMAN backup and restore speed is limited by available hardware

Observations

• RMAN backup and restore streaming I/O @ 40+MB/s− Oracle RMAN drives full backup/recovery I/O at 1MB per

OS request whenever possible− Ideal for CLARiiON 8+1 RAID-5 read/write when data

stripes over the 8 spindles at 64KB or 128KB per stripe element

− CLARiiON write cache ensures full stripe data transfer to/from storage area

− Slower ATA disk seek does not significantly affect full stripe I/O as service time dominated by data transfer time

• Backup writes to tape channels max out @ 15MB/s per parallel RMAN backup channel

Page 21: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Conclusions from Testing

Backup/Recovery from disk obviously more effective than with traditional tape approach

EMC ATA disk technology does the job

Page 22: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Related Technologies

CLARiiON storage based data replication/cloning software – Allows captured disk data to be effectively replicated to another

storage area or storage system without server resource– Second disk image copy can be repurposed and used without

interfering with primary copy usage

Oracle Data Guard– Automates the creation and maintenance of one or more

transactionally consistent copies (standby) of the production (or primary) database

– If the primary database becomes unavailable (disasters, maintenance), a standby database can be activated and assume the primary role

Page 23: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

ASummary

Joint Oracle/EMC test data shows that disk based backup and recovery is faster, simpler, and more reliable

EMC ATA storage is ideal for satisfying the added storage space required for Oracle disk based backup and recovery

Oracle10g disk based backup and recovery and EMC ATA storage technology deliver superior solutions by leveraging the new disk economics

Page 24: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Next StepsHigh Availability Sessions from Oracle

11:00 AM

How Oracle Database 10g Revolutionizes Availability and

Enables the Grid

3:30 PM

Oracle Recovery Manager (RMAN) 10g: Reloaded

5:00 PM

Proven Techniques for Maximizing Availability

8:30 AM

Oracle Database 10g - RMAN and ATA Storage in Action

 

11:00 AM

Oracle Data Guard: Maximum Data Protection at Minimum Cost

 

1:00 PM

Oracle Database 10g Time Navigation: Human-Error Correction

 

4:30 PM

Data Guard SQL Apply: Back to the Future

Wednesday in Moscone Room 304Tuesday in Moscone Room 304

For More Info On Oracle HA Go To http://otn.oracle.com/deploy/availability/

Page 25: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Next StepsHigh Availability Sessions from Oracle

8:30 AM in Moscone Room 304

Oracle Database 10g Data Warehouse Backup and Recovery:

Automatic, Simple, Reliable

8:30 AM in Moscone Room 104

Building RAC Clusters over InfiniBand

Thursday

For More Info On Oracle HA Go To http://otn.oracle.com/deploy/availability/

Real Application Clusters

Data Guard

Database Backup & Recovery

Flashback Recovery

LogMiner, Online Redefinition, and Cross Platform Transportable

Tablespaces

Database HA Demos All Four DaysIn The Oracle Demo Campground

See EMC’s ATA technology in action at the EMC booth #1302

http://www.emc.com/products/systems/clariion.jsp

Page 26: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

Reminder – please complete the OracleWorld online session survey

Thank you.

Page 27: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.

AQ&Q U E S T I O N SQ U E S T I O N S

A N S W E R SA N S W E R S

Page 28: Oracle Database 10g RMAN and ATA Storage in Action Paul Tsien Oracle Corporation Bob Ng EMC Corporation Session id: 36675.