HP Information Lifecycle Management (ILM) John Sosnowski – Account Executive Jeff Blackmon –...

HP Information Lifecycle Management (ILM)

John Sosnowski – Account Executive

Jeff Blackmon – Presales Engineer

Database Growth: Database Growth: Problems & SolutionsProblems & Solutions

2204/10/23 2

AgendaAgenda

The Data ExplosionThe Data ExplosionEffects of Database ExplosionEffects of Database Explosion

End UserEnd UserIT OperationsIT OperationsCase StudiesCase Studies

SolutionsSolutionsQ & AQ & A

3304/10/23 3

The Data ExplosionThe Data Explosion

““Data Explosion”: Data Explosion”: 130,000 Google Hits130,000 Google Hits

““Information Life Cycle Management”: Information Life Cycle Management”: 1.3M 1.3M Google Hits Google Hits

Numerous analyst papersNumerous analyst papers

Archiving vendorsArchiving vendors

4404/10/23 4

Data Explosion: Largest OLTP on Data Explosion: Largest OLTP on Unix DatabasesUnix Databases

Source: Winter Corporation; Top 10 Source: Winter Corporation; Top 10 Survey (www.wintercorp.com)Survey (www.wintercorp.com)

2003: Max: 5.4 TB, Average 2.5 TB2003: Max: 5.4 TB, Average 2.5 TB

2005: Max: 16.4 TB, Average 6.8 TB2005: Max: 16.4 TB, Average 6.8 TB

5504/10/23 5

Drivers for Data ExplosionDrivers for Data Explosion

Increased regulatory Increased regulatory retention requirementsretention requirements

Increased business Increased business intelligence and trend analysisintelligence and trend analysis

Increased detail with-in Increased detail with-in business transactions business transactions

Consolidation of systemsConsolidation of systemsUnderlying growth in Underlying growth in

business volumebusiness volume

6604/10/23 6

Data Explosion: Types of DataData Explosion: Types of Data

Enterprise Information

Business Applications

ERP SystemsERP Systems

Files(un-structured)

Messaging(semi-structured)

(future)Custom AppsCustom Apps ExchangeExchange Lotus NotesLotus Notes Enterprise Document ManagementEnterprise Document Management

Databases(structured)

7704/10/23 7

Data Explosion: Types of DataData Explosion: Types of Data

Enterprise Information


ERP SystemsERP Systems

Files(un-structured)

Messaging(semi-structured)

(future)Custom AppsCustom Apps ExchangeExchange Lotus NotesLotus Notes Enterprise Document ManagementEnterprise Document Management

Databases(structured)

8804/10/23 8

Data has a LifecycleData has a Lifecycle

High

Low

Access / SLA Requirements

Time

Retrieval Activity

Customer inquiryInternal audit

Sales order booked

Change order

Partial shipments

Complete shipment

Customer invoices generated

Sales order closed

Regulatory data retention period ends

Corporate data retention period

9904/10/23 9

Inactive DataInactive Data

Large

Small

DatabaseSize

Time

Retrieval Activity


Sales order booked

Change order

Partial shipments

Complete shipment


Sales order closed

Inactive Data

Active Data

101004/10/23 10

AgendaAgenda


End User End User IT OperationsIT OperationsCase StudiesCase Studies


111104/10/23 11

Effects of Database GrowthEffects of Database Growth

End-UserEnd-User

Declining application performanceDeclining application performance

Decreased application availabilityDecreased application availability

Information overloadInformation overloadIs your application presenting irrelevant Is your application presenting irrelevant

information to end-user, causing extra information to end-user, causing extra work?work?

121204/10/23 12

Effects of Database GrowthEffects of Database Growth

IT OperationsIT Operations

Storage requirementsStorage requirements

Server requirementsServer requirements

Backup and recovery windowsBackup and recovery windows

Maintenance and upgrades windowsMaintenance and upgrades windows

Cloning operationsCloning operations

Database and Application TuningDatabase and Application Tuning

131304/10/23 13

Case StudiesCase Studies

Only studies that have been published: Only studies that have been published: OAUG, OpenWorld, trade press OAUG, OpenWorld, trade press

All Oracle E-Business SuiteAll Oracle E-Business SuiteAll All RIM for DB LiveArchiveRIM for DB LiveArchive from HP/OuterBay from HP/OuterBayIn chronological orderIn chronological order

141404/10/23 14

Applied Materials – Server CapacityApplied Materials – Server Capacity

Data growth of 4GB per weekData growth of 4GB per week14 clones of Production14 clones of ProductionHP HP Live ArchiveLive Archive implementation led to near implementation led to near zero growthzero growth

Storage savings $1 MM/year Storage savings $1 MM/year Significant CPU utilization reductions Significant CPU utilization reductions extending server life by several yearsextending server life by several years

Runtime reductions on key reports by 50%Runtime reductions on key reports by 50%Source: Out of Gas on the Biggest Box Made, Now What? Chei Yeh, Source: Out of Gas on the Biggest Box Made, Now What? Chei Yeh,

Director Core Applications Director Core Applications Applied Materials. Applied Materials. OAUG Fall 2001OAUG Fall 2001

151504/10/23 15

Parsons Brinkerhoff - UpgradeParsons Brinkerhoff - Upgrade

10.7 to 1110.7 to 11i i upgrade of EBS upgrade of EBS Implemented Implemented Live ArchiveLive Archive before upgrade before upgrade Archive 35% of total DBArchive 35% of total DBReduced Upgrade outage from 12 days to 6 daysReduced Upgrade outage from 12 days to 6 daysAllowed 3 clones to be supported on test server Allowed 3 clones to be supported on test server

instead of 2 pre-archiveinstead of 2 pre-archiveUser agreement for archiving was easy to User agreement for archiving was easy to

achieve because of application access to achieve because of application access to archived dataarchived data

Source: “Worldwide Upgrade to Oracle 11Source: “Worldwide Upgrade to Oracle 11ii: A Recipe for Success” OAUG : A Recipe for Success” OAUG EuropeEurope 2002 by Robert P. Dallesandro Parsons-Brinkerhoff2002 by Robert P. Dallesandro Parsons-Brinkerhoff

161604/10/23 16

Apollo Group - UpgradeApollo Group - Upgrade

10.7 to 1110.7 to 11ii upgrade window reduction upgrade window reductionFixed window over 4Fixed window over 4thth July weekend July weekend$50K/day in productivity impact of additional outage $50K/day in productivity impact of additional outage

windowwindowArchived 22% of the 190 GB database pre-archiveArchived 22% of the 190 GB database pre-archiveReduced outage window by 27%Reduced outage window by 27%Avoided additional outageAvoided additional outageLessons learned: Archive before starting upgrade Lessons learned: Archive before starting upgrade

project project

Source: “Oracle 11i Data Upgrade Roadmap – A Lifecycle-Based Source: “Oracle 11i Data Upgrade Roadmap – A Lifecycle-Based Approach”, Approach”, Grant Gasson, Director of Financial Systems Grant Gasson, Director of Financial Systems Apollo Apollo Group, Inc. Group, Inc. Fall 2002 OAUGFall 2002 OAUG

171704/10/23 17

Gevity: Storage CostsGevity: Storage Costs

Reduced budget for storage –Reduced budget for storage – $1.3 savings (2007–2011)$1.3 savings (2007–2011)

Avoid purchase of additional Avoid purchase of additional storage ($664,474) for 2004storage ($664,474) for 2004

Dramatically reduce instances by Dramatically reduce instances by approximately 2TBapproximately 2TB

Saving total storage footprint of Saving total storage footprint of 12TB at implementation12TB at implementation

Additional BenefitsAdditional Benefits Sustainable and predictable Sustainable and predictable

performance/storage costsperformance/storage costs Allows high performance access to Allows high performance access to

clients worldwide via new portal, clients worldwide via new portal, while managing high performance while managing high performance reqsreqs

Greatly reduced backup, recovery Greatly reduced backup, recovery and clone times and clone times

181804/10/23 18

Agilent Technologies: Storage Agilent Technologies: Storage CostsCosts

Oracle EBS 11Oracle EBS 11ii Single world-wide database Single world-wide databaseGrowth rate 1TB+ per yearGrowth rate 1TB+ per year20 + clones to support business initiatives20 + clones to support business initiativesBenefitsBenefits

Savings for Storage: 2.5% of total 2005 IT budgetSavings for Storage: 2.5% of total 2005 IT budgetHA, Backup & Recovery reduced spend and timeHA, Backup & Recovery reduced spend and timeStable, predictable performanceStable, predictable performanceFree up resources for business initiativesFree up resources for business initiatives

Source: Agilent Case Study: Strategic Application Data Growth Management. By Naresh Shanker Sr. Director ERP Solutions, Agilent Technologies, OpenWorld SF 2004

191904/10/23 19

Agilent: Tuning - TemporaryAgilent: Tuning - Temporary

10,000

15,000

20,000

25,000

30,000

35,000

40,000

400

500

600

700

800

900

1000

1100

1200

1300

Ap

plic

atio

n D

ata

(GB

)

1300

1200

1100

1000

900

800

700

600

500

400

Tota

l B

atc

h R

un

Tim

e (

Hrs

/Mon

th)

Application Data

Batch Run Time

Data Growth Impact

Phase I Tuning


202004/10/23 20

10,000

15,000

20,000

25,000

30,000

35,000

40,000

2003-06

2003-07

2003-08

2003-09

2003-10

2003-11

2003-12

2004-01

2004-02

2004-03

2004-04

2004-05

2004-06

2004-07

2004-08

2004-09

2004-10

400

500

600

700

800

900

1000

1100

1200

1300

Tota

l B

atc

h R

un

Tim

e (

Hrs

/Mon

th)

Ap

plic

atio

n D

ata

(GB

)

Data Growth Impact

Sustained Predictable Performanc

eArchiving

Phase II Tuning

Agilent: Agilent: Archiving = StabilityArchiving = Stability


212104/10/23 21

ArvinMeritor – Disaster RecoveryArvinMeritor – Disaster Recovery

60% reduction in database size60% reduction in database size90% reduction in DR window 90% reduction in DR window 1111ii upgrade outage reduction to 2 days upgrade outage reduction to 2 days30% performance improvement30% performance improvementLower database maintenance overheadLower database maintenance overhead

Source: Automotive supplier curbs its runaway production Source: Automotive supplier curbs its runaway production database. Marcel Kuijs, director of IT at ArvinMeritor's European database. Marcel Kuijs, director of IT at ArvinMeritor's European

IT data center. Storage Network World, July 2005IT data center. Storage Network World, July 2005. .

222204/10/23 22

Case Study ThemesCase Study Themes

Many drivers for archiving Many drivers for archiving PerformancePerformanceUpgrade windowUpgrade window

Diverse set of secondary benefitsDiverse set of secondary benefitsCost avoidance, storage, servers, tapesCost avoidance, storage, servers, tapesFree resources for Strategic InitiativesFree resources for Strategic Initiatives

Benefits accrue to diverse parts of the Benefits accrue to diverse parts of the organizationorganizationData centerData centerBusiness userBusiness userApplication Support staffApplication Support staff

232304/10/23 23

AgendaAgenda


End UserEnd UserIT OperationsIT OperationsCase StudiesCase Studies


242404/10/23 24

Possible SolutionsPossible Solutions

Data Deletion / Data Deletion / Purging Purging

Add Capacity Add Capacity through Hardware through Hardware UpgradesUpgrades

Decentralize or Do Decentralize or Do Not ConsolidateNot Consolidate

Database PartitioningDatabase PartitioningDatabase ArchivingDatabase Archiving

252504/10/23 25

Solutions: Data Deletion/PurgingSolutions: Data Deletion/Purging

Some data is not subject to regulatory Some data is not subject to regulatory requirements and has no ongoing business requirements and has no ongoing business valuevalue

Candidates:Candidates:Concurrent request dataConcurrent request data

MRP runs, Workflows, etc.MRP runs, Workflows, etc.

Temporary and Interface TablesTemporary and Interface TablesSome Challenges! Introduces risk and exposure to meet legal and compliance

requirements No recourse, once the data is gone it is gone forever No validation for full data integrate

262604/10/23 26

Solutions: Add Capacity Solutions: Add Capacity Through Hardware UpgradesThrough Hardware Upgrades

StorageStorage

ServerServerScale upScale up

Scale out (RAC)Scale out (RAC)

NetworkNetwork

Some Challenges! Doesn’t solve the root cause, “Hardware Acquisition

Treadmill” One CIO observes: “Each time I buy storage, it

requires more software, backup, array and bandwidth”

272704/10/23 27

Solutions: Decentralize or Solutions: Decentralize or Do Not ConsolidateDo Not Consolidate

Sometimes managing two medium-Sometimes managing two medium-sized databases is easier than sized databases is easier than managing one large databasemanaging one large database

Some Challenges! Gives up all the advantages of consolidation

− IT Operations

− Consolidating reporting, etc…

282804/10/23 28

Solutions: Database PartitioningSolutions: Database Partitioning

Oracle feature for managing large Oracle feature for managing large tablestables

Improves performance Improves performance ifif queries are queries are able to use partition keysable to use partition keys

““Life cycle” of data may leave active Life cycle” of data may leave active data in same partition as inactive data in same partition as inactive datadataSome Challenges!

Does not address core data growth issue

Provides no help in compliance, data retention

Application must be tuned for partitioning

292904/10/23 29

Solutions: Database ArchivingSolutions: Database Archiving

Remove data from OLTP Databases Remove data from OLTP Databases while retaining ability to accesswhile retaining ability to accessDatabase Backups/SnapshotsDatabase Backups/SnapshotsExports, CSV filesExports, CSV filesXML Files or other self-describing formatXML Files or other self-describing formatRelocation to secondary databaseRelocation to secondary database

Access via reporting tools or business analyticsAccess via reporting tools or business analyticsAccess via native applicationAccess via native application

Maintain full data integrityMaintain full data integrity

Database Archiving: Key Database Archiving: Key ComponentsComponents

High

Low

Access / SLA Requirements

Time

Retrieval Activity


Sales order booked

Change order

Partial shipments

Complete shipment


Sales order closed

Regulatory data retention period ends

Corporate data retention period

Deploy Data By Cost and Class Of Service

.XML.XSD

SourceDatabaseActive Data

Inactive Data

Compliance Data


HomeGrown

323204/10/23 32

QAQA

Dev2Dev2Dev2

Database to Database Archiving

Database Subsetting

Database to File Archiving

ArchiveDatabase

Moderate Access

.XML.XSD

Infrequent Access

Database

ARCHIVE PLATFORM

User Access

Recovery Services

Information Movement

Configuration

Business Transactions

Policy Management

Analysis

Database Archiving: Key ComponentsDatabase Archiving: Key Components

333304/10/23 33

AgendaAgenda


End UserEnd UserIT OperationsIT Operations


343404/10/23 34

ConclusionConclusion

Plan for archiving!Plan for archiving!

Understand the impact of doing Understand the impact of doing nothingnothing

Make it part of your Fusion strategyMake it part of your Fusion strategy

04/10/23 35

Plan for Archiving: Next StepsPlan for Archiving: Next StepsData Collection Scripts (DCS) Offer Data Collection Scripts (DCS) Offer

Database measurement at a point in timeSnapshot

Integral part of the Discovery processNon-intrusive to actual data

Provides data/module distributionOracle ApplicationsPeopleSoft

Provides mappings to pre-packaged modulesUnderstand growth trends & areas of growth

04/10/23 36

Next Steps – How to Access DCSNext Steps – How to Access DCS

No-Cost Data Collection Script AnalysisNo-Cost Data Collection Script AnalysisCustomer receives SQL via emailScript is run against production databaseEmail results to John Sosnowski

([email protected])HP analyzes results and provides feedback &

recommendations within 2 weeksProvides growth data & basis for ROI

- Storage optimization and projected performance increases

DCS Script& Survey

to Customer

DCSProcessing

(send to ‘DCS’ alias)REPOS

DCS Spreadsheet

Customer runs DCS, completes survey &Returns via e-mail

.out survey

Non-intrusive Database SQL scripts capture table structure and storage information

Summary: The DCS Process

3939

Thank you!Thank you!

Jeff Blackmon

[email protected]

John [email protected]

www.hp.com/go/rim4dbwww.solutionbeacon.com

Real Solutions for the Real World.®

Questions and AnswersQuestions and Answers

HP Information Lifecycle Management (ILM) John Sosnowski – Account Executive Jeff Blackmon –...

Documents

Transcript of HP Information Lifecycle Management (ILM) John Sosnowski – Account Executive Jeff Blackmon –...