Exadata Implementation Strategy - Umair...

29
Exadata Implementation Strategy BY UMAIR MANSOOB

Transcript of Exadata Implementation Strategy - Umair...

Page 1: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Exadata Implementation Strategy

BY UMAIR MANSOOB

Page 2: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Who Am I• Oracle Certified Administrator from Oracle 7 – 12c

• Exadata Certified Implementation Specialist since 2011

• Oracle Database Performance Tuning Certified Expert

• Oracle Business Intelligence Foundation Suite 11g Certified Implementation Specialist

• Oracle Database Data Warehousing Certified Implementation Specialist

• Multiple Exadata Implementations / POC’s for large financial organizations

• Migrate / Upgrade databases between various versions of Oracle

• Capacity Planning for Oracle Engineered Systems

• Database Consolidation to Exadata / 12c Platform

• Architect Databases for OLTP and OLAP applications

• Not an Oracle Employee or Nor I represent Oracle in any way

Umair MansoobExadata Implementation Strategy

Page 3: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Overview

Plan CutoverOptimizeMigrate Test

Umair MansoobExadata Implementation Strategy

Page 4: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Plan

Umair MansoobExadata Implementation Strategy

Analyze Current Architecture

Deployment Decisions

Migration Considerations

HA Architecture

Testing Strategy

Page 5: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Analyze Current Architecture

Analyze source database characteristic like database size and parameter settings.

Analyze source host system characteristics like memory foot and IO through put and resource utilization.

Is there a compliance requirement to encrypt data on rest ?

Gather baseline from existing application system to compare result later.

Gather AWR, ASH and other statistics from current environment

Umair MansoobExadata Implementation Strategy

Page 6: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Deployment Decisions

Do you need to virtualized Exadata machine to Isolate targetdatabase.

What type of redundancy level you need ( High or Normal ) ,External is not supported

Do you need to implement resource management using DBRM orIORM

Do you need to isolate network or partition InfiniBand network forcompliance reason.

Umair MansoobExadata Implementation Strategy

Page 7: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Migration Considerations How much time you have to cutover the application

Will you be needing Golden Gate to replicate database formigration.

Do you have access to Database backups from Exadata Machine

How is network bandwidth between source and target ExadataSystem

Inform business user and other stake holders about upcomingmigration, so they can plan for outage

What is Recovery Time Objective (RTO)

Umair MansoobExadata Implementation Strategy

Page 8: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

High Availability Architecture

What will be your backup strategy , Tape or Exadata Storage

Depending on the database size , backing it up on Exadata storagecan be very expensive

Will Data Guard going to be part of your DR strategy

Can you offload backups or reporting services to DR site

How are you planning to use services to manage

How enable flashback database impact application performance

Umair MansoobExadata Implementation Strategy

Page 9: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Testing Strategy

How are you planning to test your application on Exadata ?

Do you need to develop additional test plans ?

Will you be introducing code or architecture changes during the migration

How are you planning to capture statistic during testing ?

Umair MansoobExadata Implementation Strategy

Page 10: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Migrate

Umair MansoobExadata Implementation Strategy

•RMAN

•Data Guard

•Transportable TbsPhysical

•Data Pump

• Insert as Select

•Golden GateLogical

Source Exadata

Page 11: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

MigrateEach migration method has its own pros and cons, so analyze themcarefully based on your requirements

Data migration methods can be categorized as physical migration orlogical migration.

You should run exachk utility to review and implement Exadata bestpractices.

Physical migration is a block by block copy of data, popular methodsare data guard and RMAN.

Popular logical methods are data pump or insert as select.

Umair MansoobExadata Implementation Strategy

Page 12: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Physical Migration Pro : Migrating data using physical methods can be very simple andstraight forward.

Pro : Support cross platform Migrations using RMAN transportabledatabase.

Con : Bring all the characteristics of target database, which mightnot be optimal.

Con : Will require extra effort to implement Exadata best practicesand enable features like compression.

Umair MansoobExadata Implementation Strategy

Page 13: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Logical Migration Pro : Exadata best practices will already be in place , if database wascreated using DBCA utility.

Pro : Can POC Exadata specific feature like compression and storageindexes

Con : Not simple , will require extra effort and time to bring dataover to Exadata machine

Con : Since its not a block by block copy , execution plans canchange.

Umair MansoobExadata Implementation Strategy

Page 14: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Optimize

Umair MansoobExadata Implementation Strategy

Optimize

Smart Scan

Partitioning

Compression

Page 15: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Optimize

You should look into testing following Exadata Features during yourPOC.

Compression not only reduces your storage footprint but alsoimprove performance.

Even though offloading and smart scan are enabled by default butmake sure they are turned on and performing as expected.

Test Storage indexes by making but selected non primary keyindexes invisible.

Umair MansoobExadata Implementation Strategy

Page 16: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Compression

Regardless of Exadata, Oracle has two native compression types,basic table compression and OLTP Compression

You can get reasonable compression ratio with OLTP compressionand it will also support DML operations.

Please note that there will be some overhead and you will needadvance compression license to use OLTP compression.

You can get extremely good compression ratio with HybridColumnar compression but OLTP operations are not supported

Umair MansoobExadata Implementation Strategy

Page 17: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Smart Flash Cache

Exadata smart flash cache has an ability to move data in and outfrom cache based on usage.

It is enabled by default, you don’t have to configure anything toenable it.

If enable , Write back flash cache provides the ability to write I/Osdirectly to PCI flash

Write-back cache can help reduce “"free buffer waits" waits forwrite intensive applications.

Umair MansoobExadata Implementation Strategy

Page 18: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Offloading / Smart ScanExadata extreme performance is archive through offloading andsmart scan.

Offloading means some of Oracle processes are offloaded toExadata Storage node.

Oracle processes that can be offloaded to storage nodes areincremental backups, Data File creation, decompression anddecryption

There are some pre-requisites for smart scan like direct path readand full table scan.

Umair MansoobExadata Implementation Strategy

Page 19: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Storage Indexes

Storage indexes are memory structure at storage level.

Storage Indexes reduce Disk I/O by maintaining an entry forminimum and maximum value for data per 1 MB by default.

You can drop most non-primary key indexes and force queries to useStorage indexes.

Usually BITMAP indexes are ideal candidates for offloading queriesto Storage Indexes.

Umair MansoobExadata Implementation Strategy

Page 20: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Partitioning

Partitioning Strategies Interval - Range , List , Hash , Composite, etc

Partitioning pruning is the simplest and also the most substantialmeans to improve performance.

Partitioning can also improve the performance of multi-table joins,by using a technique known as partition-wise joins.

Partitioned database objects provide partition independence , animportant part of a high-availability strategy.

Umair MansoobExadata Implementation Strategy

Page 21: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

ParallelismYou can execute your queries in parallel to speed up your load

You can enable parallel query execution at object level or you canuse SQL hint

AUTO DOP will automatically parallelize your queries based on athreshold

The default of parallel_min_time_threshold parameter is 10seconds

Umair MansoobExadata Implementation Strategy

Page 22: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Resource Management

Database Consolidation might require some level of resourcemanagement

Resource mgmt will help you consistent performance acrossdifferent workload and databases

You can use Oracle native resource management tool called DBRMto manage CPU utilization, parallel queueing and long running queries

You can use IORM Exadata native utility to manage I/O throughputand latency.

Umair MansoobExadata Implementation Strategy

Page 23: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Test

Umair MansoobExadata Implementation Strategy

Start Testing

Testing Considerations

Capture Statistics

Page 24: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Start Testing

Testing should include should include all the variation you want totest during your POC.

You can a test like for like, which means you are not planning tomake any changes to your database architecture like compression,partition or encryption

There are different type of tests you can run during your POC, likePerformance test, load test, break test.

Don’t forget to capture statistics during test phase of POC.

Umair MansoobExadata Implementation Strategy

Page 25: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Testing Considerations

Remember you are moving your application to new hardware

You might be changing underline hardware system for your database

You might be moving from NON-RAC to RAC database system

Performance testing provides most important statistics for your POC

Some customer like to perform failover and break test for theircritical applications

Umair MansoobExadata Implementation Strategy

Page 26: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Capture Statistics

Make sure to capture performance stats using tools like AWR, ASH,and SQL Performance analyzer

AWR reports will provide you all the details you need to compareelapse time, IO wait and CPU utilization

Also validate Exadata configuration through running Exachk

ASH reports can provide you further details about execution plansand wait times

Umair MansoobExadata Implementation Strategy

Page 27: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Cutover

Umair MansoobExadata Implementation Strategy

Source Exadata

Page 28: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Cutover

Make sure to backup both source and target databases

Have a fallback plan, just in case if you encounter any issues afterthe cutover

You will probably have to sync your target database just before thecutover

You should be on guard for next 48 hours and ready to remediateany issues.

Umair MansoobExadata Implementation Strategy

Page 29: Exadata Implementation Strategy - Umair Mansoobblog.umairmansoob.com/.../2016/05/Exadata-Implementation-Strateg… · Exadata Implementation Strategy Umair Mansoob. ... Data File

Thank You

Umair Mansoob

773-297-2061

[email protected]

http://blog.umairmansoob.com/

Umair MansoobExadata Implementation Strategy