Use the Oracle Logminer to protect your data and move to the...

SessionID:

Preparedby:

UsetheOracleLogminertoprotectyourdataandmovetotheCloud!

KonstantinKerekovski,RaymondJamesFinancial

April2-6,2017inLasVegas,NVUSA#C17LV

KonstantinRomanovKerekovski

WorkExperience:• AmericanExpress– OracleDBA11g,12c,RAC,GG,DG• RaymondJamesFinancial– OracleDBA11g,12c,Exadata,ODA

ExperiencewithReplicationTechnologies:• Goldengate11g,12c• Dataguard11g,12c• Logminer11g,12c

WhatistheLogminer?

• Asuiteofpackagesandviews• Atooltoanalyzeyourarchivedlogs

RecommendedSettings

• MinimumDatabaseSupplementalloggingenabled.

• (Optional)SupplementalloggroupsontablesinvolvedinanyLogminerreplication.

WhatisSupplementalLogging?

• Extraredologgingotherthanwhatisrequiredtorecoverdatabasechangesviamediarecovery(RMAN).

Examples:• Sessionlevelinformation• Beforeimagesofcolumns

WhyisSupplementalLoggingimportant?

• LogminercannotreturnvalidSQLstatementswithoutsupplementallogging.• Logminerwillnotbeusableforanyauditingpurposesduetomissingredodata.

AddingDatabaseMinimumSupplementalLogging

SQL> alter database add supplemental log data;

Database altered.

AddingDatabaseMinimumSupplementalLogging(cont’d)

OtherLevelsofDBSupplementalLogging

DatabaseSupplementalLoggingconsiderations

• In12c,supplementalloggingdoneatCDB$ROOTenablessupplementalloggingonallPDBs.• IncreasesamountofREDOgeneratedbyALLtransactions.

Whyistable-levelSupplementalLoggingneeded?

• Tostorebefore-imagesofkeycolumnsintoredostream.

• ToensureSQLretrievedfromSQL_REDOcolumnhastheproperpredicatesinwhereclause.

• ToavoidusingROW_ID’swhenrerunningSQL_REDOdata.

Addingtable-levelSupplementalLogging

IdentificationKeyLogging

Addingtable-levelSupplementalLogging

CustomLogGroups

SupplementalLogTestCase

Whathappenswithnotable-levelSupplementalLogging?

Whathappenswithnotable-levelSupplementalLogging?(cont’d)

NoSupplementalLoggingwhatsoever

WhathappenswithallcolumnSupplementalLogging?

WhathappenswithallcolumnSupplementalLogging?(cont’d)

WhathappenswithPKSupplementalLogging?

WhathappenswithPKSupplementalLogging?(cont’d)

WhyPrimaryKey IdentificationKeySupplementalLoggingissafer

WhyPrimaryKey IdentificationKeySupplementalLoggingissafer(cont’d)

DatabaseObjectsofinterest

• DBMS_LOGMNR_D

• DBMS_LOGMNR

• V$LOGMNR_CONTENTS

DBMS_LOGMNR_D

• DatabasePackage• Usedtostoredatadictionaryinflatfilesortheredologs.

TheDataDictionary

• MapsObjectIDstoObjectNames,aidsinDDLtracking.

• Canbeaccessedin3differentways1. Fromstoredversioninredologs2. Fromstoredversionaflatfile3. Fromthedatabaseitself.

Whyyoushoulduse1ofthe3datadictionaryoptions

DBMS_LOGMNR

• Startsandendslogminingsessions.

• Specifieswhichredologsaretobeanalyzed.

• SpecifieshowtodisplaySQL_REDOandSQL_UNDOviaOPTIONSargumentinSTART_LOGMNR

START_LOGMNROptions

• NO_SQL_DELIMITER• NO_ROW_ID_IN_STMT• COMMITTED_DATA_ONLY• CONTINUOUS_MINE

• DDL_DICT_TRACKING• DICT_FROM_ONLINE_CATALOG• DICT_FROM_REDO_LOGS

COLUMN_PRESENTandMINE_VALUE

COLUMN_PRESENTandMINE_VALUE(cont’d)

V$LOGMNR_CONTENTS

• ViewexposingREDOandUNDOminedviaDBMS_LOGMNR• SystemPrivilegeNeeded(12c)

• LOGMINING• SELECT_CATALOG_ROLE

• SystemPrivilegeNeeded(11g)• SELECTANYTRANSACTION• SELECT_CATALOG_ROLE

WhathappenswhenV$LOGMNR_CONTENTSisqueried?

• RedoisanalyzedaccordingtoSTARTSCN/ENDSCNorSTARTTIME/ENDTIME.• Logfiles aredynamicallyaddedtologminingsessionifCONTINUOUS_MINEwasspecified.• REDOandUNDOdataisreturnedintheformofROWS.• ChangerecordsreturnedinascendingSCNorderunlessotherwisespecifiedinSQLstatement.

Additionalinterestingviews• V$LOGMNR_LOGS- ContainsadditionalinformationonARCHIVELOGS.

• V$LOGMNR_PARAMETERS– Informationoncurrentlogminingsession.

AlittlemoreonV$LOGMNR_PARAMETERS

AuditingDatabaseActivity

Databasechangecausesoutage

• Databasesuddenlybecomesunresponsive.

• Databaseserverisunabletocreateanynewprocessesandneedstoberebooted.

• Everyoneispanickingandmanagementisverydispleased.

Whatdoweknow?

1. Aheavilyusedindex(HR.EMP_EMP_ID_PK)wasrecentlyalteredtoPARALLEL99.

2.Thedatabaseisauditingchangestoindexes.

3.DBA_AUDIT_TRAILhasnoauditrecordsforindex!

DBMS_LOGMNRtotherescue!

Verifyingoursuspicions

RecoveringfromLogicalCorruption

BotchedUpdateScript

SQL> !cat update_salary.sql

set echo on;

update hr.employees set salary = 100000;

where employee_id =100;

commit;

OutcomeSQL> @update_salary.sql

SQL> update hr.employees set salary = 100000;

107 rows updated.

SQL> where employee_id =100;

SP2-0734: unknown command beginning "where empl..." - rest of

line ignored.

SQL> commit;

Commit complete.

DBMS_LOGMNRtotherescue!

RetrievingtheSQL_UNDO

References

https://github.com/kerekovskik/COLLABORATE_2017https://github.com/kerekovskik/COLLABORATE_2017/wikihttps://docs.oracle.com/database/121/SUTIL/toc.htmhttps://docs.oracle.com/database/121/ARPLS/d_sql.htm

Use the Oracle Logminer to protect your data and move to the...

Documents

Transcript of Use the Oracle Logminer to protect your data and move to the...

Recent Customer Experiences with Oracle Rdb...• Oracle Rdb is not always the right database management system 4 5 Methods Application Based Table Shadowing/Mirroring Disk ~1990 LogMiner/Loader

Oracle DB High Availability on IBM Power Systems · PDF fileVIO Server Oracle Applications PowerHA or Oracle Grid Infrastructure Database Oracle Middleware Protect all components •

Oracle Unbreakable Cluster v. 12cUnbreakable+Cluster+12… · • Oracle Clusterware can be used to protect any application (restarting or failing over the application in the event

Using Oracle Clusterware to Protect Oracle VM Manager · 2 | Oracle VM 3: Using Oracle Clusterware to Protect Oracle VM Manager 2. Oracle Grid Infrastructure 12c Requirements for

LogMiner by Example

Using Oracle Clusterware to Protect 3rd Party Applications€¦ · Using Oracle Clusterware to Protect 3rd Party Applications Page 6 RULES FOR CLUSTERS USING ORACLE CLUSTERWARE Oracle

Oracle LogMiner

Using Oracle Clusterware to Protect 3rd Party Applications

Oracle Database Solutions on VMware High Availability...This document describes some high availability scenarios designed to protect a VMware virtualized Oracle database to minimize

Zero Outage Oracle to DB2 Migrations - The Fillmore Group ... · Heterogeneous Replication – LogMiner Setup • Create a table space for the LogMiner utility on the Oracle source

Protect Database Oracle 12c with Global-Active …...1 1 Protect Database Oracle 12c with Global-Active Device on Hitachi Virtual Storage Platform G Series Best Practice Guide Learn

Protect your customer data. Protect your brand. Protect ... · Protect your customer data. Protect your brand. Protect your business. “From an attack pattern standpoint, the most

JCC’s LogMiner Loadersearch.jcc.com/JCC Presentations/JCCLogMinerLoader.pdfIntegrating an Oracle-based system with Rdb database applications Uses DB-links and limited custom code

Oracle Database Snapshot and Cloning with Oracle Snap ...pauliesworld.org/img/hol2068.pdf · database administrators the flexibility to copy and protect their Oracle Database by efficiently

Poor Man’s Auditing - nocoug.org · Poor Man’s Auditing with Oracle Log Miner Caleb Small, ... • Application auditing ... ch. 17 Using LogMiner to Analyze Redo

DBMS LOGMNR - Springerextras.springer.com/2005/978-1-59059-525-1/5254AppAH...DBMS_LOGMNR 1097 DBMS_LOGMNR The LogMiner packages, DBMS_LOGMNR and DBMS_LOGMNR_D, allow for analysis of

1 0 . 4 . 0 I n f o r m a t i c a P o w e r E x c h a n g e€¦ · Oracle CDC with LogMiner Implementation Considerations..... 193 Oracle CDC with LogMiner Restrictions..... 195

JCC LogMiner Loader: Today and Beyond - download.oracle.com · 14/11/2006 · Replicate data from source database to a parallel database Rdb Oracle Performance requirements: 4,000+

Copyright 2012 PITSS America LLC 1 Protect, Extend, and Evolve – Start Preparing Your Oracle Forms & Reports Application For The Future!

Oracle Traffic Director · Traffic Director 11g ... •Request limiting to protect from DoS attack ... •External command support for deep health check •Use Cases