Prligence Empowering Intelligence 1 Painless Master Table Alter In Replication Paper # 524 Arup...

pr ligence Empowering Intelligence

Painless Master Table Alter In Replication

Paper # 524

Arup Nandapr ligence

Empowering Intelligence

Question

Two Most Important Objectives of Living Organisms

Surviving

Reproducing!

Replication Options Revisited

MASTER COPY

Multi-Master

MASTER COPY

TriggerTrigger

SnapshotLogs

ROW1 ROW1

pushROW2

TriggerTrigger

SnapshotLogs

Primary Secondary

Multi-Master contd.

• Can be Used in Disaster Recovery• Can be SYNCHRONOUS • Secondary Copy Useful for Transactions• Bidirectional Flow of Data _

Changes are PUSHED to secondaryAdvantages

Multi-Master contd.

• Continuosly Available Link Required• Conflict Resolution Logic Needed• Can Strain the Database _

Disadvantages

Updateable Snapshot

MASTER SNAPSHOT

TriggerTrigger

SnapshotLogs

ROW1 ROW1

TriggerTrigger

SnapshotLogs

CREATE SNAPSHOT MYSNAP

FOR UPDATE AS

SELECT * FROM MASTER@MAINDB

Updateble Snapshots contd.

• Changes are PULLED rather than pushedAdvantages• Controlled from Secondary Side• Continuous Link Not Needed• Can be Used in Disaster Recovery _

Updateable Snapshots contd.

Disadvantages• Conflict Management• Difficult Setup and Administration• Strain on Resources• Cannot be SYNCHRONOUS• Reporting Requirements – Overkill _

Read Only Snapshot

MASTER SNAPSHOT

TriggerTrigger

SnapshotLogs

ROW1 ROW1

Primary Secondary

Read Only Snapshots contd.

PULLEDControlled by SecondaryDisadvantages

Cannot be Used in Disaster RecoveryAdvantages• No Conflict Management• Simple Setup• Less Strain on Resources• Continuous Link Not Needed _

Altering The Master Table

EMPNO ENAME SAL

1 CHARLIE 1000

2 DAN 1500

Not captured in Refresh Process

EMPNO ENAME SAL COMM

1 CHARLIE 1000 100

2 DAN 1500 120

EMPNO ENAME SAL

1 CHARLIE 1000

2 DAN 1500

Documented

1 CHARLIE 1000 100

2 DAN 1500 120

EMPNO ENAME SAL

1 CHARLIE 1000

2 DAN 1500XDrop the Snasphot

Documented

1 CHARLIE 1000 100

2 DAN 1500 120

1 CHARLIE 1000 100

2 DAN 1500 120

Recreate the Snapshot

Documented Process

• Drop Snapshot (Snapsite)• Add Column to Master Table (Master)• Create Snapshot (Snapsite)• Refresh Snapshot (Snapsite)

Problem

• Time Consuming• Rollback Segment Space Needed• ORA-1555• Temporary Segment Space Needed• Space Needed in Target Tablespace

Database Example

• Schema Owner : ANANDA• Table TEST1

– COL1 CHAR(1)– COL2 CHAR(1)

Prepping the Master Site

Creating the Snapshot LogAs user ANANDACREATE SNAPSHOT LOG ON TEST1TABLESPACE USER_DATAWITH PRIMARY KEYINCLUDING NEW VALUES;

Create Repl Group

As REPADMIN UserDBMS_REPCAT. CREATE_MASTER_REPGROUP (GNAME=>'TEST1',QUALIFIER=>'',GROUP_COMMENT=>’TEST SNAPSHOT’

Group Name

Generate Master RepObject

DBMS_REPCAT.CREATE_MASTER_REPOBJECT(GNAME=>'TEST1',

TYPE=>'TABLE', ONAME=>'TEST1', SNAME=>'ANANDA');

Group Name

Table Name

Schema Name

Generate Repl Support

DBMS_REPCAT.GENERATE_REPLICATION_SUPPORT(SNAME=>'ANANDA',ONAME=>'TEST1',TYPE=>'TABLE',

MIN_COMMUNICATION=>TRUE);

Schema Name

Object Name

Resume Master Activity

DBMS_REPCAT.RESUME_MASTER_ACTIVITY( GNAME=>'TEST1');

Group Name

Make the Refresh Group

At Database REPL as user MVADMIN

DBMS_REFRESH.MAKE(NAME=>'MVADMIN.TEST1',NEXT_DATE=>SYSDATE+5/(24*60),INTERVAL=>'SYSDATE+5/(24*60)'

Group Name

Make the Snapshot Group

DBMS_REPCAT.CREATE_SNAPSHOT_REPGROUP(GNAME=>'TEST1',MASTER=>'PROD',PROPAGATION_MODE=> ‘ASYNCHRONOUS’

Group Name

Master Database

Create the Snapshot

At Database REPL as user ANANDA

CREATE SNAPSHOT TEST1REFRESH FASTASSELECT * FROM TEST1@PROD

Add Snapshot to Group

At Database REPL as user ANANDA

DBMS_REFRESH.ADD (NAME=>'MVADMIN.TEST1',LIST=>'ANANDA.TEST1'

Group Name

Object Name

Generate Repl Support

DBMS_REPCAT.CREATE_SNAPSHOT_REPOBJECT(

GNAME =>'TEST1',SNAME =>'ANANDA',ONAME =>'TEST1',TYPE =>'SNAPSHOT'

Group Name

Schema Name

Object Name

Most Expensive

Prebuilt Table

SNAPSHOTLOGS

EXPORT/IMPORT

SQL*LOADER DIRECT PATH

DIRECT PATH INSERT

CREATE TABLE AS SELECT

SNAPSHOTLOGS

SNAPSHOT

FAST REFRESH

Usual Method

Prebuilt Table

CREATE SNAPSHOT TEST1ON PREBUILT TABLEREFRESH FASTASSELECT * FROM TEST1@PROD

Needed Changes

• Add a column COL3 CHAR(1)• Modify column COL2 CHAR(1000)

As user ANANDA in PROD Database

ALTER TABLE TEST1 ADD (COL3 CHAR(1);

ALTER TABLE TEST1 MODIFY (COL2 CHAR(1000));

Snapshot on Prebuilt Table

TEST1TABLE

SNAPSHOT

TEST1 is a TABLECREATE SNASPSHOT TEST1

ON PREBUILT TABLEAS ….

DROP SNASPHOT TEST1TEST1 is a TABLE again!

SNAPSHOT IS CREATED ON

PREBUILT TABLE

SNAPSHOT IS DROPPED

COL3 IS ADDED TO THE TABLE

SNAPSHOT IS RECREATED ON

THE TABLE

Segment State

COL1 CHAR(1)COL2 CHAR(1)

SNAPSHOT

COL3 CHAR(1)

SNAPSHOT

Segment State Analysis

• Snapshot is Dropped• Segment Reverts to Table• Column Is Added• Snapshot is Recreated• Segment Becomes Snapshot

The state of the segment, i.e. the data is the same

at these two points intime; only the additional

column is different.

Therefore, a FULL Refresh Is NOT Needed!

Stop Any Refresh

SELECT JOB FROM USER_REFRESH WHERE RNAME = 'TEST1';

EXEC DBMS_JOB.BROKEN(<JOBNUMBER>,TRUE);

COMMIT;SELECT SID FROM

DBA_JOBS_RUNNINGWHERE JOB = <JOBNUMBER>;

Add the Columns

DROP SNAPSHOT TEST1;Snapshot dropped; Table remains

ALTER TABLE TEST1 ADD (COL4 CHAR(1);

ALTER TABLE TEST1 MODIFY (COL3 CHAR(1000));

Potential Problem

When a SNAPSHOT is Created on a Master Table, the Snashot Logs Entries are Erased

Need to Capture Snapshot Log EntriesMLOG$_<first 20 Chars of Table Name>

Table Name:THIS_IS_A_LONG_TABLE_NAME

Snap Log Name: MLOG$_THIS_IS_A_LONG_TABLE

Preserve the LogAs User ANANDACOL PART_TAB_NAME NOPRINT NEW_VALUE PART_TAB_VALSELECT SUBSTR(‘&TABNAME',1,20) PART_TAB_NAMEFROM DUAL/DROP TABLE MLOG_BAK/CREATE TABLE MLOG_BAKASSELECT * FROM MLOG$_&&PART_TAB_VAL.@PROD/

Table to Preserve

Snapshot Log

Recreate the Snapshot

• Build the Snapshot• Add the Snapshot to the Refresh Group• Build Replication Support for the Group

Snapshot Log Table

Reinstate the Log Entries

INSERT INTO MLOG$_&&PART_TAB_VAL.@PROD

SELECT * FROM MLOG_BAK/COMMIT/

Table We Preserved the Snapshot Logs In

Test the Refresh

• Do a Fast Refreshexecute dbms_snapshot.refresh('TEST1','F')

• Re-run the Jobexecute dbms_job.run(<jobnumber>)

Dare to Compare?Elapsed Time

USUAL APPROACH RECOMMENDED APPROACH

•1m•1m•5m•10 hr•1m•1m

•5m•1m

•Drop the Snapshot and Table•Add Columns in Master•NO NEED•Recreate the Table•Build the Snapshot•Add the Snapshot to the Refresh Group•Build Replication Support for the Group•NO NEED•Check Refresh

•Drop the Snapshot•Add Columns in Master•Preserve Snapshot Logs •NO NEED•Build the Snapshot•Add the Snapshot to the Refresh Group•Build Replication Support for the Group•Reinstate Logs•Check Refresh

10 hours6 minutes

16 minutes

Conclusion

• Elapsed Time Reduced As Much As 99%• Resource Utilization Low• All Processes Supported by Oracle• No Data Dictionary Manipluation, No Underscore

Parameters

pr ligence Empowering Intelligence45

Thank You!

Painless Master Table Alter In Replication

Paper # 524by Arup Nanda

www.proligence.cowww.proligence.comm

Prligence Empowering Intelligence 1 Painless Master Table Alter In Replication Paper # 524 Arup...

Documents

Transcript of Prligence Empowering Intelligence 1 Painless Master Table Alter In Replication Paper # 524 Arup...

Empowering Operations with Geographical Intelligence€¦ · A comprehensive program targeted towards operational excellence Starting from years ago, Hera managed to pursue a set

Optimizing DAX Queries - PASS | Empowering Microsoft … Ferrari_Optimizing DAX Queries.pdfAlberto Ferrari BI Expert and Consultant Founder of Book Writer Microsoft Business Intelligence

the Artificial Have you Intelligence heard about the ... · One of the team Artificial intelligence Dr. Khaled Shalabi Pag. 18 Empowering the AG word. One of our suppliers Pag. 22

Empowering Narrative Writers - schd.wsschd.ws/hosted_files/nctca2015/0d/Empowering Narrative Writers... · Empowering Narrative Writers EMPOWERING WRITERS, LLC ... character’s thoughts

SME Growth Hack - 'How a Game-Changing Business Intelligence Tool is Empowering SMEs Across the UK'

Prligence Empowering Intelligence Summary Management By Advanced Queues Paper # 419 Arup Nanda Proligence, Inc .

Empowering English Language Learners: Moving Toward ... · Empowering English Language Learners 183 in a non-threatening way, and their creative and humorous intelligence is rewarded.

EMPOWERING AEROSPACE · Threat Intelligence Transparency, data governance Connected Experience Modern Devices Integrated Workflow Factory Logistics Smart Building, Smart Office Space

Empowering marketers and brands to break away€¦ · Empowering marketers and brands to break away from the pack Mapp in 10 Facts: 3 modules: Engage, Acquire, Intelligence 4 native

“Empowering Women - Empowering Humanity: …...“Empowering Women - Empowering Humanity: Picture it!” Upcoming Events • 4 April International Day for Mine Awareness and Assistance

Full Stack IoT Platform Empowering the Intelligence of Things. · 2018-03-27 · Empowering the Intelligence of Things. Aileen Retail Einstein Entertainment Venues Metasante Healthcare

Rare earth poster3 - Seren Empowering Intelligence · RARE EARTH METALS SEPARATION & RECYCLING SEREN TECHNOLOGY ... • Ready for demonstration scale. Title: Rare earth poster3 Created

Time to distribute intelligence in container terminals Empowering … · 2018. 5. 10. · architecture based on distributed intelligence allows a leaner and more efficient system

Empowering Consumers Empowering Consumers€¦ · Empowering Consumers SSocial and behavioural change 5 Priority Areas Empowering Consumers context include Hygiene Rating, Menu Labelling,

Empowering Smart Technology Companies · Sinapse Energia Smart Lighting Infrastructure for Private and Public sector NetinDS Network Intelligence ShieldIOT Cybersecurity Solution

Empowering customers through industrial intelligence

EMPOWERING CITIESempoweringcities.eiu.com/wp-content/uploads/sites/26/2016/09/... · 2 The Economist Intelligence Unit Limited 2016 Empowering cities The real story on how citizens

Nexis Intelligence Solutions - LexisNexis Business Insight ... · Nexis® Media Intelligence Solutions, harness the power of the vast media ... Social Analytics ... empowering brands

Empowering communities Empowering people

Empowering Expository Writers Handout - schd.wsschd.ws/hosted_files/mptca2016/7d/Empowering Expository Writers... · Empowering Expository Writers EMPOWERING WRITERS, LLC TELEPHONE: