Oracle goldengate ogg
description
Transcript of Oracle goldengate ogg
WWW.TRANSFER-SOLUTIONS.COM
SPREKER :
E-MAIL :
DATUM :
Oracle GoldenGateOracle's strategic solution for real time data integration
Jos van den Oord
29 november 2011
© COPYRIGHT TRANSFER SOLUTIONS B.V. 2
Who am I
Jos van den OordWorking with Oracle products since 1998
Working at Transfer-Solutions since 2010
InterestsDatabases
Right Availability
Security, Performance
Blog : joordsblog.vandenoord.eu
Email : [email protected]
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Agenda
Introduction Oracle GoldenGate (OGG)GoldenGate Topologies
GoldenGate Intergration solutions
GoldenGate Products
Technology Overview GoldenGateSimple, Flexible Instantiation
GoldenGate Modular Building Blocks
GoldenGate Capture/Delivery
GoldenGate Checkpointing
Architecture Process Components
Demo GoldenGate
3
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Introduction Oracle GoldenGate (OGG)
Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in real time
Oracle’s real-time data movement solution Data replication for heterogeneous databases
Real-time information feeds to Oracle BI/EPM
Zero-downtime migrations and upgrades to Oracle Database and Applications
4
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Introduction Oracle GoldenGate (OGG)
GoldenGate Topologies
5
Unidirectional Bi-directional Peer to Peer
Broadcast Intergration / Consolidation
Cascading
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Introduction Oracle GoldenGate (OGG)
6
Databases O/S and PlatformsCapture:
Oracle DB2 Microsoft SQL Server Sybase ASE Ingres Teradata Enscribe SQL/MP SQL/MX
Delivery: All listed above MySQL, HP Neoview, Netezza, and
any ODBC compatible databases ETL products JMS message queues
Windows 2000, 2003, XP
Linux
Sun Solaris
HP NonStop
HP-UX
HP TRU64
HP OpenVMS
IBM AIX
IBM z/OS
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Introduction Oracle GoldenGate (OGG)
Heterogeneity Supports Afb Overview
7
Product / License Description
Oracle GoldenGate Includes GoldenGate Capture, Deliver, Active Data Guard and XStream
Oracle GoldenGate for Mainframe Includes GoldenGate Capture and Deliver for HP NonStop and IBM DB2 on z/OS
Oracle GoldenGate Veridata Add-on capability to validate data in replicated systems
Management Pack for GoldenGate Add-on management pack, includes Oracle GoldenGate Director
Oracle GoldenGate Adapters Pre-packaged application content, such as for Flat File and Java adapters
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Technology Overview GoldenGate
OGG Modular Building Blocks
Database
LogsLog
sLog
s
Deliver
Delivery: Applies transactional data with guaranteed integrity
Trail FilesDeliver Capture
Trail Files
Bi-directional
Trail Files Trail Files
Trail files: Universal data format enables heterogeneity
Route: No Distance constraints via TCP/IP. Compression & encryption.
Capture
Database
LogsLog
sLog
s
Capture: Committed changes are captures ( and can be filtered) As they occur by reading the transaction logs
LAN/WANTCP/IP
© COPYRIGHT TRANSFER SOLUTIONS B.V.
LAN/WANTCP/IP
Technology Overview GoldenGate
Simple, Flexible Instantiation Start Change Data Capture (CDC) Initial Snapshot Synchronization
9
Ongoing Data Synchronization
Initial Load
Database
Redolog
Capture DataPumpTrail Files
CollectorTrail Files
DatabaseDelivery
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Technology Overview GoldenGate
Oracle GoldenGate Capture
10
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Technology Overview GoldenGate
Oracle GoldenGate Delivery
11
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Technology Overview GoldenGate
GoldenGate Checkpointing
12
Current Read
Position
Data Pump Trail Files
-----------------
Begin TX2 Insert TX2 Commit TX2
Current
WritePosition
PUMPCheckpoint
Database
Delivery Database
-----------------
Current Read
Position
DeliveryCheckpoint
CaptureDatabase
Trail Files
-----------------
Begin TX1 Insert TX1 Begin TX2 Update TX1
Insert TX2 Commit TX2 Begin TX3
Insert TX3 Begin TX4 Commit TX3
Delete TX4
Begin TX2 Insert TX2 Commit TX2
Begin TX3 Insert TX3 Commit TX3
Current ReadPosition
Current WritePosition
CaptureCheckpoint
Start of Oldest Open (Uncommitted)Transaction
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Architecture Process Components
13
Log-basedVAM-basedLocal/Remote QueuingFilteringParallel CoordinationLocal/Remote
CAPTURENative database APIODBCBatch OperationsFilteringTransaction/Operations GroupingParrallel CoodinationLocal/Remote
DELIVERY
FilteringLocal/RemoteTCP/IPCompressionEncryption
PUMPQueue (Trail) ManagementProcess Management (Dynamic)Monitoring and Administration (Lag report)Reporting (Events, Error, Tresholds)Receive/Route request from UI
Trail FilesCheckpoint files (Capture, Pump, Delivery)Configuration FilesDiscard filesReport/Log filesBinaries
On – disk Components
MANAGER
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Demo
GoldenGate
Manager process
Extract process
DataPump Process
Replicat Process
Bi-Directional Replication
DDL Bi-Directional Replication
Extract /Replicat Filtering
Logdump
SQL statements van replicat
14
WWW.TRANSFER-SOLUTIONS.COM
SPREKER :
E-MAIL :
DATUM :
Point of Interest for Oracle GoldenGateOracle's strategic solution for real time data integration
Jos van den Oord
29 november 2011
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Point of Interest for Oracle GoldenGate•Understanding of
the business objectives
•Approved by your stakeholders?
•Understanding of the requirements?
•Appropriate replication topology
Requirements and Planning
16
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Point of Interest for Oracle GoldenGate•Creating Dedicated
Users•Encrypting
Passwords•Creating a Dedicated
Installation Directory•Using a Checkpoint
Table•Verifying the
Character Sets•Developing Naming
Standards•Using a Data Pump
Installation and Setup
17
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Point of Interest for Oracle GoldenGate•Using GGSCI Command
Shortcuts•Using OBEY Files•Generating Interim
Statistics•Using a Discard File•Reporting Regularly on
Process Health•Purging Old Trail Files
Regularly•Automatically Starting
Processes
Management and Monitoring
18
© COPYRIGHT TRANSFER SOLUTIONS B.V.
Point of Interest for Oracle GoldenGate•Running Performance
Tests•Limiting the Number of
Extracts•Using Passthru Mode
for Data Pumps•Using Parallel
Replicats•Using the Fastest
Available Storage•Tuning the Database
Performance
19
© COPYRIGHT TRANSFER SOLUTIONS B.V. 20
&Q u e s t i o n sA n s w e r s
CONSULTING | MANAGED SERVICES | EDUCATION
WWW.TRANSFER-SOLUTIONS.COM