The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

30
1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

description

The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment. Mainframe Integration without Compromise. Agenda. Introduction to Treehouse Software Today ’ s Situation IT Objective tcACCESS Data Integration tcACCESS SQL Engine tcACCESS Demo tcVISION - PowerPoint PPT Presentation

Transcript of The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

Page 1: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

1

The Mainframe Data Access& Replication Conundrum

In Today's Heterogeneous IT Environment

Page 2: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

2

Mainframe Integration without Compromise

Page 3: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

3

Agenda

• Introduction to Treehouse Software• Today’s Situation• IT Objective• tcACCESS

• Data Integration• tcACCESS SQL Engine• tcACCESS Demo

• tcVISION• Data Replication• CDC Methods• Processing Stages• tcVISION Demo

• Summary

Page 4: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

4

Introduction to Treehouse Software

• Established in 1982• Mainframe system tools vendor• Leading ISV for Software AG

• 70% penetration in North American market• Consultants with 20+ years experience• More than 300 man years of experience

• Supporting all mainframe operating systems• Focus for the past 15+ years on data migration,

replication, and integration• Over 700 customers worldwide• 20 products• 30 employees

Page 5: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

5

Treehouse Customers

Page 6: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

6

Today’s Situation

• Heterogeneous IT environments

• Legacy applications

• High-availability information systems

• Data silos

• Increasing data volumes

• Exploding costs

Page 7: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

7

IT Objective

• Intelligent data integration

• Efficient data synchronization

• Cost effective solution

Enterprise-wide Data Management through:

Page 8: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

8

Page 9: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

9

Enterprise Data Integration

• Bi-directional data-exchange across heterogeneous systems

• Direct data access across heterogeneous systems

• Data transformation for data analysis and exchange

tcACCESS Concepts

Page 10: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

10

Enterprise Data Integration

• Relational access to legacy data and applications

• Data federation – heterogeneous data views

• Integration of mainframe files and DBMS structures

• Data federation between mainframe and Windows/Open Systems data

tcACCESS Concepts

Page 11: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

11

tcACCESS SQL Engine

Host/PC & Host & Web Integration

Page 12: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

12

tcACCESS SQL Engine

• More than 90 SQL functions supported

• Operators (+, -, *, /, ||)

• Conditional Operators (>, <, =, BETWEEN, LIKE)

• Logic Operators (AND, OR)

• INNER and OUTER JOINS

• GROUP BY, ORDER BY

• Security may be applied (RACF, ACF/2, Top Secret)

• Stored Procedure Support

Page 13: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

13

tcACCESS SQL Engine

• Different data sources can be JOINed:SELECT IMS.NR, IMS.NAME, VSAM.ADDRESS FROM IMS, VSAM WHERE IMS.NR = VSAM.ID

• VIEWS can be created• Control Options available

(MAXIO, MAXROW, NOORDERBY, etc)

• Global SQL Exit available• Field Level Exits available

Page 14: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

14

tcACCESS Architecture

Page 15: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

15

Demo

Page 16: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

16

Page 17: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

17

CDC Replication

• Different data formats

• Different data models

• Large data volumes

• Limited batch window

• Requirement for up-to-date information

• Moving/replicating data...

• as much as needed

• as little...

• as transparent...

• as flexible...

• as secure...

• ...AS POSSIBLE

The Problem: The Solution:

...with

Page 18: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

18

Data Latency

Change Data Capture

Page 19: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

19

Data volume

Change Data Capture

Page 20: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

20

Mainframe Change Data CaptureChange Data Capture

• Efficient transfer of entire databases

• Analysis for data consistancy

• Best for Initial Load prior to log processing

• Best for periodic mass data transfer

• One step data transfer

Page 21: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

21

Mainframe Change Data CaptureChange Data Capture

• Comparison of data snapshots

• Efficient transfer of changed data since last processing

• IMS/DB, DL/I, VSAM, DB/2, ADABAS, CA-IDMS, DATACOM, sequential files

• Flexible processing options (SORT etc.)

• Automatic creation of deltas by tcVISION

Page 22: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

22

Mainframe Change Data CaptureChange Data Capture

• Usage of the DBMS logging capabilities

• IMS/DB, VSAM, DB/2, DL/I, ADABAS, IDMS, DATACOM

• Transfer of changed data in scheduled time frame

• Best for batch window

• Best for processing right after logfile creation

Page 23: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

23

Mainframe Change Data CaptureChange Data Capture

• Realtime capture of changed data

• Changes directly obtained from DBMS

• CA-IDMS, IMS/DB, VSAM, DB/2, DATACOM, ADABAS

• Secure data storage even across DBMS restart

• Flexible propagation methods

Page 24: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

24

Stage 0:Data in internal raw format

Stage 1:Data in tcVISION format (before and after images)

Stage 2:Data normalized with structure definition

Staged Processing

Stage 3: Data in DML or Loader format

Page 25: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

25

Stage 0:Data in internal raw format

Stage 1:Data in tcVISION format (before and after images)

Stage 2:Data normalized with structure definition

Stage 3: Data in DML or Loader format

Staged Processing

Exit pointsavailable at every stage

Page 26: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

26

Demo

Page 27: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

27

Summary• Relational access to legacy

data and applications

• Data Federation – heterogeneous data views

• Change Data Processing

• Bi-Directional real time replication

Page 28: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

28

SummarytcVISION Architecture

Page 29: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

29

SummaryBi-directional data-integration and data-synchronization

Page 30: The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

30

E-mail: [email protected]