Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide...

16
نام دوره:Oracle Data Integrator Student Guide 1,2 ت دوره: مد44 ساعت خواهید گرفت آنچه شما یاد: Oracle Data Integrator یکزی داده جامع یکپارچه سا پلت فرم که تم است بازی داده را یکپارچه ساازهای ام نی حجم وی بالارای کاده ازستفا ا باکپارچه سازی یندهای فرای مینجام اهد دOracle Data Integrator برایدیل و تیرگذاری با ها دادهز موتورهای اRDBMS فاوتی متستفاده ا می کند و می توان داده سازیوان ابزار پی به عنETL گیردارستفاده قرره داده مورد انبازی ا و پیاده سا طراحی به منظور. این دورهز پایانن بعد انشجویا دااد می یرید: گی ازOracle Data Integrator ه کنیدستفادی مختلف ایان پلت فرم ها ها در میل دادهنجام تید برای ا از های نقشهODI ت دادهنجام تبدیلام انجا برای ا هاا و بسته ، روش هELT کنید طراحی مدیریت منابعODI امنیت و تنظیم درODI راهیدنجام د ا ها وزی داده یکپارچه ساهیدنجام دی مختلف را ایان پلت فرم هایل در م تبد کیابط گرافی از رODI هایف رویه برای تعر ها و کارهای ، بستهELT ه کنیدستفاد ا. یک محیط امن و چندبره کارODI را تنظیم و کنید نگهداری ده ازستفا ا باODI اده سازی پیCDC هیدنجام د را ا مخاطبین: تحلیلگران کسب و کار زان مدلسا داده مدیرنبار ا داده مدیران پایگاه داده مشاور فنی اف دوره اهد: مدلفاهیم توصیف مODI عماری توصیف مOracle Data Integrator 12c م توپولوژیبرد مفاهی کارODI هام دادهدغا برای ا های طراحی نقشهODI ، روش هایل دادهرای تبد های بار با و برنامه ه ، بستهELT ده بال کیفیت داعما اگی داده وتجو، رسید جسODI مدیریت منابعODI منیت با و تنظیم اODI اده سازی پیCDC باODI

Transcript of Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide...

Page 1: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

Oracle Data Integrator Student Guide 1,2نام دوره:

ساعت 44مدت دوره:

آنچه شما یاد خواهید گرفت:

Oracle Data Integrator با استفاده ازکارایی بالا حجم وام نیازهای یکپارچه سازی داده را با است که تمپلت فرم جامع یکپارچه سازی داده یک

و کند می استفاده متفاوتی RDBMS از موتورهایداده ها بارگذاریتیدیل و برای Oracle Data Integratorدهد انجام میفرایندهای یکپارچه سازی

.به منظور طراحی و پیاده سازی انباره داده مورد استفاده قرار گیرد ETLبه عنوان ابزار پیاده سازی دتوانمی

گیرید:یاد می دانشجویان بعد از پایان این دوره

ازOracle Data Integrator برای انجام تیدیل داده ها در میان پلت فرم های مختلف استفاده کنید

نقشه هایاز ODI روش ها و بسته ها برای انجام انجام تبدیلات داده ، ELTطراحی کنید

مدیریت منابع ODI درو تنظیم امنیت ODI انجام دهیدرا

تبدیل در میان پلت فرم های مختلف را انجام دهیدیکپارچه سازی داده ها و

از رابط گرافیکی ODIبسته ها و کارهای برای تعریف رویه ها ، ELT استفاده کنید.

کاربره چند و امن محیط یک ODI نگهداری کنید و تنظیم را

با استفاده ازODI پیاده سازیCDC را انجام دهید

مخاطبین:

کار و کسب تحلیلگران

داده مدلسازان

داده انبار مدیر

داده پایگاه مدیران

فنی مشاور

اهداف دوره:

توصیف مفاهیم مدل ODI

توصیف معماری Oracle Data Integrator 12c

کاربرد مفاهیم توپولوژی ODI برای ادغام داده ها

طراحی نقشه های ODIبسته ها و برنامه های بار برای تبدیل داده ، روش ها ، ELT

جستجو، رسیدگی داده و اعمال کیفیت داده با ODI

مدیریت منابع ODI و تنظیم امنیت با ODI

پیاده سازی CDC با ODI

Page 2: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

Introduction to Integration and Administration o Course Objectives

o Lesson Objectives

o Agenda

o Why Oracle Data Integrator?

o Conventional Integration Process: ETL

o Extract Load Transform (E-LT)

o ODI Architecture and Components

o ODI Architecture

o ODI Components: Overview

o Using ODI Studio

o Designer Navigator (Work Repository)

o Operator Navigator (Work Repository)

o Topology Navigator (Master Repository)

o Security Navigator (Master Repository)

o What Is an Agent?

o ODI Agents

o Three Types of Agents: Java EE, Standalone, Collocated Standalone

o Using the Three Types of Agents

o Standalone Agent: Example

o ODI Console

o Enterprise Manager FMW Console

o Management Pack for ODI for Enterprise Manager Cloud Control

o Management Pack for ODI for EM CC ODI Home Page

o Agenda

o ODI Repositories

o Master and Work Repositories

o Repository Setup: Example

o Repository Setup: Multiple Master Repositories

o Components: Global View

o Possible ODI Methodology

o Checklist of Practice Activities

o Starting Oracle Data Integrator

o Using Online Help

o Summary

Administering ODI Repositories o Objectives

o Agenda

Page 3: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Initial Repository Administration Tasks

o Steps to Set Up ODI Repositories

o 1.Run Repository Creation Utility

o 1a. Create Schemas

o 1b. Create Passwords and Tablespaces

o 2. Connect to the Master/Work Repository

o 3. Create a Wallet

o Connecting to the Master/Work Repository

o Exporting the Master Repository

o Importing the Master Repository

o Creating a Work Repository

o Changing the Work Repository Password

o Quiz

o Summary

o Checklist of Practice Activities

o Practice 2-1: Creating and Connecting to ODI Master and Work Repositories

ODI Topology Concepts o Objectives

o Agenda

o What Is Topology?

o What Is in the Topology?

o Agenda

o What Is a Data Server?

o Data Servers: Examples

o Important Guideline 1

o What Is a Physical Schema?

o Physical Schemas: Properties

o Technology Terminology Among Vendors

o Important Guideline 2

o Agenda

o Infrastructure for Two Production Sites: Example

o ODI Design: Physical Architecture of the Two Production Sites

o Logical Schemas and Contexts

o What Is a Logical Schema?

o Important Guideline 3

o Logical Versus Physical Architecture

o Design Time Versus Run Time

o What Is a Context?

o A Context Maps a Logical to a Physical Schema

o Defining Contexts

o Mapping Logical and Physical Resources

o Agenda

Page 4: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o ODI Physical Agents

o Creating a Physical Agent

o ODI Agent Parameters

o Launching a Stand-Alone Agent: Examples

o Stopping the ODI Agent

o Deploying and Configuring a Java EE Agent

o Load Balancing: Example

o Important Guideline 5

o Infrastructure with Agents: Example

o Defining Agents: Example

o Special Case: Fragmentation Problem

o Special Case: Important Guideline 6

o Special Case: Defining the Physical Architecture

o Special Case: The Infrastructure

o Special Case: Physical Architecture in ODI

o Agenda

o Planning the Topology

o Matrix of Logical and Physical Mappings

o Summary

Describing the Physical and Logical Architecture o Objectives

o Agenda

o What Topology Navigator Contains

o Topology Navigator: Overview

o Review: Context Connects Logical to Physical

o Objects You Create in the Practice

o Defining a Context

o Agenda

o Physical Architecture View

o Prerequisites for Connecting to a Server

o Important Note

o Creating a Data Server

o Creating a Data Server: JDBC

o JDBC Driver

o JDBC URL

o Creating a Data Server: JNDI

o Testing a Data Server Connection

o Creating a Physical Schema

o Agenda

o Logical Architecture and Context Views

o Creating a Logical Schema

o Creating a Logical Agent

Page 5: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Editing a Context to Link Logical and Physical Agents

o Summary

Setting Up a New ODI Project o Objectives

o Agenda

o What Is a Project?

o Oracle Data Integrator Projects: Overview

o How to Use ODI Projects in Your Work

o Creating a New Project

o Agenda

o What Is a Folder?

o Creating a New Folder

o Organizing Projects and Folders

o Agenda

o What Is a Knowledge Module?

o Types of Knowledge Modules

o Which Knowledge Modules Are Needed?

o Knowledge Modules: Examples

o Importing Knowledge Modules

o Replacing Existing KMs

o Knowledge Module Editor

o Editing a Knowledge Module

o Agenda

o Exporting and Importing

o Exporting an Object

o Importing an Object

o ID Numbers: Overview

o Import Types

o Choosing the Import Mode

o Import Report

o Agenda

o What Is a Marker?

o Tagging Objects with Markers

o Removing Markers

o Marker Groups

o Project and Global Markers

o Creating a Marker Group

o Summary

Oracle Data Integrator Model Concepts o Objectives

o What Is a Model?

Page 6: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Agenda

o Relational Model

o Relational Model: Tables and Columns

o Relational Model: Keys

o Relational Model: Foreign Keys

o Relational Model: Constraints

o Relational Model: Indexes

o Relational Model Support in ODI

o Additional Metadata in ODI

o Flex Fields

o Agenda

o What Is Reverse-Engineering?

o Methods for DBMS Reverse-Engineering

o Other Methods for Reverse-Engineering

o Standard Versus Customized Reverse-Engineering

o Reverse-Engineering Life Cycle

o Agenda

o Creating a Model by Reverse-Engineering

o Step 1: Creating and Naming a New Model

o Note: Creating and Naming a New Model

o Step 2: Defining a Reverse-Engineering Strategy

o Step 3: Starting the Reverse-Engineering Process

o Using RKM for Customized Reverse-Engineering

o Selective Reverse-Engineering

o Step 4: Fleshing Out Models

o Shortcuts

o Smart Export and Import

o Summary

Organizing ODI Models and Creating ODI Datastores o Objectives

o Agenda

o What Is a Model Folder?

o Creating a Model Folder

o What Is a Submodel?

o Creating a Submodel

o Organizing Datastores into Submodels

o Setting Up Automatic Distribution

o Agenda

o Creating Datastores

o Creating a Datastore in a Model

o Adding Columns to a Datastore

o Agenda

Page 7: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o What Is a Constraint in ODI?

o Constraints in ODI

o Creating a Mandatory Column

o Agenda

o Creating a Key

o Checking a Key

o Creating a Reference

o Creating a Simple Reference

o Creating a Complex Reference

o Checking a Reference

o Agenda

o Creating a Condition

o Checking a Condition

o Agenda

o Audit/Explore: When and Why

o Audit/Explore Process: Overview

o Agenda

o Displaying the Contents of a Datastore

o Viewing the Distribution of Values

o Analyzing the Contents of a Datastore

o Agenda

o Defining Business Rules in ODI

o From Business Rules to Constraints

o Deducing Constraints from Data Analysis

o Testing a Constraint

o Auditing a Model or Datastore

o Reviewing Erroneous Records

o Summary

ODI Mapping Concepts o Objectives

o Agenda

o What Is a Mapping?

o Business Rules for Mappings

o Where Are the Rules Defined?

o Agenda

o What Is an Expression?

o What Is a Join?

o What Is a Filter?

o What Is a Lookup?

o What Is a Set?

o What Are Some of the Others?

o New with Patch: Pivot and Unpivot

Page 8: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Agenda

o How Does ODI Implement Business Rules?

o Business Problem

o Implementing the Rules

o Integration Process

o Process Details

o Process Implementation: Example

o Process Implementation: Example

o Process Implementation: Example

o Agenda

o What Is the Staging Area?

o Execution Location

o Agenda

o From Business Rules to Processes

o Knowledge Modules

o What Is a Knowledge Module?

o Code Generation

o KM Types Used in Mappings

o Agenda

o Purpose of a Mapping

o What Is an Expression?

o Creating a One-to-One Mapping

o Creating and Naming a Mapping

o Defining the Target Datastore

o Multiple Targets

o Defining the Source Datastore

o Connecting the Ports to Make the Map

o Defining the Expressions

o Valid Expression Types

o Saving the Mapping

o Running the Mapping

o Summary

Designing Mappings o Objectives

o Agenda

o Multiple-Source Datastores

o Creating a Join Manually

o Advanced Joins

o Types of Joins

o Setting Up a Join

o Creating Lookups

o Using Lookups

Page 9: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Agenda

o Filters in ODI

o Defining a Filter Manually

o Setting Up a Filter

o Agenda

o Physical Mapping Diagram

o Flow in the Physical Diagram

o What Defines the Flow?

o Scenario

o Basic Process

o Agenda

o Purpose of a Staging Area

o Placing the Staging Area

o Important Note

o Specifying the Staging Area

o Agenda

o Options for Expressions

o Setting Options for Expressions

o Disabling an Expression

o Enabling a Mapping for Inserts or Updates

o Agenda

o Execution Location and Syntax

o Why Change the Execution Location?

o Changing the Execution Location

o ODI Mapping Execution Simulation

o Agenda

o Which KMs for Which Flow?

o Knowledge Modules: Additional Information

o Identifying IKMs and LKMs

o IKMs and LKMs: Strategies and Methods

o Specifying an LKM

o Specifying an IKM

o Common KM Options

o Flow: Example 1

o Flow: Example 2

o Flow: Example 3

o Summary

Mappings: Monitoring and Troubleshooting o Objectives

o Agenda

o Operator Navigator: Viewing the Log

o Using Operator Navigator

Page 10: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Hierarchy: Sessions, Steps, Tasks

o Viewing Details of Sessions, Steps, and Tasks

o Monitoring Execution of an Mapping

o Troubleshooting a Session

o Identifying the Error

o Reviewing the Code

o Fixing the Code and Restarting the Session

o Fixing the Mapping

o Keys to Reviewing the Generated Code

o Agenda

o Common Errors and Symptoms

o Important Note

o Tips for Preventing Errors

o Using Attribute Panel for Quick Edits

o Summary

Designing Mappings: Advanced Topics 1

o Objectives

o Agenda

o Business Rules in Mappings

o Business Rule Elements

o More Elements

o Expression Editor

o Agenda

o Using a Variable in Code

o Binding Versus Substitution

o Case Sensitivity

o Agenda

o Defining a Dataset

o Using Set-Based Operators

o Example of SET: UNION

o Agenda

o Types of Sequences

o Support for Native Sequences

o Creating a Native Sequence

o Referring to Sequences

o Note: Sequences Updated by Agent

o Using Standard Sequences in Mappings Correctly

o Using ODI Standard Sequences in Mappings

o Populating Native Identity Attributes

o Sequences: Best Practices

o Automatic Temporary Index Management

o Tracking Variables and Sequences

Page 11: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o How Variable and Sequence Tracking Works

o Variable Actions

o Definition Tab of Session Step or Session Task

o Summary

Designing Mappings: Advanced Topics 2 o Objectives

o Agenda

o Partitioning

o Definition in Datastore After Reverse-Engineering

o Using Partitioning in a Mapping

o Agenda

o Reusable Mappings

o Using Reusable Mappings: Example

o Derived Select (Subselect) for Reusable Mappings

o Agenda

o What Is a User Function?

o Why Use User Functions?

o Properties of User Functions

o Using User Functions

o Creating a User Function

o Defining an Implementation

o Syntax and Implementations

o User Functions at Design Time

o User Functions at Run Time

o Note: Functions in Execution Log

o Agenda

o Using Substitution Methods

o Substitution Methods: Examples

o Agenda

o Description of KM Steps

o Details of the Steps

o Setting KM Options

o Developing Your Own KM: Guidelines

o Complex File Technology

o Summary

Using ODI Procedures o Objectives

o Agenda

o What Is a Procedure?

o Procedure: Examples

o Creating Procedures: Overview

Page 12: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Agenda

o Creating a New Procedure

o Agenda

o Creating a Command

o Arranging Tasks in Order

o Which Parameters Should Be Set?

o Valid Types of Commands

o More Elements

o Why Use a Source Command?

o Agenda

o Types of Options

o Creating a New Option

o Making a Command Optional

o Using an Option Value in a Command

o Agenda

o Procedure Execution

o Using the Operator Navigator to View Results

o Summary

Using ODI Packages o Objectives

o Agenda

o What Is a Package?

o Creating a Package

o Agenda

o Creating and Naming a Package

o Package Diagram

o Package Diagram Toolbar

o Agenda

o Package Steps

o Creating a Package Step

o What Is an ODI Tool?

o Creating an ODI Tool Step

o Tool Steps: Best Practices

o Agenda

o Sequencing Steps

o A Simple Package

o Sequencing Package Steps

o Agenda

o Executing a Package

o Agenda

o Basic Step Types

o Advanced Step Types

Page 13: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Agenda

o Creating Model, Submodel, and Datastore Steps

o Models, Submodels, and Datastore Steps

o Agenda

o Creating a Variable Step

o Variable Steps

o Agenda

o Controlling Execution

o Error Handling

o Creating a Loop

o The Advanced Tab

o Summary

Step-by-Step Debugger o Objectives

o Agenda

o Overview

o Agenda

o Process Overview

o Starting a Session in Debug mode

o Specifying Debug Properties

o Control Execution Flow

o Screen Step Numbering

o Agenda

o New Functionalities

o Benefits for End Users

o Agenda

o Debug Toolbar

o Toolbar: Current Cursor

o Toolbar: Get Data

o Toolbar: Step Into

o Toolbar: Run to Task End

o Toolbar: Run to Next Task

o Toolbar: Run to Step End

o Toolbar: Run to Next Step

o Toolbar: Pause

o Toolbar: Resume

o Summary

Managing ODI Scenarios o Objectives

o Agenda

o What Is a Scenario?

Page 14: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Properties of Scenarios

o Agenda

o Scenario-Related Tasks

o Generating a Scenario

o Regenerating a Scenario

o Generation Versus Regeneration

o Executing a Scenario from the GUI

o Executing a Scenario from a Command Line

o Executing a Scenario from a Package

o Exporting a Scenario

o Agenda

o Preparing Scenarios for Deployment

o Automating Scenario Management

o Scheduling the ODI Scenario

o Scheduling ODI Scenario with External Scheduler

o Managing Schedules

o Summary

Using Load Plans o Objectives

o Should You Organize Executions with Load Plans?

o What Are Load Plans?

o Load Plan Editor 5 Load Plan Steps

o Defining the Restart Behavior

o Are Load Plans Substitutes for Packages or Scenarios?

o Benefits of Using Load Plans

o Handling Failed Load Plans

o Summary

Enforcing Data Quality with ODI o Objectives

o Agenda

o Why Data Quality?

o When to Enforce Data Quality

o Data Quality in Source Applications

o Data Quality Control in the Integration Process

o Data Quality in the Target Applications

o Agenda

o Data Quality Business Rules

o From Business Rules to Constraints

o Agenda

o Data Quality System: Overview

o Static and Flow Controls: Differences

Page 15: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

o Data Quality Control: Properties

o Synchronous Control

o What Is a Constraint?

o What Can Be Checked?

o Enforcing Data Quality in a Mapping

o Agenda

o Setting Up Static or Flow Control

o Enabling Static or Flow Control

o Agenda

o Setting the Physical Options

o Setting the Logical Options

o Agenda

o Selecting Which Constraints to Enforce

o Selecting Which Constraints to Check

o Differences Between Control Types

o Agenda

o Reviewing Erroneous Records

o EnterpriseDataQuality Tool

o Using the EDQ Tool

o Summary

Working with Changed Data Capture o Objectives

o Why Changed Data Capture?

o CDC Techniques

o Changed Data Capture in ODI

o Journalizing Components

o CDC Infrastructure in ODI

o Simple Versus Consistent Set Journalizing

o Limitations of Simple CDC Journalizing: Example

o Consistent CDC Journalizing

o Consistent CDC: Infrastructure

o Setting Up Journalizing

o Setting CDC Parameters: Example

o Adding a Subscriber: Example

o Starting Journal: Example

o Journalizing Status

o Viewing Data/Changed Data: Example

o Using Changed Data

o Oracle GoldenGate Integration

o Oracle GoldenGate Integration in ODI 12c

o Summary

Page 16: Oracle Data Integrator Student Guide 1,2 :هرود مان...Oracle Data Integrator Student Guide 1,2:هرود مان تعاس 44:هرود تدم:تفرگ دیهاوخ دای امش

Advanced ODI Administration o Objectives

o Agenda

o Introduction to ODI Security Navigator

o Security Concepts: Overview

o Defining Security Policies

o Creating Profiles

o Using Generic and Nongeneric Profiles

o Built-in Profiles

o Creating Users

o Assigning a Profile to a User

o Assigning an Authorization by Profile or User

o Defining Password Policies

o Setting User Preferences

o ODI Security Integration: Overview

o Implementing External Authentication (OPSS)

o Implementing External Authentication (OPSS): Switching the Authentication Mode

o Implementing External Password Storage

o Agenda

o Types of ODI Reports

o Generating Topology Reports

o Generated Topology Report: Example

o Version Comparison Report: Example

o Generating Object Reports

o Agenda

o Integration of ODI with Enterprise Manager

o Java EE Agent and Enterprise Manager Configuration with WebLogic Domain: Overview

o Using ODI Console: Example

o Summary