Reusable Mapping

download Reusable Mapping

of 8

Transcript of Reusable Mapping

  • 8/9/2019 Reusable Mapping

    1/8

    Oracle

    Blogs Home

    Products & Services

    Downloads

    Support

    Partners

    CommunitiesAbout

    Login

    racle Blog

    ata Integration

    side Oracle's Data Integration community

    Oracle GoldenGate...| Main| Replicating between...

    DI 12c's Mapping Designer - Combining Flow Based and Expression Based Mapping

    y Madhu Nair on Oct 27, 2013

    ost by David Allan

    DI is renowned for itsdeclarative designer and minimal expression based paradigm. The new ODI 12c release has

    tended this even further to provide an extended declarative mapping designer. The ODI 12c mapper is a fusion ofDI's new declarative designer with the familiar flow based designer while retaining ODIs key differentiators of:

    Minimal expression based definition,

    The ability to incrementally design an interface and to extract/load data from any combination of sources, and most

    importantly

    Backed by ODIs extensible knowledge module framework.

    he declarative nature of the product has been extended to include an extensible library of common components that can

    e used to easily build simple to complex data integration solutions. Big usability improvements through consistent

    teractions of components and concepts all constructed around the familiar knowledge module framework provide the

    most flexibility.

    ereis a little taster:

    o what is a mapping? A mapping comprises of a logical design and at least one physical design, it may have many. A

    apping can have many targets, of any technology and can be arbitrarily complex. You can build reusable mappings and

    e them in other mappings or other reusable mappings.

    the example below all of the information from an Oracle bonus table and a bonus file are joined with an Oraclemployees table before being written to a target. Some things that are cool include the one-click expression cross

    ferencing so you can easily see what's used where within the design.

    https://blogs.oracle.com/dataintegration/entry/oracle_goldengate_12c_furthering_thehttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/entry/replicating_between_cloud_and_onhttps://blogs.oracle.com/roller-ui/login-redirect.rolhttp://www.oracle.com/us/corporate/index.htmlhttp://www.oracle.com/us/partnerships/index.htmlhttp://www.oracle.com/us/support/index.htmlhttp://www.oracle.com/us/products/index.htmlhttps://blogs.oracle.com/http://www.oracle.com/https://blogs.oracle.com/dataintegration/entry/replicating_between_cloud_and_onhttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/entry/oracle_goldengate_12c_furthering_thehttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/roller-ui/login-redirect.rolhttp://www.oracle.com/us/corporate/index.htmlhttp://www.oracle.com/us/community/index.htmlhttp://www.oracle.com/us/partnerships/index.htmlhttp://www.oracle.com/us/support/index.htmlhttp://www.oracle.com/technetwork/indexes/downloads/index.htmlhttp://www.oracle.com/us/products/index.htmlhttps://blogs.oracle.com/http://www.oracle.com/
  • 8/9/2019 Reusable Mapping

    2/8

    he logical design in a mapping describes whatyou want to accomplish (see the animated GIF hereillustrating how the

    ove mapping was designed) . The physical design lets you configure howit is to be accomplished. So you could have

    ne logical design that is realized as an initial load in one physical design and as an incremental load in another. In the

    hysical design below we can customize how the mapping is accomplished by picking Knowledge Modules, in ODI 12c

    ou can pick multiple nodes (on logical or physical) and see common properties. This is useful as we can quickly

    mpare property values across objects - below we can see knowledge modules settings on the access points between

    ecution units side by side, in the example one table is retrieved via database links and the other is an external table.

    the logical design I had selected an append mode for the integration type, so by default the IKM on the target will

    https://blogs.oracle.com/warehousebuilder/resource/ODI12c/odi_12c_logical_designer.gif
  • 8/9/2019 Reusable Mapping

    3/8

    oose the most suitable/default IKM - which in this case is an in-built Oracle Insert IKM (see image below). This

    pports insert and select hints for the Oracle database (the ANSI SQL Insert IKM does not support these), so by

    fault you will get direct path inserts with Oracle on this statement.

    ODI 12c, the mapper is just that, a mapper. Design your mapping, write to multiple targets, the targets can be in the

    me data server, in different data servers or in totally different technologies - it does not matter. ODI 12c will derive and

    nerate a plan that you can use or customize with knowledge modules. Some of the use cases which are greatly

    mplified include multiple heterogeneous targets, multi target inserts for Oracle and writing of XML.

    et's switch it up now and look at a slightly different example to illustrate expression reuse. In ODI you can define

    usable expressions using user functions. These can be reused across mappings and the implementations specialized per

    chnology. So you can have common expressions across Oracle, SQL Server, Hive etc. shielding the design from the

    hysical aspects of the generated language. Another way to reuse is within a mapping itself. In ODI 12c expressions can

    e defined and reused within a mapping. Rather than replicating the expression text in larger expressions you can

    compose into smaller snippets, below you can see UNIT_TAX AMOUNT has been defined and is used in two

    ownstream target columns - its used in the TOTAL_TAX_AMOUNT plus its used in the UNIT_TAX_AMOUNT (a

    cording of the calculation).

  • 8/9/2019 Reusable Mapping

    4/8

    ou can see the columns that the expressions depend on (upstream) and the columns the expression is used in

    ownstream) highlighted within the mapper. Also multi selecting attributes is a convenient way to see what's being used

    here, below I have selected the TOTAL_TAX_AMOUNT in the target datastore and the UNIT_TAX_AMOUNT in

    NIT_CALC.

    ou can now see many expressions at once now and understand much more at the once time without needlessly clicking

    ound and memorizing information.

    ur mantra during development was to keep it simple and make the tool more powerful and do even more for the user.

    he development team was a fusion of many teams from Oracle Warehouse Builder, Sunopsis and BEA Aqualogic,

    bating and perfecting the mapper in ODI 12c. This was quite a project from supporting the capabilities of ODI in 11g

    building the flow based mapping tool to support the future.

  • 8/9/2019 Reusable Mapping

    5/8

    hope this was a useful insight, there is so much more to come on this topic, this is just a preview of much more that you

    ill see of the mapper in ODI 12c.

    ategory: ODI Technical Feature Overviews

    ags: data_integrationetlodiodi-eeodi12codiee

    ermanent link to this entry

    Oracle GoldenGate...| Main| Replicating between...

    omments:

    ost a Comment:

    Name: guest

    E-Mail:

    URL:

    Notify me by email of new comments

    Remember Information?

    Your Comment:

    HTML Syntax: NOT allowed

    Please answer this simple math question

    5 + 67 =

    Preview Post

    bout

    earn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration

    oducts-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality

    arch

    nter search term:

    Search only this blog

    ecent Posts

    Let Oracle GoldenGate 12c Take You to the Cloud

    Oracle GoldenGate for Informix is Released

    ODI 12c - Spark SQL and Hive?

    https://blogs.oracle.com/dataintegration/entry/odi_12c_spark_sql_andhttps://blogs.oracle.com/dataintegration/entry/oracle_goldengate_for_informix_ishttps://blogs.oracle.com/dataintegration/entry/let_oracle_goldengate_12c_takehttps://blogs.oracle.com/dataintegration/entry/replicating_between_cloud_and_onhttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/entry/oracle_goldengate_12c_furthering_thehttps://blogs.oracle.com/dataintegration/entry/odi_12c_s_mapping_designerhttps://blogs.oracle.com/dataintegration/tags/odieehttps://blogs.oracle.com/dataintegration/tags/odi12chttps://blogs.oracle.com/dataintegration/tags/odi-eehttps://blogs.oracle.com/dataintegration/tags/odihttps://blogs.oracle.com/dataintegration/tags/etlhttps://blogs.oracle.com/dataintegration/tags/data_integration
  • 8/9/2019 Reusable Mapping

    6/8

    Big Data Governance and Metadata Management - A Recap

    Oracle Data Integrator and Hortonworks

    ODI 12c and DBaaS in the Oracle Public Cloud

    Updated Statement of Direction for Oracle Business Intelligence Analytics (OBIA)

    Raymond James Financial Leverages Oracle Data Integration

    Automating ODI development tasks using the SDK

    Big Data Governance Webcast

    p Tags

    11g

    12c

    availability

    bi

    big

    business

    cloud

    customer

    dataData_Integration

    data_integration

    Data_Integrator

    database

    downtime

    elt

    ELT

    enterprise

    etlETL

    exadata

    fusion

    gate

    golden

    goldengate

    hadoop

    hdfs

    high

    hive

    integration

    integrator

    java

    km

    MDM

    migration

    odi

    ODI

    ODI-EEogg

    openworld

    oracle

    Oracle_Data_Integrator

    Oracle_GoldenGate

    https://blogs.oracle.com/dataintegration/tags/Oracle_GoldenGatehttps://blogs.oracle.com/dataintegration/tags/Oracle_Data_Integratorhttps://blogs.oracle.com/dataintegration/tags/oraclehttps://blogs.oracle.com/dataintegration/tags/openworldhttps://blogs.oracle.com/dataintegration/tags/ogghttps://blogs.oracle.com/dataintegration/tags/ODI-EEhttps://blogs.oracle.com/dataintegration/tags/ODIhttps://blogs.oracle.com/dataintegration/tags/odihttps://blogs.oracle.com/dataintegration/tags/migrationhttps://blogs.oracle.com/dataintegration/tags/MDMhttps://blogs.oracle.com/dataintegration/tags/kmhttps://blogs.oracle.com/dataintegration/tags/javahttps://blogs.oracle.com/dataintegration/tags/integratorhttps://blogs.oracle.com/dataintegration/tags/integrationhttps://blogs.oracle.com/dataintegration/tags/hivehttps://blogs.oracle.com/dataintegration/tags/highhttps://blogs.oracle.com/dataintegration/tags/hdfshttps://blogs.oracle.com/dataintegration/tags/hadoophttps://blogs.oracle.com/dataintegration/tags/goldengatehttps://blogs.oracle.com/dataintegration/tags/goldenhttps://blogs.oracle.com/dataintegration/tags/gatehttps://blogs.oracle.com/dataintegration/tags/fusionhttps://blogs.oracle.com/dataintegration/tags/exadatahttps://blogs.oracle.com/dataintegration/tags/ETLhttps://blogs.oracle.com/dataintegration/tags/etlhttps://blogs.oracle.com/dataintegration/tags/enterprisehttps://blogs.oracle.com/dataintegration/tags/ELThttps://blogs.oracle.com/dataintegration/tags/elthttps://blogs.oracle.com/dataintegration/tags/downtimehttps://blogs.oracle.com/dataintegration/tags/databasehttps://blogs.oracle.com/dataintegration/tags/Data_Integratorhttps://blogs.oracle.com/dataintegration/tags/data_integrationhttps://blogs.oracle.com/dataintegration/tags/Data_Integrationhttps://blogs.oracle.com/dataintegration/tags/datahttps://blogs.oracle.com/dataintegration/tags/customerhttps://blogs.oracle.com/dataintegration/tags/cloudhttps://blogs.oracle.com/dataintegration/tags/businesshttps://blogs.oracle.com/dataintegration/tags/bighttps://blogs.oracle.com/dataintegration/tags/bihttps://blogs.oracle.com/dataintegration/tags/availabilityhttps://blogs.oracle.com/dataintegration/tags/12chttps://blogs.oracle.com/dataintegration/tags/11ghttps://blogs.oracle.com/dataintegration/entry/big_data_governance_webcasthttps://blogs.oracle.com/dataintegration/entry/automating_odi_development_tasks_usinghttps://blogs.oracle.com/dataintegration/entry/raymond_james_financial_leverages_oraclehttps://blogs.oracle.com/dataintegration/entry/updated_statement_of_direction_forhttps://blogs.oracle.com/dataintegration/entry/odi_12c_and_dbaas_inhttps://blogs.oracle.com/dataintegration/entry/oracle_data_integrator_and_hortonworkshttps://blogs.oracle.com/dataintegration/entry/big_data_governance_and_metadata
  • 8/9/2019 Reusable Mapping

    7/8

    performance

    quality

    real-time

    replication

    sdk

    table

    warehouse

    zero

    ategories

    Enterprise Data Quality Solutions and News

    Enterprise Data Quality Technical Features

    GoldenGate Solutions and News

    GoldenGate Technical Features

    ODI Solutions and News

    ODI Technical Feature Overviews

    ODSI News and Events

    ODSI Technical FeaturesOracle Data Integration Family Solutions & News

    rchives

    November 2014

    unMonTue WedThuFriSat

    1

    3 4 5 6 7 8

    10 11 12 13 14 15

    6 17 18 19 20 21 22

    3 24 25 26 27 28 29

    0

    Today

    enu

    Blogs Home

    Weblog

    Login

    eds

    SS

    All

    /Enterprise Data Quality Solutions and News

    /Enterprise Data Quality Technical Features/GoldenGate Solutions and News

    /GoldenGate Technical Features

    /ODI Solutions and News

    /ODI Technical Feature Overviews

    /ODSI News and Events

    https://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODSI+News+and+Eventshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODI+Technical+Feature+Overviewshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODI+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FGoldenGate+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FGoldenGate+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FEnterprise+Data+Quality+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FEnterprise+Data+Quality+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rsshttps://blogs.oracle.com/roller-ui/login-redirect.rolhttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/https://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/date/20141120https://blogs.oracle.com/dataintegration/date/20141118https://blogs.oracle.com/dataintegration/date/20141112https://blogs.oracle.com/dataintegration/date/20141110https://blogs.oracle.com/dataintegration/date/20141106https://blogs.oracle.com/dataintegration/date/201410https://blogs.oracle.com/dataintegration/category/Oracle+Data+Integration+Family+Solutions+%26+Newshttps://blogs.oracle.com/dataintegration/category/ODSI+Technical+Featureshttps://blogs.oracle.com/dataintegration/category/ODSI+News+and+Eventshttps://blogs.oracle.com/dataintegration/category/ODI+Technical+Feature+Overviewshttps://blogs.oracle.com/dataintegration/category/ODI+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/category/GoldenGate+Technical+Featureshttps://blogs.oracle.com/dataintegration/category/GoldenGate+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/category/Enterprise+Data+Quality+Technical+Featureshttps://blogs.oracle.com/dataintegration/category/Enterprise+Data+Quality+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/tags/zerohttps://blogs.oracle.com/dataintegration/tags/warehousehttps://blogs.oracle.com/dataintegration/tags/tablehttps://blogs.oracle.com/dataintegration/tags/sdkhttps://blogs.oracle.com/dataintegration/tags/replicationhttps://blogs.oracle.com/dataintegration/tags/real-timehttps://blogs.oracle.com/dataintegration/tags/qualityhttps://blogs.oracle.com/dataintegration/tags/performance
  • 8/9/2019 Reusable Mapping

    8/8

    /ODSI Technical Features

    /Oracle Data Integration Family Solutions & News

    Comments

    tom

    All

    /Enterprise Data Quality Solutions and News

    /Enterprise Data Quality Technical Features

    /GoldenGate Solutions and News/GoldenGate Technical Features

    /ODI Solutions and News

    /ODI Technical Feature Overviews

    /ODSI News and Events

    /ODSI Technical Features

    /Oracle Data Integration Family Solutions & News

    Comments

    he views expressed on this blog are those of the author and do not necessarily reflect the views of Oracle. Terms of

    se| Your Privacy Rights| Cookie Preferences

    http://www.oracle.com/html/privacy.htmlhttp://www.oracle.com/html/terms.htmlhttps://blogs.oracle.com/dataintegration/feed/comments/atomhttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FOracle+Data+Integration+Family+Solutions+%26+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODSI+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODSI+News+and+Eventshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODI+Technical+Feature+Overviewshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODI+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FGoldenGate+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FGoldenGate+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FEnterprise+Data+Quality+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FEnterprise+Data+Quality+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atomhttps://blogs.oracle.com/dataintegration/feed/comments/rsshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FOracle+Data+Integration+Family+Solutions+%26+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODSI+Technical+Features