Reusable Mapping
-
Upload
usha-ramanathan -
Category
Documents
-
view
224 -
download
0
Transcript of Reusable Mapping
-
8/9/2019 Reusable Mapping
1/8
Oracle
Blogs Home
Products & Services
Downloads
Support
Partners
CommunitiesAbout
Login
racle Blog
ata Integration
side Oracle's Data Integration community
Oracle GoldenGate...| Main| Replicating between...
DI 12c's Mapping Designer - Combining Flow Based and Expression Based Mapping
y Madhu Nair on Oct 27, 2013
ost by David Allan
DI is renowned for itsdeclarative designer and minimal expression based paradigm. The new ODI 12c release has
tended this even further to provide an extended declarative mapping designer. The ODI 12c mapper is a fusion ofDI's new declarative designer with the familiar flow based designer while retaining ODIs key differentiators of:
Minimal expression based definition,
The ability to incrementally design an interface and to extract/load data from any combination of sources, and most
importantly
Backed by ODIs extensible knowledge module framework.
he declarative nature of the product has been extended to include an extensible library of common components that can
e used to easily build simple to complex data integration solutions. Big usability improvements through consistent
teractions of components and concepts all constructed around the familiar knowledge module framework provide the
most flexibility.
ereis a little taster:
o what is a mapping? A mapping comprises of a logical design and at least one physical design, it may have many. A
apping can have many targets, of any technology and can be arbitrarily complex. You can build reusable mappings and
e them in other mappings or other reusable mappings.
the example below all of the information from an Oracle bonus table and a bonus file are joined with an Oraclemployees table before being written to a target. Some things that are cool include the one-click expression cross
ferencing so you can easily see what's used where within the design.
https://blogs.oracle.com/dataintegration/entry/oracle_goldengate_12c_furthering_thehttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/entry/replicating_between_cloud_and_onhttps://blogs.oracle.com/roller-ui/login-redirect.rolhttp://www.oracle.com/us/corporate/index.htmlhttp://www.oracle.com/us/partnerships/index.htmlhttp://www.oracle.com/us/support/index.htmlhttp://www.oracle.com/us/products/index.htmlhttps://blogs.oracle.com/http://www.oracle.com/https://blogs.oracle.com/dataintegration/entry/replicating_between_cloud_and_onhttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/entry/oracle_goldengate_12c_furthering_thehttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/roller-ui/login-redirect.rolhttp://www.oracle.com/us/corporate/index.htmlhttp://www.oracle.com/us/community/index.htmlhttp://www.oracle.com/us/partnerships/index.htmlhttp://www.oracle.com/us/support/index.htmlhttp://www.oracle.com/technetwork/indexes/downloads/index.htmlhttp://www.oracle.com/us/products/index.htmlhttps://blogs.oracle.com/http://www.oracle.com/ -
8/9/2019 Reusable Mapping
2/8
he logical design in a mapping describes whatyou want to accomplish (see the animated GIF hereillustrating how the
ove mapping was designed) . The physical design lets you configure howit is to be accomplished. So you could have
ne logical design that is realized as an initial load in one physical design and as an incremental load in another. In the
hysical design below we can customize how the mapping is accomplished by picking Knowledge Modules, in ODI 12c
ou can pick multiple nodes (on logical or physical) and see common properties. This is useful as we can quickly
mpare property values across objects - below we can see knowledge modules settings on the access points between
ecution units side by side, in the example one table is retrieved via database links and the other is an external table.
the logical design I had selected an append mode for the integration type, so by default the IKM on the target will
https://blogs.oracle.com/warehousebuilder/resource/ODI12c/odi_12c_logical_designer.gif -
8/9/2019 Reusable Mapping
3/8
oose the most suitable/default IKM - which in this case is an in-built Oracle Insert IKM (see image below). This
pports insert and select hints for the Oracle database (the ANSI SQL Insert IKM does not support these), so by
fault you will get direct path inserts with Oracle on this statement.
ODI 12c, the mapper is just that, a mapper. Design your mapping, write to multiple targets, the targets can be in the
me data server, in different data servers or in totally different technologies - it does not matter. ODI 12c will derive and
nerate a plan that you can use or customize with knowledge modules. Some of the use cases which are greatly
mplified include multiple heterogeneous targets, multi target inserts for Oracle and writing of XML.
et's switch it up now and look at a slightly different example to illustrate expression reuse. In ODI you can define
usable expressions using user functions. These can be reused across mappings and the implementations specialized per
chnology. So you can have common expressions across Oracle, SQL Server, Hive etc. shielding the design from the
hysical aspects of the generated language. Another way to reuse is within a mapping itself. In ODI 12c expressions can
e defined and reused within a mapping. Rather than replicating the expression text in larger expressions you can
compose into smaller snippets, below you can see UNIT_TAX AMOUNT has been defined and is used in two
ownstream target columns - its used in the TOTAL_TAX_AMOUNT plus its used in the UNIT_TAX_AMOUNT (a
cording of the calculation).
-
8/9/2019 Reusable Mapping
4/8
ou can see the columns that the expressions depend on (upstream) and the columns the expression is used in
ownstream) highlighted within the mapper. Also multi selecting attributes is a convenient way to see what's being used
here, below I have selected the TOTAL_TAX_AMOUNT in the target datastore and the UNIT_TAX_AMOUNT in
NIT_CALC.
ou can now see many expressions at once now and understand much more at the once time without needlessly clicking
ound and memorizing information.
ur mantra during development was to keep it simple and make the tool more powerful and do even more for the user.
he development team was a fusion of many teams from Oracle Warehouse Builder, Sunopsis and BEA Aqualogic,
bating and perfecting the mapper in ODI 12c. This was quite a project from supporting the capabilities of ODI in 11g
building the flow based mapping tool to support the future.
-
8/9/2019 Reusable Mapping
5/8
hope this was a useful insight, there is so much more to come on this topic, this is just a preview of much more that you
ill see of the mapper in ODI 12c.
ategory: ODI Technical Feature Overviews
ags: data_integrationetlodiodi-eeodi12codiee
ermanent link to this entry
Oracle GoldenGate...| Main| Replicating between...
omments:
ost a Comment:
Name: guest
E-Mail:
URL:
Notify me by email of new comments
Remember Information?
Your Comment:
HTML Syntax: NOT allowed
Please answer this simple math question
5 + 67 =
Preview Post
bout
earn the latest trends, use cases, product updates, and customer success examples for Oracle's data integration
oducts-- including Oracle Data Integrator, Oracle GoldenGate and Oracle Enterprise Data Quality
arch
nter search term:
Search only this blog
ecent Posts
Let Oracle GoldenGate 12c Take You to the Cloud
Oracle GoldenGate for Informix is Released
ODI 12c - Spark SQL and Hive?
https://blogs.oracle.com/dataintegration/entry/odi_12c_spark_sql_andhttps://blogs.oracle.com/dataintegration/entry/oracle_goldengate_for_informix_ishttps://blogs.oracle.com/dataintegration/entry/let_oracle_goldengate_12c_takehttps://blogs.oracle.com/dataintegration/entry/replicating_between_cloud_and_onhttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/entry/oracle_goldengate_12c_furthering_thehttps://blogs.oracle.com/dataintegration/entry/odi_12c_s_mapping_designerhttps://blogs.oracle.com/dataintegration/tags/odieehttps://blogs.oracle.com/dataintegration/tags/odi12chttps://blogs.oracle.com/dataintegration/tags/odi-eehttps://blogs.oracle.com/dataintegration/tags/odihttps://blogs.oracle.com/dataintegration/tags/etlhttps://blogs.oracle.com/dataintegration/tags/data_integration -
8/9/2019 Reusable Mapping
6/8
Big Data Governance and Metadata Management - A Recap
Oracle Data Integrator and Hortonworks
ODI 12c and DBaaS in the Oracle Public Cloud
Updated Statement of Direction for Oracle Business Intelligence Analytics (OBIA)
Raymond James Financial Leverages Oracle Data Integration
Automating ODI development tasks using the SDK
Big Data Governance Webcast
p Tags
11g
12c
availability
bi
big
business
cloud
customer
dataData_Integration
data_integration
Data_Integrator
database
downtime
elt
ELT
enterprise
etlETL
exadata
fusion
gate
golden
goldengate
hadoop
hdfs
high
hive
integration
integrator
java
km
MDM
migration
odi
ODI
ODI-EEogg
openworld
oracle
Oracle_Data_Integrator
Oracle_GoldenGate
https://blogs.oracle.com/dataintegration/tags/Oracle_GoldenGatehttps://blogs.oracle.com/dataintegration/tags/Oracle_Data_Integratorhttps://blogs.oracle.com/dataintegration/tags/oraclehttps://blogs.oracle.com/dataintegration/tags/openworldhttps://blogs.oracle.com/dataintegration/tags/ogghttps://blogs.oracle.com/dataintegration/tags/ODI-EEhttps://blogs.oracle.com/dataintegration/tags/ODIhttps://blogs.oracle.com/dataintegration/tags/odihttps://blogs.oracle.com/dataintegration/tags/migrationhttps://blogs.oracle.com/dataintegration/tags/MDMhttps://blogs.oracle.com/dataintegration/tags/kmhttps://blogs.oracle.com/dataintegration/tags/javahttps://blogs.oracle.com/dataintegration/tags/integratorhttps://blogs.oracle.com/dataintegration/tags/integrationhttps://blogs.oracle.com/dataintegration/tags/hivehttps://blogs.oracle.com/dataintegration/tags/highhttps://blogs.oracle.com/dataintegration/tags/hdfshttps://blogs.oracle.com/dataintegration/tags/hadoophttps://blogs.oracle.com/dataintegration/tags/goldengatehttps://blogs.oracle.com/dataintegration/tags/goldenhttps://blogs.oracle.com/dataintegration/tags/gatehttps://blogs.oracle.com/dataintegration/tags/fusionhttps://blogs.oracle.com/dataintegration/tags/exadatahttps://blogs.oracle.com/dataintegration/tags/ETLhttps://blogs.oracle.com/dataintegration/tags/etlhttps://blogs.oracle.com/dataintegration/tags/enterprisehttps://blogs.oracle.com/dataintegration/tags/ELThttps://blogs.oracle.com/dataintegration/tags/elthttps://blogs.oracle.com/dataintegration/tags/downtimehttps://blogs.oracle.com/dataintegration/tags/databasehttps://blogs.oracle.com/dataintegration/tags/Data_Integratorhttps://blogs.oracle.com/dataintegration/tags/data_integrationhttps://blogs.oracle.com/dataintegration/tags/Data_Integrationhttps://blogs.oracle.com/dataintegration/tags/datahttps://blogs.oracle.com/dataintegration/tags/customerhttps://blogs.oracle.com/dataintegration/tags/cloudhttps://blogs.oracle.com/dataintegration/tags/businesshttps://blogs.oracle.com/dataintegration/tags/bighttps://blogs.oracle.com/dataintegration/tags/bihttps://blogs.oracle.com/dataintegration/tags/availabilityhttps://blogs.oracle.com/dataintegration/tags/12chttps://blogs.oracle.com/dataintegration/tags/11ghttps://blogs.oracle.com/dataintegration/entry/big_data_governance_webcasthttps://blogs.oracle.com/dataintegration/entry/automating_odi_development_tasks_usinghttps://blogs.oracle.com/dataintegration/entry/raymond_james_financial_leverages_oraclehttps://blogs.oracle.com/dataintegration/entry/updated_statement_of_direction_forhttps://blogs.oracle.com/dataintegration/entry/odi_12c_and_dbaas_inhttps://blogs.oracle.com/dataintegration/entry/oracle_data_integrator_and_hortonworkshttps://blogs.oracle.com/dataintegration/entry/big_data_governance_and_metadata -
8/9/2019 Reusable Mapping
7/8
performance
quality
real-time
replication
sdk
table
warehouse
zero
ategories
Enterprise Data Quality Solutions and News
Enterprise Data Quality Technical Features
GoldenGate Solutions and News
GoldenGate Technical Features
ODI Solutions and News
ODI Technical Feature Overviews
ODSI News and Events
ODSI Technical FeaturesOracle Data Integration Family Solutions & News
rchives
November 2014
unMonTue WedThuFriSat
1
3 4 5 6 7 8
10 11 12 13 14 15
6 17 18 19 20 21 22
3 24 25 26 27 28 29
0
Today
enu
Blogs Home
Weblog
Login
eds
SS
All
/Enterprise Data Quality Solutions and News
/Enterprise Data Quality Technical Features/GoldenGate Solutions and News
/GoldenGate Technical Features
/ODI Solutions and News
/ODI Technical Feature Overviews
/ODSI News and Events
https://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODSI+News+and+Eventshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODI+Technical+Feature+Overviewshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODI+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FGoldenGate+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FGoldenGate+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FEnterprise+Data+Quality+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FEnterprise+Data+Quality+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rsshttps://blogs.oracle.com/roller-ui/login-redirect.rolhttps://blogs.oracle.com/dataintegration/https://blogs.oracle.com/https://blogs.oracle.com/dataintegration/https://blogs.oracle.com/dataintegration/date/20141120https://blogs.oracle.com/dataintegration/date/20141118https://blogs.oracle.com/dataintegration/date/20141112https://blogs.oracle.com/dataintegration/date/20141110https://blogs.oracle.com/dataintegration/date/20141106https://blogs.oracle.com/dataintegration/date/201410https://blogs.oracle.com/dataintegration/category/Oracle+Data+Integration+Family+Solutions+%26+Newshttps://blogs.oracle.com/dataintegration/category/ODSI+Technical+Featureshttps://blogs.oracle.com/dataintegration/category/ODSI+News+and+Eventshttps://blogs.oracle.com/dataintegration/category/ODI+Technical+Feature+Overviewshttps://blogs.oracle.com/dataintegration/category/ODI+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/category/GoldenGate+Technical+Featureshttps://blogs.oracle.com/dataintegration/category/GoldenGate+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/category/Enterprise+Data+Quality+Technical+Featureshttps://blogs.oracle.com/dataintegration/category/Enterprise+Data+Quality+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/tags/zerohttps://blogs.oracle.com/dataintegration/tags/warehousehttps://blogs.oracle.com/dataintegration/tags/tablehttps://blogs.oracle.com/dataintegration/tags/sdkhttps://blogs.oracle.com/dataintegration/tags/replicationhttps://blogs.oracle.com/dataintegration/tags/real-timehttps://blogs.oracle.com/dataintegration/tags/qualityhttps://blogs.oracle.com/dataintegration/tags/performance -
8/9/2019 Reusable Mapping
8/8
/ODSI Technical Features
/Oracle Data Integration Family Solutions & News
Comments
tom
All
/Enterprise Data Quality Solutions and News
/Enterprise Data Quality Technical Features
/GoldenGate Solutions and News/GoldenGate Technical Features
/ODI Solutions and News
/ODI Technical Feature Overviews
/ODSI News and Events
/ODSI Technical Features
/Oracle Data Integration Family Solutions & News
Comments
he views expressed on this blog are those of the author and do not necessarily reflect the views of Oracle. Terms of
se| Your Privacy Rights| Cookie Preferences
http://www.oracle.com/html/privacy.htmlhttp://www.oracle.com/html/terms.htmlhttps://blogs.oracle.com/dataintegration/feed/comments/atomhttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FOracle+Data+Integration+Family+Solutions+%26+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODSI+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODSI+News+and+Eventshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODI+Technical+Feature+Overviewshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FODI+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FGoldenGate+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FGoldenGate+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FEnterprise+Data+Quality+Technical+Featureshttps://blogs.oracle.com/dataintegration/feed/entries/atom?cat=%2FEnterprise+Data+Quality+Solutions+and+Newshttps://blogs.oracle.com/dataintegration/feed/entries/atomhttps://blogs.oracle.com/dataintegration/feed/comments/rsshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FOracle+Data+Integration+Family+Solutions+%26+Newshttps://blogs.oracle.com/dataintegration/feed/entries/rss?cat=%2FODSI+Technical+Features