BO Data Integrator

1

EIM106

What’s New for SAP

BusinessObjects Data Services 4.0

Vision and roadmap

Ben Hofmans, Product Management

October 2010

© 2010 SAP AG. All rights reserved. / Page 2

Disclaimer

This presentation outlines our general product direction and should not be relied on in making a

purchase decision. This presentation is not subject to your license agreement or any other

agreement with SAP. SAP has no obligation to pursue any course of business outlined in this

presentation or to develop or release any functionality mentioned in this presentation. This

presentation and SAP's strategy and possible future developments are subject to change and

may be changed by SAP at any time for any reason without notice. This document is provided

without a warranty of any kind, either express or implied, including but not limited to, the implied

warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP

assumes no responsibility for errors or omissions in this document, except if such damages

were caused by SAP intentionally or grossly negligent.

2


Agenda

1. SAP Enterprise Information Management and SAP BusinessObjects

Data Services

2. Vision and roadmap

3. What‘s new in Data Services 4.0

Superior SAP support

Text Data Processing

Enhanced Data Quality Management

New security model and much more


Are these terms consistent

with our business

definitions?

Can I trust this data enough

to make my critical

decisions? Has the data

passed all our business rule

checks?

How current is this data?

When was it last updated?

Where did these numbers

come from? Are we

considering all our relevant

sources?

How Good Is the Data Behind Your Dashboard

EIM adds trust in your data

3


Compliance

Failures

Lower Profits

Low

Productivity

Organizations Encounter Risk and Inefficiency

From Poorly Managed Information

Average organization loses $8.2 million annually

through poor data quality.”

Gartner

50% to 70% of ERP implementations are reported as

“challenged” in part to data integrity and/or data

accuracy problems.”

Adaptive Growth, Inc.

90% of all businesses still do not have

sufficient policies in place to meet data

governance regulations.”IT Policy Compliance Group

“

“

“


SAP Provides A Complete Approach To EIM

Encompassing People, Process & Technology

Create Monitor

Enterprise Information Management

Executive

Sponsor

Line of

Business

Owners

IT

Data

Steward

Data Integration &

Quality

Management

Master Data

Management

Content &

Information

Life-Cycle

Management

Data Warehouse

Management

PR

OC

ES

SP

EO

PL

ET

EC

HN

OLO

GY

Cleanse Integrate Manage Govern Archive

4


SAP Provides Best-In-Class EIM Solutions

Deliver Information That Is Complete, Accurate, and Accessible

Data Integration & Quality Management:

SAP BusinessObjects Data Services

SAP BusinessObjects Data Quality Management

SAP BusinessObjects Data Federator

SAP BusinessObjects Text Analysis

SAP BusinessObjects Data Insight

SAP Data Migration services

Master Data Management:

SAP NetWeaver Master Data Management

SAP Master Data Governance for Financials

Enterprise Data Warehousing:

SAP NetWeaver Business Warehouse

SAP NetWeaver Business Warehouse Accelerator

SAP BusinessObjects Rapid Marts

SAP BusinessObjects Metadata Management

Content &

Information Lifecycle Management:

SAP NetWeaver Information Lifecycle Management

SAP Extended ECM by Open Text

SAP Document Access by Open Text

SAP Archiving by Open Text


SAP Provides an Integrated End-to-End

Information Management Platform

SAP NetWeaver

BW

Data Federator

Data Services

Data Quality

ManagementData IntegratorData

Fo

un

da

tio

n

SAP NetWeaver

BW Accelerator

Master Data

Management

Text

Analysis

CRM SCM

SRM PLM

SAP Business Suite

ERP

Financials

Operations

Human Resources

Corporate Services

Data

Quality

Mgmt

3rd-Party Databases and Applications

„Classic‟ SAPSAP Business Objects

Portfolio (SBOP)3rd-Party

*SBOP Advanced Analysis (fka project Pioneer) planned for 2010

Me

ta D

ata

Ma

na

ge

me

nt

SAP NetWeaver PortalAny Portal, Any

Destination

SAP BusinessObjects Enterprise

Crystal

ReportsWeb Intelligence Xcelsius

OLAP

client

(SAP BEx,

Advanced

Analysis*)

Info

rmati

on

Access

Explorer

Mobile BI

5



Integrate and Improve the Quality of All Data

Market-leading, unified solution for

enterprise-class data integration and

data quality

Single, easy-to-use user interface to build,

test and deploy projects

Connect, transform and make the information

available from virtually any source

Comprehensive data quality solution for

cleansing and enriching all types of data

Scalable solution for high data volumes with

high throughput (batch and real-time)

SAP BusinessObjects Data Services is a ―leader‖ in the Data Integration

and Data Quality Magic Quadrants from Gartner, as well as in the Data

Integration Forrester Wave.

SAP has 5000+ customers on our Data Integration and Data Quality

solutions.

―


SAP ERP, SAP CRM,

SAP Master Data Management (MDM),

SAP NetWeaver BW, …

Webservices

Shared MetadataImpact Analysis

Data Lineage

Data

pro

filin

g


Architecture

Data

Services

Engine

Data

Auditing

Data

Validation

Data

Cleansing

Files, XML,

Mainframe,

Excel, etc.

Oracle, SQL,

DB2, etc.

PeopleSoft,

Oracle Apps,

Siebel, etc.

SAP R/3,

SAP ERP,

SAP NetWeaver BI

Query,

Reporting,

Analysis,

and Dashboards

Data Migration,

Synchronization, …

SAP NetWeaver BW

6


Agenda

1. SAP Enterprise Information Management and SAP BusinessObjects Data

Services today


3. What‘s new in Data Services 4.0






Building the EIM Suite

What we have : What we want :

Many user interfaces

Metadata spread across repositories

Multiple ways to specify rules

Multiple engines

Multiple platforms

One solution for all Information

Management tasks

Limited number of interfaces for

different types of users

Seamless metadata

DS

(DI+DQ)

TA

BOMM

Data

Insight

MDM

Design Administer

Stewardship/

Governance

Universe

Designer

This presentation and SAP‗s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind,

either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement

7


IM Solution Suite Goals

Tools

Business User UI Designer Administration

Users Developers Administrators

Data Stewards & Business Analysts

Pla

tform

Core Platform Services (security, user management, scheduling, ...)Provided by SAP BusinessObjects BI platform

Serv

ices

ETL DQ Profile Text MetadataBusiness User FocusTypically, IM products have not

been focused on the non-IT

users. The interfaces are much

too technical for even those

tasks that require considerable

business knowledge and input.

We plan to change that.

Data Governance and TrustIM provides the key elements that enable governance and improve trust in

the data infrastructure. From data quality to profiling to business metadata,

we plan to bring key IM capabilities in service of governance initiatives.

Integrated IM SuiteThe cost of IM deployments has

been raised by piecemeal,

disconnected tools. An integrated

suite based on a common

platform will reduce development

and operating costs.




SAP Completeness of Vision:

EIM Portfolio Consolidation and Integration

TextAnalysis

MetadataManagement

Data Integration

Data QualityManagement

SBOPData Services

SBOP Data Insight

SBOP Information

Steward

Master Data Management

Data Profiling

SBOP Metadata Mgmt

SAP NW MDM

SBOPText Analysis

Current Next VersionSolution



8




TextAnalysis

MetadataManagement

Data Integration


SBOPData Services

SBOP Data Insight

SBOP Data Services

SBOP Information

Steward


Data Profiling

SBOP Metadata Mgmt

SAP NW MDM

SBOPText Analysis







TextAnalysis

MetadataManagement

Data Integration


SBOPData Services

SBOP Data Insight

SBOP Information Steward 4.0

SAP NWMDM


Data Profiling

SBOP Metadata Mgmt

SAP NW MDM

SBOPText Analysis


SB

OP

BI pla

tform

SBOP Data Services 4.0DQM SDK 4.0



9


SAP BusinessObjects Information Steward

Product Vision

Empower business and IT users with a single environmentto discover, assess, define, monitor, and improve

the quality of their enterprise data asset

Define

Define business

terms, validation

rules, cleansing rules,

models

Define data

ownership:

Assign data ownership,

accountability & roles

Discover

Discover & understand

enterprise data

Data profiling,

Metadata management

Catalog data

assets

Monitor & Remediate

Surface data

quality score in

business user

applications

Workflows to

resolve data

quality issues

Monitor

data

quality

SAP

BusinessObjects

Information

Steward




SAP BusinessObjects Data Services 4.0

SAP BusinessObjects Data Services 4.0 is the Data Integration and Data Quality

Management platform for other SAP products:

SAP BusinessObjects Information Steward

Data Services provide metadata browsing and profiling services

Exchange of validation rules between Information Steward and Data Services

HANA (High-performance analytical appliance)

Data Services provides data loading from SAP and non-SAP data to load into in-memory

database

SAP BusinessObjects Financial Information Management (FIM)

Data Services provides access to SAP and non-SAP data for loading into EPM apps

SAP BusinessObjects Data Services 4.0 is also a standalone product for all your Data

Integration and Data Quality Management needs. New functionality in the core Data

Services 4.0 release :




New security model … and much more



10


Agenda

1. SAP Enterprise Information Management and

SAP BusinessObjects Data Services today


3. What‟s new in Data Services 4.0






SAP Integration: Current Functionality

Data Services XI 3.2

Data Services is the recommended ETL tool to load non-SAP data into SAP NetWeaver

BW. This provides customers with :

En easy-to use interface to access any data source without requiring to write code (no

SQL/ABAP)

Broad connectivity from files, databases, applications and even mainframe (via

partner)

Add trust to your data by cleansing and validating data before loading into BW

Data Services can access SAP ERP data via a patented approach where ABAP programs

are generated based on the graphical dataflow design created in Data Services Designer

This allows non-BW customers to extract data from SAP via Data Services

BW customers have direct access to SAP ERP data via the business content

extractors, which provides better connectivity to SAP ERP then Data Services‘ ABAP

approach:

– Extractor provide delta queues for simple changed data capture

– Extractors are ―trusted‖ sources maintained and delivered by the business suite to

guarantee consistent data

11


Extractor Support for Native Access to

Business Suite Data

With Data Services 4.0 customers will be able to access the business content extractors

natively (no BW required)

No other tool – apart from BW – will be able to access these extractors.

Benefits of using extractors :

They are delivered by the SAP Business Suite team and are the recommended method for

getting consistent data out of the SAP Business Suite apps.

They include support for delta queues (changed data capture) .

– Note: in order to get delta queue support customer will also need to update to the latest

NetWeaver versions.

Simpler deployment : no ABAP programs created/uploaded to SAP, data is streamed (no

file transfer)

How extractors are used in Data Services 4.0 :

Browse available extractors in the SAP system

Select and extractor and import the definittion (metadata) in Data Services

Drag & drop an extractor as a source in your dataflows

– Simple options are provided to define delta loads vs. full loads

– Extractors can be joined with tables in case they provide not all data required in your

project.This presentation and SAP‗s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind,



Extractor Support: Customer Benefits

BW customers

Can now easily apply data quality transformations when loading SAP data into BW

Can now use one single tool to define all extraction, validation and cleansing rules to

load all data (SAP and non-SAP) into BW.

Remark: BW customers can continue to access the extractors directly, they are not

forced to use Data Services !

Non-BW customers

Now get native access to the Business Suite without requiring to go through BW.

SAP

Business Suite

All 3rd-Party

Data SourcesSAP BusinessObjects

Data Services

SAP Extractors

DWH,

data marts,

applications, ...

SAP NetWeaver

BW



12


SAP Integration: Extractor Support

Use extractors in a data flow like a

regular source

Browse & import extractors in an

SAP applications datastore




Other SAP Integrations: Data Services for

SAP BW 7.3

Integrated Data Services connectivity in NetWeaver BW 7.3

From within the BW workbench, browse external metadata through Data Services

connectivity

Auto-generate simple Data Services extraction jobs from to load data from any source into

SAP BW

Native loading in BW 7 datastores through new staging BAPIs

No longer required to go via BW 3.5 emulation mode



13


Other SAP Integrations: SAP Solution Manager

7.1

SLD (System Landscape Directory) :

During installation register Data Services components (Job Server, Access Server, and

Management Console) in SLD.

Provide customers a single place to see all SAP software installed in their landscape.

Provide monitoring/performance statistics with CA Wily/Introscope

CPU/memory usage and total execution time at job level as well as aggregated for job

server and host.

Predefined dashboards for Data Services delivered as part of Solution Manager content.




Agenda

1. SAP Enterprise Information Management and SAP BusinessObjects Data

Services today







14


Data Explosion

A Natural Result of Modern Societies, Businesses, and the Internet

Source: IDC, 2009

Data created each year


80% of Data Is Unstructured

Source: IDC

Unstructured information

Structured information

15


Text Data Processing Capabilities

Access text data in log files, spreadsheets, surveys, comments fields and in similar places

Sort through the noise of unstructured content by automatically identifying what your text

content is ―about‖

Who, what, where, when, how much, etc


Text Data Processing on the Data Services

Platform

Native Text Data Processing on the Data Services platform

with the Entity Extraction transform to extract :

Predefined entities (like company, person, firm, city,

country, …)

Sentiment Analysis (e.g. Strong positive, Weak positive,

Neutral, Weak Negative, Strong Negative)

Custom entities (customized via dictionaries)

Languages supported (for version 4.0)

English

German

French

Spanish

Japanese

Simplified Chinese



16


Agenda









© 2010 SAP AG. All rights reserved. / Page 32© SAP 2009 / Page 32

What is Data Quality Management ?

Guarantee Clean and Accurate Data

CONTINUOUS

MONITORINGMEASURE

ANALYZE

PARSE

STANDARDIZE

CORRECT

ENHANCE

MATCH

CONSOLIDATE

Data Assessment

Enhance

Data Cleansing

Match &

Consolidate

Continuous Monitoring

Data Cleansing: automatically

correct your data based on

reference data and data

cleansing rules

Address cleansing

Data Cleansing

Data Enhancement: enhance

the data with additional

attributes.

E.g. geocoding : adding

latitude and longitude

information

Match and Consolidate:

finding duplicates and merging

records into one consolidated

record

Data Quality Management on the Data Services platform includes :

17


Expanding The Geographical Reach in Data

Services 4.0

Address Cleansing

240 countries covered of which 37 with country specific directories

New in Data Services 4.0 : street level validation for China

Geocoding

Support for United States, Canada, UK, France and Germany

New in Data Services 4.0 : adding Austria and Switzerland

*City Level Validation

*Street and House Level Validation

new




Data Services 4.0 & Information Steward :

Introducing Cleansing Package Builder

Empowers data stewards/domain experts to develop custom data cleansing solutions for

ANY data domain

Allows users to:

Enhance and change regional cleansing packages for person and firm data

Easily and quickly develop new data cleansing solutions for non-party data

AUTOMATICALLY creates the dictionary

lists, rules, and patterns in a single

repository which is published to the

Data Services Data Cleanse transform

Note: Cleansing Package Builder will not

be available in the initial Data

Services 4.0 release but will be

added in 2011



18


Customer‘s Application (Provides the ―Platform‖ for DQM SDK)

C++, Java, or

.Net API‟s

New Data Quality Management SDK

Embed Data Quality natively in any application

Data Services Platform

Pass in data for

processing via API

Retrieve operational

metadata via APIReference

Data Files

Specify Data

Quality Rules via

XML passed to API




Agenda









19


SAP BusinessObjects Data Services 4.0 and

SAP BusinessObjects Enterprise 4.0

This integration offers many new features to the Data Services customers :

Single location to store all users, passwords and connections to repositories

Advanced user management with password policies and advanced security features

Use external authentication mechanisms like Active Directory, LDAP or SAP NetWeaver

Manage permissions to control access to repositories and administative tasks to more

granular level.

Tools

Business User UI Designer Administration

Users Developers Administrators

Data Stewards & Business Analysts

Pla

tform

Core Platform Services (security, user management, scheduling, ...)Provided by SAP BusinessObjects Enterprise

Serv

ices

ETL DQ Profile Text Metadata

SAP BusinessObjects

Data Services 4.0

leverages the

SAP BusinessObjects

Enterprise 4.0 platform

for its user management.




SAP BusinessObjects Information Platform

Services 4.0

Customer already using the BI and EIM solutions from SAP BusinessObjects can now

maintain all users and permission in one central CMS (Central Management Server).

Customers who don‘t have SAP BusinessObjects BI platform 4.0 will be able to use the SAP

BusinessObjects information platform services for their Data Services user management.

Information platform services is :

A mini-version of SAP BusinessObjects BI Platform with only the CMS and related

sercices (no reporting or dashboard engines)

Offers all platform functionality from like user management, authentication, authorization,

scheduling, job processing, ...

Available for all Data Services customers from their Data Services download.



20


Conclusion

SAP BusinessObjects Data Services 4.0 is the foundation for SAP‟s EIM

portfolio offering Data Integration and Data Quality management for any

source, SAP or non-SAP, structured or unstructured data.

New features on the Data Services in this version is centered around :




New security model

… and much more …

With the introduction of Information Steward 4.0, a new user interface for the

business user will enable smooth collaboration between IT and Business to

manage the information in their organizations.




Further Information

SAP Public Web:

SAP Developer Network (SDN): http://www.sdn.sap.com/irj/sdn/ds

SAP BusinessObjects Data Services wiki on SDN : http://wiki.sdn.sap.com/wiki/display/BOBJ/BusinessObjects+Data+Services+Tips+and+Tricks

Related SAP Education and Certification Opportunities

http://www.sap.com/education/

Related Workshops/Lectures at SAP TechEd 2010

EIM105 , Product Preview: The Next Generation of Data Quality Assessment and

Analysis , Lecture (1 hour)

EIM108 , SAP BusinessObjects EIM Architecture Guidelines , Lecture (1 hour)

EIM160 , Getting Started with SAP BusinessObjects Data Services ,

Hands-on (2 hours)

http://www.sdn.sap.com/irj/sdn/ds

http://wiki.sdn.sap.com/wiki/display/BOBJ/BusinessObjects+Data+Services+Tips+and+Tricks

http://www.sap.com/education/

21


Further Information

Related Workshops/Lectures at SAP TechEd 2010 <continued>

EIM100, Enterprise Information Management Overview, Lecture

EIM104, SAP Best Practices for Data Migration , Lecture

EIM107, Resolve Those Data Quality Headaches in Your SAP Systems , Lecture

EIM109, RapidMarts: Building a Data Mart Solution for SAP ERP Within a Week ,

Lecture

EIM110, Use Text Analysis to Discover What Your Customers Say About You

When You're Not Looking! , Lecture

EIM164, SAP Best Practices for Data Migration: Hands-on Session , Hands-on

EIM201, Enterprise Information Management and Metadata Management Around

SAP NetWeaver BW 7.3 , Lecture

EIM261, Utilize SAP NetWeaver BW Accelerator and SAP BusinessObjects

Explorer to Analyze Huge Amounts of Non-SAP Data , Hands-on

ContactFeedback

Please complete your session evaluation.

Be courteous — deposit your trash,

and do not take the handouts for the following session.

22


No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.

IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation.

Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.

Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.

Oracle is a registered trademark of Oracle Corporation.

UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.

HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

Java is a registered trademark of Sun Microsystems, Inc.

JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape.

SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.

Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. in the United States and in other countries.

All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.

The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG.

This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice.

SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitation shall not apply in cases of intent or gross negligence.

The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.

© 2010 SAP AG. All Rights Reserved

BO Data Integrator

Documents

Transcript of BO Data Integrator