Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate...

19
Accelerate information on demand with Dynamic Warehousing Dynamic Warehousing Dynamic Warehousing Dynamic Warehousing TAN Ser Yean Regional Technical Manager Information Management IBM Software ASEAN

Transcript of Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate...

Page 1: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

Accelerate information on demand with Dynamic WarehousingDynamic WarehousingDynamic WarehousingDynamic Warehousing

TAN Ser YeanRegional Technical Manager

Information ManagementIBM Software ASEAN

Page 2: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

1

What Is Business Intelligence?

BI is the process of gathering, consolidating, and analyzing data from multiple sources for strategic decision making

• BI derives new value from your transactional data

• BI supports strategic planning, monitoring, and efficiency

• BI delivers knowledge of the customer, suppliers, and sales channels

• BI unifies the enterprise with a single version of the truth

Page 3: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

2

Business Intelligence Architecture

Operational Databases

Extract, transform,

merge, load

Line of Business

Data Marts

Enterprise

Data Warehouse

End User

Analytic ToolsQuery & ReportingData Mining

metadataETL

A single version of the truth

Slices of data for departments

End userDelivery & analysis

Information Integration

Operational Systems

Reporting&

Analysis

Score Carding,Dashboarding

& Event Management

Financial & OpsPlanning,

Budgeting &Forecasting

Page 4: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

3

IBM’s Holistic approach to building a Warehouse

Server

cpu n

cpu n-1

cpu 2

cpu 1

I/O Channels

BCU

memory

Server

cpu n

cpu n-1

cpu 2

cpu 1

I/O Channels

BCU

memory

Server

cpu n

cpu n-1

cpu 2

cpu 1

I/O Channels

BCU

memory

Server

cpu n

cpu n-1

cpu 2

cpu 1

I/O Channels

BCU

memory

Data Assets Layer

Data Acceleration Layer

Business Access Layer

Application Neutral Model, near 3rd NF,

EII and EAI

Business Solution Templates (BSTs)

Data Warehouse Edition (DWE) Enabled Analytics

Provide neutral Provide neutral layer as the layer as the foundationfoundation

Enable Enable performance performance

analytics analytics Mining, OLAPMining, OLAP

Business views, Business views, questions or questions or

business business processprocess

Create Create standard standard building building blocks to blocks to simplify simplify grown grown

and and capacitycapacity

Page 5: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

4

Dynamic warehousingExtending beyond the warehouse to enable information on demand

Process management

Enterprisedata modeling

Informationintegration

Search and text analytics

Master data management

Industryperspective

Traditional warehouse

Page 6: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

5

SOA Infrastructure

Process management

Enterprisedata modeling

How IBM Enables Dynamic WarehousingIntegrated offerings to enable information on demand

Informationintegration

Search and text analytics

Master data management

IBM FileNet BPMWebSphere BPM

IBM Rational®

Data Architect

IBM InformationServer

IBM WebSphereCustomer CenterProduct Center

IndustryperspectiveIBM industrydata models

IBMDB2 Warehouse

Traditional warehouse

IBM OmniFind™

Analytics Edition

Page 7: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

6

Business Intelligence Architecture

Operational Databases

Extract, transform,

merge, load

Line of Business

Data Marts

Enterprise

Data Warehouse

End User

Analytic ToolsQuery & ReportingData Mining

metadataETL

A single version of the truth

Slices of data for departments

End userDelivery & analysis

Information Integration

Operational Systems

Page 8: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

7

The IBM Solution: IBM Information ServerDelivering information you can trust

IBM Information Server

Understand Cleanse Transform Deliver

Discover, model, and govern information

structure and content

Standardize, merge,and correct information

Combine and restructure information

for new uses

Synchronize, virtualizeand move information

for in-line delivery

Platform Services

ParallelProcessing

Services

ConnectivityServices

MetadataServices

DeploymentServices

AdministrationServices

Parallel Processing

Rich Connectivity to Applications, Data, and Content

Understand Cleanse Transform Deliver

Discover, model, and govern information

structure and content

Standardize, merge,and correct information

Combine and restructure information

for new uses

Synchronize, virtualizeand move information

for in-line delivery

Unified Deployment

Unified Metadata Management

Page 9: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

8

Extract, Transform and Load (ETL) – IBM Datastage

� Codeless visual design of data flows with hundreds of built-in transformation functions

� Reuse of data integration objects

� Ability to track changes

� Impact analysis of changes

Transform

Transform and aggregate any volume of information in batch or real time

through visually designed logic

Hundreds of Built-inTransformation Functions

ArchitectsDevelopers

IBM DataStage®

Page 10: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

9

Business Intelligence Architecture

Operational Databases

Extract, transform,

merge, load

Line of Business

Data Marts

Enterprise

Data Warehouse

End User

Analytic ToolsQuery & ReportingData Mining

metadataETL

A single version of the truth

Slices of data for departments

End userDelivery & analysis

Information Integration

Operational Systems

Page 11: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

10

IBM DB2 Warehouse 9.5 Complete and integrated services

Database management

Performance optimization

Embedded analytics

Data mining & visualization

IBM DB2 Warehouse

In-line analytics

Cubing Services

Unstructured Analytics

Mo

deli

ng

an

d d

esig

n

Ad

min

istr

ati

on

an

d c

on

tro

l

Data movement and transformation

Workload

management

Database

partitioning

Deep

compression

Page 12: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

11

Row CompressionReduces the cost of data storage

Dictionary contains repeated information from the rows.

Fred, Dept 500, 10000, Plano, TX, 24355…Fred, Dept 500, 10000, Plano, TX, 24355…

Fred, (01), 10000, (02), John, (01), 20000, (02)

……

Plano, TX, 2435502

Dept 50001

John, Dept 500, 20000, Plano, TX, 24355, Site 3John, Dept 500, 20000, Plano, TX, 24355, Site 3

179.9 GB179.9 GB

42.5 GB42.5 GB

76% 76%

Smaller!Smaller!

Page 13: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

12

MOLAP in the database

Cubing Services

SQL

MDX

MDX

MDX

DB2 Warehouse

ExcelAlphabloxReporting Tool

Page 14: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

13

Min

ing

engin

e

Category Item

[Call Taker] James

[Date] 2002/08/30

[CustomerID] ADC00123

[type] Claim

[Involved Parties]

John Jones

Jack Smith

[Vehicle type] Truck

[Incident Type] Parking

Extractedmetadata

Query & visualization through standard tooling

Call Taker: James

Date: Aug. 30, 2002

Duration: 10 min.

CustomerID: ADC00123

D: Details of incident in

motor vehicle claim

including involved

parties

Unstructured data

Structured Data

Original Data

� Rich analysis framework for extracting knowledge from unstructured data

� Enables native processing in the warehouse and includes two annotators

(dictionary and pattern based extractors)

Unstructured analytics framework Standard analysis tools

Integrated Unstructured AnalyticsReach farther

Basiclinguisticanalysis

Page 15: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

Introducing IBM Balanced WarehouseTM

A fast track to warehousing

Simplicity� Predefined configurations for reduced

complexity� One number to contact for complete

solution support

Flexibility for growth

� Add BCUs to address increasing demands

� Multiple on-ramps for different needs

� Reliable, nonproprietary hardware for reusability

Optimized performance

� Preconfigured and certified for guaranteedperformance

� Based on best practices for reduced risk

Balanced Configuration Unit (BCU)

Preconfigured, pretested allocation of software, storage and hardware to support a specified combination of function and scale

Better than an appliance

Balanced WarehouseSIMPLEFLEXIBLE

OPTIMIZED

Page 16: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

15

IBM Balanced Warehouse™

The IBM Balanced Warehouse™ can be broken down into 3 different solution

classes that each target and serve a distinct warehousing market segment.

C-Class D-Class E-Class

Enterprise SolutionsGrowth SolutionsApplication Solutions

Class Name

Performance

Highly Scalable Enterprise Data

Warehouses

Advanced Departmental Data Marts

and Smaller Data Warehouses

Entry-point for Smaller Warehousing

Applications and Reporting Tools

Price Range $15 to $160K $890K to over $1.8M (With 1 BCU)

Scalability High - BCU Very High - BCULimited

Size 1TB to 5TB* 1TB and Up50GB to 1TB

NOTE: * Can scale higher if needed

Users No Hard LimitsUp to 200 Users

Segment

$220K to $280K (With 1 BCU)

Page 17: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

16

Banking(Banking Data Warehouse)

Financial Markets(Financial Markets Data Warehouse)

� Claims

� Medical management

� Provider and network

� Sales, marketing and membership

� Financials

� Profitability

� Relationship marketing

� Risk management

� Asset and liability management

� Compliance

� Risk management

� Asset and liability management

� Compliance

Health Plan(Health Plan Data Warehouse)

� Customer centricity

� Claims

� Intermediary performance

� Compliance

� Risk management

Retail (Retail Data Warehouse)

� Customer centricity

� Merchandising management

� Store operations and product management

� Supply chain management

� Compliance

Telco(Telecommunications Data Warehouse)

� Churn management

� Relationship management and segmentation

� Sales and marketing

� Service quality and product lifecycle

� Usage profile

Insurance(Insurance Information Warehouse)

Industry data modelsLeverage industry best practices for faster time to market

Over 400 Customers!

Page 18: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

17

Business Solution TemplatesKick start your data warehouse

•Customer Interaction Analysis

•Customer Investment Profile•Individual Customer Profile

•Wallet Share Analysis

Relationship Relationship

MarketingMarketing

•Outstandings Analysis

•Portfolio Credit Exposure•Security Analysis

•Liquidity Risk•Collections Analysis

•Insurance Risk Profile

RiskRisk

•Transaction Analysis

•Activity Based Costing Analysis•Insurance Product Analysis

•Investment Arrangement AnalysisProfitabilityProfitability

•Capital Allocation Analysis•Capital Procurement

•Credit Loss Provision

•Funds Maturity Analysis•Income Analysis

Asset & Liability Asset & Liability

Management Management

•Interest Rate Risk Analysis

•Credit Risk Profile

•Credit Risk Assessment•Credit Risk Mitigation Assessment

•Asset Securitization Analysis •Operational Risk Assessment

•European Central Bank Reporting•Financial Capital Adequacy Analysis

•Structure Of Regulatory Capital

•Foreign Financial Account Analysis•Suspicious Activity Analysis

•Transaction Activity Analysis•SOA Balance Sheet Analysis

•SOA Cash Flow Analysis

•SOA Statement Of Change In Shareholders' Equity Analysis

•SOA Statement Of Income Analysis

ComplianceCompliance

�Balance Sheet Portfolio Basis Approach Analysis�Balance Sheet Classified Approach Analysis�Balance Sheet Order Of Liquidity Approach Analysis�Balance Sheet Net Assets Approach Analysis�Cash Flow Direct Analysis�Cash Flow Indirect Analysis

•Customer Complaints

•Delinquency Analysis

•Customer Loyalty•Market Analysis

•Campaign Analysis

•Cross Sell Analysis

•Customer Attrition •Customer Behavior

•Lead Analysis

•Product Profitability

•Product Analysis•Organization Unit Profitability

•Performance Measurement•Business Procedure Performance

•Profitability Analysis

•Channel Profitability•Customer Lifetime Value

•Customer Profitability•Location Profitability

•Authority Profiling

•Credit Risk Analysis

•Debt Restructuring •Involved Party Exposure

•Location Exposure•Non Performing Loan

•Operational Risk Loss Analysis

•Interest Rate Sensitivity

•Liquidity Analysis

•Short Term Funding Management•Financial Management Accounting

•Net Interest Margin Variance•Structured Finance Analysis

•Equity Position Exposure

•Position Valuation Analysis

�Cash Flow Direct Financial Institution Analysis�Cash Flow Indirect Financial Institution Analysis�Income Statement By Function Analysis�Income Statement By Nature Analysis�Income Statement Financial Institution Approach Analysis�Statement Of Changes In Equity Analysis

Page 19: Accelerate information on demand with Dynamic WarehousingWarehousing+IOD_Ser+… · Accelerate information on demand with Dynamic Warehousing ... Jack Smith [Vehicle type] Truck ...

18

Business Intelligence Architecture

Operational Databases

Information Integration

Line of Business

Data Marts

Enterprise

Data Warehouse

End User

Analytic ToolsQuery & ReportingData Mining

metadataETL

DB2 WarehouseIBM Servers & Storage

DB2 WarehouseIBM Data Models

InformationServer

Operational Systems