EMC IT BI Strategy Update

17
1 © Copyright 2009 EMC Corporation. All rights reserved. EMC IT BI Strategy Update

description

EMC IT BI Strategy Update. Table of Contents. Information Management Core Disciplines Journey to Date Background Vision Progress to Date Example: BI Grid Opportunities Master Data Management / Data Quality. A. B. C. D. Information Management Core Disciplines. - PowerPoint PPT Presentation

Transcript of EMC IT BI Strategy Update

Page 1: EMC IT  BI Strategy Update

1© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT BI Strategy Update

Page 2: EMC IT  BI Strategy Update

2© Copyright 2009 EMC Corporation. All rights reserved.

Table of Contents

Information Management Core Disciplines

Journey to Date

– Background

– Vision

Progress to Date

– Example: BI Grid

Opportunities

– Master Data Management / Data Quality

A

B

C

D

Page 3: EMC IT  BI Strategy Update

3© Copyright 2009 EMC Corporation. All rights reserved.

• Guarantees data availability where and when it is required

• Movement and transformation of enterprise information

• Interconnectivity of IT portfolio

• Standardized formats and service interfaces – SOA

Data Data IntegrationIntegration

• Identification and deduplication of shared master data

• Cross-referencing and disambiguation

• Hierarchy management• Data governance framework

and stewardship processes

Master Data Master Data ManagementManagement

• Unstructured data storage and management

• Workflow-based publishing & versioning services

• Tie-in to enterprise portal and user identity / security strategies

Content Content ManagementManagement

• Framework and organization to ensure management of data as a strategic corporate asset

• Data stewardship• Policies and procedures;

monitoring and measuring

Data Data GovernanceGovernance

• Data warehouse methodology – envisioning to deployment

• Business use-case- or function-specific datamarts / reporting solutions

• Moving with agility fromreactive to predictive capability

Business Business IntelligenceIntelligence

• Assurance that trustworthy data is accessible at time of demand

• Standardization& cleansing• Business data rule

enforcement• Stale data refresh• Augmentation from external

sources

Information Information QualityQuality

Information Management Core Disciplines

Page 4: EMC IT  BI Strategy Update

4© Copyright 2009 EMC Corporation. All rights reserved.

BI Journey to Date

BI Roadmap launched in 2007

Objective:

“Define the target BI and Reporting services delivery model which will serve as the compass for future BI projects, including:

– BI Reference architecture– Services delivered from IT– Delivery Roadmap– Organization structure and processes needed to support delivery model“

Assessment Included Identifying:– Limitations in the existing BI and Reporting environment– Capability gaps– Opportunities to improve efficiency and quality of service

TOC

2007“Assess”

2008

“Enable”

2009

“Prove”

2010

“Get Value”

2011…

Page 5: EMC IT  BI Strategy Update

5© Copyright 2009 EMC Corporation. All rights reserved.

Architecture Findings:

•Existing tool set was obsolete•Lacked advanced visualization•Aging infrastructure unable to scale•Redundant hardware and data•Disparate BI architectures•Complex support structure•Multiple points of reconciliation •No tiering or archiving strategy

Business Impact:

•Customer dissatisfaction -> Shadow•Data is incomplete / quality•Increased infrastructure costs•Increased support costs•Increased Business costs

Architecture Findings

Oracle 11.0.3

Source SystemsSource Systems

Oracle 11i

Peoplesoft

SABA

eTime

EAS

NRT

DW SystemsDW Systems

IDW

EDW

CQDM

GS

Finance

HR

Marketing

Sales

ETLETL

Page 6: EMC IT  BI Strategy Update

6© Copyright 2009 EMC Corporation. All rights reserved.

Governance Findings

Business

BTG

Delivery

Assets

Governance Findings:

•Limited cross functional awareness •No cross functional prioritization•Inconsistent collaboration•Master Data management / data quality ownership•Functional bottom up reporting

Business Impact:

•Business lacks confidence in data •Reverts to gut based decisions•Analysts “fixing” data vs. using data•Redundant / wasted effort•Inconsistent metrics

NRTSales / TS

IDWFinance

EDWGS

IQDFCQ

ERG COPSERG G & A

ERG GS ERG CQ

BTGSales

BTGTS

BTGFinance

BTGGS

BTGCQ

Sales TS Finance GS CQ

Page 7: EMC IT  BI Strategy Update

7© Copyright 2009 EMC Corporation. All rights reserved.

BI Cloud Vision

Oracle 11.0.3

Source SystemsSource Systems

Oracle 11i

Peoplesoft

SABA

eTime

EASEnterprise Information

Business Information

ETL

Business Intelligence

Business

Rules

Analyze

Operational Users

Management Users Analytical Users

C O M MNO

AC C E S S

L A Y E R

Cleansed – Standardized – Consolidated - Reliable

Business Rules Applied – Actionable - Measures

Planning – Forecasting – Trending – Performance Management

Page 8: EMC IT  BI Strategy Update

8© Copyright 2009 EMC Corporation. All rights reserved.

Progress to Date

Projects:•OBI Enterprise Infrastructure•OBI POC w/ SMF

Value: Foundational

Projects:•SMF•HR Analytics•GS Skills•BI Grid Replatform•FARM Tool

Value: NPV $4M

Projects:•GDW Wave 1 (CS)•GDW Wave 2 (Sales & Finance)•Corporate Quality•TS

Value: NPV $18.2M

* Requested in budget

Page 9: EMC IT  BI Strategy Update

9© Copyright 2009 EMC Corporation. All rights reserved.

BI Grid: Live November 2009

Platform for FuturePlatform for Future

DMX to V-MAX ArchitectureDMX to V-MAX ArchitectureFirst Deployment of EFD and First Deployment of EFD and Tiered Data LayoutTiered Data Layout Unix to Linux Migration with 6 Unix to Linux Migration with 6 Node GridNode GridSun Solaris to X-86 ArchitectureSun Solaris to X-86 ArchitectureData ILMData ILMServices Configured for each Services Configured for each Major FunctionMajor Function

Massive Massive Performance GainsPerformance Gains

10x Performance Gains for Day 10x Performance Gains for Day 1 Processing1 Processing180% improvement in batch job 180% improvement in batch job performanceperformanceDatamart update times cut in halfDatamart update times cut in half200% improvement in dashboard 200% improvement in dashboard renderingrendering2-3x performance improvement 2-3x performance improvement in reporting cube build timein reporting cube build time

Seamless CutoverSeamless Cutover

15 Billion Rows/10TB of 15 Billion Rows/10TB of Data MigratedData MigratedEnd to end Leverage of End to end Leverage of EMC TechnologyEMC Technology110 hour Cutover110 hour Cutover

Significant Significant Reduction in TCOReduction in TCO

3X Reduction in Storage 3X Reduction in Storage footprintfootprintServer footprintServer footprintConsolidation of Databases Consolidation of Databases

IT Proven IT Proven

IT and Engineering IT and Engineering Collaboration Collaboration Development and Validation of Development and Validation of Engineering Best PracticesEngineering Best PracticesPublication of White Paper Publication of White Paper Engagement with Partners Engagement with Partners (Informatica and ZettaPoint)(Informatica and ZettaPoint) Reduction in backup time from Reduction in backup time from 16 to 4 hours 16 to 4 hours

Page 10: EMC IT  BI Strategy Update

10© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT – Consolidated Oracle optimized Warehouse using Symmetrix V-MAX

EFD (R5)

FC, SATA (R10)

FC, SATA (R5)

SATA (R5)

BCV/CloneBCV/Clone

Dynamic SRDF PRODUCTION

Perf

Global Data Warehouse

BACKUP Copy

TEST

Primary Site Secondary Site

GOLD Copy

BCV/CloneBCV/Clone BCV/CloneBCV/Clone

DRFC, SATA (R10)

FC, SATA R(10)

SATA (R5)

SATA (R5)

EMC Symmetrix V-MAXEMC Symmetrix V-MAX512 GB Cache512 GB Cache

400 GB 400 GB Flash DrivesFlash Drives

300 GB - 15K RPM 300 GB - 15K RPM Fibre DrivesFibre Drives

1 TB - 7200 RPM 1 TB - 7200 RPM SATA DrivesSATA Drives

DEV

Global Data Warehouse

Flash DrivesFlash Drives – Objects with – Objects with most stringent response timemost stringent response time

Fibre DrivesFibre Drives – Objects from – Objects from current & recent few quarterscurrent & recent few quarters

SATA DrivesSATA Drives – Historical data – Historical dataNRT Dev

REVD PASD

NRT Prod

REVP PASP OICP

NRT Test

REVT PAST OICT

FC, SATA (R10)

SATA (R5)

SATA (R5)

Page 11: EMC IT  BI Strategy Update

11© Copyright 2009 EMC Corporation. All rights reserved.

EMC IT - BI Grid DB - Environment Architecture

Primary SitePrimary Site

Production

Backup Copy Gold Copy

Development Test

DR

Performance

Dynamic SRDF

Secondary SiteSecondary Site

BCV/CloneBCV/Clone

7 am

7 am

7 pm7 pm

BCV / CloneBCV / Clone

Production

6 x Dell 710

Development & Test

4 x Dell 710

DR & Performance

6 x Dell 710

ST

AT

N5K-PAC-1200W

FAIL

OK

N5K-PAC-1200W

FAIL

OK

FAN STATUS

N5K-C5020-FAN

1

FAN STATUS

N5K-C5020-FAN

2

FAN STATUS

N5K-C5020-FAN

3

FAN STATUS

N5K-C5020-FAN

4

FAN STATUS

N5K-C5020-FAN

5

PS

1P

S2

ST

AT

N5K-PAC-1200W

FAIL

OK

N5K-PAC-1200W

FAIL

OK

FAN STATUS

N5K-C5020-FAN

1

FAN STATUS

N5K-C5020-FAN

2

FAN STATUS

N5K-C5020-FAN

3

FAN STATUS

N5K-C5020-FAN

4

FAN STATUS

N5K-C5020-FAN

5

PS

1P

S2

Cisco Nexus 5020s for 10G RAC Interconnect

ST

AT

N5K-PAC-1200W

FAIL

OK

N5K-PAC-1200W

FAIL

OK

FAN STATUS

N5K-C5020-FAN

1

FAN STATUS

N5K-C5020-FAN

2

FAN STATUS

N5K-C5020-FAN

3

FAN STATUS

N5K-C5020-FAN

4

FAN STATUS

N5K-C5020-FAN

5

PS

1P

S2

ST

AT

N5K-PAC-1200W

FAIL

OK

N5K-PAC-1200W

FAIL

OK

FAN STATUS

N5K-C5020-FAN

1

FAN STATUS

N5K-C5020-FAN

2

FAN STATUS

N5K-C5020-FAN

3

FAN STATUS

N5K-C5020-FAN

4

FAN STATUS

N5K-C5020-FAN

5

PS

1P

S2

Cisco Nexus 5020s for 10G RAC Interconnect

BC

V /

Clo

ne

BC

V /

Clo

ne

BC

V/C

lone

BC

V/C

lone

BCV/Clo

ne

BCV/Clo

ne

FibreSATAFlash

FibreSATA

Oracle 11g RAC, ASM & RDBMSOracle 11g RAC, ASM & RDBMS

Fibre SATA SATA

SATA SATA

RMAN Backup HostRMAN Backup Host

DB Subset HostDB Subset Host

FibreSATA

Fibre

EDLEDL

Flash DrivesFlash Drives – Objects with – Objects with most stringent response timemost stringent response time

Fibre DrivesFibre Drives – Objects from – Objects from current & recent few quarterscurrent & recent few quarters

SATA DrivesSATA Drives – Historical data – Historical data

Fibre

2 TB

/ H

r

2 TB

/ H

r

Page 12: EMC IT  BI Strategy Update

12© Copyright 2009 EMC Corporation. All rights reserved.

Highlights 67% reduction on Incremental NRT Batch (56 min), improvement of nearly 2 hours Near 62% reduction in processing time for OIC Batch 58% reduction on average in processing time for PAS Procedures, some as high as 87%

BI Grid Production Stats – NRTM

in

Min

Before After

Page 13: EMC IT  BI Strategy Update

13© Copyright 2009 EMC Corporation. All rights reserved.

APPENDIX

Page 14: EMC IT  BI Strategy Update

14© Copyright 2009 EMC Corporation. All rights reserved.

Findings

• Existing tool set (Brio) was old technology sunsetted by Oracle• EMC culture of bottoms up “roll your own” reporting• No support for dashboarding, KPIs, advanced visualization• Aging infrastructure unable to scale to meet growth of EMC

Delivery

• Multiple data warehouses with embedded business rules• Business rules embedded in reports• No enterprise approach for management of key data assets• No sense of ownership for upstream data quality

Data Quality

• Limited cross functional awareness of BI initiatives• No cross functional prioritization of initiatives• No cross functional collaboration on delivery

Governance

• Multiple hardware and DB environments hosting same data• Multiple teams supporting redundant data sets & reports• Multiple points of reconciliation consuming IT and Business

resources• No tiering or archiving strategy

TCO

Page 15: EMC IT  BI Strategy Update

15© Copyright 2009 EMC Corporation. All rights reserved.

Business Impact

Page 16: EMC IT  BI Strategy Update

16© Copyright 2009 EMC Corporation. All rights reserved.

Scorecard

Page 17: EMC IT  BI Strategy Update

17© Copyright 2009 EMC Corporation. All rights reserved.

BI Replatform: Performance Highlights

Overall Job runtime reduced by 2.5 hrs

SMF MV’s completes 45 min earlier

BookBill report finishes 3 hrs earlier than old production

CCA batch takes 50% of original time, from 3 hrs to 1.5 hrs

78% improvement in OBI Dashboard rendering and 74% improvement in OBI Drill down performance

IDWIDW

NRTNRT

EssbaseEssbase

NRT REV Batch and NRT OIC Batch jobs gained approximately 2 hrs

NRT PAS Batch shows improvement of 58% on average across the individual jobs

NRT Book Bill Report delivered 3.5 hrs earlier and NRT Sales Rev Report delivered 3 hrs earlier than old production

Channels Data Mart now updates in half the original time

SMF Essbase Cube build improved by 1.5 hrs, from 2 hrs to 30 min

Farm cube update down to 9 min from 3 hrs