Netezza da li vaš data warehouse moze biti brži dai clegg

17
© 2011 IBM Corporation The IBM Netezza Datawarehouse Appliance: faster, simpler, more accessible analytics - what the technology is - how our customers are exploiting it

description

 

Transcript of Netezza da li vaš data warehouse moze biti brži dai clegg

Page 1: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

The IBM Netezza Datawarehouse Appliance:faster, simpler, more accessible analytics

- what the technology is - how our customers are exploiting it

Page 2: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

2

Internal & External

Reporting

Governance and Integration & Development

etc…

External Feeds

External Feeds

etc...

In-house Apps

ERP

CRM

Ad hoc Analysis

Business Systems

Data Integration and Task Automation, Archiving and Test Data Management

Modeling & Calculation

ETLModeling

Data

Calculated Data

Model Parameters

Atomic Report Data

Con

solid

atio

n

Data Repository

Business GlossaryIntegration Development

Metadata and Lineage Model Management

The Datawarehouse Solution Space

Modeling & Calculation

Ad hoc Analysis

ELT

Page 3: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

The IBM Netezza Appliance: Revolutionizing Analytics

� Purpose-built analytics engine

� Integrated database, server & storage

� Standard interfaces

� Low total cost of ownership

� Speed: 10-100x faster than traditional systems

� Simplicity: Minimal administration

� Scalability: Peta-scale user data capacity

� Smart: High-performance advanced analytics

Page 4: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

Data Integration

Data In

The Netezza Appliance – Loading

IBM Information Server

Ab Initio

Business Objects/SAP

Composite Software

Expressor Software

GoldenGate Software (Oracle)

Informatica

Sunopsis (Oracle)

WisdomForce

SQ

L

O

DB

C

JDB

C

O

LE-D

B

Page 5: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

The Netezza Appliance – Querying

Reporting & AnalysisCognos (IBM)SPSS (IBM)Unica (IBM)ActuateBusiness Objects/SAPInformation BuildersKalidoKXENMicroStrategyOracle OBIEEQlikTechQuest SoftwareSAS S

QL

OD

BC

JD

BC

OLE

-DB

Data Out

Page 6: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

Page 6

Digital Media

Financial Services

Government

Health & Life Sciences

Retail / Consumer

Products

Telecom

Other

Page 7: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

“…when something took 24 hours I could only do so much with it, but when something takes 10 seconds, I may be able to completely rethink the business process…”

- SVP Application Development, Nielsen

15,000 users running 800,000+ queries per day 50X faster than before

Source: http://www.youtube.com/watch?v=yOwnX14nLrE&feature=player_embedded

Speed

Page 8: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

DAYS

WEEKS

MONTHS

“Allowing the business users access to the Netezza box was what sold it.”

Steve Taff,

Executive Dir. of IT Services

200X faster than Oracle system

ROI in less than 3 months

Up and running 6 months

before having any training

Simplicity

Page 9: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

“NYSE … has replaced an Oracle IO relational database with a data warehousing appliance from Netezza, allowing it to conduct rapid searches of 650 terabytes of data.”

ComputerWeekly.com

Source: http://www.computerweekly.com/Articles/2008/04/14/230265/NYSE-improves-data-management-with-datawarehousing.htm

1 PB on Netezza7 years of historical data100-200% annual data growth

Scalability

Page 10: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

“Because of (Netezza’s) in-database technology, we believe we'll be able to do 600 predictive models per year (10X as many as before) with the same staff."

Eric Williams,

CIO and executive VP

Coupon redemption rates as high as 25%

Predicts what shoppers are likely to buy in future visits

Smart

Page 11: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

IBM Netezza True Appliance Massively Parallel Processing

Massively Parallel Intelligent Storage

1

2

3

960

Network FabricSMP Host

DBOSFront End

High-Speed Loader/Unloader

ODBC 3.XJDBC Type 4

OLE-DBSQL/92

Execution Engine

SQL Compiler

Query Plan

Optimize

Admin

Source Systems

Client

High Performance

Loader

3rd PartyApps

DBA CLI

ETL Server

SOLARIS

LINUX

HP-UX

AIX

WINDOWS

TRU64

High-PerformanceDatabase EngineStreaming joins,

aggregations, sorts

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

Page 12: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

High-PerformanceDatabase EngineStreaming joins,

aggregations, sorts

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

Massively Parallel Intelligent Storage

1

2

3

960

Network FabricSMP Host

DBOSFront End

High-Speed Loader/Unloader

SQL Compiler

Query Plan

Optimize

Admin

SQL

Snippets

1 2 3

SQL

Source Systems

Client

High Performance

Loader

3rd PartyApps

DBA CLI

ETL Server

SOLARIS

LINUX

HP-UX

AIX

WINDOWS

TRU64

IBM Netezza True Appliance Massively Parallel Processing™

Execution Engine

2 3

2 3

2 3

2 3

Page 13: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

Our Secret Sauce

FPGA Core CPU Core

Uncompress Project Restrict,Visibility

Complex ∑Joins, Aggs, etc.

select DISTRICT,

PRODUCTGRP,

sum(NRX)

from MTHLY_RX_TERR_DATA

where MONTH = '20091201'

and MARKET = 509123

and SPECIALTY = 'GASTRO'

Slice of table

MTHLY_RX_TERR_DATA

(compressed)

Slice of table

MTHLY_RX_TERR_DATA

(compressed)where MONTH = '20091201'

and MARKET = 509123

and SPECIALTY = 'GASTRO'

where MONTH = '20091201'

and MARKET = 509123

and SPECIALTY = 'GASTRO'

sum(NRX)sum(NRX)select DISTRICT,

PRODUCTGRP,

sum(NRX)

select DISTRICT,

PRODUCTGRP,

sum(NRX)

����

Page 14: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

High-PerformanceDatabase EngineStreaming joins,

aggregations, sorts

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

S-Blade

Processor &

streaming DB logic

IBM Netezza True Appliance Massively Parallel Processing™

Massively Parallel Intelligent Storage

1

2

3

960

Network FabricSMP Host

DBOSFront End

High-Speed Loader/Unloader

SQL Compiler

Query Plan

Optimize

Admin

2 3

2 3

2 3

2 3

Consolidate

Source Systems

Client

High Performance

Loader

3rd PartyApps

DBA CLI

ETL Server

SOLARIS

LINUX

HP-UX

AIX

WINDOWS

TRU64

Execution Engine

Page 15: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

IBM Netezza data warehouse appliance family

for data life-cycle management

Queryable Archive. Backup/DR

DWH, High Performance Analytics

Development & TestingFrom a few terabytes to 10s of petabytes

Page 16: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

The IBM Netezza Appliance: Revolutionizing Analytics

� Speed: 10-100x faster than traditional systems

� Simplicity: Minimal administration

� Scalability: Peta-scale user data capacity

� Smart: High-performance advanced analytics

Page 17: Netezza   da li vaš data warehouse moze biti brži  dai clegg

© 2011 IBM Corporation

Information Management

�We claim we are simpler

�We claim we deliver performance

�We claim we work within your environment

�We claim we integrate with your 3rd party tools

Bold Claims, but...We Prove Them!

We

prov

e

We

prov

eTake the Netezza

Test Drive

Your Data. Your Site. Our Risk.

http://www.netezza.com/testdrive/

� We prove we are “easy to do business with”

� We prove we have the lowest TCO

� We prove business value