Business Intelligence and Data Warehouse Overview

8/9/2019 Business Intelligence and Data Warehouse Overview

1/30

02/05/15 04:23OutStart Inc.

Business Intelligence andData Warehouse (BIDW)

OvervieMai Hoang

Mar 18, 2009


2/30

Outstart Inc. 02/05/15 04:23

!ontent

BIDW Overview

e!ations"i# $etween Business Inte!!igence %BI& s'ste( an) Data Ware"ouse

Data Integration

Data Ware"ouse vs. Data Mart

BI *o((on +unctions

Data Mining an) na!'sis -uer' an) e#orting

Business er+or(ance Manage(ent

BIDW Drivers/ren)s

-uic !oo at Microso+t too!s

Business rocess Manage(ent %BM& MS Bi3a!


3/30

Outstart Inc. 02/05/15 04:23

Introduction

Business Inte!!igence%BI& s'ste(s turn a co(#an'4s raw )ata into

usea$!e in+or(ation t"at can "e!# (anage(ent i)enti+' i(#ortant tren)s,ana!'3e custo(er $e"avior, an) (ae inte!!igent $usiness )ecisions5uic!'.

BI re!ies on Data Ware"ousing%a )ata re#ositor' )esigne) to su##ort anorgani3ation4s )ecision (aing&, (aing cost6e++ective storing an)

(anaging o+ ware"ouse )ata critica! to an' BIDW so!ution


4/30

Outstart Inc. 02/05/15 04:23

BIDW Overvie


5/30

Outstart Inc. 02/05/15 04:23

BIDW "rocess

aw )ata is store)

In+or(ation is c!eanse)

an) o#ti(i3e)

Data (ining, 5uer' an)

ana!'tica! too!sgenerate inte!!igence

Mae strategic Business

Decisions


%BM& a##!ications trac resu!ts

Regulatedbycorporatesecuritypolicy


6/30

Outstart Inc. 02/05/15 04:23

Data Integration

Data integrationis t"e #rocess o+

co($ining )ata resi)ing at )i++erent sources

an) #rovi)ing t"e user wit" a uni+ie) view o+ t"ese )ata

Data integration a##ears wit" increasing +re5uenc' as t"e vo!u(e an)t"e nee) to s"are e7isting )ata e7#!o)es

rovi)e $asic e7tract, trans+or( an) !oa) )ata %& +unctions So(e #o#u!ar )ata integration too!s

IBM :isua! Ware"ouse %IBM&

Orac!e Data Ware"ouse 6 ODW %Orac!e&

S- Server Integration Services SSIS %Microso+t&


7/30


8/30


9/30Outstart Inc. 02/05/15 04:23

Data Warehouse Disadvantages

*an resu!t in "ig" costs

"ig" (aintenance cost over t"eir !i+e )ue to t"e )ata ware"ouse is usua!!' notstatic

cost o+ )e!ivering su$o#ti(a! in+or(ation to t"e organi3ation as it can getout)ate) re!ative!' 5uic!'.

"ere is o+ten a +ine !ine $etween )ata ware"ouses an) o#erationa!

s'ste(s. Du#!icate, e7#ensive +unctiona!it' (a' $e )eve!o#e). Or,+unctiona!it' (a' $e )eve!o#e) in t"e )ata ware"ouse t"at, in retros#ect,s"ou!) "ave $een )eve!o#e) in t"e o#erationa! s'ste(s an) vice versa.


10/30Outstart Inc. 02/05/15 04:23

Data $art

Data &art is a su$set o+ an organi3ationa! )ata store, usua!!' oriente) to

a s#eci+ic #ur#ose or (a;or )ata su$;ect, t"at (a' $e )istri$ute) tosu##ort $usiness nee)s

Data (arts are ana!'tica! )ata stores )esigne) to +ocus on s#eci+ic$usiness +unctions +or a s#eci+ic co((unit' wit"in an organi3ation

Data (arts are o+ten %so(e ti(e (ig"t not& )erive) +ro( su$sets o+ )ata

in a )ata ware"ouse


11/30Outstart Inc. 02/05/15 04:23

Wh' need Data $art

as' access to +re5uent!' nee)e) )ata

*reates co!!ective view $' a grou# o+ users

I(#roves en)6user res#onse ti(e

ase o+ creation

ower cost t"an i(#!e(enting a +u!! Data Ware"ouse

otentia! users are (ore c!ear!' )e+ine) t"an in a +u!! Data Ware"ouse


12/30Outstart Inc. 02/05/15 04:23

Business Intelligence

Business Intelligence re+ers to si!!s, tec"no!ogies, a##!ications an)

#ractices use) to "e!# a $usiness ac5uire a $etter un)erstan)ing o+ itsco((ercia! conte7t.

Business inte!!igence (a' a!so re+er to t"e co!!ecte) in+or(ation itse!+

BI a##!ications #rovi)e "istorica!, current, an) #re)ictive views o+$usiness o#erations

*o((on +unctions o+ $usiness inte!!igence a##!ications inc!u)ing

Data Mining

na!'tics %suc" as On6!ine na!'tica! rocessing6O&


an) e#orting

Business inte!!igence o+ten ai(s to su##ort $etter $usiness )ecision6(ainga BI s'ste( can $e ca!!e) a Decision Su##ort S'ste( %DSS&


13/30Outstart Inc. 02/05/15 04:23

Business Intelligence ools

*ognos %IBM&

IBM *ognos 84s We$ services6$ase) SO is (uc" $etter integrate) t"an so(e co(#etingo++erings, wit" s"are) (eta)ata across t"e #!at+or( ena$!ing ease o+ trans+er +ro( re#ortto 5uer' to ana!'sis.

Have "ig" #ro#ortion o+ enter#rise6stan)ar) BI #!at+or( )e#!o'(ents

Microso+t

Microso+t na!'sis Services

grou# o+ O an) )ata (ining services #rovi)e) in MS S- server

er+or(ance oint Server 200=

Monitor Server O#eration

!anning Server O#eration

Manage(ent e#orter

More re+erences at http://en.wikipedia.org/wiki/PerformancePoint_Server_2!

roc!arit'

Integrate) tig"t!' wit" MS S- server, es#ecia!!' MS na!'sis Services

SS

SS4s a##roac" to BI originates wit" +orecasting, #re)ictive (o)e!ing an) o#ti(i3ation,an) e($e))ing t"e( wit"in cross6+unctiona! an) in)ustr'6s#eci+ic a##!ications

n O #ro)uct, "owever a!so #rovi)es so(e +unctions
http://en.wikipedia.org/wiki/PerformancePoint_Server_2007http://en.wikipedia.org/wiki/PerformancePoint_Server_2007


14/30


15/30


16/30Outstart Inc. 02/05/15 04:23

"rocess o% Data $ining * +noledge Discover' in Data,ase(+DD) * !ont#

Mine )ata co((on!' invo!ves +our c!asses o+ tas

*!assi+ication arrange t"e )ata into #re)e+ine) grou#s

*!ustering !ie c!assi+ication $ut t"e grou#s are not #re)e+ine), so t"e a!gorit"(wi!! tr' to grou# si(i!ar ite(s toget"er.

egression atte(#t to +in) a +unction w"ic" (o)e!s t"e )ata wit" t"e !east error.

co((on (et"o) is to use Aenetic rogra((ing

ssociation ru!e !earning searc" +or re!ations"i#s $etween varia$!es.


17/30

Outstart Inc. 02/05/15 04:23

"rocess o% Data $ining * +noledge Discover' in Data,ase(+DD) * !ont#

Inter#ret resu!ts va!uate t"e #atterns #ro)uce) $' t"e )ata (ining a!gorit"(s

ot a!! #atterns +oun) $' t"e )ata (ining a!gorit"(s are necessari!' va!i).

It is co((on +or t"e )ata (ining a!gorit"(s to +in) #atterns in t"e training setw"ic" are not #resent in t"e genera! )ata set, t"is is ca!!e) over+itting. o

overco(e t"is, t"e eva!uation uses a ?test set? o+ )ata w"ic" t"e )ata(ininga!gorit"( was not traine) on. "e !earnt #atterns are a##!ie) to t"is ?test set?an) t"e resu!ting out#ut is co(#are) to t"e )esire) out#ut.

nu($er o+ statistica! (et"o)s (a' $e use) to eva!uate t"e a!gorit"( suc" asO* curves.

I+ t"e !earnt #atterns )o not (eet t"e )esire) stan)ar)s, t"en it is necessar' to

reeva!uate an) c"ange t"e #re#rocessing an) )ata (ining

I+ t"e !earnt #atterns )o (eet t"e )esire) stan)ar)s t"en t"e +ina! ste# is tointer#ret t"e !earnt #atterns an) turn t"e( into now!e)ge


18/30

Outstart Inc. 02/05/15 04:23

On-line .nal'tical "rocessing (O.")

Online anal'tical rocessing (O.") is an a##roac" to 5uic!' answer(u!ti6)i(ensiona! ana!'tica! 5ueries

Data$ases con+igure) +or O use a (u!ti)i(ensiona! )ata (o)e!,a!!owing +or co(#!e7 ana!'tica! an) a)6"oc 5ueries wit" a ra#i) e7ecutionti(e. "e' $orrow as#ects o+ navigationa! DB an) "ierarc"ica! DB t"at are+aster t"an re!ationa! DBO is so(eti(es ca!!e) as ast .nal'siso% hared $ultidi&ensional In%or&ation

"e out#ut o+ an O 5uer' is t'#ica!!' )is#!a'e) in a (atri7 %or #ivot&+or(at. "e )i(ensions +or( t"e rows an) co!u(ns o+ t"e (atri7C t"e(easures +or( t"e va!ues.


19/30

Outstart Inc. 02/05/15 04:23

O." !u,e

In t"e core o+ an' O s'ste( is a conce#t o+ an O cu$e %a!so

ca!!e) a m"#tidimensiona# c"$eor a h%perc"$e&

n O cu$e is a )ata structure t"at a!!ows +ast ana!'sis o+ )ata


20/30

Outstart Inc. 02/05/15 04:23

O." !u,e (cont#)

n O cu$e consists o+ nu(eric +acts ca!!e) meas"resw"ic" are

categori3e) $' )i(ensions

"e cu$e (eta)ata is t'#ica!!' create) +ro( a start sc"e(e or snow+!aesc"e(a o+ ta$!es in a re!ationa! )ata$ase

ac" meas"recan $e t"oug"t o+ as "aving a set o+ #a$e#s, or (eta6)ataassociate) wit" it

dimensionis w"at )escri$es t"ese #a$e#sC it #rovi)es in+or(ation a$outt"e meas"re.

7a(#!e

cu$e contains a store4s sa!es as a meas"re, an) Date/i(e as a dimension. ac"Sa!e "as a Date/i(e #a$e#t"at )escri$es (ore a$out t"at sa!e.

n' nu($er o+ dimensionscan $e a))e) to t"e structure suc" as Store, *as"ier, or*usto(er. "is a!!ows an ana!'st to view t"e meas"resa!ong an' co($ination o+ t"edimensions


21/30

Outstart Inc. 02/05/15 04:23

O." "roducts

Be!ow is a !ist o+ to# O ven)ors in 200

&ote:

'icrosoft was the on#% vendorthatcontin"o"s#% exceeded the ind"stria#average growth d"ring 2(2)

Since the a$ove data was co##ected,*%perion has $een ac+"ired $%rac#e, -artesis $% "siness $ects,"siness $ects $% S0P, 0pp#ix $%-ognos, and -ognos $% 1'


22/30

Outstart Inc. 02/05/15 04:23

BIDW Drivers/rends

>e' )rivers t"at are (aing BIDW so!utions (ission critica! inc!u)e

a#i) increase in @in+or(ation )e(ocrac'E

"e a$i!it' to (ae inte!!igent $usiness )ecisions 5uic!' is i(#erative to re(ainco(#etitive

Data is $eing custo(i3e) on a (ass sca!e, t"us )ata ware"ouses (ust $e+!e7i$!e enoug" to #rovi)e )i++erent views to )i++erent #eo#!e

ew !egis!ation an) co(#!iance regu!ations "ave (a)e BIDW (ission critica!.Data (ust $e ca#ture), retaine), an) (anage) in a wa' t"at wi!! satis+' courtsan) regu!ators

"e enor(ous )iversit' o+ )ata Organi3ations (ust store an) (anage )ata+ro( (u!ti#!e )i++erent sources suc" as an) *M s'ste(s, an) in a variet'o+ +or(ats suc" as te7t, i(ages, voice, vi)eo, unstructure) )ata, an) (ore

"e increase) nee) +or $etter securit' )ue to wi)er )ata access avai!a$i!it' an)a !arger nu($er o+ users.

"ere are a nu($er o+ in)ustr'6s#eci+ic )rivers %Aovern(ent,


23/30

Outstart Inc. 02/05/15 04:23

$ Bial Introduction

$icroso%t Bial erver, o+ten re+erre) to as si(#!' ?Bi3a!?, is a

$usiness #rocess (anage(ent %BM& server

"roug" t"e use o+ ?a)a#ters? w"ic" are tai!ore) to co((unicate wit")i++erent so+tware s'ste(s use) in a !arge enter#rise, MS Bi3ta! ena$!esco(#anies to auto(ate an) integrate $usiness #rocesses.

In a co((on scenario, Bi3a! ena$!es co(#anies to integrate an)(anage $usiness #rocesses $' e7c"anging $usiness )ocu(ents suc" as#urc"ase or)ers an) invoices $etween )is#arate a##!ications, wit"in oracross organi3ationa! $oun)aries.

Wit" over =,000 custo(ers, inc!u)ing 90 #ercent o+ t"e


24/30

Outstart Inc. 02/05/15 04:23

$ Bial erver 200 62

Bi3a! Server 200 2 $ui!)s u#on t"e Business rocess Manage(ent

an) SO/SB ca#a$i!ities in #rior re!eases to "e!# organi3ations e7ten)core #rocess (anage(ent tec"no!ogies even +urt"er wit" new ca#a$i!ities!ie

native su##ort +or !ectronic Data Interc"ange %DI&, ##!ica$i!it' State(ent 2%S2& an) a)io


25/30

Outstart Inc. 02/05/15 04:23

What Bial erver 200 62 can ,ring to 'our organiation

7ten)FSu##!' *"ains to t"e )ge

Wit" new ca#a$i!ities suc" as native su##ort +or DI an)


26/30

Outstart Inc. 02/05/15 04:23

What Bial erver 200 62 can ,ring to 'our organiation

De!iverFnter#rise roven So!utions

He!# organi3ations cost e++ective!' (anage t"eir su##!' c"ain +ro( t"e +actor' tot"e store+ront

n en)6to6en) integrate) su##!' c"ain a!!ows organi3ations to )rive (a7i(u(e++icienc' t"roug" visi$i!it' into critica! $usiness #rocesses, an) tig"terco!!a$oration wit" tra)ing #artners.


27/30

Outstart Inc. 02/05/15 04:23

$ Bial !ore unctions

Bi3a! #rovi)es t"e +o!!owing +unctions

%1& Business rocess uto(ation %B& t"e #rocess a $usiness uses to contain costs

consists o+ integrating a##!ications, cutting !a$or w"erever #ossi$!e, an) using so+twarea##!ications t"roug"out t"e organi3ation

%2& Business rocess Mo)e!ing %BM&

t"e activit' o+ re#resenting #rocess o+ an enter#rise, so t"at t"e current %?as is?& #rocess(a' $e ana!'3e) an) i(#rove) in +uture %?to $e?&

t'#ica!!' #er+or(e) $' $usiness ana!'sts an) (anagers w"o are seeing to i(#rove#rocess e++icienc' an) 5ua!it'

So(e $usiness #rocess (o)e!ing tec"ni5ues

Business rocess Mo)e!ing otation %BM&

*ognition en"ance) atura! !anguage In+or(ation na!'sis Met"o) %*ogIM& 7ten)e) Business Mo)e!ing anguage %7BM&

vent6)riven #rocess c"ain %*&

Gni+ie) Mo)e!ing anguage %GM&


28/30

Outstart Inc. 02/05/15 04:23


29/30

Outstart Inc. 02/05/15 04:23

$ Bial !ore unctions

%& Business6to6$usiness %B2B& *o((unication

Bi3a! Server 200 2 inc!u)es co(#re"ensive )ata e7c"ange o#tions to co((unicatewit" ra)ing artners t"roug" in)ustr' stan)ar)s. "ese +eatures inc!u)e integrate)su##ort wit"in t"e Bi3a! Server engine +or !ectronic Data 7c"ange %DI& )ata%inc!u)ing 12, DI


30/30

78.

Business Intelligence and Data Warehouse Overview

Documents

Transcript of Business Intelligence and Data Warehouse Overview