Data Warehousing & Data Mining

LECTURE-1INTRODUCTION AND BACKGROUND

1Foundation University

Dr. Muhammad Shaheen

Introduction and Background

2

Reference Books A. Abdullah, “Data Warehousing for beginners: Concepts &

Issues” (First Edition).

J. Han, “Data Mining: Concepts and Techniques” (Latest Edition)

3

Additional Material Research Papers

Magazine Articles

4

Semester Project

Develop an application for an organization of your choice.

A case study and coding based approach to be followed.

Use 4GL or a high level programming language.

You MUST collect the necessary data and should have a first draft of the project description approved by the instructor BEFORE initiating on detailed work.

9

Semester Project (Cont…)The project report to include, but is not limited to, the following as documentation:

Narrative description of business and tables of appropriate data. Descriptions of decisions to be supported by information produced

by system. Summary narrative of results produced. Structure charts, dataflow diagrams and/or other diagrams to

document the structure of the system. Listings of computer models/programs utilized. Reports displaying results. Recommended decision from results. User instructions.

10

Approach of the course Develop an understanding of underlying RDBMS

concepts.

Apply these concepts to VLDB DSS environments and understand where and why they break down?

Expose the differences between RDBMS and Data Warehouse in the context of VLDB.

Provide the basics of DSS tools such as OLAP, Data Mining and demonstrate their application.

Demonstrate the application of DSS concepts and limitations of the OLTP concepts through lab exercises.

11

Why this course? The world is changing (actually changed), either change or be

left behind.

Missing the opportunities or going in the wrong direction has prevented us from growing.

What is the right direction? Harnessing the data, in a knowledge driven economy.

12

13

The need

Knowledge is power, Intelligence is absolute power!

“Drowning in data and starving for information”

14

The need

DATA

INFORMATION

KNOWLEDGE

POWER

INTELLIGENCE

$

15

Historical overview

1960Master Files & Reports

1965Lots of Master files!

1970Direct Access Memory & DBMS

1975Online high performance transaction processing

16

Historical overview

1980 PCs and 4GL Technology (MIS/DSS)

1985 & 1990 Extract programs, extract processing,

The legacy system’s web

17

Historical overview: Crisis of Credibility

What is the financial health of our company?

-10% +10%

??