Data Administration (166363268)

33
Educause 2009 Data Administration Constituent Group November 5th, 2009 11/5/2009 1 Educause DASIG Constituent Group

Transcript of Data Administration (166363268)

Page 1: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 1/33

Educause 2009

Data Administration

Constituent Group

November 5th, 2009 11/5/2009 1Educause DASIG Constituent Group

Page 2: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 2/33

23 states report higher unemployment in

September

Worst recession in three decades

Endowments lose billions

Grant funding cut 11/5/2009 Educause DASIG Constituent Group 2

Page 3: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 3/33

Layoffs

Harvard

Stanford

Arizona State

Yale

WashingtonUniversity of Chicago

11/5/2009 Educause DASIG Constituent Group 3

Page 4: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 4/33

Budgets Cut

Frozen Salaries

Research Reduced

11/5/2009 Educause DASIG Constituent Group 4

Page 5: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 5/33

Aren’t we here to talk about

Data Management ???

11/5/2009 Educause DASIG Constituent Group 5

Page 6: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 6/33

All the President’s Men

(1976)

Robert Redford

Hal Holbrook

11/5/2009 Educause DASIG Constituent Group 6

Page 7: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 7/33

Use Data Management

to

Follow the Money !!!!!

11/5/2009 Educause DASIG Constituent Group 7

Page 8: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 8/33

Data Management can

contribute to the bottom lineby ….. 

• Cost Savings

• Cost Avoidance

11/5/2009 Educause DASIG Constituent Group 8

Page 9: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 9/33

Questions

• How many of you are engaged in a full time

data management role ?

• How many of you full time data managers

have other responsibilities besides data

management ?

• How many of you are in roles that require data

management assistance ?

11/5/2009 Educause DASIG Constituent Group 9

Page 10: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 10/33

Data Management

Data Management comprises all

the disciplines related to

managing data as a valuableresource.

Wikipedia

11/5/2009 Educause DASIG Constituent Group 10

Page 11: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 11/33

Data Management

Data Management is thedevelopment and execution of 

architectures, policies, practices,and procedures that properlymanage the full data lifecycle needs

of an enterprise.

DAMA

11/5/2009 Educause DASIG Constituent Group 11

Page 12: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 12/33

 So what are some of these

practices, procedures, andpolicies ?

11/5/2009 Educause DASIG Constituent Group 12

Page 13: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 13/33

Metadata Management

• Data About Data

Knowing where your data is … • … And everything about it 

• Promotes consistency, quality, standardization

11/5/2009 Educause DASIG Constituent Group 13

Page 14: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 14/33

Data Classification

• Classify data by sensitivity

• HIPAA , FERPA , SSN’s, Personal Privacy, etc. 

• Develop policies for various levels of classification

• Develop guidelines for usage and security

• Develop training in use of the data

11/5/2009 Educause DASIG Constituent Group 14

Page 15: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 15/33

Data Classification

• Valuable to prevent compromises

Guides usage of data

• Directs reporting and BI

• Encryption, archiving, removable storage

11/5/2009 Educause DASIG Constituent Group 15

Page 16: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 16/33

Data Integration

• Data from system of record needed somewhereelse

• Do you want that data moved somewhere else ?

• Consistency /integrity once it leaves the source

system

• Reporting across systems

11/5/2009 Educause DASIG Constituent Group 16

Page 17: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 17/33

Data Integration

Traditional Feed Approach – Extract, ship it somewhere, load it up

• SOA/Web Services

11/5/2009 Educause DASIG Constituent Group 17

Page 18: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 18/33

Traditional Feed Approach

• Proven

• Can be accomplished in many technologies

• Can result in many, many feeds

• Each one is hand crafted• Timing issues

11/5/2009 Educause DASIG Constituent Group 18

Page 19: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 19/33

SOA/Web Services

• Limited number

• Real time or “batch” 

• Don’t have to hand craft every time 

• Granularity of data

• Security

• Technology

11/5/2009 Educause DASIG Constituent Group 19

Page 20: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 20/33

Data Governance

The discipline embodies a convergence of dataquality, data management, business processmanagement, and risk management

surrounding the handling of data in anorganization. Through data governance,organizations are looking to exercise positivecontrol over the processes and methods used

by their data stewards to handle data.Wikipedia

11/5/2009 Educause DASIG Constituent Group 20

Page 21: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 21/33

Data Governance

• Who has Data Governance bodies in place ?

• What types of activities do those groups

undertake ?

11/5/2009 Educause DASIG Constituent Group 21

Page 22: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 22/33

Master Data Management

• Data items used by multiple applications

Codes• Department numbers

• Building identifiers

• Class identifiers

11/5/2009 Educause DASIG Constituent Group 22

Page 23: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 23/33

Why Should I Manage Master Data ?

• Provides data consistency

IPEDS reporting• I-9

• Dept of Homeland Security

• Business Intelligence

11/5/2009 Educause DASIG Constituent Group 23

Page 24: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 24/33

Data Archiving

• Email

Legal records

• Institutional records

• Research data

11/5/2009 Educause DASIG Constituent Group 24

Page 25: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 25/33

Data Archiving

• Where is it, and what is it ?

How to search archives ?

• How to access archives ?

• Volume

11/5/2009 Educause DASIG Constituent Group 25

Page 26: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 26/33

Ediscovery

• Discovery and securing of electronic

information

• Required by some form of litigation or criminal

proceedings

• Court ordered

• Email, IM chats, documents, databases, logs,

web sites, other forms of electronic data

• May also require associated metadata

11/5/2009 Educause DASIG Constituent Group 26

Page 27: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 27/33

Ediscovery

• Zubulake v. UBS Warburg LLC

Court found that defendant deleted emailsand/or failed to produce files

• Adverse inference jury instructions given

Plaintiff awarded $29.2 Million

11/5/2009 Educause DASIG Constituent Group 27

Page 28: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 28/33

Ediscovery

• Coleman Holdings Inc. v. Morgan Stanley

Defendant failed to disclose and process numerousbackup tapes until late in the proceedings

• Adverse inference jury instructions given, reversing theburden of proof 

•Jury verdict for plaintiff in the amount of $1.5 Billion

• Court awarded $15 Million in fines for failing to complywith discovery obligations

11/5/2009 Educause DASIG Constituent Group 28

Page 29: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 29/33

Ediscovery

• Talk to your legal department

• Make info handling routines routine and

consistent

• Keep a trail – DOCUMENT IT !!!!!

• Avoid spoilation

 – The deliberate or negligent destruction,

withholding, or hiding of evidence when an

investigation or litigation is under way

11/5/2009 Educause DASIG Constituent Group 29

Page 30: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 30/33

Ediscovery

• Know what you have

Backups• Archives

• Files

•Databases

• Optical media

11/5/2009 Educause DASIG Constituent Group 30

Page 31: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 31/33

Data Management

Following the Money

to

Cost Savings

&Cost Avoidance

11/5/2009 Educause DASIG Constituent Group 31

Page 32: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 32/33

Almost the Final Slide

Plug DASIG

• Listhost

11/5/2009 Educause DASIG Constituent Group 32

Page 33: Data Administration (166363268)

7/29/2019 Data Administration (166363268)

http://slidepdf.com/reader/full/data-administration-166363268 33/33

Mike Fary

Enterprise Data Architect

University of Chicago

[email protected]

11/5/2009 Educause DASIG Constituent Group 33