Educause 2009 Data Administration Constituent Group November 5th, 2009
description
Transcript of Educause 2009 Data Administration Constituent Group November 5th, 2009
Educause 2009
Data Administration Constituent Group
November 5th, 200911/5/2009 1Educause DASIG Constituent Group
23 states report higher unemployment in September
Worst recession in three decades
Endowments lose billions
Grant funding cut
11/5/2009 Educause DASIG Constituent Group 2
Layoffs
Harvard Stanford Arizona State Yale Washington University of Chicago
11/5/2009 Educause DASIG Constituent Group 3
Budgets Cut
Frozen Salaries
Research Reduced
11/5/2009 Educause DASIG Constituent Group 4
Aren’t we here to talk about
Data Management ???
11/5/2009 Educause DASIG Constituent Group 5
All the President’s Men (1976)
Robert Redford
Hal Holbrook
11/5/2009 Educause DASIG Constituent Group 6
Use Data Management to
Follow the Money !!!!!
11/5/2009 Educause DASIG Constituent Group 7
Data Management can contribute to the bottom line
by …..
• Cost Savings
• Cost Avoidance
11/5/2009 Educause DASIG Constituent Group 8
Questions
• How many of you are engaged in a full time data management role ?
• How many of you full time data managers have other responsibilities besides data management ?
• How many of you are in roles that require data management assistance ?
11/5/2009 Educause DASIG Constituent Group 9
Data Management Data Management comprises all
the disciplines related to managing data as a valuable resource.
Wikipedia
11/5/2009 Educause DASIG Constituent Group 10
Data Management Data Management is the development
and execution of architectures, policies, practices, and procedures that properly manage the full data lifecycle needs of an enterprise.
DAMA
11/5/2009 Educause DASIG Constituent Group 11
So what are some of these practices, procedures, and
policies ?
11/5/2009 Educause DASIG Constituent Group 12
Metadata Management
• Data About Data
• Knowing where your data is …• … And everything about it
• Promotes consistency, quality, standardization
11/5/2009 Educause DASIG Constituent Group 13
Data Classification
• Classify data by sensitivity
• HIPAA , FERPA , SSN’s, Personal Privacy, etc.
• Develop policies for various levels of classification
• Develop guidelines for usage and security
• Develop training in use of the data
11/5/2009 Educause DASIG Constituent Group 14
Data Classification
• Valuable to prevent compromises
• Guides usage of data
• Directs reporting and BI
• Encryption, archiving, removable storage
11/5/2009 Educause DASIG Constituent Group 15
Data Integration
• Data from system of record needed somewhere else
• Do you want that data moved somewhere else ?
• Consistency /integrity once it leaves the source system
• Reporting across systems
11/5/2009 Educause DASIG Constituent Group 16
Data Integration
• Traditional Feed Approach– Extract, ship it somewhere, load it up
• SOA/Web Services
11/5/2009 Educause DASIG Constituent Group 17
Traditional Feed Approach
• Proven• Can be accomplished in many technologies
• Can result in many, many feeds• Each one is hand crafted• Timing issues
11/5/2009 Educause DASIG Constituent Group 18
SOA/Web Services
• Limited number • Real time or “batch”• Don’t have to hand craft every time
• Granularity of data• Security • Technology 11/5/2009 Educause DASIG Constituent Group 19
Data Governance
The discipline embodies a convergence of data quality, data management, business process management, and risk management surrounding the handling of data in an organization. Through data governance, organizations are looking to exercise positive control over the processes and methods used by their data stewards to handle data. Wikipedia
11/5/2009 Educause DASIG Constituent Group 20
Data Governance
• Who has Data Governance bodies in place ?
• What types of activities do those groups undertake ?
11/5/2009 Educause DASIG Constituent Group 21
Master Data Management
• Data items used by multiple applications
• Codes • Department numbers• Building identifiers• Class identifiers
11/5/2009 Educause DASIG Constituent Group 22
Why Should I Manage Master Data ?
• Provides data consistency
• IPEDS reporting• I-9• Dept of Homeland Security• Business Intelligence
11/5/2009 Educause DASIG Constituent Group 23
Data Archiving
• Legal records
• Institutional records
• Research data
11/5/2009 Educause DASIG Constituent Group 24
Data Archiving
• Where is it, and what is it ?
• How to search archives ?
• How to access archives ?
• Volume
11/5/2009 Educause DASIG Constituent Group 25
Ediscovery
• Discovery and securing of electronic information
• Required by some form of litigation or criminal proceedings
• Court ordered• Email, IM chats, documents, databases, logs,
web sites, other forms of electronic data• May also require associated metadata
11/5/2009 Educause DASIG Constituent Group 26
Ediscovery
• Zubulake v. UBS Warburg LLC
• Court found that defendant deleted emails and/or failed to produce files
• Adverse inference jury instructions given• Plaintiff awarded $29.2 Million
11/5/2009 Educause DASIG Constituent Group 27
Ediscovery
• Coleman Holdings Inc. v. Morgan Stanley
• Defendant failed to disclose and process numerous backup tapes until late in the proceedings
• Adverse inference jury instructions given, reversing the burden of proof
• Jury verdict for plaintiff in the amount of $1.5 Billion• Court awarded $15 Million in fines for failing to comply
with discovery obligations
11/5/2009 Educause DASIG Constituent Group 28
Ediscovery
• Talk to your legal department• Make info handling routines routine and
consistent• Keep a trail – DOCUMENT IT !!!!!• Avoid spoilation– The deliberate or negligent destruction,
withholding, or hiding of evidence when an investigation or litigation is under way
11/5/2009 Educause DASIG Constituent Group 29
Ediscovery
• Know what you have
• Backups• Archives• Files• Databases• Optical media
11/5/2009 Educause DASIG Constituent Group 30
Data Management
Following the Money to
Cost Savings &
Cost Avoidance 11/5/2009 Educause DASIG Constituent Group 31
Almost the Final Slide
• Plug DASIG
• Listhost
11/5/2009 Educause DASIG Constituent Group 32
Mike FaryEnterprise Data ArchitectUniversity of [email protected]
11/5/2009 Educause DASIG Constituent Group 33