Metadata & Data Curation Services by Thu-Mai Christian

26
METADATA & DATA CURATION SERVICES THU-MAI CHRISTIAN, DATA ARCHIVIST DATAVERSE COMMUNITY MEETING JUNE 10, 2015 THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE DAVIS LIBRARY, 2 ND FLOOR, CB# 3355 UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL WWW.ODUM.UNC.EDU

Transcript of Metadata & Data Curation Services by Thu-Mai Christian

Page 1: Metadata & Data Curation Services by Thu-Mai Christian

METADATA & DATA CURATION SERVICES THU-MAI CHRISTIAN, DATA ARCHIVIST DATAVERSE COMMUNITY MEETING JUNE 10, 2015

THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE DAVIS LIBRARY, 2ND FLOOR, CB# 3355 UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL WWW.ODUM.UNC.EDU

Page 2: Metadata & Data Curation Services by Thu-Mai Christian

METADATA & DATA CURATION SERVICES

The Odum Institute for Research in Social Science

Odum Institute Data Archive

Data Curation Pipeline + Dataverse

Data Curation Service Levels

Page 3: Metadata & Data Curation Services by Thu-Mai Christian

THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE

Founded in 1924 by Howard W. Odum

Oldest university-based interdisciplinary social science research institute in the U.S.

To help grow and lead a world-class social science research infrastructure at the University of North Carolina at Chapel Hill to ensure that researchers can conduct scientifically rigorous research that contributes to better lives of the citizens of North Carolina and the World…

Page 4: Metadata & Data Curation Services by Thu-Mai Christian

THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE

PLAN

USE

CREATE A

RCH

IVE

SERVICES ACROSS THE RESEARCH LIFECYCLE

Page 5: Metadata & Data Curation Services by Thu-Mai Christian

THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE

SERVICES ACROSS THE RESEARCH LIFECYCLE Grant services Data management

plans

PLAN

USE

CREATE A

RCH

IVE

Page 6: Metadata & Data Curation Services by Thu-Mai Christian

THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE

PLAN

USE

CREATE A

RCH

IVE

SERVICES ACROSS THE RESEARCH LIFECYCLE Survey methodology Data collection Education & training

Page 7: Metadata & Data Curation Services by Thu-Mai Christian

THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE

PLAN

USE

CREATE A

RCH

IVE

SERVICES ACROSS THE RESEARCH LIFECYCLE Consultations Education & Training Facilities

Page 8: Metadata & Data Curation Services by Thu-Mai Christian

THE ODUM INSTITUTE FOR RESEARCH IN SOCIAL SCIENCE

PLAN

USE

CREATE A

RCH

IVE

SERVICES ACROSS THE RESEARCH LIFECYCLE Data curation Data preservation Data sharing

Page 9: Metadata & Data Curation Services by Thu-Mai Christian

ODUM INSTITUTE DATA ARCHIVE

One of the oldest and largest catalogs of machine readable data

Louis Harris Data Center

North Carolina Vital Statistics

National Network of State Polls (NNSP)

North Carolina Online Collection of Knowledge and Scholarship (NC DOCKS)

Over 33,000 studies with over 690,000 files

Page 10: Metadata & Data Curation Services by Thu-Mai Christian

ODUM INSTITUTE DATA ARCHIVE

Member of the Data Preservation Alliance for the Social Sciences (Data-PASS)

Awarded the 2014-2015 Data Seal of Approval

Page 11: Metadata & Data Curation Services by Thu-Mai Christian

ODUM INSTITUTE DATA ARCHIVE

Adopted the Dataverse virtual archive platform in 2005

Dataverse 3.6.2 + Data curation services

Page 12: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

DIP

SIP

AIP

Review Files

Develop Plan

Normalize Files

Build Document

Set

Clean Data

Assemble AIP

Apply Standard

Vocab

Generate Metadata

Set Access Restrictions

Brand Dataverse

Review & Test

Publish Data

Set Terms of Use

DEPOSIT TRIAGE PROCESSING ACCESS

Page 13: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

DIP

SIP

AIP

Review Files

Develop Plan

Normalize Files

Build Document

Set

Clean Data

Assemble AIP

Apply Standard

Vocab

Generate Metadata

Set Access Restrictions

Brand Dataverse

Review & Test

Publish Data

Set Terms of Use

DEPOSIT TRIAGE PROCESSING ACCESS

Page 14: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

PROCESSING

Convert files to Dataverse-compatible formats to enable subsetting and analysis

Normalize Files

Page 15: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

PROCESSING

Edit/Add labels to variables and value codes to enhance variable-level search and usability in the Dataverse

Clean Data

Page 16: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

PROCESSING

Create metadata templates to ensure completeness of cataloging information and to encourage consistent use of metadata standards across dataset records in the Dataverse

Generate Metadata

Page 17: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

ACCESS

Preserve individual or organizational identity by customizing the Dataverse look and feel by incorporating logos and HTML/CSS

Brand Dataverse

Page 18: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

ACCESS

Set and enforce access restrictions in the Dataverse according to data access policies

Set Access Restrictions

Page 19: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION PIPELINE

DIP

SIP

AIP

Review Files

Develop Plan

Normalize Files

Build Document

Set

Clean Data

Assemble AIP

Apply Standard

Vocab

Generate Metadata

Set Access Restrictions

Brand Dataverse

Review & Test

Publish Data

Set Terms of Use

DEPOSIT TRIAGE PROCESSING ACCESS

Page 20: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION SERVICE LEVELS

Guided Service

Lifecycle Service

Self-Service

Page 21: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION SERVICE LEVELS

Self-Service

✚ Standardized metadata

✚ Limited user support

✚ Dataverse tool access

✚ Persistent identification

✚ Data citation

✚ Basic utilization reports

✚ Long-term preservation

Page 22: Metadata & Data Curation Services by Thu-Mai Christian

Guided Service

DATA CURATION SERVICE LEVELS

✚ Introductory training

✚ Dataverse branding

✚ Collection arrangement

✚ Metadata templates

✚ Standard user support

Page 23: Metadata & Data Curation Services by Thu-Mai Christian

Lifecycle Service

DATA CURATION SERVICE LEVELS

✚ File normalization

✚ Data file review

✚ Access policy enforcement

✚ Education programming

✚ Dedicated user support

Page 24: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION SERVICE LEVELS

Special Services ✚ De-identification

✚ Data verification

✚ Secure data services

✚ Tool integration

Page 25: Metadata & Data Curation Services by Thu-Mai Christian

DATA CURATION SERVICE LEVELS

Clear articulation of data curation services

Emphasis on Dataverse value-added features

Advocacy for the adoption of data curation standards and best practices

A model for sustainability

Page 26: Metadata & Data Curation Services by Thu-Mai Christian

THANK YOU!

Thu-Mai Christian [email protected]

The Odum Institute

http://www.odum.unc.edu

@Odum_Institute

The Odum Institute