Research Data Management and the Research Data Lifecycle: a Gentle Introduction

Research Data Management and the Research Data Lifecycle: a Gentle Introduction

1 / 66

Research Data Management and the Research Data Lifecycle: aGentle Introduction

Glen [email protected]

http://zzzoot.blogspot.com/CNC/CODATA

November 26 2009(Updated: April 2010)

Invited speaker to the University of Ottawa School of Information Studies ISI5141 InformationBehaviours and Retrieval, Instructor: Andre Vellino

Outline

Some definitions

Data Sharing

Research & ResearchData Lifecycle

Research DataComplexity

Data Archiving

Data ManagementRoles

Conclusion

2 / 66

Some definitionsData SharingResearch & Research Data LifecycleResearch Data ComplexityData ArchivingData Management Roles

Conclusion

Some definitions

Some definitions

Data Sharing



Data Archiving


Conclusion

3 / 66

What is:n Research?n Research Data?n Research & Research Data Life Cycles?

Data Sharing

Some definitions

Data Sharing



Data Archiving


Conclusion

4 / 66

Data is becoming more important

Some definitions

Data Sharing



Data Archiving


Conclusion

5 / 66

In the past, more emphasis was given to publications.This is changing.

Diepenbroek, M., Schindler, U., Grobe, H. 2008.PANGAEA - An ICSUWorld Data Center as a Networked Publication and Library System for Geoscientific Data

http://hdl.handle.net/10013/epic.28613

Research Data Disappears

Some definitions

Data Sharing



Data Archiving


Conclusion

7 / 66

n The status quo is for most research data to (eventually)disappear: except for large well organized projects, historically

most research data collected has already disappeared.n Not through malice, just through mismanagement or more

accurately a lack of management

Degradation in information content associated with data and metadata over timeStatus quo

Time of publication

Specific details about problems with individual items or specificdates of collection are lost relatively rapidly

General details about the data collection are lostthrough time

Accident may destroydata and documentation

Retirement or career change makes access byscientists to mental storage difficult or unlikely

Death of investigator and subse-quent loss of remaining records

I

n

f

o

r

m

a

t

i

o

n

C

o

n

t

e

n

t

o

f

D

a

t

a

a

n

d

M

e

t

a

d

a

t

a

TimeNewton, G. 2009. After Michener et al. 1997, Ecological Applications 7:1:330-342

DOI 10.1890/1051-0761(1997)007[0330:NMFTES]2.0.CO;2

Why Share data?

Some definitions

Data Sharing



Data Archiving


Conclusion

9 / 66

n encourages scientific enquiry and debaten enables scrutiny of research outcomesn facilitates research beyond the scope of the original research

n leads to new collaborations between data users and datacreators

n reduces the cost of duplicating data collectionn provides important resources for education and trainingn encourages the improvement and validation of research

methodsn promotes the research that created the data and its outcomesn can provide a direct credit to the researcher as a research output

in its own right

Benefits of Data Sharing

Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research.

OECD. 2003. Promoting Access to Public Research Data for Scientific, Economic, and Social Development: OECD

Follow Up Group on Issues of Access to Publicly Funded Research Data.

http://dataaccess.ucsd.edu/Final Report 2003.pdf


Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research. Open access to,and sharing of, data reinforces open scientific inquiry,





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research. Open access to,and sharing of, data reinforces open scientific inquiry, encouragesdiversity of analysis and opinion,





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research. Open access to,and sharing of, data reinforces open scientific inquiry, encouragesdiversity of analysis and opinion, promotes new research,





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research. Open access to,and sharing of, data reinforces open scientific inquiry, encouragesdiversity of analysis and opinion, promotes new research, makespossible the testing of new or alternative hypotheses and methods ofanalysis,





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research. Open access to,and sharing of, data reinforces open scientific inquiry, encouragesdiversity of analysis and opinion, promotes new research, makespossible the testing of new or alternative hypotheses and methods ofanalysis, supports studies on data collection methods andmeasurement,





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research. Open access to,and sharing of, data reinforces open scientific inquiry, encouragesdiversity of analysis and opinion, promotes new research, makespossible the testing of new or alternative hypotheses and methods ofanalysis, supports studies on data collection methods andmeasurement, facilitates the education of new researchers,





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66

Within this new technological context, more widespread andefficient access to and sharing of research data will havesubstantial benefits for public scientific research. Open access to,and sharing of, data reinforces open scientific inquiry, encouragesdiversity of analysis and opinion, promotes new research, makespossible the testing of new or alternative hypotheses and methods ofanalysis, supports studies on data collection methods andmeasurement, facilitates the education of new researchers, enables

the exploration of topics not envisioned by the initial investigators,





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66


the exploration of topics not envisioned by the initial investigators,and permits the creation of new data sets when data from multiple

sources are combined.





Some definitions

Data Sharing



Data Archiving


Conclusion

10 / 66


the exploration of topics not envisioned by the initial investigators,and permits the creation of new data sets when data from multiple

sources are combined.Sharing and open access to publicly funded research data not onlyhelps to maximize the research potential of new digital technologiesand networks, but provides greater returns from the publicinvestment in research.




Unpredicted reuse

Some definitions

Data Sharing



Data Archiving


Conclusion

11 / 66

n Data often has value beyond that planned or even imagined bythe collector of the data

n And combining it with other data can often support thediscovery of emergent processes

Unpredicted reuse

Some definitions

Data Sharing



Data Archiving


Conclusion

12 / 66

What is the following?

Page from ships log

Some definitions

Data Sharing



Data Archiving


Conclusion

14 / 66

New Zealand, October 1769

Captain Cooks logs

Some definitions

Data Sharing



Data Archiving


Conclusion

17 / 66

His Majestys Bark [a type of ship] Endeavour on Her Passage Onthe Coast of New Zealand from Poverty Bay to SouthwOctober 15th 1769; Course: S 20 E; Winds: Vary; Location:

39

50

180

51; Moderate and fair weather...thunder and spitting

rain... Log 39, page 79. UK National Archives

n Record of date, time, location (lat/long), the sea conditions andlocal weather conditions

n Now being mined by JISC, the University of Sunderland, theMet Office Hadley Centre and the British Atmospheric DataCentre for climate change researchhttp://www.nationalarchives.gov.uk/news/stories/371.htm

Research & Research Data Lifecycle

Some definitions

Data Sharing



Data Archiving


Conclusion

19 / 66

Lyon, L. 2007. Dealing with Data: Roles, Rights, Responsibilities and Relationshipshttp://www.ukoln.ac.uk/ukoln/staff/e.j.lyon/reports/dealing with data report-final.pdf

Humphreys, C. 2006. e-Science and the Life Cycle of Researchhttp://datalib.library.ualberta.ca/humphrey/lifecycle-science060308.doc

Lord, P., A. Macdonald, L. Lyon & D. Giarretta. 2004.From Data Deluge to Data Curation. In Proceedings of the UK e-science

http://www.ukoln.ac.uk/ukoln/staff/e.j.lyon/150.pdf

Pepe,A. & Mayernik, M & Borgman, C. & Van de Sompel, H.Technology to Represent Scientific Practice: Data, Life Cycles, and Value Chains

http://arxiv.org/abs/0906.2549

Research Data Complexity

Some definitions

Data Sharing



Data Archiving


Conclusion

24 / 66


Some definitions

Data Sharing



Data Archiving


Conclusion

25 / 66

n Datan Metadatan Transformations (derived data/metadata), combinationsn More Metadata


Some definitions

Data Sharing



Data Archiving


Conclusion

26 / 66

Real research projects can have extemely complex data collectionand management.

Wallis, J. 2008. Moving Archival Practices Upstream: An Exploration of the Life Cycleof Ecological Sensing Data in Collaborative Field Research Lineage

Retrieval for Scientific Data Processing: A Survey.The International Journal of Digital Curation 1:3

http://www.ijdc.net/index.php/ijdc/article/view/67


Some definitions

Data Sharing



Data Archiving


Conclusion

28 / 66

Real research projects often have data that is described by manymetadata standards

Brandt, D.S. 2007. Data, research, metadata, metaresearch.ACRL/STS, ALA annual meeting

http://ala.org/ala/mgrps/divs/acrl/about/sections/sts/programs/annual2007programs/brandt.pdf


Some definitions

Data Sharing



Data Archiving


Conclusion

30 / 66

As data is transformed, translated, filtered, combined with otherdata in a research data workflow, lineage or provenance metadatacan capture the nature of these changes.

Bose, R. & Frew, J. 2005. Lineage Retrieval for Scientific Data Processing: A Survey.ACM Computing Surveys 37:1

http://dx.doi.org/10.1145/1057977.1057978


Some definitions

Data Sharing



Data Archiving


Conclusion

32 / 66

Some of these work flows can be very complex.

Davidson, S. & Freire, J. 2008. Provenance and scientific workflows: challenges and opportunities.SIGMOD 08: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data

http://dx.doi.org/10.1145/1376616.1376772

Freire,J. & Koop, D. & Santos, E. & Silva, C.T. 2008. Provenance for Computational Tasks: A Survey.Computing in Science & Engineering

http://dx.doi.org/10.1109/MCSE.2008.79

Barga, R. & Digiampietri,L. 2008. Automatic capture and efficient storage of e-Science experiment provenance.Concurrency and Computation: Practice and Experience 20:5:419-429

http://dx.doi.org/10.1002/cpe.1235

Bowers, S. & McPhillips, T. & Ludscher, B. 2008. Provenance in collection-oriented scientific workflows.Concurrency and Computation: Practice and Experience 20:5:519-529

http://dx.doi.org/10.1002/cpe.1235


Some definitions

Data Sharing



Data Archiving


Conclusion

37 / 66

Some transformations can cause metadata to become data!

Jones, M. and Schildhauer, P. and Reichman, O. and Bowers, Shawn. 2006.The New Bioinformatics: Integrating Ecological Data from the Gene to the Biosphere.

Annual Review of Ecology, Evolution, and Systematics 37:1:519-544.http://dx.doi.org/10.1146/annurev.ecolsys.37.091305.110031

Data Archiving

Some definitions

Data Sharing



Data Archiving


Conclusion

39 / 66

Data Archiving

Some definitions

Data Sharing



Data Archiving


Conclusion

40 / 66

n Mediumn Migration

Medium

Some definitions

Data Sharing



Data Archiving


Conclusion

41 / 66

n The physical storage medium both for analog and digitalstorage of information has an expected lifespan.

n Digital media can deteriorate and alter the underlying data (bits)of files well before their expected end of life

Miller, S. 2002. Bridging the Gap between Libraries and Data Archives: Progress Report.Presentation at Joint Informations Systems Committee (JISC, UK) and NSF Digital Libraries Initiative All Projects Meeting, Edinburgh, Scotland.

http://gdc.ucsd.edu:8080/digarch/about-project/presentations/edinburgh2002/view

Medium

Some definitions

Data Sharing



Data Archiving


Conclusion

43 / 66

Any single project can have a number of initial physical media.



Migration

Some definitions

Data Sharing



Data Archiving


Conclusion

45 / 66

n Before the endoflife of a medium, its contents need to becopied reliably (bits verified) to a new medium (the same kindor different)

n The provenance metadata needs to be updated when this occursn Sometimes the ability to read the old medium is difficult or not

possible, as the technology has progressed and due to the lackof availability of the appropriate working readers (i.e. 9track

tape readers)

Data Management Roles

Some definitions

Data Sharing



Data Archiving


Conclusion

46 / 66


Some definitions

Data Sharing



Data Archiving


Conclusion

47 / 66

Understanding roles in the research data workflow is helpful insucccessfully managing data.


Some definitions

Data Sharing



Data Archiving


Conclusion

48 / 66

One view:

Pryor, G. & Donnelly, M. 2009. Skilling Up to Do Data: Whose Role, Whose Responsibility, Whose Career?International Journal of Digital Curation 4:2

http://www.ijdc.net/index.php/ijdc/article/view/126

Roles & Responsibilities: Another view

Some definitions

Data Sharing



Data Archiving


Conclusion

50 / 66

n Scientist: creation and use of datan Institution: curation of and access to data

n Data centre: curation of and access to datan User: use of 3rd party datan Funder: set/react to public policy drivers

n Publisher: maintain integrity of the scientific record

Directly from: Lyon, L. 2007. Dealing with Data: Roles, Rights, Responsibilities and Relationshipshttp://www.ukoln.ac.uk/ukoln/staff/e.j.lyon/reports/dealing with data report-final.pdf

Roles & Responsibilities: Scientist

Some definitions

Data Sharing



Data Archiving


Conclusion

51 / 66

n Rights:u Of first use.u To be acknowledged.u To expect IPR to be honoured.u To receive data training and advice.

n Responsibilities:u Manage data for life of project.u Meet standards for good practice.u Comply with funder / institutional data policies and respect IPR

of others.u Work up data for use by others.

n Relationships:u With institution as employee.u With subject communityu With data centre.u With funder of work.


Roles & Responsibilities: Institution

Some definitions

Data Sharing



Data Archiving


Conclusion

52 / 66

n Rights:u To be offered a copy of data.

n Responsibilities:u Set internal data management policy.u Manage data in the short term.u Meet standards for good practice.u Provide training and advice to support scientists.u Promote the repository service.

n Relationships:u With scientist as employer.u With data centre through expert staff.


Roles & Responsibilities: Data Centre

Some definitions

Data Sharing



Data Archiving


Conclusion

53 / 66

n Rights:u To be offered a copy of data.u To select data of long-term value.

n Responsibilities:u Manage data for the long-term.u Meet standards for good practice.u Provide training for deposit.u Promote the repository service.u Protect rights of data contributors.u Provide tools for re-use of data.

n Relationships:u With scientist as clientu With user communities.u With institution through expert staff.u With funder of service.


Roles & Responsibilities: User

Some definitions

Data Sharing



Data Archiving


Conclusion

54 / 66

n Rights:u To re-use data (non-exclusive licence).u To access quality metadata to inform usability.

n Responsibilities:u Abide by licence conditions.u Acknowledge data creators / curators.u Manage derived data effectively.

n Relationships:u With data centre as supplier.u With institution as supplier.


Roles & Responsibilities: Funder (1/2)

Some definitions

Data Sharing



Data Archiving


Conclusion

55 / 66

n Rights:u To implement data policies.u To require those they fund to meet policy obligations.

n Responsibilities:u Consider wider public-policy perspective & stakeholder needs.

u Participate in strategy co-ordination.u Develop policies with stakeholders.u Participate in policy co-ordination, joint planning & fund service

delivery.u Monitor and enforce data policies.u Resource post-project long-term data management.u Act as advocate for data curation & fund expert advisory

service(s).u Support workforce capacity development of data curators.


Roles & Responsibilities: Funder (2/2)

Some definitions

Data Sharing



Data Archiving


Conclusion

56 / 66

n Relationships:u With scientist as funder.u With institution.u With data centre as funder.u With other funders.u With other stakeholders as policy-maker and funder of services.


Roles & Responsibilities: Publisher

Some definitions

Data Sharing



Data Archiving


Conclusion

57 / 66

n Rights:u To expect data are available to support publication.u To request pre-publication data deposit in long-term repository.

n Responsibilities:u Engage stakeholders in development of publication standards.

u Link to data to support publication standards.u Monitor & enforce public. standards.

n Relationships:u With scientist as creator, author and reader.u With data centres and institutions as suppliers.


Research Lifecycle

Some definitions

Data Sharing



Data Archiving


Conclusion

58 / 66

The Research Lifecycle needs to evolve to support DataManagement...









Conclusion

Some definitions

Data Sharing



Data Archiving


Conclusion

63 / 66

Conclusion

Some definitions

Data Sharing



Data Archiving


Conclusion

64 / 66

Not covered (brief introduction to...):n Research Data Plann Barriers to sharingn Data formatsn Indepth data and metadata examplesn National Consultation Access to Scientific Research Data

(2004)n Research Data Canada

Acknowledgments

Some definitions

Data Sharing



Data Archiving


Conclusion

65 / 66

n This presentation is derived from an yetuncompletedCNC/CODATA course: Data Management for Scientists

n Paul Budkewitsch, Larry Speers coauthors on this course

Contact and license

Some definitions

Data Sharing



Data Archiving


Conclusion

66 / 66

n Contact: Glen Newton [email protected] License: Creative Commons

Attribution-Noncommercial-Share Alike 2.5 Canada License;Paternit-Pas dUtilisation Commerciale-Partage des

Conditions Initiales lIdentique 2.5 Canadan Copyright: c2009 National Research Council;

c2010 Glen Newton and National Research Counciln Note: Various components copyright their respective owners

OutlineSome definitionsSome definitions

Data SharingData is becoming more importantResearch Data LifecycleResearch Data DisappearsfooWhy Share data?Benefits of Data SharingUnpredicted re--useUnpredicted re--usefooPage from ship's logfoofooCaptain Cook's logsfoo

Research & Research Data LifecycleResearch Data LifecycleResearch Data LifecycleResearch LifecycleResearch Lifecycle

Research Data ComplexityResearch Data ComplexityResearch Data ComplexityDataResearch Data ComplexityMore MetadataResearch Data ComplexityMore MetadataResearch Data ComplexityMore MetadataMore MetadataMore MetadataMore MetadataResearch Data ComplexityMore Metadata

Data ArchivingData ArchivingMediumResearch Data LifecycleMediumResearch Data LifecycleMigration

Data Management RolesData Management RolesData Management RolesRoles: One viewRoles & Responsibilities: Another viewRoles & Responsibilities: ScientistRoles & Responsibilities: InstitutionRoles & Responsibilities: Data CentreRoles & Responsibilities: UserRoles & Responsibilities: Funder (1/2)Roles & Responsibilities: Funder (2/2)Roles & Responsibilities: PublisherResearch LifecycleResearch LifecycleResearch LifecycleResearch LifecycleResearch Data Lifecycle

ConclusionConclusionAcknowledgmentsContact and license

Research Data Management and the Research Data Lifecycle: a Gentle Introduction

Technology

Transcript of Research Data Management and the Research Data Lifecycle: a Gentle Introduction