DwB project and the Regional Workshops Roxane Silberman

CNRS-Réseau Quetelet and DwB coordinator

2nd DwB Regional Workshop, Athens 16-17 October, 2014

Outline• DwB project objective in short • DwB main outputs• Cooperation and Regional Workshops• 2Nd Regional Workshop, Athens

16-17, October 2014 2nd DwB Regional Workshop, Athens 2

Data without Boundaries

• A FP7 project, started in May 2011, will end in April 2015

• Increase researchers access to official microdata within the ERA, both European and national o With a a focus on transnational access to national highly

detailed microdata (ScUF) including administrative data

• In a context where data issues are increasingly important for research, for public policies, for the society o While new data, big data open new paths but also debates re.

privacy protection and open data

16-17, October 2014 2nd DwB Regional Workshop, Athens 3

Cooperation at the core of the project• Building cooperation between the different communities

o European Statistical System o CESSDA as a European research data infrastructure

• An essential mean to achieve the objective o Build a more understandable and efficient landscape for the

researchers and the producerso Develop exchanges resulting in better quality of data and more data

used o Better share the burden in a context of increasing demand

• 28 partners from the different communities (8 NSIs/NSAs)o And the whole communities continuously involved workshops

conferenceso Regional workshops as part of this effort

16-17, October 2014 2nd DwB Regional Workshop, Athens 4

From the state of play …

• A general trend towards more access to official microdata both at European and national level , however:

• A fragmented landscape: no single point of access for discovery and access, silos • Lack of information

o Metadata and information about access not available or insufficient, language issues

• Lack of harmonisation: terminology, procedures, implementation, standards, access systems

• Substantial obstacles o Legal frameworks and interpretations for ScUF and transnational access

• Resulting in o No access, unfriendly access, loss of time, duplication, no possibility to work

together for researcherso Rich resources underused for data producers and society

16-17, October 2014 2nd DwB Regional Workshop, Athens 5

… to the project objectives • Discovery

Discuss and prepare a single point of access Discuss standards and start improving metadata, solving language issues

• Access Share a common understanding of legal obstacles, interpretation and

possible solutions Discuss harmonisation of the accreditation procedures Propose an architecture and build a pilot for a European Remote Access

Network (EuRAN) for Secure Use Files Improve methods for anonymisation Support immediate use of OS by researchers

• Dialogue: Promote the dialogue between the different communities

16-17, October 2014 2nd DwB Regional Workshop, Athens 6

Main outputs from the project

• Different types o Operational productso Conceptso Plots, prototypes, proof of conceptso Standards`o Improved cooperation and changes in practices

16-17, October 2014 2nd DwB Regional Workshop, Athens 7

Discovery

• Users’ stories as a background

A long term perspective requiring active involvement of NSIs • Portal prototype for harvesting metadata with different standards and

guidelines & tools for stakeholders that will prepare single point of access aligned with the CESSDA catalogue`

Immediate operational productso MISSY: Eurostat metadata baseo CIMES: National OS metadata base o Routines for facilitating OS data usage (Data-reading “Setup Files”, .csv

data-importing R-scripts, etc.)

16-17, October 2014 2nd DwB Regional Workshop, Athens 8

MISSY (Microdata Information System)

• Documentation tool (provided by GESIS/Germany)

• Adapted for the needs of DwB for documenting Eurostat microdata • Database documenting EU-Integrated datasets• (SILC, LFS, AES, CIS and SES) • Down to the variable level + online information-

integrating codebook

• Friendly metadata

16-17, October 2014 2nd DwB Regional Workshop, Athens 9

16-17, October 2014 2nd DwB Regional Workshop, Athens 10September 2014 Developments and Challenges in European Microdata Access, Luxembourg 10

September 2014 Developments and Challenges in European Microdata Access, Luxembourg 10

CIMES (Centralising and Integrating Metadata from European Statistics)

• Documentation tool developed by CNRS-RQ and CASD/France • Metadata base currently documenting over 1900 national

studies from 28 European countries• DDI based

• Including a section on Type of files (PUF,CUF, SUF, ScUF) Criteria for access (researchers, PHD ..) Links to providers and application forms

16-17, October 2014 2nd DwB Regional Workshop, Athens 11

16-17, October 2014 2nd DwB Regional Workshop, Athens 12September 2014 Developments and Challenges in European Microdata Access, Luxembourg 12

16-17, October 2014 2nd DwB Regional Workshop, Athens 13September 2014 Developments and Challenges in European Microdata Access, Luxembourg 13

CIMES fieldsSeries level Study level Dataset level

Title Title Dataset Identification NumberSubtitle Subtitle NameAlternative Title Alternative Title Access conditionsAbstract Producer Other Access ConditionsKeywords Abstract Description of accreditation proceduresGeographic Coverage Keywords ContactTime Period Covered Geographic Coverage NotesTime Method UniverseNotes Sampling Procedure

Date of CollectionTime Period CoveredKind of DataDocumentsSourcesNotes

… and further developmentsSoon open for public

• Further developments: o More studies,o Variable level o Allow access for providers/producerso A basis for the CESSDA portal development

16-17, October 2014 2nd DwB Regional Workshop, Athens 14

AccessUsers’ stories and Use Cases as background • Immediate operational outputs: National accreditation & access

procedures factsheets, Legal Frameworks visualization tool• Standards: Accreditation Standard Design Principles, ISO Norm for Security

Requirements• Technical concept & workflow for a European Remote Access Network

(EuRAN) that would allow the researchers to work with data located in different RDCs/countries together with researchers located in different places + Pilot and Proof of Concept

• Guidelines for Output Checking, Innovative methods for SDC & Software package

16-17, October 2014 2nd DwB Regional Workshop, Athens 15

16-17, October 2014 2nd DwB Regional Workshop, Athens 16

Within the current framework, immediate support to researchers access

• DwB has supported real research projects (35 projects selected so far in 6 calls) o With 7 RDCs from 4 countries (France, Germany, Netherlands, UK)

cooperating together

• Training courses for the researchers on specific data sources (e.g. SILC, LFS, AES, Censuses)o 6 courses (5th in Barcelona on censuses; 6th in Athens on

AES)

September 2014 Developments and Challenges in European Microdata Access, Luxembourg 16

Dialogue and cooperation• Getting a better common understanding of respective needs

and requirements• Discussing and setting up solutions • Inside DwB and beyond, through workshops, events, visits

• 2 European Data Access Forum gathering all stakeholders about access issues, Next: Luxembourg, March 24-25, 2015

• 2 Users’ conferences bridging researchers and producerse about EU-LFS and EU-SILC in cooperation with GESIS and Eurostat, Mannheim, Next: March 5-6, 2015

• Staff visits in RDCs promoting Remote access as a basis for a EuRA

• And … Regional workshops

• .

16-17, October 2014 2nd DwB Regional Workshop, Athens 17

Regional workshops • Foster cooperation between archives and Nsis at national

level • Discuss best forms of cooperation • Crucial as a basis for setting up a European infrastructure

• 1st Regional workshop, Ljubljana Outputs (see presentation)

• 2nd Regional workshop, Athens, October 16-17, 2014

16-17, October 2014 2nd DwB Regional Workshop, Athens 18

2nd Regional workshop, Athens • Perimeter

Southern countriesCountries not involved in DWB projectExamples of cooperation developments in some other

countries

• Some specific situations No archivesNew process or on-going discussions in several countries

16-17, October 2014 2nd DwB Regional Workshop, Athens 19

Agenda• State of play on access to OS data and cooperation with focus

on the region

• Results from the 1st workshop

• Examples of NSIs and Archives activities regarding metadata and access to data

• Discussing cooperation based on examples in the region and elsewhere

16-17, October 2014 2nd DwB Regional Workshop, Athens 20

Thank you for listening and have a good work !

More information at: www.dwbproject.org

16-17, October 2014 2nd DwB Regional Workshop, Athens 21