Implementation status of the ESS metadata Standards

Item 2.1

Standards Working Group meeting 2018

Véronique Delhaxhe-Wolmering

Eurostat, Unit B5

OVERVIEW

Implementation of ESMS and ESQRS

A screening in Eurostat - Results

ESS Metadata Handler: figures

Users' accesses: figures

ESS Metadata Handler: new functionalities

Training courses organised by Unit B/5

Standards Working Group meeting – July 2018

Implementation of ESMS and ESQRS at national level

In November 2015, the ESSC directed Eurostat to implement standard reporting structures (ESMS & ESQRS) in all European statistical domains. The implementation should be completed by end 2018.

Eurostat identified 104 statistical production processes.

For 80 of these, there are national data collections/ data transmissions and thus also the need for national reference metadata.

Standards Working Group meeting – July 2018

No data without metadata

Standards Working Group meeting – July 2018

Screening launched in May 2018

Standards Working Group meeting – July 2018

Standards Working Group meeting – July 2018

Results of the screening: total coverage

Standards Working Group meeting – July 2018

60.8%

70.6%

100.00%

Mandatory datasets All datasets

Results of the screening

Standards Working Group meeting – July 2018

59.6%

72.2%

51.8%

27.8%

70.7%

77.6%

75.6%

60.7%

41.7%

71.1%

Mandatory datasets All datasets

National accounts, prices & key indicators

Governmental finance statistics & quality

Sectoral & regional statistics

Social statistics

Global business statistics

Results of the screening: Coverage of mandatory datasets

Standards Working Group meeting – July 2018

0.0% 20.0% 40.0% 60.0% 80.0% 100.0%

77.6%

75.6%

57.9%

41.7%

69.7%

0.0%

0.0%

2.9%

0.0%

1.3%

22.4%

24.4%

39.3%

58.3%

28.9%

Current coverage Ongoing projects Uncovered

National accounts, prices & key indicators

Government finance statistics & quality

Sectoral & regional statistics

Social statistics

Global business statistics

Why the target was not achieved?

1. Implementation started with processes that did not have metadata reporting at all

2. Implementation for existing metadata reporting was more complex and time consuming: • Migrate

• Mapp concepts and sub concepts

• Estimated time needed for ESMS/ESQRS implementation was based on case 1

Next steps

1. Action plan to achieve full coverage

2. To start implementation with domains that already collect SIMS compliant metadata in excel/word

3. To prioritize domains that still do not collect national metadata with target on the most uncovered domains

4. To achieve and maintain a high level of reference metadata implementation.

Standards Working Group meeting – July 2018

ESS Metadata Handler in figures (11.06.2018)

Standards Working Group meeting - July 2018

Typologies Total April 2015

Total April 2016

Total May 2017

Total June 2018

ESMS 1947 2406 3251 4350

ESQRS 1888 2652 3309 4522*(1)

ESMS IPs 145 146 149 338*(2)

EPMS 102 102 103 105

Total 4082 5306 6812 9315

(1)* Included HICP Inventory (2)* Since mid-October 2017, creation of ESMS IP version 2.

ESS Metadata Handler in a chart

Standards Working Group meeting – July 2018

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

Total April 2015 Total April 2016 Total May 2017 Total May 2018

ESMS

ESQRS

ESMS IPs

EPMS

Total

ESS MH User access (11.06.2018)

Standards Working Group meeting - July 2018

Roles 2013 2014 2015 2016 2017 2018

Estat SUPADMIN 6 6 7 5 3 3 PUBLISHER (Estat / B5) 10 14 13 11 13 10

VALIDATOR (Estat) 91 301 307 308 322 345

SUPPROVIDER 42 50 45 52 59 63

PROVIDER 392 1086 1561 1855 2293 2653 VIEW (VIEW + SUPVIEW) 55 58 80 89 96

TOTAL 541 1512 1991 2311 2779 3170

Eurostat

New functionalities: Delete a file

• All roles except (Sup)viewers: Restore

• Publisher or higher: Restore & permanently delete

Standards Working Group meeting - July 2018

Eurostat

New functionalities: Hyperlinks are tested automatically

• When you send a metadata file for validation, the ESSMH checks your URL addresses

Standards Working Group meeting - July 2018

Training Courses June 2017-May 2018

Unit B/5 organised 28 training sessions (Webinars and in house trainings) on the following IT applications:

• ESS Metadata Handler

• EDIT and Validation

• Euro SDMX Registry

• SDMX Converter

• EDAMIS

Standards Working Group meeting - July 2018

Training courses: June 2017-May 2018 EDAMIS

Training course type Number of training Number of persons

EDAMIS3 Webinar for Data

provider and TCO 3 59

EDAMIS4 Webinar EWP for Data

Provider and TCOs 5 123

EDAMIS4 Webinar EWF Web

form for TCOs and Data

Providers 1 23

EDAMIS4 Webinar EWP for

Domain Managers 2 32

Total 11 238

Standards Working Group meeting - July 2018

Training courses: June 2017-May 2018 ESS-MH, EDIT and SDMX

Training course type Number of training Number of persons

ESS MH 8 131

EDIT 3 8

SDMX CONVERTER 2 47

Euro SDMX Registry 4 58

Total 17 244

Standards Working Group meeting - July 2018

Eurostat

Training courses: News

• New online self registration – EU Survey

• New online feedback form – EU Survey

Standards Working Group meeting – July 2018

Eurostat

New Self registration

Standards Working Group meeting - July 2018

Eurostat

New online feedback form

Quality surveys

Standards Working Group meeting - July 2018

• Evaluation type 1

•

• 1. Did the training meet your needs? Yes

• 2. Overall, I was satisfied with the course (rating from 5 – I completely agree – to 1 – I completely disagree).

• 3. I would recommend the course to others (rating from 1 – I completely disagree- to 5 – I completely agree).

• 4. The topics covered in the course covered my expectations with regard to the course description (rating from 1 – I completely disagree- to 5 – I completely agree).

Training course type Q1 Q2 Q3 Q4

EDAMIS3 EWP Webinar for

Data provider and TCOs 97 88 88 97

EDAMIS4 Webinar EWP for

Data Providers and TCOs 98 93 94 93

ESS MH 100 100 100 100

EDIT * * * *

SDMX CONVERTER 100 87 93 80

Euro SDMX Registry 100 96 95 95

*No respondents

New Quality surveys

• Evaluation type 2

•

• To what extent did you learn what you needed in this course? (0 à 100%)

• To what extent did your trainer(s) help you learn? (0 à 100%)

• Overall, how would you rate this course? (0 à 100%)

Training course type Q1 Q2 Q3

ESS MH 84 88 87

EDIT 65 75 80

SDMX CONVERTER 69 77 71

EDAMIS4 Webinar EWP for Data Providers and TCOs 77 81 90

EDAMIS4 Webinar EWF Web form for TCOs and Data Providers 79 74 77

EDAMIS4 Webinar EWP for Domain Managers 83 88 85

Standards Working Group meeting - July 2018

KEY INFORMATION

In case of problems, a single functional mailbox:

ESTAT-METADATA@ec.europa.eu

To access ESS Metadata Handler:

https://webgate.ec.europa.eu/estat/spe/metaconv/

Standards Working Group meeting - July 2018

• Thank you for your attention

Standards Working Group meeting - July 2018