Technical review of the data collection, scoring and analysis process

Technical review of the data collection, scoring and analysis process

14th National Microbiology Focal Points meeting

Katrin Leitmeyer, Senior Expert, Office of the Chief ScientistEuropean Centre for Disease Prevention and Control

14th NMFP, Stockholm, 12-13 May 2016

1

EULabCap data sources

1. Information on file at ECDC

− 20 indicators

− TESSy data by country

− EU disease network activity reports

2. NMFPs

− 40 indicators

− data available at the national level

− Self-assessment by competent body

2

EULabCap scores and indices

Score Interpretation Level

0 No or limited capability/capacity Low

1 Partial capability/capacity (e.g. below the EU target, or partial compliance)

Intermediate

2 Complete capability/capacity (e.g. EU target reached, or high compliance)

High

NA Capability/capacity not known or indicator not

applicable to country

Not scored

Capability indices - per target, dimension and overall (for each country and the EU/EEA)- aggregated scores, normalised to 10.

Indicator scores

3

Indicators modifications made between data call 2013 and 2014

For the data call 2014 the same indicators were used as in the2013 data call with the following modifications:

Indicator 3.23 “IBD-LabNet participation” (ECDC)Country was an active participant in the Invasive bacterial diseases in the EU Laboratory Network (IBD-LabNet).

• Indicator was not applicable / not scored in 2014 as participation to the workshop was not available to all the Member States.

4

Indicators modifications made between data call 2013 and 2014 (2)

NMFP Self-scoring ECDC scoring

Indicator 1.33 “C. difficile test rates” (NMFP; EU quartiles)Total number of C. difficile diagnostic tests performed/ 1000hospital inpatient days, based on national estimate.

Indicator 2.13 “NRL core functions” (NMFP)

The majority of NRLs delivered the following functions: (ECDC will use the answers provided for each function (indicators 2.13a to 2.13e) to calculate the indicator score).

Indicator 2.35 “HIV ARV genotyped” (NMFP)Total number of HIV isolates genotyped by ARV target sequence analysis divided by the total number of new HIV cases reported.

5


Score calculation method was slightly changed for:

Indicator 1.32 “Blood culture test rate” (ECDC; quartiles)Average number of blood culture sets tested/1 000 hospital inpatient days reported by EARS-Net participating hospitals from your country.

• “Non available/ non applicable” option was removed; in 2014, no data reporting was scored 0.

Indicator 2.24 “Serogroup STEC” (ECDC)Total number of O-serogrouped Shiga toxin-producing/ verotoxinproducing Escherichia coli (STEC/VTEC) isolates, divided by the total number of TESSy notified STEC/VTEC cases in accordance with EUcase definition/ECDC FWD network guidance.

• Non-typeable strains were included in the numerator in 2014.

6


Indicator 2.34 “N. meningitidis typed” (ECDC)Total number of invasive Neisseria meningitidis isolates typed by serogroup:MLST:porA:fetA method reported to TESSy divided by the total of number of invasive cases reported toTESSy”.

• Partial typing results obtained by either MLST or porA:fetAsequence analysis were included in the numerator in 2014.

Indicator 3.34 “L. monocytogenes genotyped” (NMFP)Ratio of the total number of Listeria isolates genotyped by pulsed-field gelelectrophoresis (PFGE), or by whole genome sequencing (WGS), by the totalnumber of notified cases (in percentage)”.

• Higher resolution typing method (WGS) were added in 2014 as some countries are performing solely this one.

7

Analysis and reporting – country report

NEW in 2014

• Executive summary

– How well was your country performing in 2014?

– How did your country progress compared to 2013?

8

Reflection on 2014 EULabCap process

• Feasible 30 EU/EEA countries responded

• Complete 95% complete*

No obvious learning curve effect

• Laborious Number of emails exchanged 408- Emails received 154

- Emails sent 254

• Belated not following the timeline for data submission and validation

* One indicator was not applicable/not scored

9

Timeline 2014 EULabCap data collection

2016

10

[email protected]

Technical review of the data collection, scoring and analysis process

Health & Medicine

Transcript of Technical review of the data collection, scoring and analysis process