Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

ESSnet on Data Collection for Social Surveys Using Multi Modes (DCSS)

UN-ECE Conference of European Statisticians

Seminar on Statistical Data Collection

Geneva, Switzerland , 25 -27 September 2013karen.blanke@destatis.de

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 2

Outline

Background and aims

Work in progress Query on Data Collection in Social

Surveys Web data Collection Mixed-Mode Data Collection

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 3

Some background

Initiated by Eurostat to support NSIs in: Developing web data collection tools Implementing and assessing the impacts of mixed mode data

Labor Force Survey (LFS) chosen as a concrete example

Duration of the project: autumn 2012 – 2014

Consortium: Partners (5): FI, NO, NL, UK, DE (coordinator) Support-group-members (3): SE, DK, IT External consultants

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 4

Query on Data Collection in Social Surveys (Preliminary results)

• Data collection: spring 2013• 37 NSIs (ESS & overseas)• 85 % response rate

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

21.04.23 Folie 5

• Diversity in mixed mode data collection in the NSIs

• Planning for implemenation of CAWI more than a third

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 6

WP II: Web data collection

CAWI questionnaires are … self-administered instruments computerised distributed via the net rich on functionalities and layout

However, ... “A product by itself has no value,

it has value only insofar as (functionalities) are used” (Dumas/Redish 1999)

http://www.thiossane.org/images/usability2.jpg

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Explanations (UK)

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 8

Placement & design of explanations (DE)

Text behind link

Keyword and text behind link

Directly visible text

Combination of visible text and link

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 9

Long lists & functionalities (DE)

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

DE: Error checks: soft/hard checks

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

11

Don‘t know options (NL)

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

12

Don‘t know options (NL)

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Functionalities & sensitive wording (FI)

Slide 13

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Smartphones (NO)

Slide 14

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 15

WP III: Multimode data collection

Mode effects: Review of current knowledge on mode effects How to analyse mode effects, in experiments and

in regular LFS production Impact of mode effects for the main variables of the LFS

Fieldwork and case –management systems & It-environment Impacts on weighting and estimation

►Recommend methodological activities to further harmonisation of MM data collection in the European Statistical System

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 16

Conclusion

Mixed-mode is very divers in the different countries

Tailored recommendations are requested due to different conditions and data collections strategies:

Different mm designs are less or more sensitive against mode-effects

Different applied modes are crucial to survey organisation Weighting & estimation is sophisticated

Implementation of Web questionnaires is very sensitive: Switch from interviewer administered to self-completion Change from oral to visual communication design

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Further contact:

Coordinator/WP II: Karen Blanke (karen.blanke@destatis.de)

Federal Statistical Office of Germany

WP III: Annemieke Luiten (a.luiten@cbs.nl)

CBS Statistics Netherlands

Eurostat: (http://www.cros-portal.eu)

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 18

Error messages (I): soft checks (DE)

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 19

Error messages (II): hard checks (DE)

Statistical Data Collection, 25-27 September 2013, Geneva

ESSnet DCSS

Slide 20

Placement & design of explanations (DE)

Text behind link

Keyword and text behind link

Directly visible text

Combination of visible text and link