Attrition control in a longitudinal Attrition control in a longitudinal

surveysurvey and and preventionprevention on on «« potentiallypotentially

nonnon--respondentsrespondents »»

Florent DomergueFlorent Domergue

DepartmentDepartment of of statisticsstatistics, , studiesstudies and documentationand documentation

General General secretariatsecretariat for immigration and for immigration and integrationintegration

Ljubljana – 17 July 2013

SummarySummary

�� PresentationPresentation of the ELIPA of the ELIPA surveysurvey

�� MethodsMethods to to limitlimit attritionattrition

�� Attrition in Attrition in otherother longitudinal longitudinal surveyssurveys

�� Non Non responseresponse correctioncorrection

�� TreatmentsTreatments on on «« potentiallypotentially nonnon--respondentsrespondents »»

The The DepartmentDepartment of of statisticsstatistics, , studiesstudies

and documentationand documentation

�� Part of the Part of the MinistryMinistry of the of the InteriorInterior sincesince 20102010

�� The The DepartmentDepartment includesincludes : an administrative data : an administrative data treatmentstreatmentsunit and a unit and a surveyssurveys and and studiesstudies unitunit

�� The French The French statisticsstatistics of of integrationintegration are made are made onlyonly in the in the DepartmentDepartment

�� Publications Publications relatedrelated to to mymy workwork ::Domergue, Jourdan : Domergue, Jourdan : http://jms.insee.fr/files/documents/2012/867_2http://jms.insee.fr/files/documents/2012/867_2--

JMS2012_S05JMS2012_S05--2_DOMERGUE2_DOMERGUE--ACTE.PDFACTE.PDFDomergue, Jourdan : Domergue, Jourdan : http://jms.insee.fr/files/documents/2012/957_2http://jms.insee.fr/files/documents/2012/957_2--

JMS2012_CA_S19_JOURDANJMS2012_CA_S19_JOURDAN--ACTE.PDFACTE.PDFJourdan, Bouvier : Jourdan, Bouvier : http://sondages2012.ensai.fr/wphttp://sondages2012.ensai.fr/wp--

content/uploads/2011/01/S9P2_BouvierJourdan.pdfcontent/uploads/2011/01/S9P2_BouvierJourdan.pdf

�� In In progressprogress : Non : Non responseresponse correction for ELIPA correction for ELIPA –– wavewave 33

The The DepartmentDepartment of of statisticsstatistics, , studiesstudies

and documentationand documentation

Main publications (Main publications (relatedrelated to ELIPA) : to ELIPA) :

generalgeneral overviewoverview (Domergue(Domergue--Regnard)Regnard)

economiceconomic integrationintegration (Domergue(Domergue--Jourdan)Jourdan)

econometriceconometric evaluationevaluation of of languagelanguage training training (Le (Le QuentrecQuentrec))

OtherOther issues : issues : housinghousing, , educationeducation, , homogamyhomogamy, social network, , social network, refugeesrefugees, focus on , focus on

womenwomen, discrimination, discrimination

(Bouvier, (Bouvier, BreemBreem, , CoirierCoirier, Collet, Domergue, Garcin, Jourdan, , Collet, Domergue, Garcin, Jourdan, LeQuentrecLeQuentrec, Regnard), Regnard)

SeeSee : http://www.immigration.interieur.gouv.fr/Info: http://www.immigration.interieur.gouv.fr/Info--ressources/Documentation/Etudes/Etudesressources/Documentation/Etudes/Etudes--etet--documentsdocuments

And :And : hhttp://www.immigration.interieur.gouv.fr/Infottp://www.immigration.interieur.gouv.fr/Info--ressources/Documentation/Publicationsressources/Documentation/Publications

ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the

integrationintegration of firstof first--time time arrivalsarrivals

�� French public French public statisticalstatistical system system surveysurvey

�� ConductedConducted alongsidealongside OECD, INSEEOECD, INSEE……

�� FundedFunded by by bothboth the the MinistryMinistry and the European and the European CommissionCommission

�� Total Total costcost : 3 M : 3 M -- 3,5 M 3,5 M €€ over over threethree waveswaves

�� Migrants Migrants whowho gotgot theirtheir first first residenceresidence permit in 2009, permit in 2009, allowingallowing themthem to to staystay in France in France atat least one least one yearyear (but (but likelylikely to to staystay indefinitelyindefinitely).).

�� AgedAged 18 and over18 and over

�� ComingComing fromfrom «« thirdthird countriescountries »», i.e. , i.e. outsideoutside EEA and EEA and SwitzerlandSwitzerland and living in 4 and living in 4 regionsregions in Francein France

�� SignatoriesSignatories of the of the «« receptionreception and and integrationintegrationcontractcontract »» (R&I)(R&I)

�� Questionnaire Questionnaire translatedtranslated in 14 in 14 languageslanguages

ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the

integrationintegration of firstof first--time time arrivalsarrivals

�� KnowledgeKnowledge of the of the integrationintegration pathpath of the new of the new migrantsmigrants

EconomyEconomy ((activityactivity, , incomeincome))

«« HumanHuman capitalcapital »» ((languagelanguage skillsskills, , educationeducation))

Living conditions (Living conditions (housinghousing, , familyfamily and social life, and social life, accessaccess to to rightsrights……))

�� Evaluation of public Evaluation of public policiespolicies of of receptionreception

MigratoryMigratory and administrative and administrative processesprocesses

AssessmentAssessment of the R&Iof the R&I

ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the

integrationintegration of firstof first--time time arrivalsarrivals

�� 11stst wavewave : : springspring 20102010

6,107 people 6,107 people interviewedinterviewed

�� 22ndnd wavewave : : springspring 20112011

4,756 people 4,756 people interviewedinterviewed (78 %)(78 %)

�� 33rdrd wavewave : : springspring 20132013

3,573 people 3,573 people interviewedinterviewed (75 %)(75 %)

ELIPA : Longitudinal ELIPA : Longitudinal surveysurvey on the on the

integrationintegration of firstof first--time time arrivalsarrivals

�� LimitLimit attrition due to nonattrition due to non--contactcontact

�� LimitLimit attrition due to attrition due to refusalrefusal

MethodsMethods usedused to to limitlimit attritionattrition

�� ReplyReply coupon coupon delivereddelivered to to respondentsrespondents in W1in W1

�� A A twotwo--stage stage followfollow--up :up :

TelephoneTelephone followfollow--upup

ReplyReply coupon (coupon (onlyonly for people for people unreachableunreachable by phone)by phone)

�� MatchingMatching withwith an administrative sourcean administrative source

LimitLimit attrition due to nonattrition due to non--contactcontact

FollowFollow--up data up data

81 %

19 %

6,107 respondents in

wave 1

711 people reached by

coupon (267 new

addresses)

1,182 people unreached

(neither by phone nor by

coupon)

1,893 people unreached

by phone

4,214 people reached by phone (990

new addresses)

69 % 31 %

19 %12 %

The administrative sourceThe administrative source

�� ResidenceResidence permitspermits databasedatabase

�� MatchingMatching made possible made possible throughthrough the the numbernumber of of theirtheirresidenceresidence permit, permit, askedasked to to respondentsrespondents

�� Double contribution : Double contribution :

ProvidesProvides new new addressesaddresses uncollecteduncollected by the initial by the initial followfollow--upup

Corrects the Corrects the addressesaddresses whenwhen theythey are are incompleteincomplete

�� In all, 500 In all, 500 addressesaddresses have been have been foundfound or or modifiedmodified

LimitLimit attrition due to attrition due to refusalrefusal

�� SendingSending of (in the of (in the effective effective languagelanguage of the interview) :of the interview) :

A A prepre--notification notification letterletter

A brochure on the main A brochure on the main resultsresults of the first of the first wavewave

�� SurveyedSurveyed people people requestionedrequestioned by the by the samesame

interviewer, if possibleinterviewer, if possible

�� TollToll--free free numbernumber

ComparisonsComparisons withwith previousprevious

longitudinal longitudinal surveyssurveys

DateSample

size

Response

rate (%)

Wave 1 march 94-dec 95 5,192

Wave 2 march 95-feb 97 4,465 86

Wave 3 march 97-feb 99 3,894 87

Wave 1 april 01-may 02 12,040

Wave 2 dec 02-dec 03 9,322 77

Wave 3 nov 04-nov 05 7,716 83

Wave 1 june 03-june 04 8,573

Wave 2 2007-2009 3,500 40

Wave 1 may 05-april 07 7,137

Wave 2 may 06-april 08 6,156 86

Wave 3 nov 07-oct 09 5,144 84

Wave 1 sept 06-jan 07 6,280

Wave 2 sept 07-dec 07 3,882 62

Wave 1 march 10-june 10 6,107

Wave 2 march 11-june 11 4,756 78

Wave 3 march 13-june 13 3,573 75

ELIPA (France)

LisNZ (New Zealand)

PPM (France)

Surveys

LSIA 1 (Australia)

Elic (Canada)

Nis (USA)

WhatWhat cancan explainexplain ElipaElipa’’ss lowerlower

attrition attrition comparedcompared to PPM ?to PPM ?

�� The use of the administrative source (500 The use of the administrative source (500 addressesaddresses))

�� The brochure on the main The brochure on the main resultsresults of the first of the first wavewave

�� The interviewers The interviewers experienceexperience ((mostmost of of themthemparticipatedparticipated in PPM)in PPM)

RefusalRefusal and non contact and non contact analysisanalysis

��ModellingModelling non non responseresponse due to due to refusalrefusal or non or non

contact contact involvesinvolves 5 types of variables :5 types of variables :

SocioSocio--demographicdemographic variablesvariables

Social life variablesSocial life variables

LanguageLanguage skillsskills variables variables

R&I variablesR&I variables

Variables Variables relatedrelated to the to the progressprogress of the interviewof the interview

Common Common characteristicscharacteristics of of refusalrefusal

and non contactand non contact

�� Young people Young people

�� LowLow levellevel of frenchof french

�� CommunityCommunity social networksocial network

�� LackLack of of interestinterest in the R&I trainingsin the R&I trainings

�� General General lacklack of of interestinterest in the in the wavewave 1 1 surveysurvey ::

An end of An end of periodperiod contactcontact

A qualitative postA qualitative post--surveysurvey refusalrefusal

Interviewer Interviewer poorlypoorly receivedreceived

WaveWave 3 : 3 : preventionprevention of attritionof attrition

� Limit attrition by focusing on a sub-population who isless likely to answer the survey (the « potentially non respondents »)

� 2 series of probability for the respondents in W2 :

Probability of being contacted

Probability of answering

«« The The potentiallypotentially nonnon--respondentsrespondents »»

Low 10%

Higher 90%

Total 100%

2%

8%

10%

8%

82%

90%

Probability of

answering the

survey

Probability of being

contacted

Low Higher

Total

WhatWhat guidances ?guidances ?

� End of period contact in wave 2

To be contacted as a priority

�Difficulties in understanding French during the interview

Suggest one of the 13 foreign languages

�All characteristics

Brochure on the results

Attrition in Attrition in WaveWave 33

75 65

25 35

0%

100%

Total (n=4,756) Priority interviews (n=190)

Success Failure

ThanksThanks for for youryour attentionattention