WelcomeWelcomeIPUMS/IECM-Europe Workshop:IPUMS/IECM-Europe Workshop:

Accomplishments, plans and challenges Accomplishments, plans and challenges https://international.ipums.org/international

* * ** * *Robert McCaa, Professor of population historyRobert McCaa, Professor of population history

University of MinnesotaUniversity of Minnesotarmccaa@umn.edu

for additional details, please seefor additional details, please see::www.hist.umn.edu/~rmccaa/ipums-europewww.hist.umn.edu/~rmccaa/ipums-europe

Introductions, organization and programIntroductions, organization and program» Thank youThank you

» CED: Dr. Anna Cabre, Albert Esteve & the IECM staffCED: Dr. Anna Cabre, Albert Esteve & the IECM staff» INED: Dr. Patrick Festy for hosting Paris meeting & ambitious INED: Dr. Patrick Festy for hosting Paris meeting & ambitious

program of supporting research activitiesprogram of supporting research activities» NSIs: for continued support over past 4 yearsNSIs: for continued support over past 4 years» New candidate NSIs: Kyrgyz Republic, Latvia, and UkraineNew candidate NSIs: Kyrgyz Republic, Latvia, and Ukraine

» Program (please see the workshop folder): an intensive dayProgram (please see the workshop folder): an intensive day» Invited speakers: NSIs, INED, CED (Barcelona)Invited speakers: NSIs, INED, CED (Barcelona)» MPC/CED: MPC/CED:

» Listen and learnListen and learn» Demonstrate what has been accomplished: recovery, confidentiality, Demonstrate what has been accomplished: recovery, confidentiality,

integration, disseminationintegration, dissemination» Show the websites and how to make good use of themShow the websites and how to make good use of them» Discuss plans and innovations for the 2Discuss plans and innovations for the 2ndnd five-year plan of IPUMS-Europe: five-year plan of IPUMS-Europe:

2010-20142010-2014

Introductions, organization and programIntroductions, organization and program» Thank youThank you

» CED: Dr. Anna Cabre, Albert Esteve & the IECM staffCED: Dr. Anna Cabre, Albert Esteve & the IECM staff» INED: Dr. Patrick Festy for hosting Paris meeting & ambitious INED: Dr. Patrick Festy for hosting Paris meeting & ambitious

program of supporting research activitiesprogram of supporting research activities» NSIs: for continued support over past 4 yearsNSIs: for continued support over past 4 years» New candidate NSIs: Kyrgyz Republic, Latvia, and UkraineNew candidate NSIs: Kyrgyz Republic, Latvia, and Ukraine

» Program (please see handouts): an intensive dayProgram (please see handouts): an intensive day» Invited speakers: NSIs, INED, CED (Barcelona)Invited speakers: NSIs, INED, CED (Barcelona)» MPC/CED: MPC/CED:

» Listen and learnListen and learn» Demonstrate what has been accomplished: recovery, confidentiality, Demonstrate what has been accomplished: recovery, confidentiality,

integration, disseminationintegration, dissemination» Show the websites and how to make good use of themShow the websites and how to make good use of them» Discuss plans and innovations for a 2Discuss plans and innovations for a 2ndnd five-year plan of IPUMS-Europe: five-year plan of IPUMS-Europe:

2010-20142010-2014

OutlineOutline

no. of slidesno. of slides

1. Introductions & Appreciations1. Introductions & Appreciations 22

2. Accomplishments—celebrate a success far beyond…2. Accomplishments—celebrate a success far beyond…a.a. Goals, objectives, milestones, accomplishmentsGoals, objectives, milestones, accomplishments 44b.b. Microdata inventoried and integratedMicrodata inventoried and integrated 44c.c. Confidentiality, Security and AccessConfidentiality, Security and Access 55

3. IPUMS/IECM Europe II: 3. IPUMS/IECM Europe II: plans and challengesplans and challenges 22» Censuses to integrate, 2010 round, tabulator, GIS, Censuses to integrate, 2010 round, tabulator, GIS,

Laboratories of High SecurityLaboratories of High Security

4. Invitation to 57th ISI 4. Invitation to 57th ISI (Durban, Aug 16-21 ’09)(Durban, Aug 16-21 ’09) 11

Workshop goals Workshop goals 1.1. Evaluate integrations to date: Evaluate integrations to date:

10 countries, 31 censuses10 countries, 31 censuses2.2. Discuss plans to complete the remaining integrations: Discuss plans to complete the remaining integrations:

5+ countries, 20+ censuses 5+ countries, 20+ censuses 3.3. Consider new initiativesConsider new initiatives

a.a. TabulatorTabulatorb.b. GIS files corresponding to the microdata GIS files corresponding to the microdata c.c. High Security Laboratory for 25-100% count microdata; elderly High Security Laboratory for 25-100% count microdata; elderly

over-sample, aging projectover-sample, aging project

4.4. Improve methods and procedures of the IPUMS/IECM Improve methods and procedures of the IPUMS/IECM projects projects

5.5. Reflect on the obstacles and challenges for the 2010 Reflect on the obstacles and challenges for the 2010 census round.census round.

6.6. Respond to doubts, questions, or concerns regarding Respond to doubts, questions, or concerns regarding any aspect of the collaboratoryany aspect of the collaboratory

Remember: objectives of IPUMSRemember: objectives of IPUMS

1.1. Preserve census microdata and documentation for all the Preserve census microdata and documentation for all the countries in the worldcountries in the world

2.2. Integrate microdata and metadata Integrate microdata and metadata

3.3. Disseminate--without cost--extracts of samples with the Disseminate--without cost--extracts of samples with the corresponding documentation to researcherscorresponding documentation to researchers

IPUMS MilestonesIPUMS Milestones

» 1995: IPUMS-USA first release of integrated microdata1995: IPUMS-USA first release of integrated microdata

IPUMS-USA continues: 1850-2000 + ACS IPUMS-USA continues: 1850-2000 + ACS samplessamples

» 1999: IPUMS-International funded1999: IPUMS-International funded

» 2002 - 12002 - 1stst International release: 7 countries, including International release: 7 countries, including Colombia and MexicoColombia and Mexico

» 2006 release: 20 countries, 63 censuses, 2006 release: 20 countries, 63 censuses, » 2008 release: 35 countries, 111 censuses2008 release: 35 countries, 111 censuses

» ~263 million person records~263 million person records

» Two thousand usersTwo thousand users» 2013 release: ~60 countries, ~200 censuses 2013 release: ~60 countries, ~200 censuses

Note: microdata are already entrusted to MPC Note: microdata are already entrusted to MPC

Some members of the IPUMS team (2008) Some members of the IPUMS team (2008)

(Not present: computer gurus, some researchers, and others who were too busy (Not present: computer gurus, some researchers, and others who were too busy to make time for taking a photo!)to make time for taking a photo!)

Steven Ruggles, inventor of IPUMS, Professor of History, and Director of the Minnesota Population Center

Inventory of census microdata archived by region Inventory of census microdata archived by region and decade (% of censuses conducted)and decade (% of censuses conducted)

•Note: cases confirmed by the corresponding official statistical institute. Some Note: cases confirmed by the corresponding official statistical institute. Some datasets remain to be certified. Some countries have not responded to the invitation to datasets remain to be certified. Some countries have not responded to the invitation to inventory their stocks of data. inventory their stocks of data. Source: http://www.hist.umn.edu/~rmccaa/IPUMS/country6.htmSource: http://www.hist.umn.edu/~rmccaa/IPUMS/country6.htm

Region/continent Countries 2000s 1990s 1980s 1970s   1960s

Latin America 21 100% 100% 89% 81% 72%

North America 27 91% 72% 64% 24% 8%

Africa 58 15% 22%  25%  15%  2% 

Asia 44 ?% 54% 31% 30% 13%

Europe 46 ?% 67% 55% 41% 13%

Pacific(pob>.5m) 7 100% 100% 100% 43% 29%

Integration: IPUMS-Europe in global context Integration: IPUMS-Europe in global context dark greendark green = already integrated = already integrated

(35 countries, 111 censuses, 263 millon person records)(35 countries, 111 censuses, 263 millon person records)green = to be integrated (39 countries, 103 censuses, 150 mill.)green = to be integrated (39 countries, 103 censuses, 150 mill.)

Mollweide projection

» Past: Thank you! Past: Thank you! » 15 statistical offices of Europe are cooperating with the 15 statistical offices of Europe are cooperating with the

IPUMS/IECM projects. IPUMS/IECM projects. » Assembled/Recovered: 50 sets of microdata & Assembled/Recovered: 50 sets of microdata &

documentationdocumentation» Present, Present, samples of 10 countries (31 censuses) of Europe:samples of 10 countries (31 censuses) of Europe:

» integrated in the IPUMS/IECM systems integrated in the IPUMS/IECM systems https://international.ipums.org/international & & www.iecm-project.org » Austria (4), Belarus (1), France (5+1), Greece (4), Hungary (4), Austria (4), Belarus (1), France (5+1), Greece (4), Hungary (4),

Netherlands (3), Portugal (3), Romania (2+1), Spain (3), and UK Netherlands (3), Portugal (3), Romania (2+1), Spain (3), and UK (2+ ?)(2+ ?)

» Integrated microdata, dynamic metadata, integrated Integrated microdata, dynamic metadata, integrated tabulatortabulator

» Future: 2009-14: Future: 2009-14:

IPUMS – Europe: past, present and futureIPUMS – Europe: past, present and future

» Past: Thank you! Past: Thank you! » Present , Present , samples of 10 countries (31 censuses) of Europe.samples of 10 countries (31 censuses) of Europe. » Future: 2009-14: Future: 2009-14:

» 2009/10: 2009/10: » Czech Republic (3+?), Germany (8), Switzerland (4), Slovenia (1), Czech Republic (3+?), Germany (8), Switzerland (4), Slovenia (1),

Turkey (2), and ???Turkey (2), and ???» New candidate countries: ???New candidate countries: ???» Additional censuses from: France, RomaniaAdditional censuses from: France, Romania» Sample error metadata for each census in database Sample error metadata for each census in database

» 2010-142010-14» Censuses of the 2010 round (entrusted before 2014)Censuses of the 2010 round (entrusted before 2014)» New features: GIS, Elderly over-sample, High Security Laboratories New features: GIS, Elderly over-sample, High Security Laboratories

with integrated microdata and metadatawith integrated microdata and metadata» Extended network: more countries, organizations (EuroStat?), Extended network: more countries, organizations (EuroStat?),

research centersresearch centers

IPUMS – Europe: past, present and futureIPUMS – Europe: past, present and future

IPUMS Statistical Confidentiality, IPUMS Statistical Confidentiality, Security and AccessSecurity and Access

»Cited by UN-ECE as “good practice”Cited by UN-ECE as “good practice”

»On-site inspection: the Dennis Trewin ReportOn-site inspection: the Dennis Trewin Report

Why was IPUMS cited as Why was IPUMS cited as “good practice” by “good practice” by the UN-ECE the UN-ECE

(2007, Annex 23, pp. 98-103)?(2007, Annex 23, pp. 98-103)?

http://www.unece.org/stats/documents/tfcm.htm

Good practices (see annex 23):Good practices (see annex 23):

1.1. High level of confidence and transparency between the High level of confidence and transparency between the researchers (users) and the national statistical institutesresearchers (users) and the national statistical institutes

2.2. The conditions of use are well definedThe conditions of use are well defined

3.3. Sanctions for misuse are clearly spelled outSanctions for misuse are clearly spelled out

4.4. Good use is assured by both juridical and administration Good use is assured by both juridical and administration mechanisms to prevent violationsmechanisms to prevent violations

5.5. Sanctions are imposed no only against those who misuse the Sanctions are imposed no only against those who misuse the data but also against their institutions.data but also against their institutions.

6.6. The data are anonymized by highly efficient technical meansThe data are anonymized by highly efficient technical means

The standard agreement between National Statistical The standard agreement between National Statistical Institutes and the University of MinnesotaInstitutes and the University of Minnesota

Statistical confidentiality and security:Statistical confidentiality and security:see the Trewin Reportsee the Trewin Report

» ““The best practice for an international The best practice for an international repository of microdata”repository of microdata”

» ““The security of IPUMS is first class…the The security of IPUMS is first class…the standard of the best national statistical offices”standard of the best national statistical offices”

» ““in full compliance with the principles and in full compliance with the principles and recommendations of the ECE”recommendations of the ECE”

3. IPUMS-Europe II, 2010-14: plans 3. IPUMS-Europe II, 2010-14: plans

PlansPlans1.1. Conclude the integration of the censuses of the Conclude the integration of the censuses of the

remaining countries in the region remaining countries in the region

2.2. Incorporate samples for the 2010 roundIncorporate samples for the 2010 round

3.3. Add digital boundary files at the second Add digital boundary files at the second administrative leveladministrative level

4.4. Facilitate pre-analysis with an on-line tabulatorFacilitate pre-analysis with an on-line tabulator

5.5. Construct Laboratories of High Security Construct Laboratories of High Security

IPUMS-Europe II, 2010-14: invitationIPUMS-Europe II, 2010-14: invitation

Invitation:Invitation:

1.1. Confirm participation in IPUMS-Europe IIConfirm participation in IPUMS-Europe II

2.2. Facilitate copies of digital boundary filesFacilitate copies of digital boundary files

3.3. In time, make available census microdata and In time, make available census microdata and documentation for the 2010 rounddocumentation for the 2010 round

4.4. Begin discussing participation in the IPUMS integrated Begin discussing participation in the IPUMS integrated high security laboratory (2012+)high security laboratory (2012+)

a.a. Adopt advanced security measuresAdopt advanced security measures

b.b. High density microdata (25-100%)High density microdata (25-100%)

c.c. Siting: Siting: i.i. MPC, national partners only?MPC, national partners only?

ii.ii. Eurostat?Eurostat?

iii.iii. Other academic? Other academic?

4. IPUMS at the 574. IPUMS at the 57thth ISI ISI (Durban, Aug 16-21, 2009)(Durban, Aug 16-21, 2009)http://www.statssa.gov.za/isi2009/index.aspxhttp://www.statssa.gov.za/isi2009/index.aspx

» IPUMS-NSI IPUMS-NSI Workshop Workshop (Sat, Aug 15)(Sat, Aug 15)

» STCPM STCPM session:session:cross-national cross-national microdatamicrodata

» IPUMS-Users IPUMS-Users Workshop Workshop

» IPUMS IPUMS Funding for Funding for delegates from delegates from developing developing country country

Thank you!!Thank you!!

rmccaa@umn.edurmccaa@umn.edu