DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

90
DDI 3.0 and SOEP Goebel & Wackerow Outline New Frontiers: Can Panel Studies Go DDI? First Experiences in Documenting the German Socio-Economic Panel Study with DDI 3.0 Jan Goebel 1 Joachim Wackerow 2 1 German SOEP Study, DIW Berlin 2 GESIS-ZUMA IASSIST, Montr´ eal, 17. May 2007

Transcript of DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

Page 1: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

OutlineNew Frontiers:

Can Panel Studies Go DDI?

First Experiences in Documenting the German Socio-Economic

Panel Study with DDI 3.0

Jan Goebel1 Joachim Wackerow2

1German SOEP Study, DIW Berlin

2GESIS-ZUMA

IASSIST, Montreal, 17. May 2007

Page 2: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

Outline

Outline

What is SOEP?DescriptionData Structure

SOEP & DDI 3.0 Grouping ModelOverviewExample: SOEPData Relationships

Page 3: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

Outline

Outline

What is SOEP?DescriptionData Structure

SOEP & DDI 3.0 Grouping ModelOverviewExample: SOEPData Relationships

Page 4: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Outline

What is SOEP?DescriptionData Structure

SOEP & DDI 3.0 Grouping ModelOverviewExample: SOEPData Relationships

Page 5: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What is SOEP?

I SOcio-Economic Panel StudyI Collect yearly representative microdata on the same

households and persons in the Federal Republic ofGermany since 1984 . . .

I . . . and since 1990 in East Germany.I Measuring Stability and Change in living conditions.

I In 2005, there were nearly 12,000 households, andmore than 21,000 persons sampled.

I Available for researchers in Germany and abroad

I More than 400 research groups currently using thedata

I All documentation as well as variable and valuelabels are available in German and English

I Part of the Cross-National Equivalent File (CNEF)

Page 6: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What is SOEP?

I SOcio-Economic Panel StudyI Collect yearly representative microdata on the same

households and persons in the Federal Republic ofGermany since 1984 . . .

I . . . and since 1990 in East Germany.I Measuring Stability and Change in living conditions.

I In 2005, there were nearly 12,000 households, andmore than 21,000 persons sampled.

I Available for researchers in Germany and abroad

I More than 400 research groups currently using thedata

I All documentation as well as variable and valuelabels are available in German and English

I Part of the Cross-National Equivalent File (CNEF)

Page 7: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What is SOEP?

I SOcio-Economic Panel StudyI Collect yearly representative microdata on the same

households and persons in the Federal Republic ofGermany since 1984 . . .

I . . . and since 1990 in East Germany.I Measuring Stability and Change in living conditions.

I In 2005, there were nearly 12,000 households, andmore than 21,000 persons sampled.

I Available for researchers in Germany and abroad

I More than 400 research groups currently using thedata

I All documentation as well as variable and valuelabels are available in German and English

I Part of the Cross-National Equivalent File (CNEF)

Page 8: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What is SOEP?

I SOcio-Economic Panel StudyI Collect yearly representative microdata on the same

households and persons in the Federal Republic ofGermany since 1984 . . .

I . . . and since 1990 in East Germany.I Measuring Stability and Change in living conditions.

I In 2005, there were nearly 12,000 households, andmore than 21,000 persons sampled.

I Available for researchers in Germany and abroad

I More than 400 research groups currently using thedata

I All documentation as well as variable and valuelabels are available in German and English

I Part of the Cross-National Equivalent File (CNEF)

Page 9: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What is SOEP?

I SOcio-Economic Panel StudyI Collect yearly representative microdata on the same

households and persons in the Federal Republic ofGermany since 1984 . . .

I . . . and since 1990 in East Germany.I Measuring Stability and Change in living conditions.

I In 2005, there were nearly 12,000 households, andmore than 21,000 persons sampled.

I Available for researchers in Germany and abroad

I More than 400 research groups currently using thedata

I All documentation as well as variable and valuelabels are available in German and English

I Part of the Cross-National Equivalent File (CNEF)

Page 10: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What is SOEP?

I SOcio-Economic Panel StudyI Collect yearly representative microdata on the same

households and persons in the Federal Republic ofGermany since 1984 . . .

I . . . and since 1990 in East Germany.I Measuring Stability and Change in living conditions.

I In 2005, there were nearly 12,000 households, andmore than 21,000 persons sampled.

I Available for researchers in Germany and abroad

I More than 400 research groups currently using thedata

I All documentation as well as variable and valuelabels are available in German and English

I Part of the Cross-National Equivalent File (CNEF)

Page 11: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What do we measure?

I SOEP data cover a wide range of subjects including:I Personality traitsI Occupational and family biographiesI Employment, participation and professional mobilityI EarningsI HealthI Personal satisfactionI Household composition, living situation

I Questionnaires:I Household (each year, head of household)I Personnel (each year, each person age 17 or older)I Biography (asked only once)I Triggered Questionnaires (e.g. “Mother & Child”,

when giving birth)

Page 12: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What do we measure?

I SOEP data cover a wide range of subjects including:I Personality traitsI Occupational and family biographiesI Employment, participation and professional mobilityI EarningsI HealthI Personal satisfactionI Household composition, living situation

I Questionnaires:I Household (each year, head of household)I Personnel (each year, each person age 17 or older)I Biography (asked only once)I Triggered Questionnaires (e.g. “Mother & Child”,

when giving birth)

Page 13: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What do we measure?

I SOEP data cover a wide range of subjects including:I Personality traitsI Occupational and family biographiesI Employment, participation and professional mobilityI EarningsI HealthI Personal satisfactionI Household composition, living situation

I Questionnaires:I Household (each year, head of household)I Personnel (each year, each person age 17 or older)I Biography (asked only once)I Triggered Questionnaires (e.g. “Mother & Child”,

when giving birth)

Page 14: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What do we measure?

I SOEP data cover a wide range of subjects including:I Personality traitsI Occupational and family biographiesI Employment, participation and professional mobilityI EarningsI HealthI Personal satisfactionI Household composition, living situation

I Questionnaires:I Household (each year, head of household)I Personnel (each year, each person age 17 or older)I Biography (asked only once)I Triggered Questionnaires (e.g. “Mother & Child”,

when giving birth)

Page 15: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Ideal Structure of a Panel Survey

“A data set containing observations on multiplephenomena observed over multiple time periodsis called panel data.” (Wikipedia: Panel Data)

I The same persons or households are interviewedeach year with the same instrument or questionnaire

I No change in documentation needed, except forupdating the year

I However, life is not that easy . . .

Page 16: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Ideal Structure of a Panel Survey

“A data set containing observations on multiplephenomena observed over multiple time periodsis called panel data.” (Wikipedia: Panel Data)

I The same persons or households are interviewedeach year with the same instrument or questionnaire

I No change in documentation needed, except forupdating the year

I However, life is not that easy . . .

Page 17: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Structure

I Most Data is on Person or Household Level(Dependence)

I Questionnaires and/or Variables are changing overtime

1. Improvement of instrument2. Changing real world3. Special Topics4. Changing Variable Names

I Principle Data Structure is Cross-Sectional⇒ New Datasets for each new wave (by year)

Page 18: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Structure

I Most Data is on Person or Household Level(Dependence)

I Questionnaires and/or Variables are changing overtime

1. Improvement of instrument2. Changing real world3. Special Topics4. Changing Variable Names

I Principle Data Structure is Cross-Sectional⇒ New Datasets for each new wave (by year)

Page 19: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Structure

I Most Data is on Person or Household Level(Dependence)

I Questionnaires and/or Variables are changing overtime

1. Improvement of instrument2. Changing real world3. Special Topics4. Changing Variable Names

I Principle Data Structure is Cross-Sectional⇒ New Datasets for each new wave (by year)

Page 20: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Structure

I Most Data is on Person or Household Level(Dependence)

I Questionnaires and/or Variables are changing overtime

1. Improvement of instrument2. Changing real world3. Special Topics4. Changing Variable Names

I Principle Data Structure is Cross-Sectional⇒ New Datasets for each new wave (by year)

Page 21: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Structure

I Most Data is on Person or Household Level(Dependence)

I Questionnaires and/or Variables are changing overtime

1. Improvement of instrument2. Changing real world3. Special Topics4. Changing Variable Names

I Principle Data Structure is Cross-Sectional⇒ New Datasets for each new wave (by year)

Page 22: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Structure

I Most Data is on Person or Household Level(Dependence)

I Questionnaires and/or Variables are changing overtime

1. Improvement of instrument2. Changing real world3. Special Topics4. Changing Variable Names

I Principle Data Structure is Cross-Sectional⇒ New Datasets for each new wave (by year)

Page 23: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Structure

I Most Data is on Person or Household Level(Dependence)

I Questionnaires and/or Variables are changing overtime

1. Improvement of instrument2. Changing real world3. Special Topics4. Changing Variable Names

I Principle Data Structure is Cross-Sectional⇒ New Datasets for each new wave (by year)

Page 24: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

Page 25: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

Individual Level

Household Level

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

Page 26: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

Individual Level

Address Log

Household Level

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

$HBRUTTO

Page 27: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

Individual Level

Address Log

Address Log

Household Level

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

$HBRUTTO

$PBRUTTO

Page 28: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

Individual Level

Individual QuestionnaireAddress Log

Address Log

Household Level

Household Questionnaire

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

$H

$P

$HBRUTTO

$PBRUTTO

Page 29: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

Individual Level

Individual QuestionnaireAddress Log

Address Log

Household Level

Household QuestionnaireGenerated and Status Variables

Generated and Status Variables

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

$HGEN

$PGEN

$H

$P

$HBRUTTO

$PBRUTTO

Page 30: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

Individual Level

Individual QuestionnaireAddress Log

Address Log

Household Level

Household QuestionnaireGenerated and Status Variables

Generated and Status Variables

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

$KIND

$HGEN

$PGEN

$H

$P

$HBRUTTO

$PBRUTTO

Page 31: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

Individual Level

Individual QuestionnaireAddress Log

Address Log

Household Level

Household QuestionnaireGenerated and Status Variables

Generated and Status Variables

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

$PKAL

$KIND

$HGEN

$PGEN

$H

$P

$HBRUTTO

$PBRUTTO

Page 32: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Data Structure

$PEQUIV

Individual Level

Individual QuestionnaireAddress Log

Address Log

Household Level

Household Questionnaire

GHOST

Generated and Status Variables

Generated and Status Variables

$: Wave specification: A, B, C, ... W for file names; where A=1984 ... W=2006 1: Waves G and H only; 2: Waves B through Q only; 3: Waves A through L only

Gross Information Generated InformationNet Information (Questionnaires)

$PKAL

$KIND

$HGEN

$PGEN

$H

$P

$HBRUTTO

The SOEP consists of265 datafiles and

after 22 Years!over 30,000 Variables

$PBRUTTO

Page 33: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Linkage Structure

Time (Years)

Wave T Wave U Wave V2003 2004 2005

TPUP

VP

Page 34: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Linkage Structure

persnrpersnr

Time (Years)

Wave T Wave U Wave V2003 2004 2005

TPUP

VP

Page 35: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Linkage Structure

PersonalLevel

HouseholdLevel

UHVH

TH

persnrpersnr

Time (Years)

Wave T Wave U Wave V2003 2004 2005

TPUP

VP

Page 36: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Linkage Structure

PersonalLevel

HouseholdLevel

UHVH

TH

thhnr

uhhnrvhhnr

persnrpersnr

Time (Years)

Wave T Wave U Wave V2003 2004 2005

TPUP

VP

Page 37: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

SOEP: Principle Linkage Structure

PersonalLevel

HouseholdLevel

persnr

persnr

persnrPPFA

D

UHVH

TH

HPF

AD

uhhnr

vhhnr

thhnr

thhnr

uhhnrvhhnr

persnrpersnr

Time (Years)

Wave T Wave U Wave V2003 2004 2005

TPUP

VP

Page 38: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Outline

What is SOEP?DescriptionData Structure

SOEP & DDI 3.0 Grouping ModelOverviewExample: SOEPData Relationships

Page 39: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What this Example is about!

I Description of the logical structure and possibilitiesto document a complex panel survey, like SOEP

I We do not focus on Physical representation of dataand frequencies

I We skip thinks likeI data format, column position, and width of variables

(module PhysicalDataProduct), as well asI Frequencies and descriptive statistics (module

PhysicalInstance)

I Each variable in those modules points by referenceto the overall definition of the variable in the moduleLogicalProduct

Page 40: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What this Example is about!

I Description of the logical structure and possibilitiesto document a complex panel survey, like SOEP

I We do not focus on Physical representation of dataand frequencies

I We skip thinks likeI data format, column position, and width of variables

(module PhysicalDataProduct), as well asI Frequencies and descriptive statistics (module

PhysicalInstance)

I Each variable in those modules points by referenceto the overall definition of the variable in the moduleLogicalProduct

Page 41: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What this Example is about!

I Description of the logical structure and possibilitiesto document a complex panel survey, like SOEP

I We do not focus on Physical representation of dataand frequencies

I We skip thinks likeI data format, column position, and width of variables

(module PhysicalDataProduct), as well asI Frequencies and descriptive statistics (module

PhysicalInstance)

I Each variable in those modules points by referenceto the overall definition of the variable in the moduleLogicalProduct

Page 42: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What this Example is about!

I Description of the logical structure and possibilitiesto document a complex panel survey, like SOEP

I We do not focus on Physical representation of dataand frequencies

I We skip thinks likeI data format, column position, and width of variables

(module PhysicalDataProduct), as well asI Frequencies and descriptive statistics (module

PhysicalInstance)

I Each variable in those modules points by referenceto the overall definition of the variable in the moduleLogicalProduct

Page 43: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What this Example is about!

I Description of the logical structure and possibilitiesto document a complex panel survey, like SOEP

I We do not focus on Physical representation of dataand frequencies

I We skip thinks likeI data format, column position, and width of variables

(module PhysicalDataProduct), as well asI Frequencies and descriptive statistics (module

PhysicalInstance)

I Each variable in those modules points by referenceto the overall definition of the variable in the moduleLogicalProduct

Page 44: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

What this Example is about!

I Description of the logical structure and possibilitiesto document a complex panel survey, like SOEP

I We do not focus on Physical representation of dataand frequencies

I We skip thinks likeI data format, column position, and width of variables

(module PhysicalDataProduct), as well asI Frequencies and descriptive statistics (module

PhysicalInstance)

I Each variable in those modules points by referenceto the overall definition of the variable in the moduleLogicalProduct

Page 45: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

The Idea of Grouping and Inheritance

I Hierarchical Model

I On the top level:definition of Informationas a standard

I On a lower level:capture of variationsand additions

I Inheritance of allcharacteristics ofstudies down thehierarchy tree ofmeta-data!

Group− Concept− Data Collection− Logical Product

Page 46: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

The Idea of Grouping and Inheritance

I Hierarchical Model

I On the top level:definition of Informationas a standard

I On a lower level:capture of variationsand additions

I Inheritance of allcharacteristics ofstudies down thehierarchy tree ofmeta-data!

− Concept− Data Collection− Logical Product

StudyUnit 1

− Concept− Data Collection− Logical Product

StudyUnit X

Group− Concept− Data Collection− Logical Product

Page 47: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

The Idea of Grouping and Inheritance

I Hierarchical Model

I On the top level:definition of Informationas a standard

I On a lower level:capture of variationsand additions

I Inheritance of allcharacteristics ofstudies down thehierarchy tree ofmeta-data!

− Concept− Data Collection− Logical Product

Subgroup 1

− Concept− Data Collection− Logical Product

Subgroup 1

− Concept− Data Collection− Logical Product

StudyUnit 1

− Concept− Data Collection− Logical Product

StudyUnit X

Group− Concept− Data Collection− Logical Product

Page 48: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

The Idea of Grouping and Inheritance

I Hierarchical Model

I On the top level:definition of Informationas a standard

I On a lower level:capture of variationsand additions

I Inheritance of allcharacteristics ofstudies down thehierarchy tree ofmeta-data!

− Concept− Data Collection− Logical Product

StudyUnit 1

− Concept− Data Collection− Logical Product

StudyUnit 1

− Concept− Data Collection− Logical Product

Subgroup 1

− Concept− Data Collection− Logical Product

Subgroup 1

− Concept− Data Collection− Logical Product

StudyUnit 1

− Concept− Data Collection− Logical Product

StudyUnit X

Group− Concept− Data Collection− Logical Product

Page 49: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easiest Task

I A variable like the PERSNR (never changing personID) is consistently defined with constant values overthe whole period and for all datasets (currently in169)

I Definition only necessary at the top-level(ConceptScheme, LogicalProduct)

I However most variables do change, at least thevariable name (within SOEP)!

Page 50: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easiest Task

I A variable like the PERSNR (never changing personID) is consistently defined with constant values overthe whole period and for all datasets (currently in169)

I Definition only necessary at the top-level(ConceptScheme, LogicalProduct)

I However most variables do change, at least thevariable name (within SOEP)!

Page 51: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easiest Task

I A variable like the PERSNR (never changing personID) is consistently defined with constant values overthe whole period and for all datasets (currently in169)

I Definition only necessary at the top-level(ConceptScheme, LogicalProduct)

I However most variables do change, at least thevariable name (within SOEP)!

Page 52: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

I Variables like School Degree or Life Satisfaction areconsistently defined with constant values over thewhole period, but with different names over time

I Basic Definition at the top-level (ConceptScheme,LogicalProduct, which include VariableScheme,CodeScheme, as well as CategoryScheme)

I At the lower level (StudyUnit), for each year the the“variable name part” of the variable definition will beadded

Page 53: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

I Variables like School Degree or Life Satisfaction areconsistently defined with constant values over thewhole period, but with different names over time

I Basic Definition at the top-level (ConceptScheme,LogicalProduct, which include VariableScheme,CodeScheme, as well as CategoryScheme)

I At the lower level (StudyUnit), for each year the the“variable name part” of the variable definition will beadded

Page 54: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

I Variables like School Degree or Life Satisfaction areconsistently defined with constant values over thewhole period, but with different names over time

I Basic Definition at the top-level (ConceptScheme,LogicalProduct, which include VariableScheme,CodeScheme, as well as CategoryScheme)

I At the lower level (StudyUnit), for each year the the“variable name part” of the variable definition will beadded

Page 55: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

GroupPerson Level

waves 1997−2003information for all

⇒ Corresponding Variables over Time can be identified bythe definition in the VariableScheme in the overall group.

Page 56: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

− Concept− Variable Definition− Question Text− Category Scheme− Code Scheme

Definition of:Group

Person Level

waves 1997−2003information for all

⇒ Corresponding Variables over Time can be identified bythe definition in the VariableScheme in the overall group.

Page 57: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

Wave N 1997(Satisfaction with life,

School Degree)

Study UnitWave O 1998

(Satisfaction with life,School Degree)

Study Unit

− Concept− Variable Definition− Question Text− Category Scheme− Code Scheme

Definition of:Group

Person Level

waves 1997−2003information for all

⇒ Corresponding Variables over Time can be identified bythe definition in the VariableScheme in the overall group.

Page 58: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

Add Definition of:− Changing Variable Names

Wave N 1997(Satisfaction with life,

School Degree)

Study UnitWave O 1998

(Satisfaction with life,School Degree)

Study Unit

GroupPerson Level

waves 1997−2003information for all

⇒ Corresponding Variables over Time can be identified bythe definition in the VariableScheme in the overall group.

Page 59: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The easy Task

Wave T 2003(Satisfaction with life,

School Degree)

Study Unit

Wave S 2002(Satisfaction with life,

School Degree)

Study Unit

Wave R 2001(Satisfaction with life,

School Degree)

Study Unit

Wave Q 2000(Satisfaction with life,

School Degree)

Study Unit

Wave P 1999(Satisfaction with life,

School Degree)

Study UnitWave N 1997

(Satisfaction with life,School Degree)

Study UnitWave O 1998

(Satisfaction with life,School Degree)

Study Unit

GroupPerson Level

waves 1997−2003information for all

⇒ Corresponding Variables over Time can be identified bythe definition in the VariableScheme in the overall group.

Page 60: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The realistic task

I Questionnaires and/or Variables are changing overtime (not only the names)

I Improvement of instrument with change in wording,categories . . .

I Changing real world with new or obsolete variablesI Special Topics in only some years

I Solution: Introduce Subgroups

Page 61: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The realistic task

I Questionnaires and/or Variables are changing overtime (not only the names)

I Improvement of instrument with change in wording,categories . . .

I Changing real world with new or obsolete variablesI Special Topics in only some years

I Solution: Introduce Subgroups

Page 62: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: The realistic task

I Questionnaires and/or Variables are changing overtime (not only the names)

I Improvement of instrument with change in wording,categories . . .

I Changing real world with new or obsolete variablesI Special Topics in only some years

I Solution: Introduce Subgroups

Page 63: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping Model: Example I

I Because of the European Monetary Union (1.1.2002)the currency of income changes from DM to e

I Insert two Subgroups (before and after)

Subgroup Subgroup

Time Period 1997−2001:

Currency DM

Person Level

Group

waves 1997−2003information for all

Time Period 2002−2003:

Currency EURO

Page 64: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping Model: Example I

I Because of the European Monetary Union (1.1.2002)the currency of income changes from DM to e

I Insert two Subgroups (before and after)

Definition of:− Concept− Variable Definition

Subgroup Subgroup

Time Period 1997−2001:

Currency DM

Person Level

Group

waves 1997−2003information for all

Time Period 2002−2003:

Currency EURO

Page 65: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping Model: Example I

I Because of the European Monetary Union (1.1.2002)the currency of income changes from DM to e

I Insert two Subgroups (before and after)

Add Definition of:− Question Text

Subgroup Subgroup

Time Period 1997−2001:

Currency DM

Person Level

Group

waves 1997−2003information for all

Time Period 2002−2003:

Currency EURO

Page 66: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping Model: Example I

I Because of the European Monetary Union (1.1.2002)the currency of income changes from DM to e

I Insert two Subgroups (before and after)

(household incomein DM and EURO)

(household incomein DM and EURO)

(household incomein DM and EURO)

(household incomein DM and EURO)

(household incomein DM and EURO)

(household incomeonly in EURO)

(household incomeonly in EURO)

Wave N 1997Study Unit

Wave O 1998Study Unit

Wave P 1999Study Unit

Wave Q 2000Study Unit

Wave R 2001Study Unit

Wave S 2002Study Unit

Wave T 2003Study Unit

Subgroup Subgroup

Time Period 1997−2001:

Currency DM

Person Level

Group

waves 1997−2003information for all

Time Period 2002−2003:

Currency EURO

Add Definition of:− Changing Variable Names

Page 67: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: Example II

Company Size Change in surveyed categoriesTwo different CodeSchemes(1997–1999 and 1999–2003)

Concerns about the e Only asked around the currencyunion (1999-2003)

⇒ Introduction of only two Subgroups

(1997–1998 and 1999–2003)

Page 68: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: Example II

Company Size Change in surveyed categoriesTwo different CodeSchemes(1997–1999 and 1999–2003)

1997–1998 1999–2003

Value Category Label Value Category Label

1 LT 5 1 LT 52 GE 5 and LT 20 2 GE 5 and LT 203 GE 20 and LT 200 3 GE 20 and LT 1004 GE 200 and LT 2000 4 GE 100 and LT 2005 GE 2000 5 GE 200 and LT 20006 NA, Self-Employed 6 GE 2000

7 Self-Employed

Concerns about the e Only asked around the currencyunion (1999-2003)

⇒ Introduction of only two Subgroups

(1997–1998 and 1999–2003)

Page 69: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: Example II

Company Size Change in surveyed categoriesTwo different CodeSchemes(1997–1999 and 1999–2003)

1997–1998 1999–2003

Value Category Label Value Category Label

1 LT 5 1 LT 52 GE 5 and LT 20 2 GE 5 and LT 203 GE 20 and LT 200 3 GE 20 and LT 1004 GE 200 and LT 2000 4 GE 100 and LT 2005 GE 2000 5 GE 200 and LT 20006 NA, Self-Employed 6 GE 2000

7 Self-Employed

Concerns about the e Only asked around the currencyunion (1999-2003)

⇒ Introduction of only two Subgroups

(1997–1998 and 1999–2003)

Page 70: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: Example II

Company Size Change in surveyed categoriesTwo different CodeSchemes(1997–1999 and 1999–2003)

Concerns about the e Only asked around the currencyunion (1999-2003)

⇒ Introduction of only two Subgroups

(1997–1998 and 1999–2003)

Page 71: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: Example II

Company Size Change in surveyed categoriesTwo different CodeSchemes(1997–1999 and 1999–2003)

Concerns about the e Only asked around the currencyunion (1999-2003)

⇒ Introduction of only two Subgroups

(1997–1998 and 1999–2003)

Page 72: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

DDI 3.0 Grouping: Example II

Wave O 1998Study Unit

Company Size

Study UnitWave N 1997Company Size

Subgroup SubgroupTime Period 1997−1998:

Size of Company

Person LevelGroup

waves 1997−2003information for all

Time Period 1999−2003:Size of Company and

Concerns about EURO

Study UnitWave P 1999Company Size

Study UnitWave R 2001

Company Size

Study UnitWave T 2003Company Size

Study UnitWave S 2002Company Size

Study UnitWave Q 2000Company Size

Concerns Euro Concerns Euro Concerns Euro

Concerns EuroConcerns Euro

Page 73: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Connected Data over Time(Wave Relationship)

PERSNR RP13501Satisfaction

123

56

4

n

4

62

8110

x

2001

I Top Group: Formal panel groupI Description of Wave relationship and case identifierI Inheritance down the hierarchical tree to each study

unit (wave level)

I The central case ID (here PERSNR) is described inthe section DataRelationship of the LogicalProduct

Page 74: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Connected Data over Time(Wave Relationship)

123

57

4

n

3

67

569

x

PERSNR SP13501Satisfaction

2002

PERSNR RP13501Satisfaction

123

56

4

n

4

62

8110

x

2001

I Top Group: Formal panel groupI Description of Wave relationship and case identifierI Inheritance down the hierarchical tree to each study

unit (wave level)

I The central case ID (here PERSNR) is described inthe section DataRelationship of the LogicalProduct

Page 75: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Connected Data over Time(Wave Relationship)

1

n x

PERSNR TP14201Satisfaction

7 8

3

56

4

107646

2003

123

57

4

n

3

67

569

x

PERSNR SP13501Satisfaction

2002

PERSNR RP13501Satisfaction

123

56

4

n

4

62

8110

x

2001

I Top Group: Formal panel groupI Description of Wave relationship and case identifierI Inheritance down the hierarchical tree to each study

unit (wave level)

I The central case ID (here PERSNR) is described inthe section DataRelationship of the LogicalProduct

Page 76: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Connected Data over Time(Wave Relationship)

1

n x

PERSNR TP14201Satisfaction

7 8

3

56

4

107646

2003

123

57

4

n

3

67

569

x

PERSNR SP13501Satisfaction

2002

PERSNR RP13501Satisfaction

123

56

4

n

4

62

8110

x

2001

I Top Group: Formal panel groupI Description of Wave relationship and case identifierI Inheritance down the hierarchical tree to each study

unit (wave level)

I The central case ID (here PERSNR) is described inthe section DataRelationship of the LogicalProduct

Page 77: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Connected Data over Time(Wave Relationship)

1

n x

PERSNR TP14201Satisfaction

7 8

3

56

4

107646

2003

123

57

4

n

3

67

569

x

PERSNR SP13501Satisfaction

2002

PERSNR RP13501Satisfaction

123

56

4

n

4

62

8110

x

2001

I Top Group: Formal panel groupI Description of Wave relationship and case identifierI Inheritance down the hierarchical tree to each study

unit (wave level)

I The central case ID (here PERSNR) is described inthe section DataRelationship of the LogicalProduct

Page 78: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Connected Data over Time(Wave Relationship)

1

n x

PERSNR TP14201Satisfaction

7 8

3

56

4

107646

2003

123

57

4

n

3

67

569

x

PERSNR SP13501Satisfaction

2002

PERSNR RP13501Satisfaction

123

56

4

n

4

62

8110

x

2001

I Top Group: Formal panel groupI Description of Wave relationship and case identifierI Inheritance down the hierarchical tree to each study

unit (wave level)

I The central case ID (here PERSNR) is described inthe section DataRelationship of the LogicalProduct

Page 79: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Household-Person Relationship

1

n

PERSNR

7

3

56

4

THHNR

x

Satisfaction

8107646

TP14201

122233

m

20032003

THHNRHH−IncomeHINC03

123

ym

50003500

800

I Top Group: Description of Household-Person(hierarchical) relationship

I Section DataRelationship

I Changing household ID on wave/study unit level

Page 80: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Household-Person Relationship

1

n

PERSNR

7

3

56

4

THHNR

x

Satisfaction

8107646

TP14201

122233

m

20032003

THHNRHH−IncomeHINC03

123

ym

50003500

800

I Top Group: Description of Household-Person(hierarchical) relationship

I Section DataRelationship

I Changing household ID on wave/study unit level

Page 81: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Household-Person Relationship

1

n

PERSNR

7

3

56

4

THHNR

x

Satisfaction

8107646

TP14201

122233

m

20032003

THHNRHH−IncomeHINC03

123

ym

50003500

800

I Top Group: Description of Household-Person(hierarchical) relationship

I Section DataRelationship

I Changing household ID on wave/study unit level

Page 82: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Conclusion

I Current possibilities:I Documentation of changes in meta data over time

(Panel Surveys)I Description of connected data over time, as well asI between hierarchical data (i.e. Household- and

Person-Level)

I LimitsI XML Structure getting very complex, need for tools

to create and maintain the XML File(s)I Existing documentation must may be reconsidered,

adapted or/and supplemented to fit into the newDDI structur, i.e. Concepts.

I However, still some open questions:I Integration in existent workflow?I Technical reorganization? XML-Database?

Page 83: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Conclusion

I Current possibilities:I Documentation of changes in meta data over time

(Panel Surveys)I Description of connected data over time, as well asI between hierarchical data (i.e. Household- and

Person-Level)

I LimitsI XML Structure getting very complex, need for tools

to create and maintain the XML File(s)I Existing documentation must may be reconsidered,

adapted or/and supplemented to fit into the newDDI structur, i.e. Concepts.

I However, still some open questions:I Integration in existent workflow?I Technical reorganization? XML-Database?

Page 84: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Conclusion

I Current possibilities:I Documentation of changes in meta data over time

(Panel Surveys)I Description of connected data over time, as well asI between hierarchical data (i.e. Household- and

Person-Level)

I LimitsI XML Structure getting very complex, need for tools

to create and maintain the XML File(s)I Existing documentation must may be reconsidered,

adapted or/and supplemented to fit into the newDDI structur, i.e. Concepts.

I However, still some open questions:I Integration in existent workflow?I Technical reorganization? XML-Database?

Page 85: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Conclusion

I Current possibilities:I Documentation of changes in meta data over time

(Panel Surveys)I Description of connected data over time, as well asI between hierarchical data (i.e. Household- and

Person-Level)

I LimitsI XML Structure getting very complex, need for tools

to create and maintain the XML File(s)I Existing documentation must may be reconsidered,

adapted or/and supplemented to fit into the newDDI structur, i.e. Concepts.

I However, still some open questions:I Integration in existent workflow?I Technical reorganization? XML-Database?

Page 86: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Conclusion

I Current possibilities:I Documentation of changes in meta data over time

(Panel Surveys)I Description of connected data over time, as well asI between hierarchical data (i.e. Household- and

Person-Level)

I LimitsI XML Structure getting very complex, need for tools

to create and maintain the XML File(s)I Existing documentation must may be reconsidered,

adapted or/and supplemented to fit into the newDDI structur, i.e. Concepts.

I However, still some open questions:I Integration in existent workflow?I Technical reorganization? XML-Database?

Page 87: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Conclusion

I Current possibilities:I Documentation of changes in meta data over time

(Panel Surveys)I Description of connected data over time, as well asI between hierarchical data (i.e. Household- and

Person-Level)

I LimitsI XML Structure getting very complex, need for tools

to create and maintain the XML File(s)I Existing documentation must may be reconsidered,

adapted or/and supplemented to fit into the newDDI structur, i.e. Concepts.

I However, still some open questions:I Integration in existent workflow?I Technical reorganization? XML-Database?

Page 88: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Page 89: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

XML-Example:

www.ddialliance.org/DDI/ddi3/SOEP DDI3.zip

J. Goebel: [email protected]

J. Wackerow: [email protected]

Page 90: DDI 3.0 and SOEP Goebel & Wackerow New Frontiers: Outline ...

DDI 3.0 and SOEP

Goebel & Wackerow

What is SOEP?

Description

Data Structure

SOEP & DDI 3.0Grouping Model

Overview

Example: SOEP

Data Relationships

Conclusion

Thank you for your attention!Enjoy the DDI soup!

(SOEP in Dutch = soup)

XML-Example:

www.ddialliance.org/DDI/ddi3/SOEP DDI3.zip

J. Goebel: [email protected]

J. Wackerow: [email protected]