Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández...

42
Overview of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy- June 24-27, 2014 Note: These slides were prepared as part of the IEA training portfolio with the collaboration of IEA staff and resource persons.

Transcript of Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández...

Page 1: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the IDB Analyzer

Andrés Sandoval-Hernández – IEA DPC

Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets

Ispra, Italy- June 24-27, 2014

Note: These slides were prepared as part of the IEA training portfolio with the collaboration of IEA staff and resource persons.

Page 2: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Table of contents

• Introduction to the IEA IDB Analyzer

• Installation walkthrough

• Use of the IDB Analyzer

2

Page 3: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

• What is IEA IDB Analyzer?

– A software program developed by the IEA Data Processing and Research Center for analyzing data from all IEA surveys, (CivED, TIMSS, PIRLS, ICCS, TEDS-M, ICILS, SITES) and OECD studies (PISA, PIAAC, TALIS) and some cross-organizational

studies (IALS, ALLS)

– Handles complex sample designs and makes use of plausible value methodology (not used in TALIS!)

– Calculates correct standard errors when conducting analysis with large-scale surveys

– Uses optimized algorithms for computing means, percentages and regressions and other statistics

Introduction to IEA IDB Analyzer

3

Page 4: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

• BONUS!

– Easy creation of data sets for use in SPSS

– Merging countries and/or data levels

– Selection of analysis variables

Introduction to IEA IDB Analyzer

4

Page 5: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

What does it do?

• Compute estimates of percentages, means, percentiles, correlations, and linear regression parameters, including their respective standard errors

• Can handle properly the sampling and study-specific method to compute the correct standard errors

• Possibility to select more than one analysis variable when computing means

• Creates enhanced SPSS output on-screen and SPSS data file and Excel output file in the working folder

• Creates graphs for the descriptive analyses 5

Page 6: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Requirements

• Windows XP or higher, SPSS 15 or higher, .NET 4 and Microsoft Excel needs to be installed beforehand

• Administrator rights are required for installation process but not for use

6

Page 7: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Very common question: “Why can’t I just do this in SPSS?”

Answer: “Because of the data structure!”

– Sampling is multi-stage, clustered, and stratified which can not be handled correctly by SPSS (remember the sample design presentation!)

– SPSS can not do variance estimation using replication methods

– The plausible values

IDB Analyzer handles these issues and “adds” the missing features to SPSS

Why Do We Need IDB Analyzer?

7

Page 8: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Table of contents

• Introduction to the IEA IDB Analyzer

• Installation walkthrough

• Use of the IDB Analyzer

8

Page 9: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Installation walkthrough

• Double click on the setup file

(C:\EU_Workshop\Software\IEA_IDBAnalyzer_Setup_v3.1.14.exe)

9

Page 10: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Installation walkthrough • Follow through the wizard windows to a successful installation

10

Page 11: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Table of contents

• Introduction to the IEA IDB Analyzer

• Installation walkthrough

• Use of the IDB Analyzer

11

Page 12: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

How to Open the IDB Analyzer

• Start All Programs IEA IDBAnalyzerV3 IEA IDBAnalyzer

12

Page 13: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

What you will see…

One integrated environment, two modules

Prepare data for analysis

Conduct analysis

Help Manual

13

Page 14: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Table of contents

• Introduction to the IEA IDB Analyzer

• Installation walkthrough

• Use of the IDB Analyzer

• Merge Module

• Analysis Module

14

Page 15: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Merging Data Files

• Merge module

• Merges data from different respondents (e.g. in TALIS: school and teacher) and different countries

• Select source files

• Select participants

• Select variables

• Define the output (merged) file

• Create and save SPSS syntax for merging the data

• Execute the SPSS syntax to produce the merged dataset

15

Page 16: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Merge Module

Data Source Directory

Select... C:\EU_Workshop\Data

16

Page 17: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Merge Module

Select...

Data Source Directory

Participants

PIAAC PIAAC Cycle 1

17

Page 18: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Merge Module

Select... Data Source Directory

Participants

18

Page 19: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

File Types

Variables

Merge Module

Select...

3

2

You can search by name or description

1

19

Page 20: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Define File Name and Save

Merge Module

20

Page 21: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Merge Module

Syntax file is automatically stored in specified directory AND SPSS, the created syntax file is automatically opened

21

Page 22: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Merge Module

• From the SPSS syntax editor choose: – Run > All

– The syntax is executed and the merged file is saved under the location you have chose in the last step of the IDB Analyzer Merge Module

22

Page 23: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Merge Module

23

Page 24: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Table of contents

• Introduction to the IEA IDB Analyzer

• Installation walkthrough

• Use of the IDB Analyzer

• Merge Module

• Analysis Module

24

Page 25: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Analyzing data with the IEA IDB Analyzer

25

Page 26: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Choose file containing the data for analysis

Overview of the Analysis Module

26

Page 27: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

27

Page 28: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

• Percentages and Means

– Computes the percentages within specified subgroups and their mean and standard deviation on the continuous variable selected

– Also computes the appropriate standard errors for those percentages, means and standard deviations

28

Page 29: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

• Percentages Only

– Computes the percentages within specified subgroups

– Computes the appropriate standard errors for those percentages

29

Page 30: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

• Regression

– Computes a simple or multiple linear regression between a dependent variable and a set of independent variables

– Can apply dummy and effect coding on the fly to test for differences across groups

– Computes the regression coefficients and their corresponding standard errors

30

Page 31: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

• Correlations

– Calculates correlation coefficients between selected analysis variables their standard errors

31

Page 32: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

• Percentiles

– Calculates the score points that separate a given percentage of the distribution of a variable, by subgroups defined by the grouping variables with the respective standard errors

32

Page 33: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Mandatory for all analysis types

33

Page 34: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Applies to: Percentages and Means Regression Correlations

Percentiles 34

Page 35: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Applies to:

Regression

35

Page 36: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Select variables of interest

Search for variable by name or label

36

Page 37: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Selected automatically when file is opened

37

Page 38: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Add or remove variables

38

Page 39: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Choose the desired number of decimals in the output

39

Page 40: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Define the location of the output files to be produced

40

Page 41: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Overview of the Analysis Module

Start SPSS and produce syntax

41

Page 42: Overview of the IDB Analyzer - European Commission of the IDB Analyzer Andrés Sandoval-Hernández – IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy-

Any Questions?

Thank you for your attention!

42