National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

23
National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008

Transcript of National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

Page 1: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

National Adaptation Forms

International Study Centre

Data Management Seminar

Hamburg, July 2008

Page 2: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Adapting FT instruments

• All instruments have to be adapted– including those for English-speaking

countries

• Adaptations should be kept to a minimum

• Adaptations have to be documented in National Adaptation Forms (NAF)

• There should be consultation with the International Study Centre (ISC)

Page 3: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Types of adaptations

• There are parts of instruments that have to be adapted– Provision in translation notes and NAF– Usually in carets (< >)

• There may be the need for adapting other items– This should only be done when absolutely

necessary!

• In some cases, national centres may want to add items or categories– Should be discussed and agreed with ISC

Page 4: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Purpose of National adaptation forms

• Necessary information for translation verification

• Reference for layout verification

• Facilitates data processing– Documenting any deviation from

international format

Page 5: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Process of adapting instruments

• Completing NAF in cooperation with translator and reviewer (> Version I)

• Consultation about NAF with ISC (> Version II)

• Documenting any changes from translation verification (> Version III)

• Documenting any changes from layout verification (> Version IV)

Page 6: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

National adaptation forms (NAF)

• EXCEL format• One general information spreadsheet• Nine adaptation forms

– Cognitive test– Student questionnaire– Teacher questionnaire– School questionnaire– European regional test– European regional questionnaire– Latin American regional test– Latin American regional questionnaire

Page 7: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

General information spreadsheet

• Includes– Name of country– Language of instrument – ISC consultant name

• Record of dates for each NAF version Information on participation in international options

• Space for comments

Page 8: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Columns in NAF - 1

• Columns 1 to 3 should not be modified:– 1: International question numbers– 2: International question/category wording– 3: International variable or code

• Column 4 to 5 may have to be completed– Only when adding items or categories!– No changes for test items!

Page 9: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Columns in NAF - 2

• Columns 6 to 7 have to be completed when marked in yellow:– 6: National wording of adaptation– 7: English translation of this adaptation

• Column 8 is reserved for any comments NRC would like to make– Useful for consultation when implementing

adaptations that are additional

• Column 9 is reserved for comments by the ISC during the consultation

Page 10: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Adding items or categories

• Not acceptable for cognitive test(s)!

• Requires discussion and agreement with ISC

• Only acceptable in exceptional circumstances

• MUST be documented in NAF!

Page 11: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

International and national options

• International options will be included in NAF– National centres should indicate whether

they want to include the optional question(s)

• National options should be documented in the NAF– At the end of each questionnaire

spreadsheet space is provided for documenting national questions

Page 12: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Regional instruments

• Spreadsheet for regional instruments should be deleted from NAF for non-participating countries

• NAF for Asian regional module will be provided once the instrument is finalised

Page 13: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Adapting test items

• No additional items or categories are allowed

• Less room for adaptations than with questionnaire items

• Typically only some expressions in carets (< >) have to adapted, for example:– <Zedtown>– <female name>– <parliament/legislature>

Page 14: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Student questionnaire - 1

• Notes provided to guide adaptation

• Many required adaptations, in particular for background questions

• Examples of compulsory category adaptations are– ISCED levels for expected qualification

and parental education– Language spoken at home– Country of birth

Page 15: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Student questionnaire - 2

• Educational levels should be adapted following the international ISCED classification– http://www.uis.unesco.org/ev.php?URL_I

D=3813&URL_DO=DO_TOPIC&URL_SECTION=201

– Manuals in English, French, Spanish, Russian, Arabic and Chinese

• Where ISCED mapping is difficult, the ISC will help during consultation!

Page 16: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Student questionnaire - 3

• Expressions – <school parliament>– <local community>– <ethnic/racial groups>

• International options in StQ– Q2b Ethnic background of student– Q11b Household composition– Q34 – Q36 Questions on religion

Page 17: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Teacher questionnaire - 1

• Notes provided to guide adaptation

• Need to adapt terms that depend on national educational system

• Categories that need to be adapted, for example:– School subject categories

• Expressions that need to be adapted to national context as for example:– <deputy/assistant principal>– <school governing board/school council>

Page 18: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Teacher questionnaire - 2

• International option with questions for teacher teaching subjects related to civic and citizenship education

• <civic and citizenship education related subject> – to be adapted as subjects that at the

national level can be labelled as “civic and citizenship education”

Page 19: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

School questionnaire

• Notes provided to guide adaptation

• Need to adapt terms that depend on national educational system

• Expressions that need to be adapted to national context as for example:– <deputy/assistant principal>– <school governing board/school council>

Page 20: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

After completion of NAF

• Send NAF to [email protected] immediately after completion

• International Study Centre will respond within shortly and send NAF back with– indications whether adaptation is appropriate

from the ISC’s point of view (ok)– suggestions for changes (!)– possible questions for further clarification

• Modified NAF will become version II

Page 21: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Questions or comments?

Page 22: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Practical example - 1

• Cognitive test:– Provide adaptations for item codes 103

and 105

• Student background questionnaire– Provide adaptations for expected ISCED

qualifications A04a and A04b– Provide adaptations for country of birth

(B02)

Page 23: National Adaptation Forms International Study Centre Data Management Seminar Hamburg, July 2008.

ICCSDMS

HamburgJuly 2008

Practical example - 2

• Student perceptions questionnaire:– Provide adaptations for question H02

(trust in institutions)

• Teacher questionnaire– Provide adaptations for Q1 to Q3

• School questionnaire– Provide adaptations for Q5