Reliability of Divergent Thinking Tasksmodelingcreativity.org/blog/wp-content/uploads/... ·...

1
Reliability of Divergent Thinking Tasks Pre-registration of a meta-analysis Lea Naczenski 1 , Claire Stevenson 1 , Baptiste Barbot 23 1 Department of Psychological Methods, University of Amsterdam, Amsterdam, Netherlands 2 Child Study Centre, Yale University, New Haven, CT, United States 3 Pace University, New York, NY, United States Objective Divergent thinking tasks (DTT) are used to measure creative abilities, how they change over time or after an intervention. However, when you measure a person's creative abilities on two successive days, their performance can be quite different. How reliable are divergent thinking tasks for repeated assessment? Expectations +r (DT1 DT2)<+r (DT1 DT2) +r <+r +r <+r Analysis Plan Literature search Screening Selection Data extraction deduplication |’include’/’exclude’ based on criteria | two independent raters OVID PsychInfo | Medline | EMBASE |ERIC backward and forward search | grey literature, unpublished data through mailing researchers 1) DT 2) correlation of fluency between two separate administrations 3) if manipulation then control condition 4) if clinical population then healthy control Objective Divergent thinking tasks (DT) measure creative abilities, how they change over time or after an intervention. However, when you measure a person's creative abilities on two successive days, their performance can be quite different. How reliable are divergent thinking tasks for repeated assessment? according to schema incl. quality assessment: Please take a handout with you for more details concerning the project. | [email protected] Multivariate meta-analyses of Fisher‘s z- transformed correlation coefficients Random effects model estimated by restricted maximum likelihood Meta-regression incl. moderators for every 10 additional effect sizes Publication bias with p-uniform method Divergent thinking Baas, De Dreu & Nijstad (2011) Torrance (1981) Guilford & Hoepfner (1966) Test-retest reliability Alternate-form reliability Convergent validity Test-retest reliability Alternate-form reliability Convergent validity Test-retest reliability Alternate-form reliability Convergent validity

Transcript of Reliability of Divergent Thinking Tasksmodelingcreativity.org/blog/wp-content/uploads/... ·...

Page 1: Reliability of Divergent Thinking Tasksmodelingcreativity.org/blog/wp-content/uploads/... · Reliability of Divergent Thinking Tasks Pre-registration of a meta-analysis Lea Naczenski1,

Reliability of Divergent Thinking TasksPre-registration of a meta-analysis

Lea Naczenski1, Claire Stevenson1, Baptiste Barbot23

1Department of Psychological Methods, University of Amsterdam, Amsterdam, Netherlands2Child Study Centre, Yale University, New Haven, CT, United States 3Pace University, New York, NY, United States

ObjectiveDivergent thinking tasks (DTT) are used

to measure creative abilities, how they

change over time or after an intervention.

However, when you measure a person's

creative abilities on two successive days,

their performance can be quite different.

How reliable are divergent thinking tasks

for repeated assessment?

Expectations

+r (DT1 DT2)<+r (DT1 DT2)

+r <+r

+r <+r Analysis Plan

Literature search

Screening

Selection

Data extractiondeduplication |’include’/’exclude’ based on criteria | two independent raters

OVID

PsychInfo | Medline | EMBASE |ERIC

backward and forward search | grey literature,

unpublished data through mailing researchers

1) DT

2) correlation of fluency between two

separate administrations

3) if manipulation then control

condition

4) if clinical population then healthy

control

ObjectiveDivergent thinking tasks (DT) measure

creative abilities, how they change over

time or after an intervention. However,

when you measure a person's creative

abilities on two successive days, their

performance can be quite different. How

reliable are divergent thinking tasks for

repeated assessment?

according to schema incl. quality assessment:

Please take a handout with you for more details concerning the project. | [email protected]

• Multivariate meta-analyses of Fisher‘s z-

transformed correlation coefficients

• Random effects model estimated by restricted

maximum likelihood

• Meta-regression incl. moderators for every 10

additional effect sizes

• Publication bias with p-uniform method

Divergent thinking

Baas, De Dreu & Nijstad (2011)Torrance (1981)Guilford & Hoepfner (1966)

Test-retest reliability

Alternate-form reliability

Convergent validity

Test-retest reliability

Alternate-form reliability

Convergent validity

Test-retest reliability

Alternate-form reliability

Convergent validity