The 2nd Pilot Study in Germany focussing on 8-year-olds

13
03.07.22 The 2nd Pilot Study in Germany focussing on 8-year-olds Zoe Clark, Sabine Andresen, Katharina Gerarts www.childrensworlds.org

description

The 2nd Pilot Study in Germany focussing on 8-year-olds. Structure. The pilot study Main result: „Kids are happy“ Abstract questions Content validity Problems with the scale Construct validity Some reservations about the questionnaire Possible next steps. - PowerPoint PPT Presentation

Transcript of The 2nd Pilot Study in Germany focussing on 8-year-olds

Page 1: The 2nd Pilot Study in Germany  focussing on 8-year-olds

20.04.23

The 2nd Pilot Study in Germany

focussing on 8-year-olds

Zoe Clark, Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 2: The 2nd Pilot Study in Germany  focussing on 8-year-olds

220.04.23

Structure

1. The pilot study

2. Main result: „Kids are happy“

a. Abstract questions

b. Content validity

c. Problems with the scale

d. Construct validity

3. Some reservations about the questionnaire

4. Possible next steps

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 3: The 2nd Pilot Study in Germany  focussing on 8-year-olds

320.04.23

1. Pilot Study: Work in Progress

Pilot study for 8-year-olds in Germany:

Mixed methods:

1. Quantitative pilot with 8-9 year olds (N=55)

2. Cognitive interviews with 8 year olds (N=3)

3. Group discussions with 8-9 year olds (2)

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 4: The 2nd Pilot Study in Germany  focussing on 8-year-olds

420.04.23

2. Main Result: „Kids are happy“

With our Data we Cannot go Further Beyond this Result: “Kids are happy”. Nearly all of the children agreed that they were happy with most of the things asked, like, for example:

-Family interaction

-School peer/friend interaction

-Subjective well-being

-With their town and neighbourhood

-School achievement

-Health

-Leisure time

-Things they have access to

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 5: The 2nd Pilot Study in Germany  focussing on 8-year-olds

520.04.23

2. Main Result: a. Abstract Questions

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 6: The 2nd Pilot Study in Germany  focussing on 8-year-olds

620.04.23

2. Main Result: a. Abstract questions

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 7: The 2nd Pilot Study in Germany  focussing on 8-year-olds

720.04.23

2. Main Result: b. Content Validity

Extended family [boy who lives with his parents]: I: “Who are you thinking about, if I ask you about your family?”

C: “About my uncle a little and also a little about playing with my friend.“

I: “Who are you thinking about?”

C: “Actually about everybody.”

I: “Do you have a big family?”

C: “I have big family.“

(Interview 3, line 25/26)

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Nuclear family [girl, living with parents and a brother]:

I: “ Who are you thinking about now, if it is about your family?C: “About my mother, my father, my brother.“

(Interview 1, line 41-42)

Who is the family? Three interviews, two family models:

There seem to be different concepts about the family in different sociocultural environments what does this mean for our questionnaire?

Page 8: The 2nd Pilot Study in Germany  focussing on 8-year-olds

820.04.23

2. Main Result:b. Content validity

1. Do the children understand the questions in the way they were intended?

2. Are we as researchers sure about the meaning of each question?

3. Is there one unequivocal meaning of the question?

4. Can the child duplicate that intended meaning?

5. Hence, can answers by different children to the same question be compared?

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 9: The 2nd Pilot Study in Germany  focussing on 8-year-olds

920.04.23

2. Main Result:c. Problems with the scale

• The middle category ‘neither...nor’ also caused confusion:

C2: “What should it mean: neither nor?

I: “If you do not agree and do not disagree.”

C2: “Thus it is somehow both?”

I: “yes, or none of them”

C2: “mhm” [she doesn’t sound very convinced].

(Interview 2, line 119)

• In addition, the children tend to transform the 5 likert scale into a binary scale.

• A 5 endpoint scale could be a good alternative:

Fully agree ○○○○○ fully disagree

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 10: The 2nd Pilot Study in Germany  focussing on 8-year-olds

1020.04.23

2. Main Results: d. Construct Validity: Independent

Factors?

Stability of the factors when rotated with others:

1. Items switch between factors when rotated

2. Some items have double loadings; they have similar loadings on more than one factor.

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 11: The 2nd Pilot Study in Germany  focussing on 8-year-olds

1120.04.23

3. Some Reservations about the Questionnaire

• The questionnaire consists of 59 single items which are related to at least 11 dimensions (plus demographic items). Is it suitable for 8 and 9 year olds?

• Do we need a better operationalization with respect to comparisons?

• Does the questionnaire show a tendency to solicit positive answers?

• How can we solve the problem of items having too little variance?

• Can we conclude that variance is related to a lack of content validity?

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 12: The 2nd Pilot Study in Germany  focussing on 8-year-olds

1220.04.23

4. Possible Next Steps

• A reduction in the number of dimensions restructure the questionnaire.

• More detailed operationalization of the items of those

dimensions used clearer questions

• Discussing the complexity of scales for eight year old

children.

• We should try to include more questions on the life

situation of children, to make questions better understood

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org

Page 13: The 2nd Pilot Study in Germany  focussing on 8-year-olds

1320.04.23

Thank you!

Prof. Dr. Sabine Andresen

Goethe-University Frankfurt

[email protected]

Zoe Clark

Goethe-University Frankfurt

[email protected]

Katharina Gerarts

World Vision Institute for Research and Innovation

[email protected]

www.childrensworlds.org

Zoe Clark, Prof. Sabine Andresen, Katharina Gerarts www.childrensworlds.org