Validity And Reliabilty
description
Transcript of Validity And Reliabilty
![Page 1: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/1.jpg)
This presentation was developed for the exclusive use of students enrolled in:
Educational Testing & Grading, Professor Gregory E. Stone.
© 2004 Gregory E. Stone. All rights reserved. This presentation may not be reproduced in any form, in part or as a whole, without the express written permission of the author.
![Page 2: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/2.jpg)
Validity & Reliability
Exam ScoreQuality
![Page 3: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/3.jpg)
No matter how well theobjectives are written,or how clever the items,the quality and usefulnessof an examination ispredicated on Validityand Reliability
Validity & Reliability
![Page 4: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/4.jpg)
Examination ScoreQuality
Evaluative
Statistical
Validity & Reliability
![Page 5: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/5.jpg)
Examination ScoreQuality
Validity
Reliability
Validity & Reliability
![Page 6: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/6.jpg)
BOTH CONCEPTSRELATE TO THE
SCORE NOTTHE TEST!
Validity
Reliability
Validity & Reliability
![Page 7: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/7.jpg)
Validity Reliability
Validity & Reliability
We don’t say “an exam is valid and reliable”
We do say “the exam score is reliable andValid for a specified purpose”
KEY ELEMENT!
![Page 8: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/8.jpg)
Reliability“Was the measure of studentability reached by accident orchance, or was it reached througha clear and stable, meaningfulexamination?”
Validity & Reliability
![Page 9: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/9.jpg)
ReliabilityAnswers questions relative tothe stability and clarity of anexamination.
Validity & Reliability
![Page 10: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/10.jpg)
Validity & Reliability
ReliabilityReliability is a STATISTIC.
Specifically, a correlationranging from
0 = Completely Unreliable1 = Perfectly Reliable
![Page 11: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/11.jpg)
Validity & Reliability
ReliabilityReliability is also a measure of
error within an examination.
Poor wording, ambiguity,correct answer issues, failure
to link with objectives, etc.
![Page 12: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/12.jpg)
Validity & Reliability
Content/Action + Error
![Page 13: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/13.jpg)
Validity & Reliability
Content/Action + Error
The information we seek and our best hope for obtaining it.
![Page 14: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/14.jpg)
Validity & Reliability
Content/Action + Error
The information we seek and our best hope for obtaining it.
Our human frailty and inability to write effective questions.
![Page 15: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/15.jpg)
Validity & Reliability
ReliabilityReliability comes in multiple
forms, including:
Test-Retest ReliabilitySplit-Half Reliability
![Page 16: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/16.jpg)
Validity & Reliability
ReliabilityTest-Restest
Administer to students.After time, administer again.
Are the students performing ina consistent manner?
![Page 17: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/17.jpg)
Validity & Reliability
ReliabilitySplit-Half
Create 2 smaller contentBalanced tests and administer.
Do students perform similarlyon each test half?
![Page 18: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/18.jpg)
Validity & Reliability
Validity“Did the test we created reallymeasure what we hoped itwould measure?”
![Page 19: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/19.jpg)
Validity & Reliability
ValidityRelates to questions about thereasonability of content,criterion and constructassociated with the learningobjectives and assessment.
![Page 20: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/20.jpg)
Validity & Reliability
![Page 21: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/21.jpg)
Validity & Reliability
![Page 22: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/22.jpg)
Validity & Reliability
ValidityContent Related Validity
Does the content we have selectedappropriately represent ourconstruct (top level domain)?
![Page 23: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/23.jpg)
Validity & Reliability
ValidityConstruct Validity
Is there really such a concept aswhat we created as a construct?(e.g. Does “reading ability” reallyexist?)
![Page 24: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/24.jpg)
Validity & Reliability
ValidityCriterion Related Validity
Does our test adequately link thecontent to the construct? Is the test a good measure of the construct?
![Page 25: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/25.jpg)
Validity & Reliability
Examination Quality
Validity
Reliability
![Page 26: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/26.jpg)
Validity & Reliability
![Page 27: Validity And Reliabilty](https://reader033.fdocuments.net/reader033/viewer/2022051108/54736fd9b4af9fbe0a8b5422/html5/thumbnails/27.jpg)
Validity & Reliability
RELIABILITYis a necessary but
not sufficient condition forVALIDITY