Test Validity & Spirituality Steve Pawluk AACU Constituency Meeting May 17, 2004.

Test Validity & SpiritualityTest Validity & Spirituality

Steve PawlukSteve Pawluk

AACU Constituency MeetingAACU Constituency Meeting

May 17, 2004May 17, 2004

Steve Pawluk, May 2004Steve Pawluk, May 2004

Watches and YardsticksWatches and Yardsticks

ReliabilityReliability

ValidityValidity


ValidityValidity

Does a test actually measure what it Does a test actually measure what it purports to measure?purports to measure?

Are the interpretations of test results Are the interpretations of test results adequateadequate and and appropriateappropriate for our use? for our use?

– Robert L. Linn & Norman E. Gronlund. (1995).Robert L. Linn & Norman E. Gronlund. (1995).

Measurement and Assessment in Teaching.Measurement and Assessment in Teaching.


3 Ways of Thinking 3 Ways of Thinking About ValidityAbout Validity

Content ValidityContent Validity

Criterion-Related ValidityCriterion-Related Validity

Construct ValidityConstruct Validity



Linn & GronlundLinn & Gronlund::

Determine the extent to Determine the extent to which a set of which a set of assessment tasks assessment tasks provides a provides a relevantrelevant and and representativerepresentative sample. sample.

JesusJesus::

““Love the Lord. . . Love Love the Lord. . . Love your neighbor. . . All the your neighbor. . . All the Law and the Prophets Law and the Prophets hang on these two hang on these two commandments.”commandments.”

- Matt 22:37-40- Matt 22:37-40

““. . . All men will know you . . . All men will know you are my disciples, if you are my disciples, if you love one another.”love one another.”

- Jn 13:35- Jn 13:35




Not all items actually Not all items actually measure what they measure what they appear to measure.appear to measure.

JesusJesus::

““Everything they do is Everything they do is done for men to see: done for men to see: They make their They make their phylacteries wide . . . phylacteries wide . . .

You . . . look beautiful on You . . . look beautiful on the outside . . . the outside . . .

- Matt 23:5 & 27 - Matt 23:5 & 27




Determine the extent to Determine the extent to which test performance is which test performance is related to some other related to some other valued measure of valued measure of performance.performance.

““He has showed you, O He has showed you, O man, what is good. And man, what is good. And what does the Lord what does the Lord require of you?require of you?– Act justlyAct justly– Love mercyLove mercy– Walk humbly with your Walk humbly with your

GodGod- Micah 6:8- Micah 6:8




Determine the extent to Determine the extent to which test performance is which test performance is related to some other related to some other valued measure of valued measure of performance.performance.

““Now the Bereans were Now the Bereans were of more noble character, . of more noble character, . . . for they received the . . for they received the message . . . and message . . . and examined the Scriptures . examined the Scriptures . . . to see if what Paul said . . to see if what Paul said

was true.”was true.” - Acts 17:11- Acts 17:11


Construct ValidityConstruct Validity


““A construct is an individual A construct is an individual characteristic that we characteristic that we assume exists in order to assume exists in order to explain some aspect of explain some aspect of behavior.”behavior.”

JesusJesus::

““I am the vine; you are the I am the vine; you are the branches. If a man branches. If a man remains in me and I in remains in me and I in him, he will him, he will bear much bear much fruitfruit; . . .; . . .

- Jn 15:5- Jn 15:5


Constructs are ComplexConstructs are Complex

Animal loverAnimal lover

Spiritual personSpiritual person


Salvation is Simple,Salvation is Simple,but Defining Spirituality but Defining Spirituality May Be More ComplexMay Be More Complex

““Master,” said John, ‘we saw a man driving out demons in Master,” said John, ‘we saw a man driving out demons in your name and we tried to stop him, because your name and we tried to stop him, because he is not he is not one of usone of us.” .” (RSV)(RSV) “. . . because he “. . . because he does not follow with does not follow with usus.” .” (NIV)(NIV)

““Do not stop him,” Jesus said, “for whoever is not against Do not stop him,” Jesus said, “for whoever is not against you is for you.”you is for you.”

~ Luke 9:49, 50 (NIV)~ Luke 9:49, 50 (NIV)


Postulate: Postulate: Spirituality on our CampusesSpirituality on our Campuses

Content ValidityContent Validity Based on “confession Based on “confession of belief.”of belief.”

Evidenced by “others-Evidenced by “others-focused” behavior.focused” behavior.

Absence of Absence of “phylacteriology.”“phylacteriology.”



Criterion-Related ValidityCriterion-Related Validity Spirituality is highly Spirituality is highly correlated with other correlated with other Biblical indicators of Biblical indicators of character measurement:character measurement:– Acts of JusticeActs of Justice– Love of MercyLove of Mercy– Life of HumilityLife of Humility– Open Inquiry Open Inquiry



Construct ValidityConstruct Validity Based on observable, Based on observable, measurable, indicators measurable, indicators that have consistently that have consistently been associated with been associated with spirituality and that are spirituality and that are consistently absent from consistently absent from non-spirituality.non-spirituality.



But the fruit of the Spirit is:But the fruit of the Spirit is:– LoveLove– JoyJoy– PeacePeace– PatiencePatience– KindnessKindness– GoodnessGoodness– FaithfulnessFaithfulness– GentlenessGentleness– Self-controlSelf-control

Gal 5:22Gal 5:22



The Spirit of the Lord is on me, because he has The Spirit of the Lord is on me, because he has anointed me to:anointed me to:– Preach good news to the poorPreach good news to the poor– Proclaim freedom for the prisonersProclaim freedom for the prisoners– Recovery of sight for the blindRecovery of sight for the blind– Release the oppressedRelease the oppressed– Proclaim the year of the Lord’s favorProclaim the year of the Lord’s favor

- Luke 4:18 & 19- Luke 4:18 & 19


Summary: Summary: Spirituality on our CampusesSpirituality on our Campuses

Assessment of the validity of spirituality might be based on Assessment of the validity of spirituality might be based on these three general Biblical factors:these three general Biblical factors:

1.1. Are we and our students expressing an interest in Are we and our students expressing an interest in enhancing our relationships with Jesus Christ?enhancing our relationships with Jesus Christ?

2.2. Are we and our students demonstrating honest and Are we and our students demonstrating honest and open inquiry as we seek to understand and apply open inquiry as we seek to understand and apply justice, mercy, & humility in “others-oriented” lives?justice, mercy, & humility in “others-oriented” lives?

3.3. Are we and our students giving clear evidence of the Are we and our students giving clear evidence of the fruit of the Spirit in our lives?fruit of the Spirit in our lives?


Spirituality on our CampusesSpirituality on our Campuses

Proposal:Proposal:

A valid working definition of observable A valid working definition of observable spirituality:spirituality:

Grace-motivated, others-oriented, livingGrace-motivated, others-oriented, living

Test Validity & Spirituality Steve Pawluk AACU Constituency Meeting May 17, 2004.

Documents

Transcript of Test Validity & Spirituality Steve Pawluk AACU Constituency Meeting May 17, 2004.