Post on 26-Mar-2015
Dan WrightSample City, KS
Common waiver component for several Kansas districts.
Common Core & Smarter Balance emphasis on college/career readiness.
Availability of College Readiness Benchmarks in ACT series assessments.
Scaled scores in each subject area demonstrated to be associated with a 50% chance of getting a “B” or higher, or a 75% chance of getting a “C” or higher, in a credit-bearing freshman college course.
How do these benchmarks compare with KCA performance?
Concurrent testing, Spring 2011 8th Grade KCA General Ed, only (no KAMM) “Universal” Explore testing 1,150+ cases
KCA Reading Distribution at 8th Grade
Explore Reading Distribution at 8th Grade
(Upper end of Explore distribution is only 25)
100806040200
KCA Reading
26.0
24.0
22.0
20.0
18.0
16.0
14.0
12.0
10.0
8.0
6.0
4.0
Exp
lore
Rea
din
g
The joint KCA-Explore Reading distribution, shaped by both measures.
100806040200
KCA Reading
26.0
24.0
22.0
20.0
18.0
16.0
14.0
12.0
10.0
8.0
6.0
4.0
Exp
lore
Rea
din
g
R Sq Linear = 0.34
A number of approaches might be attempted to find a “best fit.”
Linear regression was chosen, pending additional data.
r = .58
CollegeReadinessBenchmark
KCA cut points and the Explore benchmark were applied.
100806040200
KCA Reading
25.0
20.0
15.0
10.0
5.0
Exp
lore
Rea
din
g
R Sq Linear = 0.34
Joint Distribution of KCA and Explore Reading
ExemplaryExceeds StandardMeets Standard
Explore Scale Scores Corresponding to Lower Ranges of KCA Performance Categories
Explore READING Explore MATH
KCA Meets Standard12 13
KCA Exceeds Standard14 16
KCA Exemplary15 17
ACT College Readiness Benchmarks
15 17
Concurrent Testing, Spring 2010 ACT cohort for 2011, tested in 2010 Spring, 2010 KCA Banked OTL from earlier years not used ACT-takers are self-selected Resulting group sizes of 330-480
10080604020
KCA Reading
35.0
33.0
31.0
29.0
27.0
25.0
23.0
21.0
19.0
17.0
15.0
13.0
11.0
9.0
7.0
5.0
3.0
1.0
-1.0
ACT
Rea
ding
R Sq Linear = 0.392
ExemplaryExceeds StandardMeets Standard
College Readiness Benchmark
(Upper end of ACT distribution is 36)
r = .63
ACT Scale Scores Corresponding to Lower Ranges of KCA Performance Categories
Reading Math Science
KCA Meets Standard16 16.5 17
KCA Exceeds Standard19 19.5 21.5
KCA Exemplary21 21.5 24.5
ACT College Readiness Benchmarks
21 22 24
How to “best fit” the observed distributions.
How to extend the sample into upper ranges.
How might this change the predicted values.
Implications for the next generation of assessments?