Post-Test Data Analysis Workshop. Agenda I. Analyze 2014 TerraNova Results II. Comparative Data...
-
Upload
trevor-richard -
Category
Documents
-
view
219 -
download
0
Transcript of Post-Test Data Analysis Workshop. Agenda I. Analyze 2014 TerraNova Results II. Comparative Data...
Post-Test Data Analysis Workshop
Agenda
I. Analyze 2014 TerraNova Results
II. Comparative Data Analysis: TerraNova & Explore Test Results
III. Using CTB Online Reporting
IV. Generate & Analyze Subgroups
V. Deep Dive: Measurable Learning Objectives
Data Rich…….Information PoorMany schools invest a great of time in creating elaborate analyses of the end-of-year assessment. Such reports are often exhaustively detailed, breaking down student results by every conceivable demographic or academic attribute. Yet despite the huge amount of data it generates, analysis of these test is of little use to the students who took them. Indeed, it may show what went wrong, but it comes too late to make a difference. Rather than pouring time into figuring out what students failed to learn at year’s end, it is much more effective to focus on interim assessments and avoid failures altogether.
- Paul Bambrick-Santoyo, Driven by data (2010)
I. Analyze 2014 TerraNova Results
TerraNova Template
Data Points: NP of the Mean NCE vs Mean NCE National Percentile
(NP) Normal Curve
Equivalent (Mean NCE)
Mean Anticipated NCE Quartiles
Analyze 2014 TerraNova Results Which areas are above the expected levels of
performance? Which areas are below the expected levels of performance? What is the achievement gap between student
performance in reading and mathematics, and the mean NCE of 76 (90th percentile)?
Is the percent of students above the national mean greater than or equal to 66%?
What is the percent of students that are in Quartile 1? Which of the above reported findings are consistent with
findings from previous TerraNova results?
II. Comparative Analysis: TerraNova & Explore
Results
Understand Explore Results
Use the Profile Summary Report
Explore Test Frequencies & National Averages
Table 1a Columns:
- Explore score range- Freq- CP*- Local & Nat’l
Explore Test Quartiles & Score Ranges
Score Ranges vary by test
Q1 = 1-24% Q2 = 25-49% Q3= 50-74% Q4= 75-
100%
Three Analysis Types
1. Status Analysis: percent performing at or above grade-level
2. Impact Analysis: impact teacher has on different groups of students
3. Growth Analysis: academic growth with cohort of students
Status Analysis1. Use the 2012, 2013, and 2014 TerraNova results
2. What is the percent performing at or above grade-level for the last three years?
3. Is the level of performance on the TerraNova consistent?
4. Use the 2012, 2013, and 2014 Explore results
5. What is the percent performing at or above grade-level for the last three years?
6. Is the level of performance on the Explore consistent?
Impact AnalysisUse the 2012, 2013, and 2014 TerraNova resultsReading: Is the Mean NCE within ±7 points for all
years tested?Reading: Are the Quartile distributions
consistent for all years tested?
Math: Is the Mean NCE within ±7 points for all years tested?
Math: Are the Quartile distributions consistent for all years tested?
Which subject areas indicate the overall highest performance?
Which subject areas indicate the overall lowest performance?
Impact Analysis
Growth Analysis Use the 2012, 2013, and 2014 TerraNova results Compare Mean NCE scores for a cohort of
students. For example, grade 3 students in 2012 are in grade 4 in 2013, and in grade 5 in 2014
Analyze reading: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6 Mean NCE)?
Analyze math: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6 Mean NCE)?
Analyze the other subject tests
Growth Analysis Describe the areas that show a positive trend in
performance. Describe the areas that show a negative trend in
performance. Which areas indicate the overall highest performance? Which areas indicate the overall lowest performance?
Growth Analysis: Student Performance on Different Psychometric Summative Assessments
Cohort Quartile performance on TerraNova to quartile performance on Explore
Diagnostic Questions:
1. Top performing subject test: What is the top performing subject test and what is the quartile distribution on the TerraNova in grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression?
Student Performance on Different Psychometric Summative Assessments Cohort Quartile performance on TerraNova to quartile
performance on Explore
Diagnostic Questions:
2. Least performing subject test: What is the least performing subject test and what is the quartile distribution on the TerraNova in grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression?
III. CTB Online Reporting
Log into CTB Online Reporting
Guide to CTB Online Reporting- Spring 2014
1.Summary Report: Combination
2.Summary Report: Objectives
3.Roster Report
4.Item Summary
5.Cohort Comparison Report
IV. Generate & Analyze Subgroups
Are there Achievement Gaps in Sub-Groups?
School’s demographics shape the subgroups
Types of sub-groups: ethnicity, gender, Title 1, English Language Learners, transfer-in, other
Identify at least one sub-group but no more than three
V. Deep Dive: Measurable Learning
Objectives
Deep Dive: Measurable Learning Objectives
CTB Online Reporting
1.Summary Report: Objectives
2.Item SummaryObjectives and Subskills
(OCS Resource Portal- Academic Excellence- Assessment)
Your Questions
“I Choose C”
https://www.youtube.com/watch?v=dY2mRM4i6tY
I Appreciate Our Time Together!