Student Assessment Updates Susie Morrison, Deputy Superintendent Chief Education Officer Mary...
-
Upload
molly-saxe -
Category
Documents
-
view
219 -
download
4
Transcript of Student Assessment Updates Susie Morrison, Deputy Superintendent Chief Education Officer Mary...
Student Assessment Updates
Susie Morrison, Deputy Superintendent Chief Education Officer
Mary O’Brian, Director of Assessment
Illinois State Board of Education
3 Welcome to 2013-2014 School Year
• PARCC • 2014 ISAT• Change in performance level cut
scores• Growth model
Changes in Assessment
Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
Assessment
Instruction
Curriculum
Higher Expectations with Common Core
4
ELA/Literacy
Read sufficiently complex texts independently
Write effectively to sources
Build and present knowledge through research
Math
Solve problems: content and mathematical practice
Reason mathematically
Model real-world problems
Have fluency with mathematics
Key ELA and Literacy Shifts• Reading
– Balance of literature and informational texts– Focus on text complexity
• Writing – Emphasis on argument and informative/
explanatory writing– Writing to sources – Writing analytical essays
• Speaking and Listening– Inclusion of formal and informal talk
5
Key Mathematics Shifts
• Each grade focuses on fewer standards:• Greater depth • Coherent progression across
grades
• Conceptual understanding of topics
• Extend knowledge to real-life modeling and application
6
What Is PARCC?
The Partnership for Assessment of Readiness for College and Careers: Made up of 19 states + DC and US Virgin Islands
KY and PA are participating states Developing common, high-quality math and English
language arts (ELA) tests for grades 3–11Computer-based and linked to what students need to
know for college and careers
Field Testing: Spring 2014
For use starting in the 2014–15 school year
7
8
Getting All Students College and Career Ready
K–2 Grades 3–8 HighSchool
Optional K–2 assessment being developed, aligned to
the Common Core State Standards
Timely data showing whether ALL students are on track for college and career
readiness
College readiness score to identify who is ready for college-
level coursework
Success In first-year,
credit-bearing, postsecondary
coursework
Ongoing student support/interventions
Professional development for educators
PARCC Assessment DesignEnglish Language Arts/Literacy and Mathematics, Grades 3-11
End-of-Year Assessment
• Innovative, computer-based items
Performance-BasedAssessment (PBA)
• Extended tasks• Applications of concepts
and skills
Summative,Required assessment
Interim, optional assessment
Diagnostic Assessment• Early indicator of student knowledge and skills to inform instruction, supports, and PD
ELA - Speaking And ListeningAssessment
• Locally scored• Non-summative, required
Optional Assessments/Flexible Administration
Mid-Year Assessment• Performance-based• Emphasis on hard-to-
measure standards• Potentially summative
2
ELA: Grade 7 Sample Item
10
Students read the text that introduces the topic Items are designed to help students gather information from the
texts to lead to the final writing prompt Items require different types of responses to allow students to
demonstrate a command of evidence with complex texts
Part A: Highlight the claim that is supported by the most relevant and sufficient facts within “Earhart’s Final Resting Place Believed Found.”
Part B: Click on two facts within the article that best provide evidence to support the claim selected in Part A.
ELA: Grade 7 Sample Item
11
Claims
Earhart and Noonan lived as castaways on Nikumaroro Island.
Earhart and Noonan’s plane crashed into the Pacific Ocean
People don’t really know where Earhart and Noonan died.
ELA: Grade 7 Sample Item
12
Math: Grade 3 Sample Item
13
• This a fairly traditional fraction task in a computer-based setting.
• Unlike traditional multiple choice, it is difficult to guess the correct answer or use a choice elimination strategy and there is more than one correct solution.
• Unlike paper and pencil tests, students can create a visual representation even though the task is scored automatically.
Math: Grade 3 Sample Item
14
• Second part of multi-step problem, and, unlike traditional multiple choice, it is difficult to guess the correct answer or use a choice elimination strategy.
Math: High School Sample Item
15
Item has two possible solutions Students have to recognize the nature of the equation to know how to
solve Technology prevents guessing and working backward
PARCC Comprehensive Accessibility Policies
16
Accommodations**
* Available to all participating students**For students with disabilities, English learners, and English learners with disabilities
Accessibility Features for All Students
17
Accessibility Features for All StudentsAudio Amplification
Blank Paper (provided by test administrator)Eliminate Answer Choices
Flag Items for ReviewGeneral Administration Directions Clarified (by test administrator)
General Administration Directions Read Aloud and Repeated (by test administrator)
Highlight ToolHeadphones
Magnification/Enlargement DeviceNotePad
Pop-Up GlossaryRedirect Student to Test (by test administrator)
Spell CheckerWriting Tools
Accessibility Features Identified in Advance
18
Accessibility Features Identified in Advance
Answer Masking
Background/Font Color (Color Contrast)
General Masking
Text-to-Speech for the Mathematics Assessments
Line Reader Tool
Administrative Considerations for All Students
• Detailed guidelines will be included in the PARCC Test Administration Manual.
• Principals may determine that any student may require one or more of the following test administration considerations, regardless of the student’s status as a student with a disability or an English learner: – Small group testing – Frequent breaks – Time of day – Separate or alternate location – Specified area or seating – Adaptive and specialized equipment or furniture
19
Presentation Accommodations
20
Content Area Presentation Accommodations
ELA/Literacy Text-to-Speech or Video of a Human Interpreter for the ELA/Literacy Assessments, including items, response options, and passages*
Braille Edition of ELA/Literacy Assessments(Hard-copy braille tests and refreshable braille displays for ELA/Literacy)
Closed-Captioning of Multimedia Passages on the ELA/Literacy Assessments
Descriptive Video
Mathematics Video of a Human Interpreter for the Mathematics Assessments for a Student Who is Deaf or Hard of Hearing
Braille Edition of Mathematics Assessments(Hard-copy braille tests for Mathematics)
Both Content Areas
Additional Assistive Technology (Guidelines available fall 2013)
Tactile Graphics
Video of a Human Interpreter for Test Directions for a Student Who is Deaf or Hard of HearingPaper-and-Pencil Edition
Response Accommodations
21
Content Area Response Accommodations
ELA/LiteracyScribing or Speech-to-Text (i.e., Dictation/Transcription or Signing) for constructed responses on the English Language Arts/Literacy Assessments*
Word prediction on the ELA/Literacy Performance-Based Assessment*
Mathematics Calculation Device and Mathematics Tools*(on Non-calculator Sessions of Mathematics Assessments)
Both Content Areas
Additional Assistive Technology (Guidelines available fall 2013)
Braille note-taker
Scribing or Speech-to-Text (i.e., Dictation/Transcription or Signing) for the Mathematics assessments, and for selected response items on the English Language Arts/Literacy assessments
PARCC Technology Platform
22
• PEARSON’s TestNav platform has been selected for the Field Test (Spring 2014) and 1st Operational assessment in 2014-15.
• TestNav will provide a Proctor Caching solution that will allow for test downloads to individual computers for testing and then uploads when testing is completed reducing the amount of bandwidth needed during test administration.
• TestNav specifications (including bandwidth) will be released in August.
23
Looking Ahead
April 2013
• Draft Performance Level Descriptors for public review (April 10-May 8)
• Draft Accommodations Manual for students with disabilities and English learners for public review (April 18-May 13)
Spring 2013
• Test Blueprints and Evidence Statements (~May 1)• Guidance on Participation in Field Test and Practice Tests
June 2013 • Final Subject- and Grade-Level Performance Level Descriptors• Final Accommodations Manual for Students with Disabilities and
English Learners
Summer 2013
• Additional Sample Items • Estimates for Assessment Cost
Fall 2013• Design of Student Score Reports• Minimum Technology Specifications, version 3.0
24
Looking AheadThroughout 2013-14
• Additional Guidance to Districts on Assessment Administration
Spring 2014 • Field Test Administration and Practice Test
Fall 2014 • Operational Assessment Administration Manual
SY 2014-15• Operational Administration of PARCC Summative
Assessments
Summer 2015
• Standard Setting
PARCC Field Testing
• PARCC is developing a stratified random sample for classrooms to participate in field testing
• Classrooms will be chosen within schools given identified characteristics– Most students will take either Performance-
based assessments OR End of Year assessments
Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
• Change reading approximately 20 percentage points
• Change in mathematics approximately 25 percentage points
Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
Change in Performance Level Cut Scores
Change in Performance Level Cut Scores
Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
• Backmapping process was used with data from 2011 PSAE and 2008 8th grade ISAT– Equipercentile equating was used to determine
performance categories– Maximizes the reliability of these data
• Reliability and stability of the new performance levels was tested through analysis of trend data for all ISAT scores for five years
2014 ISAT
• 100% of the test items are connected to the Common Core State Standards
• Test maps will be available soon
Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
ISAT Online Pilot
• 15 districts have been invited to participate in online pilot– One grade level at one school within each
district
• Districts are at all levels of technology readiness
Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License
• Growth model metrics: Underlying assumptions
– Valid, reliable, and fair– Transparent– Value proficiency at the
Meets Standards level– Value changes in
achievement level of students
School A
Performance Level in Year 2
1A 1B 2A 2B 3A 3B 4A 4B
Performance
Level in Year 1
1A
1B 1
2A 1 2
2B 1 3 6 7
3A 1 3 3 2 1
3B 2 11 9 1 1
4A 4 6 4 4
4B 1 5 1 2
77.5% of Students Meet/Exceed Standards Growth Value: 94.5
School B
Performance Level in Year 2
1A 1B 2A 2B 3A 3B 4A 4B
Performance
Level in Year 1
1A 1
1B 1 13 8 5 1
2A 4 12 16 4
2B 16 12 5 1
3A 1 2 6 3
3B 2 3 1
4A 1
4B
28% of Students Meet/Exceed Standards Growth Value: 111.2
School C
Performance Level in Year 2
1A 1B 2A 2B 3A 3B 4A 4B
Performance Level in Year 1
1A 1 3
1B 4 9 5 1 1
2A 8 14 17 6 1
2B 4 5 46 31 5
3A 1 18 50 16 2
3B 5 19 24 6 4
4A 3 13 7 2
4B 1 1 3 7 4
58.4% of Students Meet/Exceed Standards Growth Value: 101.5
• Each student within the school/district is placed within a cell of the table based on his or her ISAT scores over two years
• The scores of all the students within the school or district are averaged to determine a total growth value
Implementation Process
36
2,339,468 Every Student Every Day
36