Test Development Center, June 2009 1 Next-Generation Sunshine State Standards : Assessments and...
-
date post
18-Dec-2015 -
Category
Documents
-
view
213 -
download
0
Transcript of Test Development Center, June 2009 1 Next-Generation Sunshine State Standards : Assessments and...
Test Development Center, June 2009 1
Next-Generation Sunshine State Standards : Assessments and Interpretive Products
June 1, 2009CLAS PresentationRenn Edenfield, FCAT Writing CoordinatorLyla Springfield, FCAT Reading CoordinatorVince Verges, Executive Director, Test Development CenterFlorida Department of Education
1
Test Development Center, June 2009 22
Topics
Staff Change End of Course Assessments SB 1908 Impact Reading Updates Writing Updates Interpretive Products Other Assessment Information
Questions
Test Development Center, June 2009 3
New Executive Director of National Assessment Governing Board (NAGB) Dr. Cornelia Orr, Assistant Deputy
Commissioner of Accountability, Research and Measurement, will be leaving the Department in mid-July to assume her new responsibilities
A search will be underway shortly for a replacement
Test Development Center, June 2009 4
End-of-Course (EOC) Assessments
Algebra 1 – Field test in May 2010, computer based only
Biology – Field test in May 2011, computer based only
American History - Field test in May 2012, computer based only
Currently, no plans for ELA EOCs
4
Test Development Center, June 2009 55
Revised Language Arts Standards: Impact on FCAT Reading
Assessment of 2007 standards was planned for FCAT Reading in 2011, but an interim solution will be used that is still to be decided, based on final 2009 standards
Draft Reading Test Item Specifications & 2010 field testing
Retakes remain the same, no PTs; FCAT Retakes given through a time yet to be determined
Test Development Center, June 2009 6
Revised Language Arts Standards: Impact on FCAT Reading
Planned Content Advisory meeting for Fall 2009 to gather educator input and recommendations on future reading assessments based on 2009 standards
Further timelines to be determined later
Test Development Center, June 2009 77
FCAT Reading - What is being tested and when? Last FCAT Reading Test – March
9-19, 2010 Field Test new benchmarks - 2010 No performance tasks at grades
4,8,10 2011 and beyond No summer retakes for Reading or
Mathematics
Test Development Center, June 2009 88
New Reading Test Item Specifications
Appendix B was released last Fall for Reading and Mathematics, 9/30/08
Spring 2009 release for Next-Generation Assessments Reading and Math Test Item Specifications
New Specifications document can be found at:http://fcat.fldoe.org/fcatis01.asp Remember: Impact on future tests is still TBD.
Test Development Center, June 2009 18
SB 1908 and Writing
“Beginning with the 2012-2013 school year, the comprehensive
assessments of writing shall be composed of a combination of
selected-response test items, short-response performance tasks,
and extended-response performance tasks, which shall measure a
student's content knowledge of writing, including, but notlimited to, paragraph and sentence structure, sentenceconstruction, grammar and usage, punctuation,
capitalization,spelling, parts of speech, verb tense, irregular verbs,
subjectverb agreement, and noun-pronoun agreement. “
Test Development Center, June 2009 19
SB 1908 and Writing
September Content Advisory to gather educator input and recommendations on future writing assessments based on 2009 standards
Test Development Center, June 2009 2020
New Writing Test Timeline
December 2011 - Field Test Grade 4 New Writing Test , paper
based Spring 2012 Field test
Grades 7, 11 New Writing Test, computer based, not during regular Grade 8 and 10 tests
*************************************** Spring 2013 New Writing Test
Grades 4, 7, 11
Test Development Center, June 2009 21
FAQs about FCATWhat are the 2009-10 dates for FCAT Writing?
No December 2009 Field Test
Census Test– February 9-11, 2010
21
Test Development Center, June 2009 22
Are certain scorers assigned to each school or district?
Short answer: NO responses are distributed
randomly among all scorers each year
each school's responses are seen by a large number of scorers
22
Test Development Center, June 2009
23
Grade 4 NarrativePercentage of students earning
score point 3 and above and score point 4 and above
0102030405060
708090
100
2001 2002 2003 2004 2005 2006 2007 2008 2009
3 and above
4 and above
Per
cent
age
of s
tude
nts
Test Development Center, June 2009
24
Grade 4 Expository Percentage of students earning
Score point 3 and above and Score point 4 and above
010
2030
4050
6070
8090
100
2001 2002 2003 2004 2005 2006 2007 2008 2009
3 and above
4 and above
Per
cent
age
of s
tude
nts
Test Development Center, June 2009
25
Grade 8 Persuasive Percentage of students earning
Score point 3 and above and Score point 4 and above
0
10
20
30
40
50
60
70
80
90
100
2001 2002 2003 2004 2005 2006 2007 2008 2009
3 and above
4 and above
Per
cent
age
of s
tude
nts
Test Development Center, June 2009
26
Grade 8 Expository Percentage of students earning
Score point 3 and above and Score point 4 and above
010
20
30
4050
60
70
8090
100
2001 2002 2003 2004 2005 2006 2007 2008 2009
3 and above
4 and above
Per
cent
age
of s
tude
nts
27
Grade 10 Expository Percentage of students earning
Score point 3 and above and Score point 4 and above
0
10
20
3040
50
60
70
80
90
100
2001 2002 2003 2004 2005 2006 2007 2008 2009
3 and above
4 and above
(Note: No expository prompt given in 2008)
Per
cent
age
of s
tude
nts
Test Development Center, June 2009
28
Grade 10 PersuasivePercentage of students earning
Score point 3 and above and Score point 4 and above
0
10
20
30
40
5060
70
80
90
100
2001 2002 2003 2004 2005 2006 2007 2008 2009
3 and above
4 and above
Per
cent
age
of s
tude
nts
Test Development Center, June 2009 2929
Writing Lessons Learned…
FCAT Writing Lessons Learned: 2001-2008 Data Analyses and Instructional Implications
Scheduled for delivery to districts in Spring 2010
PDF file posted To FDOE website after ADA compliance requirements - districts will be notified when it is available
Test Development Center, June 2009 3030
All FCAT Subjects: Handscoring Quality Controls Rangefinder Meetings with Florida
Educators scoring student responses that are then used as training materials for FCAT scorers at handscoring
FCAT scorers are trained, monitored, and supervised throughout scoring
Test Development Center, June 2009 3131
Handscoring Quality Controls
Education – minimum of a bachelor’s degree
Intensive training monitored by FDOE
Must qualify to score – demonstrate accuracy and consistency in scoring
Monitored throughout scoring by FDOE
Test Development Center, June 2009 32
Handscoring Quality Controls
20% of Reading and Mathematics performance task responses at all grades will receive a score from a 2nd reader
20% of responses to Writing prompts at grades 4 and 8 will receive a score from a 2nd reader
100% of responses to Writing prompts at grade 10 will receive a score from a 2nd reader
Test Development Center, June 2009 33
Distributed Scoring
Utilizes the same scorer requirements and controls
Will only be used with short-response in Reading and Mathematics in 2010 only
Extended responses will be scored at a specific regional site
Will not be used at all in Writing
33
Test Development Center, June 2009 3434
2009 FCAT Content Focus Report Now available on the DOE website Has the benchmarks and content focus
for each item that counted towards student scores on the 2009 FCAT
Has total points for each reporting cluster/category
Identifies the benchmarks that had performance tasks
Reading and Mathematics have old to new benchmarks crosswalks
Test Development Center, June 2009 3535
Sample Test Materials
Anticipated delivery date of January 2010 for Reading,
Mathematics, and Science (by legislative request)
Test Development Center, June 2009 3636
FCAT Preparation Activities
Requires school districts to prohibit each public school from suspending a regular program of curricula in order to administer practice test or engage in other test-preparation activities for a statewide assessment (i.e., FCAT or end-of-course assessment).
Test Development Center, June 2009 3737
Preparation continued…
to the extent determined necessary in State Board of Education rule, distribute and administer sample practice tests and answer keys published by FDOE or engage in other test-preparation activities.
Test Development Center, June 2009 3838
“Florida Recycles” logo and statement will appear on non-secure FCAT materials.
Support the effort in your district!
DOE is going green!
FCAT contractors already use eco-friendly production methods. DOE is now actively promoting
recycling.
39
Region • Panhandle: 22%• East Central: 23%• Northeast: 17%• South: 20%• West Central: 17%
County Type• Rural: 19%• Urban: 36%• Suburban: 43%• University/Other 2%
County Size • Small: 22%• Medium: 40%• Large: 35%• University/Other: 3%
Ethnicity• Asian: 1% • African Am: 20%• Caucasian: 67%• Hispanic: 7%• Other: 5%
Gender• Female: 79% • Male: 21%
One Year of FCAT Participants2007 – 2008
40
One Year of FCAT Participants
Writing+ - 163 Members • Content Advisory• Educator Visits to Handscoring• Prompt Review• Item Content Review• Rangefinder
Science - 127 Members• Content Advisory• Educator Visits to Handscoring• Expert Review• Item Content Review• Lessons Learned• Rangefinder• Rangefinder Review• Gridded Adjudication
Reading - 140 Members• Content Advisory • Educator Visits to Handscoring• Item Content Review• Passage Review• Rangefinder• Rangefinder Review
Mathematics -144 Members• Content Advisory• Gridded Adjudication• Educator Visits to Handscoring• Item Content Review• Rangefinder• Rangefinder Review
Sensitivity - 31 Members• Reading• Mathematics • Science• Writing+
Bias - 45 Members•Reading & Mathematics• Science • Writing+
2007-2008
677 participants, 38 weeks of meetings, and 76 different meetings
Advisory - 27 Members• Technical Advisory• FCAT Reports
Test Development Center, June 2009 4141
FCAT Resources On the Web
• website: fcat.fldoe.org
• FDOE website: fldoe.org
Test Development Center, June 2009 4242
Available Resources 2009 FCAT Writing Anchor Sets
posted to web, on or before August 2009
2008 Florida Reads! Writes! Solves! Inquires! CD in Districts
Test Development Center Sharepoint Site:http://sharepoint.leon.k12.fl.us/tdc/external/default.aspx
Test Development Center, June 2009 4343
FCAT PublicationsContact Information
Trish Lyons Publications Coordinator
(850) 922-2584 ext. 227 SunCom 292-2584 ext. 227 [email protected]
Test Development Center, June 2009 4444
Contact Information Lyla Springfield, FCAT Reading Coordinator:
[email protected] Steve Ash, FCAT Mathematics Coordinator:
[email protected] Renn Edenfield, FCAT Writing Coordinator:
[email protected] Linda Oravetz, FCAT Science Coordinator:
[email protected] Vince Verges, Executive Director Test
Development Center: [email protected]