SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

31
SD WriteToLearn SD WriteToLearn Assessment Pilot Assessment Pilot TIE Conference TIE Conference April 20, 2010 April 20, 2010

Transcript of SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Page 1: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

SD WriteToLearn SD WriteToLearn Assessment PilotAssessment Pilot

TIE ConferenceTIE Conference

April 20, 2010April 20, 2010

Page 2: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

AgendaAgenda Background InformationBackground Information

WriteToLearn OverviewWriteToLearn Overview

Program DemonstrationProgram Demonstration

SD Writing Assessment PilotSD Writing Assessment Pilot

2010-2011 School Year2010-2011 School Year

Off-Grade LicensesOff-Grade Licenses

Q&AQ&A

Page 3: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Background InformationBackground Information State law requires all students in grades 5, 7, & 10 State law requires all students in grades 5, 7, & 10

to participate in a statewide writing assessment to participate in a statewide writing assessment

SD DOE heard concerns over the Dakota Writing SD DOE heard concerns over the Dakota Writing Assessment from educatorsAssessment from educators– summative assessment did not meet the needs of summative assessment did not meet the needs of

teachers in measuring the writing processteachers in measuring the writing process Timed testTimed test Feedback not immediateFeedback not immediate No practice opportunityNo practice opportunity Little flexibility in prompt selectionLittle flexibility in prompt selection

Dakota Writing Assessment suspendedDakota Writing Assessment suspended

Page 4: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Background InformationBackground Information Online formative writing assessment pilot Online formative writing assessment pilot

– Spring 2010Spring 2010 80 school districts 80 school districts 700 Teachers 700 Teachers 15,500 students15,500 students

– Grades 5, 7, & 10 Grades 5, 7, & 10 70,500 Submissions 70,500 Submissions

Schools not participating in the pilot exempt from Schools not participating in the pilot exempt from the Dakota Writing Assessment in spring 2010 onlythe Dakota Writing Assessment in spring 2010 only

WriteToLearnWriteToLearn– Student literacy program provided by Pearson Student literacy program provided by Pearson

Page 5: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

What is What is WriteToLearnWriteToLearnTM??

Page 6: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

What’s in WriteToLearnWhat’s in WriteToLearnTMTM??

At-a-glance reporting

Immediate, automated feedback

Online writing assessment with

instruction

(1) (2) (3)

Karen Lochbaum
This screenshot doesn't really seem to go with the text above, though nobody but us will probably know what the screenshot is :-)
Page 7: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

What’s in WriteToLearnWhat’s in WriteToLearnTM??

1. 1. An online writing assessment tool with built-in instruction

Scores essays on 6 traits of writing

Builds reading comprehension through summarization

Includes essay prompts and reading passages across the curriculum

Available for grades 4-12

Page 8: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

What’s in WriteToLearnWhat’s in WriteToLearnTM??

2. Immediate, automated feedback and 2. Immediate, automated feedback and suggestions for improvementsuggestions for improvement

Easy student interface for self-paced classroom workEasy student interface for self-paced classroom work

Reliable scoringReliable scoring– Using KAT (Knowledge Analysis Technologies) scoring Using KAT (Knowledge Analysis Technologies) scoring

engineengine Research based scoring that understands the Research based scoring that understands the

meaning of textmeaning of text

Page 9: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

What’s in WriteToLearnWhat’s in WriteToLearnTM??

3.3. At-a-glance reportingAt-a-glance reporting Visually appealingVisually appealing

Allows teacher to monitor progress at the student Allows teacher to monitor progress at the student and classroom leveland classroom level

Allows teachers to target students who need further Allows teachers to target students who need further instruction or to challenge those advancing studentsinstruction or to challenge those advancing students

Page 10: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Who uses Who uses WriteToLearnWriteToLearnTMTM??

Page 11: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Who uses WriteToLearnWho uses WriteToLearnTM??

Over 350 Schools…

Over 5000 Classrooms… …adds up to

nearly half a million tests!

Page 12: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Why Use Why Use WriteToLearnWriteToLearnTM??

Page 13: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Why use WriteToLearnWhy use WriteToLearnTM??

WriteToLearn is a WriteToLearn is a Formative Assessment Formative Assessment tooltool with built-in instruction with built-in instruction– Allows for a better measure of student progressAllows for a better measure of student progress

– Provides immediate feedback to studentsProvides immediate feedback to students

– Allows for feedback to help shape instructionAllows for feedback to help shape instruction

Page 14: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Why use WriteToLearnWhy use WriteToLearnTM??

WriteToLearn helps:WriteToLearn helps:– FFocus teacher time on curriculum, not testingocus teacher time on curriculum, not testing

– Support overall student literacySupport overall student literacy

– Become better writersBecome better writers

Page 15: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Why use WriteToLearnWhy use WriteToLearnTM??WriteToLearn also provides:WriteToLearn also provides:

Opportunity for students to improve on their writing skills during Opportunity for students to improve on their writing skills during classroom instructionclassroom instruction

Immediate, easy-to-understand feedback for both the teacher and the Immediate, easy-to-understand feedback for both the teacher and the studentstudent

Online suggestions on how to improve writing and reading comprehensionOnline suggestions on how to improve writing and reading comprehension

Essay writing and summary writing activities across the curriculumEssay writing and summary writing activities across the curriculum

Self paced advancementSelf paced advancement

Page 16: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

WriteToLearnWriteToLearnTM Demonstration SiteDemonstration Site

www.writetolearn.netwww.writetolearn.net

Page 17: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

How do I use How do I use WriteToLearnWriteToLearnTM?

Let’s begin by looking Let’s begin by looking at the student at the student interface…interface…

Page 18: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

SD DOE SD DOE

Writing Assessment Writing Assessment PilotPilot

Page 19: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Writing Assessment Pilot Writing Assessment Pilot GoalsGoals

Meet state law Meet state law

Improve student writing with the Improve student writing with the support of formative assessmentsupport of formative assessment

Gather information to shape next Gather information to shape next year’s statewide writing assessment year’s statewide writing assessment

Page 20: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Writing Assessment Writing Assessment Pilot TimelinePilot Timeline

EventEvent DateDate

Pilot Schools Selected & NotifiedPilot Schools Selected & Notified Mid-January 2010Mid-January 2010

Informational Meeting for Pilot Schools (online)Informational Meeting for Pilot Schools (online) January 28 & 29, 2010January 28 & 29, 2010

WriteToLearn Account Administrator Training WriteToLearn Account Administrator Training (online)(online)

February 10 & 11, 2010February 10 & 11, 2010

WriteToLearn Teacher Trainings (Face-to-Face)WriteToLearn Teacher Trainings (Face-to-Face) February 16, 17, & 19, 2010February 16, 17, & 19, 2010

WriteToLearn District-Level Teacher TrainingsWriteToLearn District-Level Teacher Trainings Late February/Early March Late February/Early March 20102010

Testing Window OpensTesting Window Opens March 1, 2010March 1, 2010

Testing Window ClosesTesting Window Closes April 2, 2010April 2, 2010

Participant Feedback CollectedParticipant Feedback Collected April/May 2010April/May 2010

WriteToLearn Licenses ExpireWriteToLearn Licenses Expire June 30, 2010June 30, 2010

Page 21: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

How will SD utilize How will SD utilize WriteToLearnWriteToLearnTM??

– Pilot program began Spring 2010Pilot program began Spring 2010 Testing dates March 1Testing dates March 1stst – April 2 – April 2ndnd, 2010, 2010 Students were required to submit a minimum of one essay, Students were required to submit a minimum of one essay,

but not limitedbut not limited

– SD DOE monitored how many students participated SD DOE monitored how many students participated during the testing windowduring the testing window

Page 22: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

What counted for What counted for participation?participation?

Students writing Students writing essaysessays in response in response to the prompt that was assigned by to the prompt that was assigned by the teacher.the teacher.

Page 23: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

How did SD utilizeHow did SD utilize WriteToLearn WriteToLearnTM??

Teachers who used the program for state assessment purposes Teachers who used the program for state assessment purposes were DOE trained and certifiedwere DOE trained and certified

Teacher selected grade-appropriate prompts for their studentsTeacher selected grade-appropriate prompts for their students– Teachers could have established sub-classroom environmentsTeachers could have established sub-classroom environments

– Students could have responded to different promptsStudents could have responded to different prompts

Students were not limited by a set number of revisions or scoring Students were not limited by a set number of revisions or scoring targetstargets– Individual student scores were not collectedIndividual student scores were not collected

– School scores were not comparedSchool scores were not compared

Students were not limited by time restraintsStudents were not limited by time restraints

Teachers could assign summary activities Teachers could assign summary activities – did not count toward SD DOE compliancedid not count toward SD DOE compliance

Page 24: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

SD DOE Reporting SD DOE Reporting

Schools did not submit any additional Schools did not submit any additional reportsreports– Students only needed to use the Students only needed to use the

programprogram

State extracted data on the back endState extracted data on the back end

Page 25: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

What have we heard?What have we heard?

Page 26: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Teacher FeedbackTeacher Feedback“They were excited to edit!”“They were excited to edit!”

“I even had reluctant writers enjoy the process!”“I even had reluctant writers enjoy the process!”

ProsPros– Immediate Immediate

feedbackfeedback– Easy to useEasy to use– Increased student Increased student

engagementengagement– 6 traits6 traits– Could individualize Could individualize

instructioninstruction

ConsCons– Scoring EngineScoring Engine– FormattingFormatting– Canned commentsCanned comments

Page 27: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Student FeedbackStudent Feedback “Can we write at home?” “Can we write at home?”

“You don’t get eraser shavings all over your “You don’t get eraser shavings all over your hands.”hands.”

ProsPros– Increased amount Increased amount

of data about their of data about their own writingown writing

– Immediate Immediate feedbackfeedback

– Multiple triesMultiple tries– Used a computerUsed a computer– No judgment in No judgment in

scoringscoring

ConsCons– Spell CheckSpell Check– Limited number of Limited number of

triestries– Specificity of Specificity of

feedbackfeedback– PromptsPrompts

Page 28: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Additional FeedbackAdditional Feedback

WriteToLearn is an instructional toolWriteToLearn is an instructional tool

Students and teachers need time to Students and teachers need time to

practice using the programpractice using the program

FlexibilityFlexibility

Page 29: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Looking Forward…Looking Forward…Tentative 2010-2011 PlanTentative 2010-2011 Plan

Evaluation results of pilot process will help shape details for Evaluation results of pilot process will help shape details for the 2010-11 school yearthe 2010-11 school year

All students in grades 5, 7, & 10 will participateAll students in grades 5, 7, & 10 will participate

3 Testing Windows (Fall, Winter, Spring)3 Testing Windows (Fall, Winter, Spring)

Compliance will be through participationCompliance will be through participation students will be required to respond to at least one essay prompt students will be required to respond to at least one essay prompt

during each testing windowduring each testing window

individual student scores will not be collected and school scores will individual student scores will not be collected and school scores will not be comparednot be compared

Final details should be set before the end of 2009-10 school Final details should be set before the end of 2009-10 school yearyear

Page 30: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Off-grade LicensesOff-grade Licenses School districts may purchase off-grade licenses at state School districts may purchase off-grade licenses at state

raterate

2010-11 School Year2010-11 School Year– Full-year license (July 2010 – June 2011)Full-year license (July 2010 – June 2011)– $10 per student$10 per student

Schools must order a minimum of 50 licenses for state rates to Schools must order a minimum of 50 licenses for state rates to apply.apply.

Schools districts interested in purchasing off-grade licenses should Schools districts interested in purchasing off-grade licenses should

contact Pearson directly, using the following contact information.  contact Pearson directly, using the following contact information.  – Scott Avila Scott Avila

Pearson – Educational Assessment Pearson – Educational Assessment 19500 Bulverde Road 19500 Bulverde Road San Antonio, Texas 78259 San Antonio, Texas 78259 Phone: 1-800-228-0752 ext 245225 Phone: 1-800-228-0752 ext 245225 Email: Email: [email protected]@pearson.com

Page 31: SD WriteToLearn Assessment Pilot TIE Conference April 20, 2010.

Questions?Questions? Visit the DOE website Visit the DOE website

http://http://doe.sd.gov/octa/assessdoe.sd.gov/octa/assessment/writetolearn.aspment/writetolearn.asp

FAQ FAQ TimelineTimeline Technical RequirementsTechnical Requirements

For any additional For any additional questions, please questions, please contact Erin Larsencontact Erin Larsen

[email protected]@state.sd.us 605-773-2533 605-773-2533