Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading

Invitational Research Symposium

Alternate Assessments Based on Modified Achievement Standards

in Reading

July 24, 2008

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 2

Welcome and How We Got Here

Introductions Planning Team

Renee Cameto, SRI International Sue Bechard, Measured Progress Pat Almond, SRI International Consultant Martha Thurlow, NCEO, U of Minnesota Cara Laitusis, Educational Testing Service (ETS) Anne Chartrand, SERRC Jan Sheinker, SES Sheinker Educational Services. Kate Nagle, SRI International Kavita Seerantan, SRI International

Participants

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading

If we knew what we were doing, it wouldn’t be called Research.

A. Einstein

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 4

Purpose of the Symposium Focus on assessment of reading for AA-MAS Engage in professional discourse about the

application of the “tools of the trade” to a new area of research.

Explore strategies for implementing cognitive interviews with students with disabilities.

Explore strategies for investigating test and item manipulations that make assessments more accessible and valid.

Provide support for researchers in these areas.

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 5

Non-purposes Discuss issues related to policy

(e.g., eligibility guidelines). Discuss the “2% conundrum”. Determine the one right strategy

or method. Create a list of current projects. Produce definitive conclusions.

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 6

Participants will….. Build on what we know Share relevant experiences and

practices Identify what we don’t know and

what we want to know Develop a synthesis of the status

of the art

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 7

Expected outcomes for today Identify common experiences,

challenges, and lessons learned Identify key issues and possible solution

related to each topic Consider this a “launch event” for white

papers Develop an outline for white papers Plan for paper production Identify potential authors for the white

papers

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 8

Outcomes as a result of today Inform current grants and the broader

field about research strategies related to key 2% issues

Move the field forward with greater understanding of the challenges, important lessons learned, and advice to other researchers.

Publish white papers (suggest journals and dissemination possibilities)

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 9

White Paper Definition(Wikipedia)A white paper is a report or guide that

often addresses problems and how to solve them. White papers are used to educate readers and help people make decisions. They are used in politics and in business. The white papers published by corporations are usually available from their websites.

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 10

Audience: researchers White papers should focus on the

needs of readers, rather than the specific solution.

Length: 12-20 pages

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 11

Organization of a White PaperExecutive summaryIntroduction / Summary Quickly identify the main points Provide definitions of words used for specific purposesBackground / Methodological Problems Provide readers with general background information of

the issue in order to help them make their decisions based on the understanding of facts.

Provide evidence. Point out problems from your readers' perspective.

Do not pose problems for which you cannot provide possible solutions.

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 12

Organization of a White Paper (continued)Array of Solutions Propose solutions List steps or procedures, if applicableConclusion ReferencesAppendices, if applicable

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 13

Other Considerations “Parking Lot”

We’ll keep a list of topics of importance that come up in our discussions but are not part of today’s agenda

Reference List for the White Paper Papers, articles, reports that are germane to our topics Mention them today, we’ll keep a running list Send us other references if you think of them after today

renee.cameto@sri.com sbechard@measuredprogress.org

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 14

White Paper Logistics

All participants recognized in the white paper Looking for a lead author and contributors for each

topic Stipends/honorariums

For lead authors - $1500 For contributors - $700

Reviewers – External review panel Production and publishing by SRI and Measured

Progress

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 15

White Paper Timeline Section writers submit in 3-4 weeks by

Labor Day Lead author compiles by end of October SRI/MP send to reviewers in early

November Draft by Thanksgiving. To editors by early December Final version ready for distribution by end

of December

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 16

Time Task/Topic Organizer(s)

8:00-8:30 Breakfast

8:30–9:00 Welcome and Introductions Sue BechardRenee Cameto

9:00–10:30 Lessons from NARAP: Martha ThurlowCara Laitusis

10:30–10:45 Break

10:45–12:00 Work Group A: Cognitive Labs Anne Chartrand

Work Group B: Test and Item Manipulations Jan Sheinker

12:00–12:45 Lunch

12:45–3:00 Work Group A: Cognitive Labs Anne Chartrand

Work Group B: Test and Item Manipulations Jan Sheinker

3:00–3:15 Break

3:15–4:00 Large group report-out and cross sharingDevelop white paper plansConclusionsWrap Up

Pat AlmondSue BechardRenee Cameto

4:00 Adjourn

Agenda

Invitational Research SymposiumAlternate Assessments Based on

Modified Achievement Standards in Reading 17

Assignments

Work Group Assignments Cognitive Lab Work Group – past the food Test and Item Manipulation – stay in room

Audio Taping