Using the SAT Suite of Assessments to Inform Instruction

71
Using the SAT ® Suite of Assessments to Inform Instruction November 2018

Transcript of Using the SAT Suite of Assessments to Inform Instruction

Using the SAT® Suite of Assessments to Inform InstructionNovember 2018

• Overview of the SAT Suite of Assessments• Benefits of the SAT Suite• Classroom Connection• Scores and Benchmarks

• Creating a Crosswalk Between State Standards and SAT Content Domains

• Leveraging Educator Reports to Validate Assumptions Activity

• Official SAT Practice on Khan Academy®

• Relate the SAT Suite of Assessment Subscores to Official SAT Practice

• Next Steps• Instructional Resources for the Classroom• Connect Students to Career Opportunities

Agenda

The SAT Suite of Assessments

Beyond Tests, More Opportunities

SAT Suite of Assessments

The SAT Suite offers an improved indicator of student progress through in-depth scores and reports, designed to focus efforts on targeted areas of knowledge and skills with an integrated, personalized plan for practice and growth

Benefits of the SAT Suite

Establish a baseline and check-in for

college readiness

Reflects the work students do in school

Closely aligned score scales throughout

Suite

Link tocollege

scholarships

Free, online personalized practice

AP Potential connection

Support college and career planning

Access to online scores and reports

• When students take the PSAT/NMSQT or the PSAT 10 and say "yes" to Student Search Service® they help scholarship providers find them

• We also connect students to our scholarship partners, who offer over $240 million annually in scholarships to qualified students with financial need

Expanded Scholarship Opportunitieswww.psat.org/scholarships

Rhode2College (R2C) and College Board Opportunity Scholarships

• Rhode2College is designed to motivate high-achieving students from low- and moderate-income households to take the steps necessary to prepare for an enroll in college

• Over their last two years of high school, participating Rhode2College Scholars can earn up to $2,000 in short- and long-term payments to help towards college as they complete key college preparation milestones

• The College Board Opportunity Scholarships program is open to class of 2020 high school students in the United States, Puerto Rico, and other U.S. territories

• The College Board is investing $25 million in a new scholarship program, with students earning $5 million in scholarships each year, beginning with the class of 2020

• The more effort students put in, the more chances students have to earn a scholarship ranging from $500 to $2,000

• If students complete all six steps, they are eligible to earn a $40,000 scholarship

• Scholarships are awarded—through monthly drawings—to students who complete each step

http://rhode2college.org/

cb.org/opportunity

• Aligns to state standards• Aligns to classroom instruction• No obscure vocabulary• Rights-only scoring• Focused on the knowledge and skills most

important for success after high school:• Defining words in context• Using evidence to support arguments• Appropriate use of Standard English Conventions• Analyzing and utilizing data• Fundamental algebra concepts

• Encourages close reading and using knowledge and skills in various contexts (science, social studies, career, etc.)

The SAT Suite Relates to Classroom Instruction

Key Features of the SAT

Words in Context Command of Evidence

Math that Matters Most

Essay Analyzing a Source

No Penalty for Guessing

U.S. Founding Documents and the

Great Global Conversation

Analysis in Science and in

History/Social Studies

Problems Grounded in Real-

World Contexts

SAT Scores and Subscores

The graphic shows score ranges for SAT. PSAT-related assessments have slightly different score ranges.

Longitudinal Progress Monitoring

Section Scores are placed on a vertical scale.

The same concept holds true for the Test, Cross-Test Scores and Total Score.

100 200 300 400 500 600 700 800

SAT (200-800)

PSAT/NMSQT and PSAT 10 (160-760)

PSAT 8/9 (120-720)

6 10 15 20 25 30 35 40

SAT (10-40)

PSAT/NMSQT and PSAT 10 (8-38)

SAT (400-1600)

PSAT/NMSQT and PSAT 10 (320-1520)

200 400 600 800 1000 1200 1400 1600

PSAT 8/9 (240-1440)PSAT 8/9 (6-36)

• 75% likelihood of earning at least a C in a first-semester, credit-bearing college course in a related subject

• Set at section level• Overall college and career readiness is defined as

achieving both of the section-level benchmarks on a given assessment.

• Grade-level benchmarks are based on expected student growth toward the SAT Benchmarks:

SAT College and Career Readiness Benchmarks

Grade 8 Grade 9 Grade 10 Grade 11 SAT

Section Level390 410 430 460 480 ERW

430 450 480 510 530 MATH

Section Scores

• A student who meets the benchmark for her grade level is in the green range

• A student who does not meet the benchmark for the previous grade level is in the red range

• A student in between these two ranges is in the yellow range

Reporting: Color-Coded Score Ranges

Grade 10 BM Grade 11 BM

Example: Math Section, 11th Graders

480 510

Creating a Crosswalk Between State Standards and SAT Content Domains

17

In small groups, review the Evidence Based Reading and Writing Domains or Math Domains.

1. Circle what three domains you are confident (+75%) your students understand and are able to demonstrate.

2. Underline the three domains you are concerned about your students demonstrating understanding

Discuss in groups:1. Are we teaching this?2. Where and when?3. To what depth? Is it a lesson, unit, quiz question,

homework, etc.4. With what success? What is your evidence?

Share across groups and identify common areas of strength and development

Through research, the College Board has identified a critical set of knowledge, skills, and understandings that consistently predict student success in college and workforce training programs

Creating a Crosswalk Between State Standards and SAT Content Domains

Handout: Page 1

Leveraging Educator Reports Activity

Online reporting portal:• Easy accessibility via your College Board account

login to score reports for all SAT Suite assessments• Interactive features (e.g., sorting, filtering)• “Search” functionality and ability to configure groups• Enhanced data and drill-down capabilities

• Compare scores with district, state, and total group

• Identify students in each performance band• Read the questions (and answers) students

missed most often • Identify groups of students for additional support

K-12 Score Reporting Portal

Counsel Students

Improve Instruction

Track Progress

Roster Question Analysis

Summary

Scores and Benchmarks

Instructional Planning

Scores and Benchmarks

Scores and Benchmarks

Ways to Leverage the K-12 Score Reporting Portal Question Analysis

• Grant department heads/groups of teachers Detailed Reports access

• Use the Question Analysis Report to review test questions and determine how students performed on specific skills

• Assess strengths and areas for potential improvement in curriculum and instruction

Instructional Planning

• Use the color-coded test score and subscore ranges to pinpoint which skills your students have mastered and which they need to strengthen

• For students with large gaps in performance, develop a plan to enhance classroom instruction and/or create intervention groups using Official SAT Practice on Khan Academy to bolster skills

Scores and Benchmarks

• To support school improvement plans, click on Score Details to analyze the distribution of scores and develop assessment goals

• Leverage Skills Insight for the SAT Suite (https://collegereadiness.collegeboard.org/pdf/skills-insight-sat-suite.pdf) for actionable suggestions that help students gain additional practice.

• Run Benchmark by Student Reports to identify test takers who met, did not meet, or are approaching the ERW and Math benchmarks

Scores and Benchmarks: Using Skills Insight

Note: All data is illustrative

1. Log into collegeboard.org and click on My Dashboard

2. Click on K-12 Assessment Reporting

3. Once in the Reporting Portal, click on a. Run Reportsb. Report Type:

Question Analysisc. Assessment:

PSAT 10d. Administration Date:

Spring 2018e. Grade Level: 10th

Accessing the Reporting Portal

Handout: Page 2

Question Analysis Report: Understand Student Achievement at a Detailed Level

Note: All data is illustrative

Please write down the question number, course(s) in which the content is taught, the skill the question is measuring, and its corresponding difficulty level.Analyzing the Data:

• Which questions did your students’ perform either better or worse than students in the state or nation?

• Which questions did your students’ answer patterns differ from those of students in the state or nation?

• Looking at frequently missed questions, did students choose the same distracters?

• Are students missing too many easy questions? Omitting questions?

• Where in the curriculum are the skills from the questions being taught/or where should they be taught?

The Question Analysis Report shows responses and answer patterns for each test question allowing you to compare your students’ performance with other students in the state and nation.

Item-Level Analysis

Question Course(s) in which the content is taught

Skill Being Measured

Question Difficulty Level

Percentage Correct

Handout: Page 3

Instructional Planning Report: Focus Improvement Efforts

Note: All data is illustrative

Analyzing the Data:• Looking at either Evidence-Based Reading and Writing Section

Scores or Math Section Scores, how many students fall into “Need to Strengthen Skills?” and “Approaching Benchmark?”

• Compare your Section Scores with your Test Score and Subscoreresults. What conclusions can you draw?

• Do these results vary significantly from the state and/or nation? Why or why not?

• Is this information consistent or inconsistent with other pieces of data you use? What other data sources do you use to assess these skills?

• What interventions can be implemented to help students reach the benchmark? What interventions are already in place?

Provides aggregate and student-level performance in three performance groups related to the benchmarks and allows you to see how your school compares to the state and nation regarding benchmark performance.

Using the Instructional Planning Report

Section ScoresThe color-coded bar chart for is designed to provide context for understanding scores.• Green: Students who met or exceeded the

benchmark• Yellow: Students who did not meet the

benchmark, but are within one year’s growth• Red: Students who have a score more than a

year’s growth below the grade-level benchmark

Test Scores and SubscoresThe colors on each of these score scales represent the typical performance of students in their grade who met (green), approached (yellow), or were further away (red) from the benchmark.

Handout: Page 4

Official SAT Practice on Khan Academy™

satpractice.org

Free, Official SAT Practice Through Khan Academy

Full Length Practice TestsEight official practice tests, with more to come, plus revision assistance and automatic scoring for the SAT Essay, and study and test-taking tips

Video LessonsEasy-to-follow videos explain problems step-by-step

Interactive Problems & Instant FeedbackGet hints, explanations and constant progress updates to know where you stand

Daily Practice AppMore practice available on your phone featuring questions of the day plus the ability to ease the Scan and Score feature

Research on Score Improvements with Official SAT PracticeAverage number of points gained from PSAT/NMSQT to SAT correlated to hours spent practicing on Khan Academy

Practice advanced students regardless of gender, race, income, and high school GPA

Usage is Consistent Across Demographics

Connecting the SAT Suite of Assessment Subscores to Official SAT Practice through Khan Academy

Diagnostic Quizzes

Practice Personalized Recommendations

Hints and Tutorials Available to Build Skills

Earn Energy Points

Take Full-Length Exams

• Practice Tests 1 and 2 have essay passages and prompts. Students can receive scores on these essays.

• Official SAT Practice on Khan Academy includes three practice prompts.• The system analyzes student’s writing and gives specific

recommendations for how to improve their writing in the three areas scored on the SAT essay: Reading, Analysis, and Writing.

• Students get “Signal Strengths” to get a sense for how well the essay is measuring against different criteria.

• Students can revise and rewrite to improve the essay and writing skills.

• An optional prewriting area is provided to outline and organize ideas.• Students can view the rubric used to evaluate SAT essays.

• Tips and Strategies are available to help students approach the essay task.

New Essay Practice!

Features include:Recommended SAT Skills to focus on based on class performance

• Lesson Plans created by teachers for teachers available for skills in Math, Reading, and Writing

• Additional Khan Academy content

Recent SAT activity by student• Top recommended skills for practice• Upcoming SAT test date• Notification if account is connected to their College Board

account

Individual progress by each student• Questions attempted, answer choices, and correct answers• Practice Test scores

Coaching ResourcesAllow teachers, counselorsand other educators to see student progress and provide targeted help based on their practice

Student permissionsIn addition to adding a student to a class, the student will need to accept the SAT coach data sharing agreement.

When you add students to a class, they will see the following image on their SAT dashboard prompting them to share SAT data with you.

In the SAT tab, coaches now have the ability to:• see cumulative progress and

time spent• download CSV files for

progress and time• breakdown progress and time

by subject area• see if students are doing their

recommended practice or other practice problems

• view when the data was last updated

Recent SAT Practice Activity

Click on Student’s Name to See Additional Information Including Practice Test ScoresEach time a student completes a timed mini-section (it’s always the final activity), Khan Academy generates a new four-item list of practice recommendations.

Coaches will also receive a weekly notification about a student’s progress.

These emails will include information about practice tests students just completed or have upcoming this week, plus a summary of student’s activity for the past week.

Student Tab

Daily Practice for the SAT

Daily SAT practice questions

Instant practice test scoring

sat.org/scoring

1. Designate classes in which students will spend time creating and linking Khan Academy accounts. Train staff to work with students to create and link accounts.

2. Reach out to local community-based organizations and/or college access groups to help get students logged into their College Board/Khan Academy accounts

3. Raffle off small prizes for participation (gas cards, coffee, pizza, etc.)

4. Incentivize classes/grades to compete with each other (percentage of student who have linked their accounts to Khan Academy; completion of full-length practice test; largest number of energy points earned; use of Daily Practice for the SAT app features)

5. Honor academic achievement through recognition ceremonies

6. Strengthen your school’s college-going culture and empower students to think of themselves differently

Ideas for Increasing Student Engagement

Teacher/Coach Implementation Guide

Purpose: The Teacher/Coach Implementation Guide is a six-week, turn-key guide to incorporating SAT Practice into a content course, SAT class, advisory period, or after-school program to help students get ready for test day

https://collegereadiness.collegeboard.org/pdf/teacher-coach-implementation-guide.pdf

• Go to satpractice.org/k12 for resources about Official SAT Practice on Khan Academy.

• View sample study plans and study-group ideas at sat.org/studygroup.

• Student resources for the SAT and PSAT-related assessments are at sat.org/k12.

• Instructional videos on Khan Academy at youtube.com/collegeboard.

Khan Academy Resources

Relate the SAT Suite of Assessment Subscores to Official SAT Practice

50

1. Go to satpractice.org2. Click on “Start Practicing”3. Either log in or create a Khan Academy account4. If you are creating an account:

a. Please select “Teacher”b. Sign in with Google, Facebook, or an email

addressc. Click “Let’s Get Started”d. You can either create a class or go directly to

SAT practice5. When prompted answer “B” to both questions and

select “Onward”6. Once in your SAT Practice Dashboard, click on the

“Practice” tab7. Please select either the “Math” or “Reading &

Writing” tab

Using Official SAT Practice on Khan Academy to Further Inform Instruction

Handout: Page 5

Once logged into satpractice.org, under the “Practice” tab click on either the “Math” or “Reading & Writing” tab to scroll through the full list of practice and videos. Select a subscore to review and answer questions associated with that area of focus.

Analyzing the Data:• What skills do students need to have mastered to answer the

questions associated with your area of focus? • How are the content and skills measured currently included in

your curriculum/lesson plans?• Is the skill listed as an objective in lesson plans? • Is it practiced frequently?• Is the skill explicitly assessed? • Is it assessed differently on different tests?• Does the curriculum provide sufficient attention to the skill?

• What instructional strategies can be implemented to strengthen students’ skills in these areas?

Using Official SAT Practice on Khan Academy to Further Inform Instruction

Handout: Page 6

Next Steps

Other Questions to Consider:• In which areas are students not meeting, meeting and/or

exceeding college and career readiness benchmarks? Compare these areas to curriculum pacing maps, instructional strategies, and common assessments.

• What is helping students to be successful in these areas:• Time-on-task?• Spiraled learning opportunities?• Questions aligned to those used on common assessments

for practice?• Compare these processes with those in content areas in which

students are less successful as indicated by the reports. Identify possible processes for improvement in less successful areas.

• Are there existing opportunities to collaborate to design common activities, assignments, and assessments that build skills from year to year?

• What protocols are in place to ensure all students link their College Board and Khan Academy accounts?

• How will Official SAT Practice on Khan Academy be incorporated into the school day and with what frequency?

Putting It All Together

Handout: Page 7

Use the chart to develop a plan for making curriculum changes• Action Steps: How do you plan to use this data? What are

your action steps?• Staff Responsible: Which individual(s) and/or group(s) are

responsible for follow-up?• Resources Needed: Is any additional information/data

needed to support your action steps?• Timeline: Is this a short-term or a long-term strategy?

What is your timeline?• Measurable Outcome: What are the instructional changes

that will be implemented as a result of your action steps and what are the anticipated outcomes from these instructional changes?

• Indicator of Success: How will you monitor implementation? What evidence will demonstrate if the instructional changes are effective or not?

Action Steps

Staff Responsible

Resources Needed Timeline Measurable

Outcome

Indicator of Success

Next Steps

Handout: Page 8

Instructional Resources for the Classroom

• The most important things students can do to prepare for the SAT are to take the most challenging courses available to them, do their best work, and benefit from daily instruction that prepares them for college and career.

• You can prepare your students by continuing to develop and focus on the college and career readiness skills—reading comprehension, writing, analysis of text and data, and problem solving—that you’re already teaching in your discipline.

• With its deeper focus on fewer topics and current instructional best practices, the SAT Suite aligns to your instruction, rather than presenting you with more responsibilities.

• You will not be “teaching to the test”—instead, the test will reflect your teaching.

• The SAT Suite offers you and your students an improved indicator of their progress through in-depth scores and reports, designed to focus efforts on targeted areas of knowledge and skills with an integrated, personalized plan for practice and growth.

• Because the assessments reflect shifts in high school instruction, standards, and assessment, they better measure the knowledge, skills, and understandings students need in high school and beyond.

What Does This Mean for You and Your Classroom? Clearer connections to classroom instruction

https://collegereadiness.collegeboard.org

Educator Resources

Purpose:

• To provide information, resources, and tools to help educators prepare students to take the redesigned SAT, PSAT/NMSQT, PSAT 10, and PSAT 8/9

• Click on For Educators > K-12 Educators and, in the side panel, you will see the list of tools available

Each module includes:• A PowerPoint Presentation• A Facilitator’s Guide, which

includes:• Introduction• Table of Contents• Presentation Suggestions

for Time Allotted• Suggested Discussion

Points• Handouts

A set of resources that allows the user to deliver a professional development presentation to a variety of audiences

Professional Development Modules

Key Features Using Scores and Reporting to Inform Instruction

Words in Context and Command of Evidence

Connecting History/Social Studies Instruction with the SAT Suite of Assessments

Expression of Ideas andStandard English Conventions

Connecting Science Instruction

with the SAT Suite of Assessments

Heart of Algebra and Problem Solving and Data Analysis The SAT Essay

Passport to Advanced MathAnd Additional Topics

Supporting Student Success with Official SAT Practice

https://collegereadiness.collegeboard.org/educators/k-12/professional-development-modules

https://collegereadiness.collegeboard.org/pdf/redesigned-sat-k12-teacher-implementation-guide.pdf

Teacher Implementation Guide

Purpose:• Explain to teachers and curriculum

specialists the reasoning and goals behind the redesign of the SAT

• Describe the structure and content of the redesigned SAT and the eight key changes to the assessment

• Provide practical, actionable, classroom-related information to help teachers work with students to prepare for SAT

• Create confidence by replicating testing conditions• Give timed assessments with four answer choices• Use test directions in classroom assignments

• Increase familiarity by modeling test design• Follow the same format of reading passages,

math questions, and essay prompt but substitute existing content with your course’s content

• Have students answer multiple questions pertaining to the same prompt

• Build students writing and analysis skills• Have students to provide quotations from reading

passages, data from graphs, tables or charts, or from other relevant text as evidence to support their conclusions in class

• Practice revising and editing during class by asking students to refine their own work, as well as the work of their peers

• Give students the opportunity to correct mistakes

Reinforce for students the alignment between your course activities and the tasks students will be asked to perform on the PSAT/SAT

General Instructional Strategies

• Have students practice reading and analyzing extended passages of text at varied levels of text complexity

• Include graphs, tables, and charts in reading assignments and ask students to draw connections between the text and graphics

• Practice evaluating evidence for consistent and legitimate supporting arguments

• Ask students to investigate the way authors create a desired effect in both fiction and nonfiction passages

• Have students make meaning from challenging, often abstract texts on topics such as rights, duties, and freedoms (e.g. U.S. Founding Documents, texts in the great global conversation) and engage them in the “conversations” these texts inspire

Instructional Strategies for ELA/Social Studies

• Assign a range of reading passages that includes some longer and more difficult selections

• Ask students to select a particularly meaningful or powerful word or phrase from a reading selection and then substitute another word or phrase of similar meaning and discuss how it is uncommon for two words or phrases to have exactly the same impact, nuance, or connotation

• When analyzing texts, ask students to use the SOAPSTonemethod (Speaker, Occasion, Audience, Purpose, Subject, and Tone.)

• Ask students to identify meaningful and relevant information in order to create high-quality questions for their peers to answer and when students answer their peers’ questions, require them to provide the evidence that supports their selection.

• Have students create a Venn diagram to identify similarities and differences in multiple passages to help them organize their thoughts and facilitate synthesis and analysis of multiple texts.

• Ask students to practice both synthesizing and supporting their ideas with evidence by identifying and presenting additional texts that support an author’s conclusion and then have them defend their choices by citing textual evidence (e.g., quotations) from the additional texts.

Skill-Building Strategies for ELA/Social Studies

• Teach students to use OPTIC to interpret informational graphics:O – write Overview notes about the graphic; P – zoom in on the Parts of the visual and describe important details; T – highlight the words of the Title; I – identify Interrelationships among elements of the graphic; C – draw Conclusions about the graphic as a whole.

• Using the informational graphics in a textbook or periodical, provide students with inaccurate interpretations of data and ask them to correct the error(s) and explicitly describe the data they used to make each correction.

• Provide students with a reading passage containing several sentences in need of correction. After students make corrections, ask them to explain their reasoning and discuss how these changes influence the tone and meaning of the passage.

• Employ peer editing and/or use released student essay samples to practice analyzing text for strength of proposition, support, focus, and effective language use.

• Use rubrics to support students in analyzing their writing or their peers’ writing

• Use the SAT Essay prompt with passages relevant to your curriculum giving students the opportunity to analyze quality pieces of writing in the content area and to practice with the prompt.

Skill-Building Strategies for ELA/Social Studies

• Ensure that students practice solving multistep problems• Organize students into small working groups and ask them

to discuss how to arrive at solutions and discuss how to make corrections when their solutions are incorrect

• Encourage them to express quantitative relationships in meaningful words and sentences to support their arguments and conjectures.

• Vary the types of problems in homework assignments so that students are not always using the same strategy to solve every problem

• Assign students math problems/assessments that do not allow the use of a calculator.

• Use tables, expressions, and graphs that students encounter in other content areas to present math as a tool that may be applied to many areas of study

• Have students practice both multiple choice and student-produced response questions (grid-ins)

Instructional Strategies for Math/Science

• Provide students with explanations and/or equations that incorrectly describe a graph. Ask students to identify the errors and provide corrections, citing the reasoning behind the change.

• Ask students to create pictures, tables, graphs, lists, models, and/or verbal expressions to interpret text and/or data to help them arrive at a solution.

• Ask students to solve problems that require multiple steps.• As students work in small groups to solve problems, ask open-

ended questions and facilitate discussions in which they communicate their own thinking and critique the reasoning of others as they work toward a solution.

• Have students find a chart/graph/table from a periodical and write a series of questions about the graphic to be discussed in class. Ask them to present purposefully incorrect interpretations and have the class to correct their analyses.

• Use “Guess and Check” in which students first guess the solution to a problem and then check that the guess fits the information in the problem and is an accurate solution.

• Assign problems for students to solve without the use of a calculator, problems for which the calculator is actually a deterrent to expedience, and the choice whether to utilize the calculator.

Skill-Building Strategies for Math/Science

Connect Students to Career Opportunities

Visit: collegeboard.roadtripnation.com

Goals for Roadmap to Careers

Motivate Prepare ExposeInspire college readiness

for studentsEnsure prerequisite

courses are completedOpen students’ eyes to

new opportunities

Students Choose Their Three Core Interests And Receive a Personalized Journey

The student roadmap

A Look at Careers That May be of Interest

A Look at Leaders with Similar Interests

A Look at College Majors That Align with Students’ Career Interests

Actions Related to Students’ Career Interests

Students can connect to Big Future™

High School Course and College Majors Suggestions