Using Student Growth Percentiles in Educator Evaluations

Warm Up

The median is the middle number in a sequence of numbers

• On your table is a ½ sheet of paper that lists the heights of students in a teacher’s class

• Write the students’ heights in order from shortest to tallest

• Identify the median height and circle it

Norms• Fully present• Share your expertise• Equity of voice• Active listening• Respect the current speaker – no side

conversations• Safety to share different opinions and

perspectives• Respectful use of technology

ConnectorOn an index card please complete the

following sentence stem

“One of the most important learnings that I hope to take away today is…”

Give One, Get One!

You will have 5 minutes to:

Circulate around the roomIntroduce yourself to a colleague

(name, position & district)Share the information on your card,

and then exchange cardsStart the process over again

Outcomes for Today

• To increase knowledge of Student Growth Percentiles (SGPs) and Median Student Growth Percentiles (MSGPs)

• Clarify the connection between SGPs and SLGs for the 2015-16 SY

Waiver Update

On July 23, 2015,the USDOE approved Oregon’s ESEA flexibility waiver renewal request for three years through the 2017-2018 school year

In other words…

Oregon met the condition placed on our waiver the previous year to provide evidence of a statewide approach for how teachers and principals set their student learning and growth goals in tested grades and subjects to ensure rigor and consistency across the state

As a result…

Beginning in the 2015-16 school year, as a requirement of the ESEA waiver, all districts will begin using Student Growth Percentiles (SGPs) to meet the state assessment requirement for Student Learning and Growth (SLG) in grades 4-8 in English/Language arts (ELA) and math

Request to USED for 2015-16• ODE has requested a modification to the

waiver • Districts will determine MSGPs, but not

incorporate them in educator summative evaluations for SY 2015-2016

• Districts required to provide SGP training to staff

• ODE recommends that all educators set two goals that use Category 2 measures

Student Growth Percentiles

(SGPs)

Normative growth measure

One year of growth

Growth is relative to students with a similar score history

What do we mean by normative growth?

35% 65%

Percentiles

35th

3rd Grade

2262

Level 1

4th Grade

2398

Level 2

Anthony

Level 1

Level 2

Level 3

Level 4

2367

ELA/Literacy Scale Score Thresholds

2432 2490

OregonScore Distribution

3rd Grade Reading

Grade 3

Grade 4

Level 1

Level 2 Level 3

Level 4

4th Grade2398

3rd Grade2262

2398- 2262

136 points

Anthony’s Comparison Group

19

All 3rd grade test takers in Oregon

Anthony

…with Anthony’s Prior Score ~2262

Level 1

Level 2 Level 3

Level 4

Anthony’s prior score ~2262

Anthony’s Comparison Group

Anthony

Level 1

Lev el 2 Level 3

Level 4

Level 1

Level 2 Level 3

Level 4

Anthony’s Comparison Group

High score

Middle score

4th Grade Score Distribution

Anthony’s prior score ~2262

Level 1

Level 2 Level 3

Level 4

Anthony’s Comparison Group

4th Grade Score Distribution

80% of students in Anthony’s comparison group scored below him

2398

Level 1

Level 2 Level 3

Level 4SGP = 80

Anthony’s Comparison Group

4th Grade Score Distribution

Processing Time

• With the colleagues at your table:

• Talk about what you’ve heard so far• Identify a question your group still has about

SGPs

(Up Next: Determining Median SGPs)

Term Clarification

• A Student Growth Percentiles (SGP) measures growth for an individual student

• A Median Student Growth Percentile (MSGP) represents the exact middle of a group of students’ SGPs

Median Student Growth Percentiles

Students in Mr. Waters class

Student SGPSheryl 3Hector 22Robert 36Miranda 38Tre 51Anna 54Eric 71Anthony 80Amina 93

Making a Determination of Student Growth

Category 1 SLG Rating

1 2 3 4

Median SGP Criteria

1 to 34percentile

35 to 49percentile

50 to 64percentile

65 to 99percentile

Interpretation Low growth Below average growth

Above average growth

High growth

The Median Student Growth Percentile (SGP) determines the educator’s Category 1 SLG Rating

X-Axis = SLG Rating • SLG performance level based on two

goals• Two-year cycle select two of four goals • Score SLG goals• Get a rating between 1 and 4;• Use X-Axis thresholds to determine

SLG level: • 4 = both goals 4s• 3 = both goals 3s; one goal 3 & one

goal 4; one goal 2 & one 4• 2 = both goals 2s; one goal 2 & one

3; one goal 1 & one 3; one goal 4 & one 1

• 1= both goals 1s; one goal 1 & one 2

Mr. Waters• SGP was rated 3• Second SLG was rated 3

X-Axis Rating = Level 3 SLG Rating

Y-Axis = PP/PR Rating

• Add up all component scores for total points possible;

• Divide by number of components in your rubric;

• Get a rating between 1 and 4; • Use Y-Axis threshold to determine

PP/PR level:• 3.6 - 4.0 = 4 • 2.81-3.59 =3 • 1.99 – 2.8 = 2 * • < 1.99 = 1

*PP/PR Scoring Rule: If the educator scores two 1’s in any PP/PR component and his/her average score falls between 1.99-2.499, the educator’s performance level cannot be rated above a 1.

Mr. Waters• District rubric with 20

components• Component ratings:

• 17 components were rated 3; and 3 were rated 2 = 57 points possible

• 57/20=2.85

2.85 = Level 3 PP/PR Rating

*Inquiry Process

Mr. Waters: Y-axis = 3 & X-axis = 3

Y-A

xis:

PP

/ P

R

LEVEL 4

Collegial

*SLG Inquiry

3

Facilitative or

Collegial

* SLG Inquiry

3 or 4

Facilitative

4

Facilitative

4

LEVEL 3

Collegial or Consulting

*SLG Inquiry

2 or 3

Collegial

3

Collegial

3

Collegial

3

LEVEL 2

Consulting

2

Consulting

2

Consulting

2

Collegial or Consulting

* PP/PR Inquiry

2 or 3

LEVEL 1

Directed

1

Directed

1

Consulting or

Directed

* PP/PR Inquiry

1 or 2

Consulting

* PP/PR Inquiry

2

LEVEL 1 LEVEL 2 LEVEL 3

LEVEL 4

X-Axis: SLG

Questions?

Your Turn!

• Use the data packet provided to:• Calculate Mr. Hendrick’s Y-axis rating • Determine Mr. Hendrick’s median SGP• Calculate Mr. Hendrick’s X-axis rating

• Share Out

*Inquiry Process

Y-

Axi

s: PP

/ P

R

LEVEL 4

Collegial

*SLG Inquiry

3

Facilitative or

Collegial

* SLG Inquiry

3 or 4

Facilitative

4

Facilitative

4

LEVEL 3

Collegial or Consulting

*SLG Inquiry

2 or 3

Collegial

3

Collegial

3

Collegial

3

LEVEL 2

Consulting

2

Consulting

2

Consulting

2

Collegial or Consulting

* PP/PR Inquiry

2 or 3

LEVEL 1

Directed

1

Directed

1

Consulting or

Directed

* PP/PR Inquiry

1 or 2

Consulting

* PP/PR Inquiry

2

LEVEL 1 LEVEL 2 LEVEL 3

LEVEL 4

X-Axis: SLG

Timeline and Responsibilities2015-16

SYODE RESPONSIBILITIES DISTRICT RESPONSIBILITIES

Fall 2015

Provide districts state criteria for determining Median Student Growth Percentiles (see Table 3 on page 5 in this guidance).

Provide districts with communications and guidance.

Select Option A or Option B to be used district-wide.Establish a process for determining the teacher of record.

Create class rosters and establish a roster verification process.

2015-16 School Year

Provide districts with professional development and technical support.

Provide training in the district to educators, evaluators, and coordinating staff.

February - June 2016

Administer Smarter Balanced Assessment Administer Smarter Balanced AssessmentEducators verify class rosters.

Summer 2016

 

Calculate Student Growth Percentiles for all students.

Send districts Student Growth Percentiles and Smarter Balanced achievement data in August.

Receive Student Growth Percentiles and Smarter Balanced results from ODE.

Fall 2016

Provide guidance and support to districts. Determine the Median Student Growth Percentile ratings using the state criteria.

Incorporate median Student Growth Percentile ratings into educator summative evaluations.

How do SGPs change the goal setting and scoring processes?

• Teachers and principals in grades 4- 8 in ELA and math

• All other educators

All Other Educators• Minimum of 2 SLG goals each year• Quality Review Checklist used for goal setting• Goals can use either:

• Category 1 (statewide assessments) OR• Category 2 (school or district-wide assessments)

measures• Goals scored using the statewide SLG Scoring

Rubric• Oregon Matrix used to identify summative scores

• Student Learning and Growth Guidance

Teachers and Principals in Grades 4 – 8 ELA and Math• Minimum of 2 SLG goals each year• Quality Review Checklist used for goal setting• One goal must use Category 1 measure (Smarter)

• Method for scoring Category 1 goal depends on whether the district uses Option A or Option B

• Second goal can use either Category 1 or Category 2 measures• Category 2 goals scored using the statewide SLG

Scoring Rubric• Oregon Matrix used to identify summative scores

What do districts need to do?

• Select Option A or B

• Establish procedures

• Create rosters

Select Option A or Option B

Collaboration is key!

Option A Option BEducators are not required to set a Category 1 SLG goal. There is no required goal setting process for Category 1.

Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric

Educators are required to set one Category 1 SLG goal using Smarter Balanced and rate their goal using the SLG scoring rubric. Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric .

Student Growth Percentiles are used exclusively to determine the Category 1 SLG rating.

Educators’ SLG goal rating is then compared with their Median Student Growth Percentile rating to determine their final Category 1 SLG rating.

OPTION A

Fall

1. Districts determine which educators are required to use Median Student Growth Percentiles and create the educators’ class rosters for teachers and principals in grades 4-8, ELA/math.

2. Educators set a Category 2 SLG goal following the SLG goal setting template. (They do not set a

Category 1 SLG goal.)

Spring 

3. In May educators verify their class roster through a district-determined process.

Summer/Fall

 

4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration.

5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator’s class roster as follows:

a. Rank the students’ scores in the class roster from highest to lowest.b. Locate the middle score (median) in the range to find the Median Student Growth Percentile.

• If the educator has an even number of students, average the two middle scores.c. Using the state criteria identify the corresponding Median Student Growth Percentile Category 1

SLG rating (1-4).

6. The educator and evaluator use the X-axis table to determine the educator’s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings.

Fall

1. Districts determine which educators are required to use median Student Growth Percentiles and create the educators’ class rosters for teachers and principals in grades 4-8, ELA/math. 2. Educators set two goals: Category 1 SLG goal and Category 2 SLG goal following the SLG goal setting template.

Spring 

3. In May, educators verify their class roster through a district-determined process.

Summer/Fall

 

4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration. 5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator’s class roster as follows:

Rank the students’ scores in the class roster from highest to lowest.Locate the middle score (median) in the range to find the Median Student Growth Percentile.

If the educator has an even number of students, average the two middle scores.Using the state criteria identify the corresponding Median Student Growth Percentile Category 1 SLG rating (1-4).

6. Using the state assessment results, the educator and evaluator score the Category 1 SLG goal using the state SLG Goal Scoring Rubric. 7. The evaluator uses the decision table to compare the educator’s Category 1 SLG goal rating with the Median Student Growth Percentile rating to determine the combined Category 1 SLG rating (X- and Y-axes intersect). 8. The educator and evaluator use the X-axis table to determine the educator’s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings. 9. If the ratings differ by more than two, use the inquiry process below to determine the final rating.

OPTION B

FOCUSED COLLABORATIONLearning Exercise

• Discuss with colleagues at your table how your district might go about making the decision as to which option the district will choose

Remember Districts are advised to have a collaborative team

of teachers, administrators, and association representatives work collaboratively to choose

between Options A and B

• Before using Student Growth Percentiles, districts will need to establish procedures and a process for using Median Student Growth Percentiles district-wide.

• This process should be established Fall 2015

Starting to Plan…

Establish Procedures…

• Teacher of Record: which teachers and principals are responsible for content covered by Smarter Balanced assessments in grades 4-8 for ELA and math

• Roster creation and verification• Provide rosters to teachers and principals in

the fall for planning purposes• Verify rosters in the spring for evaluation

Create rosters…• Determine who is on each roster

• Elementary: Every student in a class that takes Smarter in ELA or math

• Middle: All students within a particular course who take Smarter in either ELA or math

• Principals: All students in a particular grade who take Smarter in either ELA or math

Impact of Class Size on SGPs

• Districts are required to use Median Student Growth Percentiles for educators who have at least 20 students

• Teachers and principals in grades 4-8 (ELA and math only) who fall below 20 students must use other measures that are valid, reliable, and comparable across the school or district (Category 2 measures)

Using an index card at your table, please identify:

• One learning from today; and • Two questions you still have about SGPs

Feedback

Resources

• ODE Webpage for SGPs has been added to the EE Toolkit

• ESD Regional Workshops• Contact your ESD to find out when a

regional training might be available in your area

Remaining questions?

ODE Contacts

Educator Effectiveness Team:

• Tanya Frisendahl tanya.frisendahl@state.or.us

• Sarah Martin sarah.martin@state.or.us

• Sarah Phillips sarah.phillips@state.or.us

• Brian Putnam brian.putnam@state.or.us