Interpreting, Using, and Communicating Results

Riverside County Assessment NetworkSeptember 18, 2015

California Assessment of STUDENT PERFORMANCE

and PROGRESS

This year’s test results are a fresh, new start.

With California’s new academic standards comes a new 21st century

way to measure student achievement.

Communicate NEW Results

Results cannot be compared to prior years.

Well…

at least we’re both fruits!

California Assessment of Student Performance and Progress (CAASPP)Smarter Balanced Summative Assessments

English Language Arts/LiteracyMathematics

● Different content/performance standards are being assessed.

● Different assessment methods are being used.

● Different levels of cognitive rigor are required.

COLLEGE AND CAREER READY

The level of preparation a student needs to

• enroll and succeed—without remediation—in credit-bearing college course work, or

• enter a high-quality certificate program in a career pathway with potential future advancement.

Adpated from David T. Conley, 2010

Analyses also showed the following skills were required for a successful

college experience and advancement in the workforce

Problem solving

Critical thinking

Systems thinking

Information/ IT literacy

College & Career Reported Areas of Skill Need

Data indicates training programs reported weaknesses in HS grads

Reading complex technical and informational texts

Writing well-supported arguments

Solving non-routine problems

State Standards are designed to produce College & Career Ready students who…...

Build strong content knowledgeRespond to the varying demands of audience, task, purpose, and disciplineComprehend as well as critiqueValue evidenceUse technology and digital media strategically and capablyUnderstand other perspectives and culturesDemonstrate independenceSolve real world issues and challenges

Smarter Balanced Assessment System English language arts/literacy and mathematics tests administered

to California public school students in grades 3 - 8 and grade 11

Administered online, the assessments are adaptive by basing difficulty of future questions on previous answers

Untimed tests

Taken independently

Designated supports, accessibility resources and accommodations available for all students who need them

Computer Adaptive Test (CAT) • Each student is administered an appropriately challenging set of

grade-level standards test questions.• The student’s performance on the test questions determines if

subsequent questions are harder or easier.

Performance Task (PT)• A Performance Task (PT) is preceded by a class activity.• PTs are not targeted to students’ specific ability levels.• The items associated with the PTs may be scored by machine or by

human raters.

Two-Part Assessment for both ELA and Math

Overall Scores: 4 Achievement Levels

English Language Arts – Mathematics

Report Progress on

“The Standard”for being

on track in College & Career

Readiness

Exceeded the Standard

Met the Standard

Nearly Met the Standard

Has Not Met the Standard

Target Improvement

Target Improvement

College and

Career Ready

College and

Career Ready

Assess Standards

& Skills

Smarter Balanced Assessment of Standards

Overall Claim for Grades 3–8 “Students can demonstrate progress toward college and career readiness in English language arts, literacy and mathematics.”

Overall Claim for Grade 11 “Students can demonstrate college and career readiness in English language arts, literacy and mathematics.”

DSUSD 2015 Preliminary Achievement Level Scores

Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 11

DSUSDAll

CountyAll

StateAll

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

37% 40%

49%

39%43% 44%

62%

45%41% 44%

2015 Smarter Balanced Assessments Standard Met or Exceeded RatesDesert Sands Unified School District by Grade

ELA

35%31%

27% 29% 26% 24% 27% 28% 28%33%

Math

Desert Sands Unified School District2015 CAASPP Overall Achievement Level Summary

Sample Elementary

Sample

Achievement Levels for Claims● Achievement levels for claims are based on the distance a

student’s performance on the claim is from the Level 3 proficiency cut.

● Similar to subscores providing supplemental information on students’ strengths or weaknesses

● No achievement level setting occurred for claims

● Only three levels for claims as fewer items within each claim

● Student must complete all items within a claim to receive achievement level

Sample Elementary

Smarter Balanced Scale Score RangesEnglish Language Arts/Literacy Achievement Levels

19

Sample Elementary ELA

ELA Standard Met Min. SS

Samp Avg SS

Samp Diff

DSUSD Avg SS

DS Diff

3 2432 2431 -1 2402 -30

4 2473 2452 -21 2447 -26

5 2502 2502 0 2494 -8

Standard Met

2015 Smarter Balanced Assessments: baseline data from which to measure growth in 2010-adopted California standards

2003 to 2013 California Standards Tests: advantaged from the implementation and assessment of 1998-adopted California standards

In Perspective: Raising the Bar

CST 2003

CST 2013

CAASPP2015

CST 2003

CST 2013

CAASPP2015

CST 2003

CST 2013

CAASPP2015

Grade 3 Grade 6 Grade 11

0

10

20

30

40

50

60

70

80

90

100

44

2134 35

13

30

46

19 15

29

33

2938

31

32

28

32

24

20

3021

18

33

2819

29

36

715 16

1023

10 820 26

English Language Arts Percent of Students by Achievement Level CST 2003, CST 2013, CAASPP 2015

Grade 3, Grade 6, Grade 11

FBB/BB(Not Met)

Basic (Nearly Met)

Proficient (Met)

Advanced (Exceeded)

DESERT SANDS UNIFIED SCHOOL DISTRICT

Grade 11 Early Assessment Program (EAP) in collaboration with:

California State UniversityCalifornia Community CollegesCalifornia Department of EducationState Board of Education

Established in 2006: uses grade 11 assessment results to demonstrate readiness for credit-bearing college coursework upon acceptance and enrollment

In Perspective: Post-Secondary Collaboration

Early Assessment Program: Grade 11Smarter Balanced Achievement Levels

College Ready: Standard Exceeded

College Ready-Conditional: Standard MetReadiness determined with successful completion of

grade 12 English and/or math coursework

Not yet demonstrating readiness:Standard Nearly Met or Not Met

20

14

20

15

20

14

20

15

20

15

A

d-ju

ste

d

Usi

ng

P

revi

-o

us

El-

igib

ility

C

rite

ria

English Language Arts Mathematics

16%

36% 41%

19%29%

24%

26%8%

8%

12%

41%40%

Desert Sands Unified School District Grade 11 Early Assessment Program (EAP)

2014 and 2015 Comparison

62%

49%

27%

Comparable Student GroupsEnglish ProficiencyEconomic StatusEthnicityDisability Status

In Perspective: Achievement Equity“Addressing the achievement gap is at the heart of California’s comprehensive plan for improving education. ” -CDE

2015 Smarter Balanced Assessment Standard Met or Exceeded RatesEnglish Fluency Subgroups Comparison

English Learners English Proficient English Learners English ProficientEnglish Language Arts Mathematics

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

16%

54%

12%

33%

10%

48%

9%

32%

11%

52%

11%

39%

DSUSD County State

22.5% 22.9%77.5% 77.1%

2015 Smarter Balanced Assessment Standard Met or Exceeded RatesHispanic and White Subgroups Comparison

Hispanic White Hispanic WhiteEnglish Language Arts Mathematics

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

37%

66%

20%

48%

33%

56%

20%

41%

32%

61%

21%

49%

DSUSD County State

70.3% 20.6% 70.3% 20.6%

Riverside County: 4th most populous in California Over 425,000 K-12 students

22 Comparable School Districts

In Perspective: Countywide Performance

Rank % UPP ELA Rank

(Met/Exceeded) Math Rank

(Met/Exceeded)EAP ELA Rank Ready/

Ready-ConditionalEAP Math Rank Ready/

Ready-Conditional

1=Lowest UPP

Temecula Valley Unified 23.8% 1 1 1 2 2

Murrieta Valley Unified 34.3% 2 2 2 1 1

Menifee Union Elementary 47.3% 3 4 4

Corona-Norco Unified 47.7% 4 3 3 4 3

Beaumont Unified 60.7% 5 8 6 10 9

Riverside Unified 65.9% 6 6 4 5 4

Lake Elsinore Unified 66.5% 7 11 11 6 6

Perris Union High 72.6% 8 7 18 6 6

Desert Sands Unified 72.9% 9 5 6 3 4

Palo Verde Unified 73.6% 10 21 21 17 18

Romoland Elementary 74.9% 11 15 13

Jurupa Unified 80.4% 12 19 14 15 16

Nuview Union 81.2% 13 10 8

Hemet Unified 81.6% 14 13 12 13 9

San Jacinto Unified 82.8% 15 16 19 16 13

Alvord Unified 83.1% 16 11 8 14 7

Val Verde Unified 83.4% 17 9 10 8 11

Moreno Valley Unified 84.2% 18 16 19 11 13

Banning Unified 86.8% 19 20 14 9 11

Palm Springs Unified 89.2% 20 14 14 11 13

Perris Elementary 92.8% 21 16 14

Coachella Valley Unified 96.1% 22 22 22 18 17

1= Highest Comparable Countywide Performance

Riverside County District

Unduplicated Pupil

Percentage (UPP) 1= Highest Comparable Countywide Performance

DSUSD Local Control Accountability Plan

Goal 1: All students will demonstrate growth as measured by federal, state and district assessments.

Goal 2: All students will graduate and be prepared to make a successful transition to further education and/or career opportunities.

Goal 3: All students will develop and consistently demonstrate responsible, respectful and ethical behavior in a safe, clean and orderly learning environment.

2016: Celebrating Academic Growth for All

34

36

Supporting Student Growth:CAASPP Student Goals

To identify areas of need and focus for each ELA and math claim

Teachers use Achievement Level Descriptors

Students add “I can” statements

37

38

Implications for Instruction

ELA Summative Assessment Blueprints

Achievement Level Descriptors: ELA

Grade 3Level 3

ELA/Literacy

Orange County Department of Education 21st Century Competencies

…The Deeper Understandingfor understanding

Expectations are higher and deeper - students are asked to explain reasoning, support arguments with evidence from texts, and persevere in solving real world problems.

Nominate Great Feedback-Givers

Most Valuable Feedback

#1

Cathy DoyleAdministrator for Assessment & Accountability

Desert Sands Unified School DistrictCathy.doyle@desertsands.us

760-771-8667 bit.ly/aawebsite