Create Actionable Data for Schools July 16-26 2012 Dr. Yuwadee Wongbundhit and Mr. Nelson Suarez...

Create Actionable Data for Schools

July 16-26 2012Dr. Yuwadee Wongbundhit and Mr. Nelson Suarez

Curriculum and Instruction

Day 1 Topics

FCAT 2.0/EOC Data Elements

School Level Data: Year-at-a Glance Reports, Reports from DOE and OADA Web

2012 School Grade Reports

Student Performance Indicators and 2012 Student Report from Pearson

Use of Excel Pivot Table and Excel Filter for Data Analysis

Day 2 Topics

Data Elements from Accountability Report

Data Elements from File Download Manager

Use of Excel Vlookup

Use of Excel Pivot Table for Data Analysis

Assumptions:You...

are familiar with the School Grade System and FCAT 2.0/EOC

have some experience in data analysis

are comfortable using Excel 2010

love, love, love data!!!

4

NORMS

5

Norms

Listen to others

Engage with the

ideas presented

Ask questions

Reflect on relevance

to you

Next, set your

learning into action

Http://osi.dadeschools.net/actiondata

Designed by

Nelson Suarez

http://osi.dadeschools.net/actiondata

Update on Assessments

Math at a Glance

2012 Math District and State Results% Scoring Achievement Level 3 and Above

Gr3 Gr4 Gr5 Gr6 Gr7 Gr80

50

100

58 60 57 53 56 5760 62 5850 52 56

State District

% o

f S

tud

ents

+2+2 +2+2 +1+1 -3-3 -4-4 -1-1

2011 to 2012 Math Results% Scoring Achievement Level 3 and Above


50

100

56 58 56 53 56 5658 60 57 53 56 57

State

20112012

% o

f S

tud

ents


50

100

58 61 54 47 51 5460 62 58 50 52 56

District

20112012

% o

f S

tud

en

ts

+2+2 +2+2 +1+1 00 00 +1+1

+2+2 +4+4 +3+3+1+1 +1+1 +2+2

Understanding FCAT 2.0/EOC Reports?

Understanding FCAT 2.0 and EOC Reports, Spring 201212

http://fcat.fldoe.org/mediapacket/2012/default.asp

http://fcat.fldoe.org/mediapacket/2012/default.asp

http://fcat.fldoe.org/fcat2/

FCAT 1999

FCAT 2001FCAT

2002FCAT 2010

Base scale of FCAT

1996 SSS

Base scale of FCAT 2.0

2007 NGSSS

2011FCAT 2.0

Equivalent Scores

FCAT 2.0 Scores Reading/Math

13

FCAT 2.0 2014

FCAT 2.0 2013

FCAT 2.0 2012

FCAT 2.0 2011 2010-11 Baseline Year (Retrofitted Scores)

FCAT 2.0 Scores, Reading/math

14

http://osi.dadeschools.net/actiondata

RawScore

C2

C3

C4

C1

Content Area Scores

FCAT 2.0 Reading-Math Scores Raw Score

Developmental Scale Score (DSS)(140 to 302 R: G3-10)

(140 to 298 M: G3-8)

Achievement Level

(1 to 5)

Sample Math Report, Grade 3-4

16

31

32

Developmental Scale Score (Math)

G6

G8

140 298Developmental Scale Scores

Min Max

G3

Raw Score

Grade 3 Grade 10

Grade Level 1 Level 2 Level 3 Level 4 Level 5

3 140-182 183-197 198-213 214-228 229-260

4 155-196 197-209 210-223 224-239 240-271

5 163-204 205-219 220-233 234-246 247-279

6 170-212 213-226 227-239 240-252 253-284

7 179-219 220-233 234-247 248-260 261-292

8 187-228 229-240 241-255 256-267 268-298

3 4 5 6 7 8180

220

260

204

217215

223

220

226224

234

234

243

De

vel

op

me

nta

l Sc

ale

Sc

ore

s

Grades

G3-4 G4-5 G5-6 G6-7 G7-8

State: Gain Scores 13 9 6 9 7

District: Gain Scores 13 8 5 10 9

% of Students Matched to 2011 92 93 92 92 93

2012 FCAT 2.0 Mathematics - District Mean Developmental Scale Score (Matched Students)

2012 FCAT 2.0 Mathematics - District Mean Developmental Scale Score (DSS)


220

260

202

216

223 225

233

242

Dev

elo

pm

enta

l S

cale

Sco

re

2012 FCAT 2.0 Possible Points, Grades 3-5 Mathematics Reporting Category

Content G3 G4* G5Number: Operations, Problems, and Statistics

21

Number: Fractions 10

Geometry and Measurement 13 12 14

Number: Operations and Problems 18Number: Base Ten and Fractions

10 22

Expressions, Equations, and Statistics 10

Total 44 40 46

2012 FCAT 2.0 Possible Points, Grades 6-8 Mathematics Reporting CategoryContent G6 G7 G8

Fractions, Ratios, Proportional Relationships, and Statistics 18Expressions and Equations 17Geometry and Measurement 9 13 17Number: Base Ten 11Ratios/Proportional Relationships 12Statistics and Probability 8Number: Operations, Problems, and Statistics 12Expressions, Equations, and Functions 19

Total 44 44 48

RawScore

C1

C2C3

Algebra Content Scores

Algebra 1 EOC ScoresRaw Score

EOC Scale Score(325 - 475)

Achievement Level(1 to 5)

Source: FL DOE/Office of Assessment

Level 1 Level 2 Level 3 Level 4 Level 5

325-374(49)

375-398(23)

399-424(25)

425-436(11)

437-475(38)

Sample Algebra 1 Report

25

15

15

Raw Score

T-Score Scale(20 to 80)

Statewide Comparison by

Thirds

RawScore

C1

C2C3

Content Scores

Geometry EOC Scores

Statewide by Thirds

T-Score Scale Range

1 20-45

2 46-54

3 55-80

2012 Geometry EOC Scale Distribution - Statewide

27

20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 800

1000

2000

3000

4000

5000

6000

7000

8000

9000

2012 Geometry EOC Distribution

EOC Scale Scores

Num

ber o

f Stu

dent

s 35% of Students at the bottom third (MDCPS: 44%)

34% of Students at the top third(MDCPS: 27%)

Statewide by Thirds T-Score Scale Range1 20-452 46-543 55-80

28

Test

For

m

Scal

e Sc

ore Statewide

Comparison

Points Earned by Content

Area

1 2 3

Student Name and ID

End-of-CourseReporting Category %

2012items

Alg 1

Functions, Linear Equations, and Inequalities

55% 31

Polynomials 20% 10Rationals, Radicals, Quadratics, and Discrete Mathematics

25% 13

Total 100% 54

Geo. Two-Dimensional Geometry 65% 35

Three-Dimensional Geometry 20% 11

Trigonometry & Discrete Math 15% 8

Total 100% 54

FCAT 2.0/EOC Achievement Level Policy Definitions

5. Demonstrate mastery of the most challenging content of the NGSSS.

4. Demonstrate an above satisfactory level of success with the challenging

content of the NGSSS.

3. Demonstrate a satisfactory level of success with the challenging content of the

NGSSS.

2. Demonstrate a below satisfactory level of success with the challenging content of

the NGSSS.

1. Demonstrate an inadequate level of success with the challenging content of the

NGSSS.

FCAT 2.0/EOC Achievement Level Policy Definitions

Level 1

Student has little success with the challenging content of the SSS.

Level 2

Student has limited success with the challenging content of the SSS.

Level 3

Student has partial success with the challenging content of the SSS, but performance is inconsistent.

Level 4

Student has success with the challenging content of the SSS.

Level 5

Student has success with the most challenging content of the SSS. A student scoring in Level 5 answers most of the test questions correctly, including the most challenging questions.

Demonstrate an inadequate level of success with the challenging content of the NGSSS.

Demonstrate a below satisfactory level of success with the challenging content of the NGSSS.

Demonstrate a satisfactory level of success with the challenging content of the NGSSS.

Demonstrate an above satisfactory level of success with the challenging content of the NGSSS.

Demonstrate mastery of the most challenging content of the NGSSS.

FCAT FCAT 2.0 and EOC

Worksheet 1: Calculate the % correct for each content area.Total Points Points Earned By Content Area % Correct By Content Area

Number of Points Possible 7 21 11 100% 100% 100%

SchoolRaw Score % Corr. Content

1Content

2Content

3% Content

1% Content

2% Content

339 100%

1 6 17 82 5 17 93 4 12 74 4 13 65 5 17 96 6 18 97 4 13 78 4 21 79 4 10 5

10 5 14 711 4 9 412 3 10 513 4 8 714 6 10 715 4 11 616 5 14 717 4 19 718 3 9 619 4 12 620 4 15 621 5 13 722 5 19 323 3 17 924 4 5 725 5 13 5 34

Worksheet 1: Calculate the % correct for each content area.Total Points Points Earned By Content Area % Correct By Content Area

Number of Points Possible 7 21 11 100% 100% 100%

SchoolRaw Score % Corr. Content

1Content

2Content

3% Content

1% Content

2% Content

339 100%

1 31 79 6 17 8 86% 81% 73%2 31 79 5 17 9 71% 81% 82%3 23 59 4 12 7 57% 57% 64%4 23 59 4 13 6 57% 62% 55%5 31 79 5 17 9 71% 81% 82%6 33 85 6 18 9 86% 86% 82%7 24 62 4 13 7 57% 62% 64%8 32 82 4 21 7 57% 100% 64%9 19 49 4 10 5 57% 48% 45%

10 26 67 5 14 7 71% 67% 64%11 17 44 4 9 4 57% 43% 36%12 18 46 3 10 5 43% 48% 45%13 19 49 4 8 7 57% 38% 64%14 23 59 6 10 7 86% 48% 64%15 21 54 4 11 6 57% 52% 55%16 26 67 5 14 7 71% 67% 64%17 30 77 4 19 7 57% 90% 64%18 18 46 3 9 6 43% 43% 55%19 22 56 4 12 6 57% 57% 55%20 25 64 4 15 6 57% 71% 55%21 25 64 5 13 7 71% 62% 64%22 27 69 5 19 3 71% 90% 27%23 29 74 3 17 9 43% 81% 82%24 16 41 4 5 7 57% 24% 64%25 23 59 5 13 5 71% 62% 45%

Use Excel for Data Analysis1. At the FLDOE website (Select one grade), download School Scores for All

Curriculum Groups2. Save the file on the desktop and open the file3. Apply Filter to column header4. Filter out District number 135. Delete all rows below the state row6. Clear filter from “District Number”7. Apply Freeze panes to appropriate cell8. Copy reporting categories name to new empty cell 9. Apply filter to column header including the new ones10. Calculate Average % Correct for each reporting category11. Sample formula: =N11/N$10*10012. Apply formula to all cells

36

Data Analysis Worksheet 2

37

1. In each reporting category, name three schools with the lowest average % Correct.

RC 1:____________________ RC 2:____________________ RC 3:____________________ RC 4:____________________

2. In each reporting category, name three schools with the highest average % Correct.

3. Which schools have %Level 1 >= 50? 4. Which schools have % level 5 > 20%

5. How many schools have % Levels 3-5 >=70?____________

7. Name 6 schools that have increased their %L3-5 the most from last year in your assigned school region?

6. How many schools have the %L3-5 > the State? _________

Grade ______ Assessment:___________

Update on School Grades

Florida School Accountability

• Performance Status• Annual Learning

Gains

School Grade

• Performance Status• Performance by subgroupsAYP

Adequate Yearly Progress (AYP) Benchmark

Year%Proficiency Targets

Reading Math

2009-10 65 68

2009-10 72 74

2010-11 79 80

2011-12 86 86

2012-13 93 93

2013-14 100 10040

AYP 39 Components Criteria (NA, No, Yes)

41

Group

Participation Met(Tested 95%) Proficiency Met

Reading Math Reading Math

TOTAL 1 1 1 1

WHITE 2 2 2 2

BLACK 3 3 3 3

HISP. 4 4 4 4

ASIAN 5 5 5 5

Am. Ind. 6 6 6 6

ED 7 7 7 7

ELL 8 8 8 8

SWD 9 9 9 9

School Grade

Total Group

GraduationTotal Group

WritingTotal Group

Other AYP Criteria

Annual Measurable Objectives

AYP is gone.AMO is here.Annual Measurable Objectives

ESEA Flexibility Waivershttp://www.fldoe.org/esea/

Ambitious & Achievable Goal

42

Transition from AYP to AMOAMO-1

• School Performance Grade Target

AMO-2

• Reading and Math Performance Targets

AMO-3

• Target for Annual Learning of Students in the Lowest-Performing 25% in Reading and Math

AMO-4

• Benchmark Florida’s Students Performance to the Highest-Performing States and nations. This is a statewide target.

AMO vs. Differentiated Accountability• The AMOs are not linked to

Differentiated Accountability categories.

Not Linked to DA

44

School Grade ESEA Category DA CategoryA Reward

Schools that increase their grade

Reward

BC Prevent PreventD Focus CorrectF Priority Intervene

Target Performance for AMO-2

45

• Increase % of students scoring at Levels 3-5 and reduce % of students scoring at levels 1 and 2 by 50% over six years (using 2010-11 as the baseline year).

Annual Measurable Objective 2

(AMO 2) sets targets

for each school and subgroup

to:

AMO Performance Targets: 2010-11 to 2016-17

2016-17AMO Target

Proficient

30+35=65%

Non-proficient

70-35=35%

2010-11PerformanceBaseline Year

Proficient (%L3-5)

30%

Non-proficient(%L1-2)

50% of 70 = 35

70%

46

The goal of AMO-2 is to reduce the % of

non-proficient by 50% over six years

(2010-11 to 2016-17).

2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase %pt. 5.8 11.7 17.5 23.3 29.2 35.0

30 36 42 48 53 59 65

35÷6 = 5.83

AMO Performance Targets: 2010-11 to 2016-17

2016-17AMO Target

Proficient

60+20=80%

Non-proficient

40-20=20%

2010-11PerformanceBaseline Year

Proficient (%L3-5)

60%

Non-proficient(%L1-2)

50% of 40 = 20

40%

47

The goal of AMO-2 is to reduce the % of

non-proficient by 50% over six years

(2010-11 to 2016-17).

2010-11 2011-12 2012-13 2013-14 2014-15 2015-16 2016-17Increase %pt. 3.3 6.7 10 13.3 16.6 20

60 63 67 70 73 77 80

20÷6 = 3.33

Worksheet 3: AMO-2 TargetSchool

Baseline Year

2010-11% L3-5

Baseline Year2010-11% L1-2

Baseline Year2010-11

50% of L1-2 Annual

Increment

% AMO-2 Target at

Year 62016-17

% AMO-2 Target for

Year 22012-13

1 70%2 40%3 58%4 45%5 38%6 73%7 50%8 63%9 35%

10 20%

Worksheet 3: AMO-2 TargetSchool

Baseline Year

2010-11% L3-5

Baseline Year2010-11% L1-2

Baseline Year2010-11

50% of L1-2 Annual

Increment

% AMO-2 Target at

Year 62016-17

% AMO-2 Target for

Year 22012-13

1 70% 30 15.0 2.5 85 752 40% 60 30.0 5.0 70 503 58% 42 21.0 3.5 79 654 45% 55 27.5 4.6 73 545 38% 62 31.0 5.2 69 486 73% 27 13.5 2.3 87 787 50% 50 25.0 4.2 75 588 63% 37 18.5 3.1 82 699 35% 65 32.5 5.4 68 46

10 20% 80 40.0 6.7 60 33

OSI Website -- Http://osi.dadeschools.net

50

Direction: Go tohttp://osi.dadeschools.net/actiondata

Click on “2012-2013 School Improvement Tools”

Locate “SIP Current and Expected Results”, click on

AMO-2 SIP Targets

http://osi.dadeschools.net/12-13_SIP/DevelopmentTools/AMO-2.ASP

Annual Measurable Objective (AMO)

51

Are there consequences for not making annual progress to wards an AMO-2 target?

AMO-2 Reports• AMO-2 performance targets will be

established separately for each subgroup and all students in reading and mathematics.

Reading and mathematics

• AMO-2 targets will be used to determined whether the students are making progress in the current year to be on track to reduce the % of levels 1 and 2 by half by 2016-17.

Monitoring Progress

• Any subgroup fail to meet AMO-2 target

Not making satisfactory

progress52

Lunch Break

Please be back on time at 12:30 p.m.Thank you!

School Grade Components

2008 to 2012 School Grade Performance

Year School Grade

% Meeting High Standards % Making Learning Gains

% of Lowest 25% Making Learning

Gains Total Points

R M W S R M R M

2012 B 55% 57% 81% 47% 67% 67% 67% 64% 505

2011 B 64% 71% 83% 47% 61% 67% 60% 66% 519

2010 B 64% 71% 88% 41% 63% 69% 58% 67% 521

2009 B 62% 69% 88% 40% 63% 69% 63% 67% 521

2008 B 60% 67% 87% 39% 61% 71% 60% 70% 515

School Grade Scaling

F=0-394, D=395-434, C=435-494, B=495-524, A = 525-800

* State assessment scores include FCAT, FCAT 2.0, end-of-course assessments (EOCs), and Florida Alternate Assessment (FAA**) scores, as applicable.**The FAA is administered to students with cognitive disabilities for whom the FCAT or FCAT 2.0 would not be appropriate assessments.

Which students are included?All full-year enrolled students, including students

with disabilities (SWDs) and English language learners (ELLs), have state assessment scores applied in all school grading measures, with one exception. ELLs who have less than one year of school in the U.S. are not included in the performance components for reading, math, writing, and science.

Which students are included in the lowest 25% of students?

• Meet all criteria for inclusion in school grade,

• Have both a prior year score and current year score,

• Are ranked in the lowest 25% based on their prior year FCAT 2.0 scores (separate by grade), and

• Have a prior year score less than an achievement level 3 score.

• Include all retained students

Elem. & Combination Schools up to grade 7School Grade of 800 Points

% of students performing at or above satisfactory level of

success

Reading – 100

Math – 100

Science – 100

Writing – 100

% of student making annual learning gains

Reading - 200• Overall - 100• Low 25% - 100

Math - 200• Overall - 100• Low 25% - 100

F: 0-394; D: 395-434; C: 435-494; B: 495-524, A: 525-800

2011-12 through 2013-14 School Grade:Middle School (900 Points)


success

Reading – 100

Math – 100

Science – 100

Writing – 100



Math - 200• Overall - 100• Low 25% - 100

F: 0-444; D: 445-489; C: 490-559; B: 560-589, A: 590-900

Algebra EOC – 100• Participation - 50• Performance - 50

2014-15 School Grade:Middle School (1000 Points)


success

Reading – 100

Math – 100

Science – 100

Writing – 100



Math - 200• Overall - 100• Low 25% - 100

Algebra EOC – 100

Civics EOC - 100

2011-12 High School GradeFCAT Component (800 points)

• Reading (100 Points)• Math (100 Points)• Writing (100 Points)

Meeting High Standards

• Reading (200 Points)• Math (200 Points)

Making Learning Gains

• Reading• Math

FCAT Retake Bonus Point (10 Points)

Non-FCAT (800 points)

• Overall (200 points)• At Risk (100 points)

Graduation

• Participation (150 Points)• Performance (150 Points)

Acceleration Courses


Readiness (200 Points)

F: 0-789; D: 790-869; C: 870-989; B: 990-1049, A: 1050-1600

Bonus Points for High Schools: High schools are eligible for an additional 10 points if at least 50% of students retaking assessments required for graduation in reading and math score high enough to meet graduation requirements in both areas.

2013-14 High School GradeFCAT Component (800 points)

• Reading (100 Points)• Math (100 Points)• Writing (100 Points)• Science (100 Points)

Meeting High Standards (400 Points)


Making Learning Gains (400 Points)

• Reading• Math

FCAT Retake Bonus Point (10 Points)

Non-FCAT (800 points)

• Overall (200 points)• At Risk (100 points)

Graduation (300 Points)

• Participation (100 Points)• Performance (100 Points)

Acceleration Courses (200 Points)


Readiness (200 Points)

US History (100 Points)

F: 0-789; D: 790-869; C: 870-989; B: 990-1049, A: 1050-1600

Testing participation• Schools must test at least 90%

of eligible students (at least 95% to be eligible for an “A”) to be assigned a regular letter grade.

• Schools testing below 90% are initially assigned an “I” and are reviewed further to determine whether a grade penalty will apply.

Letter-grade drop limit for 2011-12.• For 2011-12 only, no school’s

assigned grade will be more than one letter grade lower than the school grade assigned for 2010-11.

Adjusted Scores for Letter-grade drop limit for 2011-12

R M W S R Gain

M Gain

L25 R

Gain

L25 M

GainTotal Pts.

2012 Grade

2011 Grade

50 49 68 26 68 54 59 30 404 D BMin. points needed for C is 435 C

Gap points 31 PointsAdjusted Scores: Divided the gap points by 3 and added to reading, math and writing

Adjusted Scores Points10 10 1160 59 79 26 68 54 59 30 435 C

F: 0-394; D: 395-434; C: 435-494; B: 495-524, A: 525-800

Adjusted Scores for Letter-grade drop limit for 2011-12

R M W S R Gain

M Gain

L25 R

Gain

L25 M

GainTotal Pts.

2012 Grade

2011 Grade

20 34 59 8 58 57 64 66 366 F CMin. points needed for C is 395 D

Gap points 29 PointsAdjusted Scores: Divided the gap points by 3 and added to reading, math and writing

Adjusted Scores Points9 9 11

29 43 70 8 58 57 64 66 395 D

F: 0-394; D: 395-434; C: 435-494; B: 495-524, A: 525-800

Annual Learning Gains

2011FCAT


2012 CurrentFCAT

School Year

Fall Interim Assessment

Winter InterimAssessment

Baseline.


Performance

Performance

70

3-Ways to Make Annual Learning Gains1. Improve

achievement level

FCAT 2.0 Achievement

Level

EOC Assessment Achievement

Level

FAA Performance

Level

2. Maintain Achievement

Level

FCAT 2.0 L3-5 (3-3, 4-4, 5-5)

EOC L3-5(3-3, 4-4, 5-5)

FAA – L 4-9(4-4, 5-5, 6-6, 7-7, 8-8, 9-9)

3. Demonstrate a year’s growth for

students remain with low proficient levels

FCAT 2.0: 1-1, 2-2

EOC: 1-1, 2-2

FAA: 1-1, 2-2,3-3

Annual Learning Gains for FCAT 2.0Start

Additional Weight for DSS Gains

Example: A 4th grader scoring at level 1 in prior-year would need to increase score by at least 16 DSS points to qualify

for 1.1. (12+ 33% more than 12 = 16)

1.1 Points1.0 Points

Annual Learning Gains for EOC

Start

Annual Learning Gains for FAA

Start

Level 5

2011 FCAT 2.0 Level

2012 FCAT 2.0 Level

Level 4

Level 3

Level 5

Level 3

Level 3

Level 1

Level 2

Level 1

Level 2

-2

5

-8

11

5

DSS Change

2012 LG?

?

?

?

?

?

Y

N

Y

N

N

Reading Learning Gains

3

2011 FCAT Tested Grade

2012 FCAT Tested Grade

6

9

4

7

10

3

10

3

10

Student2011

Tested Grade

2012Tested Grade

2011 FCAT 2.0 DSS

2012 FCAT 2.0 DSS

2011 FCAT 2.0 Level

2012 FCAT 2.0 level DSS Change 2012 LG

Points2012 PF

Point

1 10 10 215 219 1 1 4 2 9 10 221 245 1 3 24 3 9 9 231 235 2 2 4 4 3 4 225 221 4 4 -4 5 7 8 230 NM 2 NA 6 9 10 250 256 3 4 6 7 3 4 185 210 2 3 25 8 6 7 238 240 4 3 2 9 4 5 230 247 4 5 17

10 10 10 240 244 2 2 4 11 5 6 210 217 2 2 7 12 4 5 221 227 4 3 6 13 8 9 241 224 3 2 -17 14 6 7 225 260 3 5 35 15 3 3 145 158 1 1 13 16 7 8 250 249 4 4 -1 17 10 10 225 228 1 2 3 18 5 6 205 237 2 4 32 19 7 8 175 181 1 1 6 20 8 9 245 242 3 3 -3 21 8 9 269 256 5 4 -13 22 5 6 162 170 1 1 8 23 4 4 179 190 1 1 11 24 6 7 200 215 1 2 15 25 8 9 296 277 5 5 -19

Worksheet 4: Learning Gains – FCAT 2.0 Reading

Student2011

Tested Grade

2012Tested Grade

2011 FCAT 2.0 DSS

2012 FCAT 2.0 DSS

2011 FCAT 2.0 Level

2012 FCAT 2.0 level DSS Change 2012 LG

Points2012 PF Points

1 10 10 215 219 1 1 4 0 02 9 10 221 245 1 3 24 1.1 13 9 9 231 235 2 2 4 0 04 3 4 225 221 4 4 -4 1 15 7 8 230 NM 2 NA NA 06 9 10 250 256 3 4 6 1.1 17 3 4 185 210 2 3 25 1.1 18 6 7 238 240 4 3 2 0 19 4 5 230 247 4 5 17 1.2 1

10 10 10 240 244 2 2 4 0 011 5 6 210 217 2 2 7 0 012 4 5 221 227 4 3 6 0 113 8 9 241 224 3 2 -17 0 014 6 7 225 260 3 5 35 1.2 115 3 3 145 158 1 1 13 1 016 7 8 250 249 4 4 -1 1 117 10 10 225 228 1 2 3 1 018 5 6 205 237 2 4 32 1.1 119 7 8 175 181 1 1 6 0 020 8 9 245 242 3 3 -3 1 121 8 9 269 256 5 4 -13 0 122 5 6 162 170 1 1 8 0 023 4 4 179 190 1 1 11 0 024 6 7 200 215 1 2 15 1.1 025 8 9 296 277 5 5 -19 1 1

Worksheet 3: Learning Gains – FCAT 2.0 Reading

Adequate Progress Criteria for the Low25%

Made Learning Gains

50% - 100%

Between40% to 49%

Below 40%

Made adequate progress

Higher than that of prior year by 1 percentage point

Made adequate progressAND

Higher than that of prior year by 5 percentage points

Made adequate progressAND

To avoid having the school grade reduced:

• Must show adequate progress of the low25% in both reading and math for the current year

School Grade A

• Must show adequate progress of the low25% in both reading and math for either the current or previous year

School Grades B or C

2012R

2012M

2013R

2013M

School Grade A

No No Yes Yes

School Grades B or C

Yes No No Yes

No Yes Yes No

Yes Yes

Meet Adequate Progress Criteria for the Low25%?

Suspend the adequate progress requirements for reading and math in

2011-12

Analyze School Grades Using Excel Pivot Table

Pivot Table

81

Tool for Data

Analysis

Data Analysis Questions for School Grade

How many schools are listed in each school types?

For each school type, how many schools earned letter grade A, B, C, D, and F? Which Schools ?

How many schools increase their grades from last year? Which schools?

How many schools decrease their grades from last year? Which schools?

Which schools have the highest learning gains in reading/math?

Student Performance Indicators Data Elements

83

Direction• Create a folder call SPI• Select a school • Download data• Save it into the SPI folder

On ActionData Website• Download SPI Splitter• Wait for more

instructions

SPI School Data Elements1. CLASS_SCHOOL

2. STUDENT_NAME

3. STUDENT_ID

4. STUDENT_STATUS_CODE

5. GENDER

6. STUDENT_ETHNICITY

7. STUDENT_GRADE

8. STUDENT_HOMEROOM

9. LEP_Entry_Date

10. LUNCH_CODE

11. Birthdate

12. ESE_INFO

13. LEP_INFO

14. FCAT_CURR_GROUP

15. FCAT_TEST_YEAR

16. FCAT_TEST_MONTH

17. FCAT_GRADE

18. FCAT_NRT_MATH_SCALE

19. FCAT_NRT_MATH_PERCENT

20. FCAT_NRT_MATH_STANINE

21. FCAT_NRT_READ_SCALE

22. FCAT_NRT_READ_PERCENT

23. FCAT_NRT_READ_STANINE

24. FCAT_SSS_MATH_SCORE

25. FCAT_SSS_MATH_LEVEL26. FCAT_SSS_MATH_DEVELOP27. FCAT_SSS_MATH_NS (Rpt. Cat. 1)28. FCAT_SSS_MATH_M (Rpt. Cat. 2)29. FCAT_SSS_MATH_GS (Rpt. Cat. 3)30. FCAT_SSS_MATH_AT (Rpt. Cat. 4)31. FCAT_SSS_MATH_DA32. FCAT_SSS_READ_SCORE33. FCAT_SSS_READ_LEVEL34. FCAT_SSS_READ_DEVELOP35. FCAT_SSS_READ_WP (Rpt. Cat 1)36. FCAT_SSS_READ_MIP (Rpt. Cat 2)37. FCAT_SSS_READ_C (Rpt. Cat 3)38. FCAT_SSS_READ_RR (Rpt. Cat 4)39. FCAT_SSS_SCI_SCORE40. FCAT_SSS_SCI_LEVEL41. FCAT_SSS_SCI_PC (Rpt. Cat 1)42. FCAT_SSS_SCI_ES (Rpt. Cat 2) 43. FCAT_SSS_SCI_LE (Rpt. Cat 3)44. FCAT_SSS_SCI_ST (Rpt. Cat 4)45. FCAT_SSS_WRITE_PT46. FCAT_SSS_WRITE_SCORE47. FCAT_READ_PASS_FAIL 48. FCAT_MATH_PASS_FAIL

Data Analysis Questions for SPI Data

How many students on this report?

How many students scoring at each achievement level in 2012? What are the %? Who scored in Level 1?How many students scoring at each achievement level in 2011 and 2012?

How many students scoring at or above satisfactory levels in 2012? Which student?

What is the range of % correct by achievement level?

Which student performed below 51% in each reporting category? How many students?

Which student performed above 70% in each reporting category? How many students?

What is the average % correct for each reporting category by achievement level?

2012 % Correct of Reporting Category by FCAT 2.0 Achievement LevelReporting Category

# of Stu < 51%

What%?

# of Stu >= 70%

What%?

Avg. % Corr.

Avg. % Corr.

Level 1

Avg. % Corr.

Level 2

Avg. % Corr.

Level 3

Avg. % Corr.

Level 4

Avg. % Corr.

Level 5

2012 % Correct Range by FCAT 2.0 Achievement Level

Grade:________ Assessment:__________ Total Students:______________

Level 1 Level 2 Level 3 Level 4 Level 5 L 3-5 L 1-2

Number of students

Range of % Correct

Worksheet 5: Looking at Student Data

2012 % Correct Range by FCAT 2.0 Achievement Level – Math(Sample based on data from couple of schools)

Grade Level 1 Level 2 Level 3 Level 4 Level 5

3 0%-48% 45%-68% 68%-86% 86%-93% 93%-100%

4 0%-53% 53%-70% 68%-85% 83%-95% 95%-100%

5 0%-43% 35%-57% 57%-74% 72%-79% 89%-100%

6 0%-36% 30%-52% 50%-73% 73%-89% 89%-100%

7 0%-41% 30%-55% 50%-73% 68%-86% 84%-100%

8 0%-40% 35%-56% 50%-73% 69%-88% 85%-100%

ALG 0%-26% 13%-37% 31%-61% 57%-74% 78%-100%

Day 2 Topics

Data Elements from Accountability Report

Data Elements from File Download Manager

Use of Excel Vlookup

Use of Excel Pivot Table for Data Analysis

Conversion of 2012 FCAT/EOC PDF Student Data

Report File to Excel File

Student Report in PDF File

90

Conversion Process

PDFCombined

Grades

TextCombined

Grades

Templateby Grade

Level/EOC

Excel Report by Grade

Level/EOC

91

2012 FCAT

Reading1. R-Templates

2. R-PDF3. R-Text4. R-Excel

Math1. M-Templates

2. M-PDF3. M-Text4. M-Excel

Science1. S-Templates

2. S-PDF3. S-Text4. S-Excel

Folder and File Structure

If you do not have student report in PDF file, use the one from the website.

Instructions for Conversion PDF File• Open Adobe Reader. • On the File menu, open the student report, and select Save As- Text • Name the file and save into the PDF folder• Wait until the export process is completed• Close the student report file

Step 1Export PDF File to

Text

• Open the 2012 Action Data Template• Click on “Import Data”• Locate the appropriate text file and click Open• Wait until the import process is completed

Step 2Import Text to Template file

• Under “Check your data!”, click on the hyper text “inputData…”

• Spot check data from beginning to end

Step 3Verify Data

• On worksheet “Direction”, click Data Button• On worksheet “Direction”, click Raw Score Distribution

Button

Step 4Review the Results

• On File menu, select Save As• Use appropriate name (remove “Template 06”• Save as type: select “Excel workbook”• Click Save

Step 5Save as the file

Instructions for Calculating LG PointsPreparation Steps1. Insert two empty columns:

Step 1 – Highlights Columns R and S, right click, then click on Insert Step 2 – On the Home menu, click on Conditional Formatting, and select “Clear Rules from Selected Cells”. Next, under Number group of the Home menu, select “General”. Next, under Font group of the Home menu, select Borders and select All Borders. Step 3 – In Cell R2, type “Learning Gains Points” Step 4 – In Cell S2, type “Performance L3-5 Points”

2. Hide all columns with the exception of the following:• Student Name ( Column A),• 2012 DSS (Column C),• 2012 Level (Column D),• 2011 level (Column I),• 2011 DSS (Column J),• DSS Change (Column K),• Learning Gains Points (Column R)• Performance L3-5 Points (Column S)

3. Highlight Cell A2 to S2. On the DATA menu, under Sort & Filter group, click Filter twice.4. Cell A2, filter out “Blanks” from Student Name.

Instructions for Calculating LG PointsFollow the leaning gain flow chart to determine learning gains points1. Filter “NM and NA” 2011 Level. Next, in the first empty cell under “Learning Gains Points”, type “NA” and highlight to the last cell. Next, fill down.

Clear filter from 2011 Level.2. Increase achievement level one or more in 2011 level to Level 5 in 2012:

– Step 1: Filter 5 under 2012 Level and 1-4 under 2011 level– Step 2: Column “Learning Gains Points”, in the first empty cell, type “1.2” and highlight to the last cell. Next, fill down. – Step 3: Clear filter from 2011 Level and 2012 Level

3. Increase achievement level one or more in 2011 level to Level 4 in 2012:– Step 1: Filter 4 under 2012 Level and 1-3 under 2011 level– Step 2: Column “Learning Gains Points”, in the first empty cell, type “1.1” and highlight to the last cell. Next, fill down. – Step 3: Clear filter from 2011 Level and 2012 Level

4. Increase achievement level from Level 1 in 2011 to Level 3 in 2012:– Step 1: Filter 3 under 2012 Level and 1 under 2011 level – Step 2: Filter DSS change greater than or equal to the 33% more than the min. required gain. See table 33% point gain.– Step 3: Column “Learning Gains Points”, in the first empty cell, type “1.1” and highlight to the last cell. Next, fill down. – Step 4: Clear filter from DSS Change and this time filter value less than 33% more than the required gain.– Step 5: Column “Learning Gains Points”, in the first empty cell, type “1.0”, highlight to the last cell. Next, fill down– Step 6: Clear filter from DSS Change, 2011 Level, and 2012 Level

5. Increase achievement level from Level 2 in 2011 to Level 3 in 2012: Follow steps in item 46. Increase achievement level from Level 1 in 2011 to Level 2 in 2012: Follow steps in item 47. Maintain Level 3-3, Level 4-4, and Level 5-5

– Step 1: Filter 3 under 2012 Level and 3 under 2011 Level– Step 2: Column “Learning Gains Points”, in the first empty cell, type “1.0”, highlight to the last cell. Next, fill down– Step 3: Clear filter from 2012 Level and 2011 Level– Repeat above steps 1 to 3 for L4-4 and L5-5

8. Retain at Level 1-1 and Level 2-2– Step 1: Filter 1 under 2012 Level and 1 under 2011 level – Step 2: Filter DSS change greater than or equal to the 33% more than the min. required gain. See table 33% point gain.– Step 3: Column “Learning Gains Points”, in the first empty cell, type “1.1”, highlight to the last cell. Next, fill down– Step 4: Clear filter from DSS Change and this time filter value at or higher than the min. required gain and less than 33% point gain.– Step 5: Column “Learning Gains Points”, in the first empty cell, type “1.0”, highlight to the last cell. Next, fill down– Step 6: Clear filter from DSS Change and this time filter value less than the min. required gain– Step 7: Column “Learning Gains Points”, in the first empty cell, type “0”, highlight to the last cell. Next, fill down– Step 8: Clear filter from DSS Change, 2011 Level, and 2012 Level– Repeat above steps 1 to 8 for retain at Level 2-2

9. Under Learning Gains Points, Filter Blanks. In the first empty cell, type “0”, highlight to the last student. Next, fill down. 10. Next, clear filter from Learning Gains Points

Student Database

96

Student Database

Demographics Information

Course Enrollments

FCAT, FCAT2.0, EOC scores,

FAA

Accountability Information

Interim Assessments

Monthly Assessment

2011-2012 Ideal Data File

97

2011-12Data File

2011-12 Demographics

Information

2010-11 FCAT Scores

2011-12 Interim

Assessments

2011-12 FCAT2.0 and EOC Scores

2011-12 Course

Enrollment

2011-12 Student

Accountability Information

Student ID

Student ID

Student ID

Stu

dent

ID

Student ID

Student ID

Student Data Sources

98

Student Data

Sources

Student Performance

Indicators (SPI)

Accountability Reports on

Principal Portal

Edusoft

File Download Manager

“Student ID” is used as a lookup value to merge the data from different files using Excel formula “V-Lookup”

=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)

99

Accountability Reports on Principal Portal


Bubble

Reading

Math

Gains

Reading

Math

Regress

Reading

Math

Lowest 25, 35, 45

Reading

Math

101


Gain(Annual Learning

Gains)

YN

Bubble

PPossibility to be at

the next level

NNeutral

RRisk to decline the

level

RegressRN

Ranking: Percentile Ranking based on DSS

0-25 26-35 36-45 45-100

Edusoft Report Builder-1

104


105

Result


106

A

B

Result


107

2. Type Report Name

Note:Create a new folder and name “Edusoft Files”

Save the export file under “Edusoft Files” Folder

VLOOKUP FUNCTION (P8)

=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY , COLUMN INDEX NUMBER, FALSE)

Lookup_Value:What value are you searching for?Excel will look for a match to this value in the leftmost column of the lookup table

Table_Array:Where do you want to search?Use absolute references to “lock” the range by pressing F4 key

Col_index_numWhich column contains the search result?Count over from the first column to figure out what this number should be, starting with 1.

FALSETo force Excel to lookup value be exact match

=VLOOKUP(b2,‘Homeroom'!$A$2:$B$37,2,FALSE)

VLOOKUP Formula

109

1 2 3 4 5A B C D E F G

1 Name Grade Student ID Gender Fall IA

PF ELL Winter IA PF

2 1818181 I S

3 1212121 S S

4 6666666 I L

5 11111111 L I

6 22222222 S S

7 33333333 S S

8 4444444 L S

9 5555555 L S

10 7777777 I I

11 8888888 L L12 9999999 S L13 1010101 S S14 1313131 L I

=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)

C2 =vlookup(A2,‘Interim PF’!$C$2:$G$14,5,false)

A B C

1 Student ID 2012 Level

Winter PF

2 4444444 3 3 5555555 5 4 1111111 1 5 7777777 1 6 1515151 4 7 9999999 2 8 1010101 3 9 2020202 5

10 1212121 5 11 3333333 5

Column Index Number

Worksheet “Interim PF”

Worksheet “2012 FCAT”

Download File Download Manager

Create Actionable Data for Schools July 16-26 2012 Dr. Yuwadee Wongbundhit and Mr. Nelson Suarez...

Documents

Transcript of Create Actionable Data for Schools July 16-26 2012 Dr. Yuwadee Wongbundhit and Mr. Nelson Suarez...