ACCESS for ELLs Reporting Workshop

ACCESS for ELLs Reporting WorkshopSeptember 2021

Student Assessment Services

Melanie Manares, English Proficiency Assessment Coordinator

Shannon Cullen, MCAS and ACCESS Assessment Specialist

Dan Wiener, Administrator of Inclusive Assessment

Massachusetts Department of Elementary and Secondary Education

Questions During Today’s Presentation

• Audience members are muted to avoid distractions.

• Please type your question in the Q&A below and we will

respond in writing as we are able.

• Also, feel free to reach out to us after the presentation with

questions about specific circumstances or students.

o by email at mcas@doe.mass.edu or access@mass.gov, or

o by phone at 781-338-3625.

Thank You!2

Welcome – Reminders – Q and A

• Proficiency (i.e., Attainment) = Level 4.2 overall, plus Level 3.9

literacy composite score (in effect since 2016)

oDistricts may NOT exit students who do not attain this ACCESS score.

• Reporting Elements #1−5 (LOOK; ESSA−Title III)

• Post-Reporting Data Validation: September 8-16o This was your last chance to unite your students’ records

oA complete student record = 4 domain tests combined for a student

oAny differences may prevent receiving an overall score (e.g., different

or incorrect spelling of name, mismatched SASID, etc.).

oCorrected records will be available in WIDA AMS on September 30.

Results for the WIDA Consortium and Massachusetts

• Participation

o How many students took ACCESS and Alternate

ACCESS in 2021?

o How does this compare with 2020?

• Proficiency

o Overall and in each Domain

• ACCESS Participation and Growth SGPA) will

not be included for Accountability in 2021.

• What are the implications?

o Many students will not have Progress indicators.

o Students may only be exited from EL status if they

have taken ACCESS and scored Overall Level 4.2

and Literacy 3.9.4

Participation: Total MA Students Tested on ACCESS 2018-2021

82%of ELs

reported

in Oct.

Overall Proficiency Levels in 2020 and 2021

• Scores reflect ALL students who

tested in 2020 and 2021.

• Many fewer students tested in

2021. Scores might have differed

if more students had tested.

• There is much to learn about

which students did/didn't test.

• Testing conditions were

very different in 2021.

• Data is "reliable," but be

cautious drawing conclusions

and making inferences, esp. if

fewer than 80% tested in a

school/district.

2021 ACCESS: Urban vs. Non-Urban (Average Overall Scaled Scores)

Change in Domain

Scores (2020 to 2021): Listening

• Average scale

scores on the

Listening test

decreased or

remained about the

same in all grades

except grade 9,

which gained 7

points.

• The largest declines

were in grades 3, 5,

and 12.

Change in Domain Scores

(2020 to 2021):

Reading

• Average scale scores on the Reading test increased in grades 1, 2, and 9−12.

• Scores decreased 1−7 points in all other grades, with the largest declines in grades 4 and 5.

(2020 to 2021):

Speaking

• Average scale scores

on the Speaking test

decreased in every

grade except grade 9,

which gained 7

points.

• Grades 4−6 and

10−12 decreased

significantly, with

largest declines in

grades 4 and 5

(-10 and -14

respectively).

(2020 to 2021):

Writing

• Average scale scores

on the Writing test

showed largest

declines, except in

grade 9 which

gained 7 points.

• Grade K−6 showed

significant declines.

WIDA Consortium: Number of students tested

WIDA Consortium: Changes in Domain Scores from 2020 to 2021

Accessing YourACCESS for ELLs Results

•2021 ACCESS ResultsoAvailable August 5 in WIDA AMS

▪ Individual Student Reports (ISRs)

▪ School and District Frequency Reports

▪ Student Roster Reports

oPaper results mailed to schools on

September 8

o In DropBox Central (mid-October)

o In Edwin Analytics (mid-October)

Accessing YourACCESS for ELLs Results

•2021 ACCESS ResultsoAvailable August 5 in WIDA AMS

▪ Individual Student Reports (ISRs)

▪ School and District Frequency Reports

▪ Student Roster Reports

oPaper results mailed to schools on

September 8

o In DropBox Central (mid-October)

o In Edwin Analytics (mid-October)

Accessing Your Results in WIDA AMS

• ACCESS for ELLs

• Alternate ACCESS for ELLs

WIDA AMS Reports

District Frequency Report – ACCESS for ELLs

District Frequency Report – Alternate ACCESS

Student Roster Report – ACCESS

• School level report by grade shows individual students’ scale scores and

proficiency levels for each domain, plus composite and overall scores.

• Also shows the test tier taken by the student.

Student Roster Report – Alternate ACCESS

• Same as the ACCESS Student Roster Report, minus a “tier”

column.

WIDA AMS On-Demand Reports

• “On-demand”

reports are

Individual Student

Reports (ISRs) that

can be downloaded

for individual

students or a group

of students in

English and in other

languages.

• Reports download as

a single pdf in each

language selected.

WIDA AMS On-Demand Reports

Individual Student Report (ISR) – ACCESS

• Proficiency Level and Scale Score

for each domain and composites

• Brief description of what student

can do at that proficiency level

• Available for download by school

and grade in Spanish and English

• On-Demand Report in other

languages

• Can download a single pdf by

selected individual, by school-

level or by grade-level

ISR: Top section

provides

- student

information

- proficiency level

in each domain and

composite

- scale score for the

domain and

composite29

Individual Student Report − ACCESS

• Bottom section of ISR provides brief description of what a

student at that level generally can do.

Individual Student Report (ISR) – Alternate ACCESS

• Proficiency Level and Scale Score for each domain and composites

• Student’s performance in Listening and Reading domains

• Test Administration Information

• Brief description of what student can do at each proficiency level

• Available for download by school and grade in Spanish and English

• On-Demand Report in other languages

• Can download a single pdf by selected individual, by school-level or by grade-level

• Describes the kinds of skills

that students at each level

(A1-P3) are able to

demonstrate.

• Described in terms of the

Productive domains

(Speaking and Writing) and

Receptive domains (Listening

and Reading)

• Provides Test Administration

information such as:

o Test Environment

oAreas of the test where

accommodations were used

o Test Administrator Title

o Test Administrator's Knowledge

of the student’s abilities

WIDA AMS Reports

Report Delivery and

Parent Notification

Report Delivery

• Reports are available electronically in WIDA AMS now.

• Printed reports arrived in schools on September 8:

o School Frequency Report

o Student Roster Report

o Individual Student Reports (English)

o District Frequency Report (the only report mailed to the district office)

• In WIDA AMS, District ACCESS Test Coordinators can view both district-

level and school-level reports. School ACCESS Test Coordinators can view

school-level reports. Test Administrators cannot view reports unless they

have the assigned permission.

• All Applications>User

Management

• Select Administration

2020-2021 and “Test

Administrator” under

User Role

• Find User>Profiles

Giving Test Administrators Access to Individual Student Reports

District Test Coordinator can give access to ISRs to Test Administrators.

• Check the users you want to give access to ISRs, and click

“Assign Permissions”

• Scroll through the list of

available permissions in

the left-hand box

• Select View Dynamic Reports

• Click the single arrow

• Save

• Test Administrators will be able to view ISRs under

All Applications>Report Delivery>On-Demand Reports

Options for Parent Notification

• Schools may provide results to parents electronically by:

▪ Secure email (password-protected)

▪ Parent portal (if available)

▪Other secure method used by the district

• Schools may text or use an app to notify parents that results are

available to discuss

• Mail English-language ISRs to parents that were sent to schools.

• Schools can print ISRs locally in languages other than English

and mail to parents.41

Additional Parent Resources (Optional)

To be mailed or sent electronically:

• Sample letters – can place school or district letterhead on

the sample letter and send with the student’s results

• Parent Handouts - answers basic questions about ACCESS

or Alternate ACCESS

• Parent Guide for Score Reports – explains the Individual

Student Report in a two-page document (ACCESS or

Alternate ACCESS)

• NOTE: ISRs are confidential, but the resources above are not.42

Resources linked on the DESE ACCESS web page

43bottom of the page

Reporting Elements

• Reporting Element 1 – # and % making progress, disaggregated for

EL SWD

• Reporting Element 2 – # and % attaining proficiency (i.e., meeting

exit criteria – Level 4.2 overall and 3.9 literacy)

• Reporting Element 3 – # and % exited based on attaining proficiency

• Reporting Element 4 – # and % FELs meeting or exceeding

expectations on MCAS ELA, Math, and STE, disaggregated for FEL

• Reporting Element 5 - # and % not-yet-proficient after six years

Guide to Understanding the Title III Reporting Elements for English Learners in Massachusetts for

2017 and Beyond available on DESE ACCESS webpage: http://www.doe.mass.edu/mcas/access/default.html

ACCESS Results

on DESE web page:

http://www.doe.mass.edu/mcas/access/results.html

• ACCESS for ELLs Results by

District/School (not just Title III

districts)

oReporting Element 1

(Progress)

(Progress/Attainment)

• State, Title III Districts, and

Consortia

oReporting Elements 1, 2, 3,

and 5 46

DESE ACCESS web page (www.doe.mass.edu/mcas/access)

Reporting Elements

•Under “ACCESS for

ELLs” on the left-hand

•Click “Results”

Massachusetts Department of Elementary and Secondary Education 48

2021 Reporting Elements 1 and 2 available in October

ACCESS for ELLs Results by District/School

• Participation rate (ACCESS and Alternate ACCESS)

• # and % at each ACCESS level by grade span and all grades

• Reporting Element 1- Progress (those meeting benchmarks, or

scoring one proficiency level higher in any domain on Alt ACCESS)

• Reporting Element 2 - Attainment (those scoring 4.2 overall and

3.9 literacy on ACCESS)

Reporting Element 4 – District by FEL/FEL SWD and Year FEL

• Reporting Element 4 – # and % FELs meeting or exceeding

expectations on MCAS ELA, Math, and STE, disaggregated for FEL

SWD (by year FEL)

• State, Title III Districts and Consortia

Reporting Elements 1, 2, 3, and 5: State, Title III Districts, and Consortia

• Reporting Element 1 = Progress by district (not grade span) for Grades K-8 and High

School

o Participation

o Progress (total)

o Mean SGPA (current year and previous year)

o Difficulty Index, # and % making progress, progress target and yes/no indicator for Grades K-8 and

High School

o # and % making progress EL SWD for K-8 and High School

Reporting Elements 1, 2, 3, and 5: State, Title III Districts, and Consortia

• Reporting Element 2 = Attaining proficiency

o # and % attaining proficiency (by district, not grade span)

• Reporting Element 3 = # and % exited based on proficiency

• Reporting Element 5 = # and % not yet proficient after six years

Targets and Indicators in

Security Portal DropBox and

Progress Indicators and Progress Targets for Students

•Security Portal DropBox

o“ACCESS2021_student_level_R1_and_R2_” (early-mid

October)

•Edwin Analytics

oACCESS for ELLs District and School Summary (EL327)

(mid-October)

▪Participation for schools and district

▪# and % making progress for schools and districts

oACCESS for ELLs Student Roster (EL627) – individual

students (mid-October) 54

DropBox Files and Edwin Reports in the Security Portal

DropBox Files

DropBox Files – Available in October

DropBox Files - Your District’s Data (available in October)

DropBox Files – Your District’s Data

• 2021 ACCESS files available in October• ACCESS2021_student_level_R1_and_R2_

• ACCESS2021_with_reporting_elements - later in the fall (December)

ACCESS 2021 Files – Available in October

• Student level results• Progress targets 2021 and 2022

• Progress indicator

• ACCESS overall scores 2021 and 2022

• SGPA, etc.

ACCESS 2021 Files – Available in October

• Student level results • Attainment, future targets and difficulty index (2022)

• RE3 not included in October

Edwin Reports – available mid-October

Edwin Analytics – available mid-October

ACCESS for ELLs District and School Summary (EL327)

ACCESS for ELLs Student Roster (EL627)

can select claimed students

can select certain students

to go to PR600

Assigning Scores for Missing

Test Domains (SPD)

Assigned Scores for Missing Test Domains

• Since 2020, DESE has assigned scores to missing ACCESS test domains

for students for whom there were unavailable accommodations.

• Overall scores and proficiency levels are provided for these students so

reclassification determinations and growth-to-proficiency (benchmark)

calculations can occur.

• Will be reported this fall in the Security Portal DropBox in file

“ACCESS2021_student_level_R1_and_R2_”.

• Will not be included on ISRs or any other reports found in WIDA AMS.

• See the Guide to Assigning Scores for Missing Domains on ACCESS for

ELLs Tests for English Learners with Disabilities posted on DESE ACCESS

web page. 67

QUESTIONS?

DESE: access@mass.gov

781-338-3625

WIDA: help@wida.us

1-866-276-7735

DRC: WIDA@datarecognitioncorp.com

1-855-787-9615

ACCESS for ELLs Reporting Workshop

Documents

Transcript of ACCESS for ELLs Reporting Workshop

RTI & ELLs

GADS 101 Data Reporting Workshop

Mile End School Reporting Workshop November 2012.

EMetric Presents A reporting application designed to fit the needs of ACCESS for ELLs users.

Sage Reporting Workshop Understanding the Information/Reporting Requirement Graham Hoyle, Cherryl Holliday.

Economic Data Reporting (EDR) Stakeholder Workshop

ADP Reporting Workshop for the Advanced User Part 10F916658-03DA... · ADP Reporting Workshop for the Advanced User ... An alternate way to add coded fields in Advanced Reporting

Regulatory reporting workshop 4 November 2014 slides

ELLs and Mathematics ELLs and MATHEMATICS

Multimedia & Education Reporting - Al Fanar Workshop

Year End Financial Reporting Workshop

CiviCRM Reporting Workshop: Practice and Application

Framework for reporting STATUS workshop 1

ACCESS for ELLs 2.0 Federal Programs Fall Workshop Susan Beard Student Assessment Section.

2019 Financial Reporting Workshop...Financial Reporting Workshop 2020 Presented By: Statewide Financial Reporting Section (SFRS Team) Bureau of Financial Reporting Division of Accounting

PRELIMINARY FINDINGS: Incident Reporting Survey ROSIS WORKSHOP

Presentation on SAP Reporting Workshop - Final

Haupttitel ElCom Workshop Reporting under ESO 26a

#Blending4Ag Social Reporting Workshop

SCOMathon workshop week Tuesday session. Reporting, Alert ...