Pennsylvania Value-Added Assessment System (PVAAS)

Bobbie W. Pfingstler, Ed.D. Director of Continuous School

Improvement Services CIU # 10

Update to CIU # 10 Curriculum Coordinators

September 22, 2011

Working with Your IUs

• Ali Grafenstine: pdepvaas@iu13.org• Jennifer Ross– IUs: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 27, 28

• Joan Perekupka – IUs: 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24,

25, 26, 29

• Kristen Lewald– PDE, PATTANs, Other Statewide Groups/Organizations

Agenda• NEW features and enhancements to Fall 2011

PVAAS reporting:– Color Code Scheme and Legend Language– User-friendly Report Labels/Terms & Rollovers–Web-based Scatterplots– Redesign of School Search feature– Pre-defined Packets– Resources and Supports

Agendaman, PDE website, PVAAS login page:

NEW FeaturesHandout and PPT

COLOR CODE SCHEME AND

LEGEND LANGUAGE

RationaleThe NEW color code scheme and legend language allow

for alignment of the reporting for grades 4-8 AND grades 9-11- reading, math, science and writing

The NEW color code scheme differentiates on both ends of the continuum, whereas the previous grades 4-8 color code scheme only differentiated below ZERO (a year’s worth of growth).

Each color code range is determined based on the standard error (SE).

NEW Color Legend for Use in Both Grades 4-8 & Grades 9-11 PVAAS

Value-Added Reports

Crosswalk: Old to New Legends

Performance Diagnostic Summary Report

NEW Color Legend for Use in Both Grades 4-8 & Grades 9-11 PVAAS Performance Diagnostic

Summary Reports

New Colors Same Descriptors

B

G

P

USER-FRIENDLY REPORT LABELS/TERMS AND

ROLLOVERS

User-Friendly Terms“Mean NCE Gain”

is now “Growth Measure”

“Std Error” is now

“Standard Error”

“3-Yr-Avg NCE Gain” is now

“3-Yr-Avg Growth Measure”

“(Year) Mean” is now

“(Year) Achievement”

Demo Site Access

https://pvaas.sas.comUser Name: PVAAS.TrainingPassword: PVAAS2011

New “Roll-over” Feature

The district value-added report….The Growth Standard

represents the minimal….

The State 3-YR-Avg…

New “Roll-over”

Feature

Common QuestionsQ: Will the new color codes scheme/legends be used on the Public

PVAAS reporting site?A: Yes, the colors and the legends will be the same on

the LEA protected site and the public PVAAS siteQ: How do you interpret the different shades of blue? Does dark blue

mean more growth was achieved then light blue?A: The key statement in the legend is the level of

evidence – significant and moderate.

Common Questions

Q: Will the roll-over text show up when I print a report?A: No, not with the Sept 2011 release of the PVAAs

reporting. In future versions of PVAAS, there is a plan to offer an annotated version of a printed report that will include the roll-over text .

Q: Is the roll-over text located in a document that I can use to explain certain terms to my district/school teams?A: All rollover text is fully explained in the help menus.

WEB-BASED SCATTER PLOTS

RationalePVAAS scatterplots have been provided to

LEAs in a static form (PPTs) for the past several years. Scatterplots will now be provided via the web-based PVAAS reporting site!

Districts and schools can use this new web-based report to find and highlight their schools.

The availability to view data from other LEAs will be aligned to legislative requirements for public access.

Accessing Scatter Plots

The new scatter plot report can be accessed directly within the orange “Reports” tab

Customizing Scatter Plots

Users can switch subjects

and grade

Users can also switch the the X and Y Axis

Roll-Over Feature to Identify Schools!

Demo Site Access

https://pvaas.sas.comUser Name: PVAAS.TrainingPassword: PVAAS2011

Common QuestionsQ: Will my district /LEA still receive a PowerPoint file with

my district’s scatter plots in comparison to my IU region and the state as in previous years?A: Yes! For SY11-12 all comparative scatter plot files will

be distributed by mid-to-late November to IUs to disseminate to LEAs. Decisions for future years will be based upon feedback from focus groups during the 2011-12 school year

Q: Who can access the new web-based scatter plots?A: These will be included on the LEA PVAAS protected

site and the PVAAS public site; The data reported will be different on each site

Common QuestionsQ: Will web-based scatter plots be available on the Public

PVAAS reporting site?A: Yes - however, the public site will only include data

that is required via legislation; currently legislation does not require the reporting of grade level data

Q: Will other districts/schools/public be able to see my district’s gain and achievement levels?A: PA legislation determines what data is public

reported. Since the reporting of grade level data is not required by legislation, LEAs will only see the grade level data for their respective LEA.

REDESIGN OF SCHOOL SEARCH FEATURE

Accessing School Search

PVAAS School Search is accessed the same way it always has been – via links at the top of the page or using the orange Reports tab

Predictive Text to Assist in Locating Schools

Example: the user enters the word “Pink” and school names containing the word “Pink” appear as options to select.

School Search Results

School Search Results

Finding Similar Schools

Demonstration

https://pvaas.sas.comUser Name: PVAAS.TrainingPassword: PVAAS2011

PRE-DEFINED PACKETS

What’s new?• Comprehensive Planning Packet– Previously named “District

Improvement/eStrategic Planner)”

• School Improvement Data Packet– Previously named “School Improvement: Getting

Results Data Packet)”

• Grade Level Planning Reports Packet

Comprehensive Planning Packet

This packet includes the following reports for mathematics and reading for grades 4-8 and 9-11:

– District Value-Added Report– Value-Added Summary Report– District Performance Diagnostic Reports– Performance Diagnostic Summary Reports

•Users have the option to select subgroups to be included in this report.

Grade Level Planning Reports Packet

This packet includes the following reports for mathematics and reading for grades 4-8 and 9-11:School Performance Diagnostic Reports

For designated grade level(s) onlySchool (Single Grade) Projection Summary Reports

For designated grade level(s) onlyCurrently Enrolled or Last TestedOne- and Two-Year Projections if applicable

QUESTIONS ON NEW PVAAS FEATURES AND

ENHANCEMENTS?

Communication: Local IU Meetings

• Fall Meetings– Who: Superintendents/Curriculum/Principals/Content Leaders

• What Might be Shared:– NEW Features: One Page Handout for Participants• New Legends/Color Code• Web-based Scatterplots

– Suggest LIVE demo of web-based scatterplots– NEW Features PPT for your use during update sessions– PVAAS PD Booklet: Give to participants

Reminder! Opportunities this fall!

Agendaman, PDE website, PVAAS login page:

SY11-12 PVAAS PD Booklet

Webinar Topics

• Introduction to PVAAS/PVAAS Overview• PVAAS 2011 Release: New Features• Open Q&A/Office Hours• PVAAS Public Site Tour• Effectively Communicate PVAAS with your

Board and Community• High Growth, Achieving Schools: Is it Possible?

• Using Multiple Data Sources to Identify Students at Risk of Not Reaching Proficiency

• Using Multiple Data Sources to Ensure High-Achieving Students Stay on the Path of High Performance

• Growth and High-Achieving Students• Meeting the Needs of Low-Performing

Students

Webinar Topics

Webinar Topics

• Meeting the Needs of Subgroups• Using PVAAS Data for Resource Allocation

Planning• Using PVAAS Data As Part of Scheduling

Students• PVAAS and PA Data Tools: Resources for

Higher Ed

Access a Recorded PVAAS Webinar

• To access an archived version of a webinar, go to http://elluminate.iu13.org.

• Click on “Recordings” in the upper left. • Using the calendar in the upper right corner of your

screen, click on the day the webinar was originally held. Click on the link that displays the title of the session.

• Enter your email address in the space provided and your first and last name as your Display Name. Click “Play” on the lower right portion of the screen.

Podcasts

PDE PVAAS Website

Questions?pdepvaas@iu13.org