Pennsylvania Value-Added Assessment System (PVAAS):

45
Pennsylvania Value-Added Assessment System (PVAAS): NEW Features/Enhancements in Fall 2011 PVAAS Reporting PVAAS Statewide Core Team Fall 2011

description

Pennsylvania Value-Added Assessment System (PVAAS):. NEW Features/Enhancements in Fall 2011 PVAAS Reporting. PVAAS Statewide Core Team Fall 2011. Agenda. Review the NEW features and enhancements to Fall 2011 PVAAS reporting: Color Code Scheme and Legend Language - PowerPoint PPT Presentation

Transcript of Pennsylvania Value-Added Assessment System (PVAAS):

Page 1: Pennsylvania Value-Added  Assessment System (PVAAS):

Pennsylvania Value-Added Assessment System (PVAAS):

NEW Features/Enhancements in Fall 2011 PVAAS Reporting

PVAAS Statewide Core TeamFall 2011

Page 2: Pennsylvania Value-Added  Assessment System (PVAAS):

AgendaReview the NEW features and enhancements to Fall

2011 PVAAS reporting:Color Code Scheme and Legend Language

Alignment of Legends: Grades 4-8 and 9-11User-friendly Report Labels/Terms & RolloversWeb-based ScatterplotsRedesign of School Search featurePre-defined PacketsResources and Supports

Page 3: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 4: Pennsylvania Value-Added  Assessment System (PVAAS):

RationaleThe NEW color code scheme and legend language allow

for alignment of the reporting for grades 4-8 AND grades 9-11- reading, math, science and writing

The NEW color code scheme differentiates on both ends of the continuum, whereas the previous grades 4-8 color code scheme only differentiated below ZERO (a year’s worth of growth).

Each color code range is determined based on the standard error (SE).

Page 5: Pennsylvania Value-Added  Assessment System (PVAAS):

NEW Color Legend for Use in Both Grades 4-8 & Grades 9-11 PVAAS

Value-Added Reports

Page 6: Pennsylvania Value-Added  Assessment System (PVAAS):

Crosswalk: Old to New Legends

Page 7: Pennsylvania Value-Added  Assessment System (PVAAS):

PA Academic Growth defined as:Math & Reading Grades 4-8:  The standard

for PA Academic Growth is met when the student group makes one year’s growth/maintains their relative achievement level from one year to the next in relation to the statewide distribution (2006 baseline). 

Science, Writing, Math & Reading Grades 9-11:  The standard for PA Academic Growth is met when the student group’s actual achievement meets their predicted achievement - based on the average schooling experience.

Page 8: Pennsylvania Value-Added  Assessment System (PVAAS):

Example for Interpretation

Page 9: Pennsylvania Value-Added  Assessment System (PVAAS):

Example for Interpretation

Page 10: Pennsylvania Value-Added  Assessment System (PVAAS):

Common QuestionsQ: Will the new color codes scheme/legends be used on the Public

PVAAS reporting site?A: Yes, the colors and the legends will be the same on the LEA

protected site and the public PVAAS siteQ: How do you interpret the different shades of blue? Does dark blue

mean more growth was achieved then light blue?A: The key statement in the legend is the level of evidence –

significant and moderate. The higher the Average Growth Index the more growth made by

the district/school. Average Growth Index = Growth Measure/Standard Error

Page 11: Pennsylvania Value-Added  Assessment System (PVAAS):

Performance Diagnostic Summary Report

Page 12: Pennsylvania Value-Added  Assessment System (PVAAS):

NEW Color Legend for Use in Both Grades 4-8 & Grades 9-11 PVAAS

Performance Diagnostic Summary Reports

New Colors Same Descriptors

B

G

P

Page 13: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 14: Pennsylvania Value-Added  Assessment System (PVAAS):

User-Friendly Terms“Mean NCE Gain”

is now “Growth Measure”

“Std Error” is now

“Standard Error”

“3-Yr-Avg NCE Gain” is now

“3-Yr-Avg Growth Measure”

“(Year) Mean” is now

“(Year) Achievement”

Page 15: Pennsylvania Value-Added  Assessment System (PVAAS):

Value-Added New Language

Page 16: Pennsylvania Value-Added  Assessment System (PVAAS):

New “Roll-over” Feature

Page 17: Pennsylvania Value-Added  Assessment System (PVAAS):

The district value-added report….The Growth

Standard represents the

minimal….

The State 3-YR-Avg…

Page 18: Pennsylvania Value-Added  Assessment System (PVAAS):

Common QuestionsQ: Will the roll-over text show up when I print a report?

A: No, not with the Sept 2011 release of the PVAAs reporting. In future versions of PVAAS, there is a plan to offer an annotated version of a printed report that will include the roll-over text .

Q: Is the roll-over text located in a document that I can use to explain certain terms to my district/school teams?A: All rollover text is fully explained in the help menus.

Page 19: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 20: Pennsylvania Value-Added  Assessment System (PVAAS):

RationalePVAAS scatterplots have been provided to

LEAs in a static form (ppts) for the past several years. Scatterplots will now be provided via the web-based PVAAS reporting site!

Districts and schools can use this new web-based report to find and highlight their schools.

The availability to view data from other LEAs will be aligned to legislative requirements for public access.

Page 21: Pennsylvania Value-Added  Assessment System (PVAAS):

Accessing Scatter PlotsThe new scatter plot report

can be accessed directly within the orange “Reports” tab

Page 22: Pennsylvania Value-Added  Assessment System (PVAAS):

Customizing Scatter PlotsUsers can

switch subjects and grade

Users can also switch the the X and Y Axis

Page 23: Pennsylvania Value-Added  Assessment System (PVAAS):

Roll-Over Feature to Identify Schools!

Page 24: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 25: Pennsylvania Value-Added  Assessment System (PVAAS):

Common QuestionsQ: Will my district /LEA still receive a PowerPoint file with

my district’s scatter plots in comparison to my IU region and the state as in previous years?A: Yes! For SY11-12 all comparative scatter plot files will

be distributed by mid-to-late November to IUs to disseminate to LEAs. Decisions for future years will be based upon feedback from focus groups during the 2011-12 school year

Q: Who can access the new web-based scatter plots?A: These will be included on the LEA PVAAS protected

site and the PVAAS public site; The data reported will be different on each site

Page 26: Pennsylvania Value-Added  Assessment System (PVAAS):

Common QuestionsQ: Will web-based scatter plots be available on the Public

PVAAS reporting site?A: Yes - however, the public site will only include data

that is required via legislation; currently legislation does not require the reporting of grade level data

Q: Will other districts/schools/public be able to see my district’s gain and achievement levels?A: PA legislation determines what data is public reported.

Since the reporting of grade level data is not required by legislation, LEAs will only see the grade level data for their respective LEA.

Page 27: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 28: Pennsylvania Value-Added  Assessment System (PVAAS):

Accessing School Search

PVAAS School Search is accessed the same way it always has been – via links at the top of the page or

using the orange Reports tab

Page 29: Pennsylvania Value-Added  Assessment System (PVAAS):

Predictive Text to Assist in Locating Schools

Example: the user enters the word “Pink” and school names containing the word “Pink” appear as options to select.

Page 30: Pennsylvania Value-Added  Assessment System (PVAAS):

School Search Results

Page 31: Pennsylvania Value-Added  Assessment System (PVAAS):

School Search Results

Page 32: Pennsylvania Value-Added  Assessment System (PVAAS):

Finding Similar Schools

Page 33: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 34: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 35: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 36: Pennsylvania Value-Added  Assessment System (PVAAS):

What’s new?Comprehensive Planning Packet

Previously named “District Improvement/eStrategic Planner)”

School Improvement Data PacketPreviously named “School Improvement: Getting

Results Data Packet)”

Grade Level Planning Reports Packet

Page 37: Pennsylvania Value-Added  Assessment System (PVAAS):

Comprehensive Planning Packet

This packet includes the following reports for mathematics and reading for grades 4-8 and 9-11:

District Value-Added ReportValue-Added Summary ReportDistrict Performance Diagnostic ReportsPerformance Diagnostic Summary Reports

Users have the option to select subgroups to be included in this report.

Page 38: Pennsylvania Value-Added  Assessment System (PVAAS):

Grade Level Planning Reports Packet

This packet includes the following reports for mathematics and reading for grades 4-8 and 9-11:School Performance Diagnostic Reports

For designated grade level(s) onlySchool (Single Grade) Projection Summary Reports

For designated grade level(s) onlyCurrently Enrolled or Last TestedOne- and Two-Year Projections if applicable

Page 39: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 40: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 41: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 42: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 43: Pennsylvania Value-Added  Assessment System (PVAAS):
Page 44: Pennsylvania Value-Added  Assessment System (PVAAS):

Reminder! Opportunities this fall!

Check out what is being offered this school year by visiting the PVAAS login page!

Page 45: Pennsylvania Value-Added  Assessment System (PVAAS):

Questions?Materials and Resources

PVAAS Statewide Team for [email protected]

(717) 606-1911