Improving Quality SystemwideOctober 11, 2012

What is your role in afterschool?

NEW RESOURCE: BUILDING CITYWIDE SYSTEMS FOR QUALITY

NEW resource from The Wallace Foundation and the Forum for Youth Investment, available online:

http://forumfyi.org/building_system_quality

Includes:• How-to guide• Six case studies• Capacity self-assessment tool

TODAY’S SPEAKERS

Nicole YohalemDirector, Special Projects

Charles SmithExecutive Director, CYPQVP for Research, Forum for Youth Investment

Laura La FuenteDirector, Target Graduation

Denice WilliamsAssistant Commissioner

WHY FOCUS ON QUALITY IMPROVEMENT?

• Quality Matters• Quality is Measurable• Quality is Malleable

QUALITY MATTERS

In a 2007 meta-analysis of 73 evaluations, afterschool programs on average had positive effects on:

Attitudes toward schoolSocial behaviorSchool grades and achievement test scoresReduced problem behaviors from aggression

But programs without specific quality features had NO effect.

-Durlak & Weissberg (2007)

QUALITY IS MEASURABLE

Tool & Developer Common Elements of Quality

Afterschool Program Assessment SystemNational Institute on Out-of-School Time

Youth EngagementSkill-BuildingRelationshipsEnvironmentRoutines & StructureBehavior ManagementOrganizational ManagementFamily/Community Linkages

Youth Program Quality AssessmentDavid P. Weikart Center for Youth Program Quality

Youth Program Quality Monitoring ToolPolicy Studies Associates

QUALITY IS MALLEABLE

Key findings from the Youth Program Quality Intervention (YPQI) Study

A continuous quality improvement strategy:

• Improves program quality (and the more, the better).

• Works across different types of afterschool systems as well as challenging staffing conditions, and may increase staff tenure.

• Appears to be sustainable and cost-effective.

- Smith et al (2012)

www.cypq.org/ypqi

Improving Quality Systemwide

Charles SmithExecutive Director, Center for Youth Program Quality

VP for Research, Forum for Youth Investment

COMPONENTS OF AN EFFECTIVE QUALITY IMPROVEMENT SYSTEM (QIS)

Shared definition of quality Lead organizationEngaged stakeholders Continuous improvement modelInformation system(s) Guidelines and incentives for participation

Adequate resources

BUILDING A QIS: STAGES AND TASKS

How far along are you in building a quality

improvement system?

Improving Quality Systemwide

Laura LaFuenteDirector, Target Graduation

United Way for Greater Austin

2007

Since 2008:

• 294 assessments were conducted

• 38 organizations were assessed

• 481 individuals have participated in at least one training

• 34 individuals were trained as Methods trainers – 17 are still active

• 32 individuals were trained as External Assessors – 22 are still active

Spring 2008

Fall 2008

Austin’s Ready by 21 Coalition awarded Quality Counts grant

United Way, Central Texas Afterschool Network and Ready by 21 began building and implementing Austin improvement systems.

First Austin sent first cohort of Methods trainers

United Way trained first set of assessors

HISTORY OF YOUTH PROGRAM QUALITY AT UNITED WAY FOR GREATER AUSTIN:

Fall 2012Out-of-School Time Agenda

YOUTH PROGRAM QUALITY INITIATIVECYCLE OF IMPROVEMENT

Assess Program (External or Self

Assessor): Collect data about your program.

Create Improvement Plan: Develop a plan based on collected

data.

Attend Professional Development: Staff attends professional

development sessions that align with what

they want to improve.

Assess Program Again (External or Self

Assessor): Reassess the program and see if areas have improved.

More Professional Development: If the plan was successful,

have more staff attend the professional development.

Improving Quality Systemwide

Denice WilliamsAssistant Commissioner

New York City Department of Youth & Community Development

DYCD funds nonprofits to provide a wide range of high-quality programs including:Adolescent LiteracyThe Out-of-School Time InitiativeBeacon Community CentersCornerstoneSummer Youth EmploymentTEEN Action/Service Learning

17

DYCD Out-of-School Time InitiativeNYC Department of Youth and Community Development

Elements of the Out-of-School Time System

Quality Services

Capacity Building

Evaluation

ProgramsRFP, New Program

Design & Required Program Activities

New Workscope and

Budget Program Quality Monitoring Tool

(PQMT), Coaching & Observing for Quality & Annual Evaluation

(VENDEX )

Professional Development,

Technical Assistance & Conferences

DYCD Online

19

DYCD Out-of-School Time2013 Program Orientation

INFRASTRUCTURE TO SUPPORT QUALITY

KEY ISSUES IN BUILDING A QIS

1. Stakeholder engagement

2. Clarifying purpose

3. Sustainability

NEW RESOURCE: BUILDING CITYWIDE SYSTEMS FOR QUALITY

NEW resource from The Wallace Foundation and the Forum for Youth Investment, available online:

http://forumfyi.org/building_system_quality

Includes:• How-to guide• Six case studies• Capacity self-assessment tool

Improving Quality Systemwide will be archived at: www.wallacefoundation.org

and www.forumfyi.org

Please direct follow up questions to: Nicole Yohalem at nicole@forumfyi.org or

(202) 207-3344

Thank you for participating!