8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 1/12

Evaluation of Citizen

Schools¶ Expanded

Learning Time

Initiative

Study Overview

July 16, 2011

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 2/12

AbtA

ssociates | pg 2

Overview

Purpose

Research Questions

Key Study Features (Design, Data Collection

Strategies, Schedule)

 Approach to Analysis

Implications

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 3/12

AbtA

ssociates | pg 3

Purpose

Expanded Learning Time (ELT) is gaining traction as

a potentially powerful School Reform strategy.

Prior research has indicated that Citizen Schools¶

programs have positive impacts on participants.

 (PSA2009)

Citizen Schools¶ ELT program plays a key role in the

organization¶s growth strategy. 

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 4/12

AbtA

ssociates | pg 4

Research Questions

Implementation

� How are schools implementing and integrating expanded

learning time opportunities into their school days?

Outcomes

� What is the impact of participating in Citizen Schools¶ELT

program for middle grades students ± in terms of academic

as well as behavioral and aspirational outcomes?

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 5/12

AbtA

ssociates | pg 5

Key Study Features: Design

Interrupted Time Series: Quasi-Experimental Design

Compares Citizen Schools program sites to a group of carefully

selected comparison schools (1 Citizens School ELT campus, 4

comparison schools).

 Analysis of Pre- and Post- ELT student performance data.

 Analysis of student and teacher surveys from Citizen School ELT

campuses and matched comparison sites.

Qualitative analysis of interviews with key informants at both groupsof schools. 

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 6/12

AbtA

ssociates | pg 6

Key Study Features: Data Collection

Strategies

Surveys (Teachers, Students )

Interviews (Citizen Schools staff, School

 Administrators)

 Academic performance of students

Student demographic, attendance, discipline

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 7/12

AbtA

ssociates | pg 7

Key Study Features: Instruments

Student Survey

� Attitudes about school, teachers/staff, length of day

� Activities in and out of school

Teacher Survey

� Perceptions of the school environment/culture/communication/policies

� Instructional methods, teacher resources & support

� Level of satisfaction (in general and ELT-specific)

Interviews with Stakeholders

� Historical/contextual information

� Goals and expectations

� Implementation (communication, response to ELT, operations)

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 8/12

AbtA

ssociates | pg 8

Key Study Features: Schedule

YEAR 1

� Late summer/early fall: begin district IRB submissions

� Late fall/early winter: site visits to new ELT sites

� Winter/spring: collection of student extant data from state/district

� Spring: selection of matched comparison sites interviews with principals

YEAR 2

� Fall: student and teacher surveys

THEREAFTER

�A

nnual student and teacher surveys� Bi-annual site visits

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 9/12

AbtA

ssociates | pg 9

 Analysis

Comparisons between Citizen Schools and Matched

Comparison Schools

� Student outcomes (achievement, attendance, and discipline)

� Student perceptions/experiences on survey items

� Teacher perceptions/experiences on survey items

Descriptions of ELT implementation� Administrator interviews

� Citizen Schools staff interviews

� Site visits

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 10/12

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 11/12

Abt Associates | pg 11

Questions?

 Alyssa Rulf Fountain

Project Director 

alyssa_rulf_fountain@abtassoc.com

Beth Gamse

Principal Investigator 

beth_gamse@abtassoc.com

8/6/2019 Abt Associates Presentation

http://slidepdf.com/reader/full/abt-associates-presentation 12/12