Evaluation of Citizen Schools Expanded Learning Time Initiative

Study Overview July 16, 2011

Overview
 Purpose  Research Questions  Key Study Features (Design, Data Collection Strategies, Schedule)  Approach to Analysis  Implications

Abt Associates | pg 2

Purpose
 Expanded Learning Time (ELT) is gaining traction as a potentially powerful School Reform strategy.  Prior research has indicated that Citizen Schools programs have positive impacts on participants. (PSA
2009)

 Citizen Schools ELT program plays a key role in the organizations growth strategy.

Abt Associates | pg 3

Research Questions
 Implementation
How are schools implementing and integrating expanded learning time opportunities into their school days?

 Outcomes
What is the impact of participating in Citizen Schools ELT program for middle grades students in terms of academic as well as behavioral and aspirational outcomes?

Abt Associates | pg 4

Key Study Features: Design

Interrupted Time Series: Quasi-Experimental Design  Compares Citizen Schools program sites to a group of carefully selected comparison schools (1 Citizens School ELT campus, 4 comparison schools).  Analysis of Pre- and Post- ELT student performance data.  Analysis of student and teacher surveys from Citizen School ELT campuses and matched comparison sites.  Qualitative analysis of interviews with key informants at both groups of schools.

Abt Associates | pg 5

Key Study Features: Data Collection Strategies

 Surveys (Teachers, Students )  Interviews (Citizen Schools staff, School Administrators)  Academic performance of students  Student demographic, attendance, discipline

Abt Associates | pg 6

Key Study Features: Instruments

 Student Survey
Attitudes about school, teachers/staff, length of day Activities in and out of school

 Teacher Survey
Perceptions of the school environment/culture/communication/policies Instructional methods, teacher resources & support Level of satisfaction (in general and ELT-specific)

 Interviews with Stakeholders

Historical/contextual information Goals and expectations Implementation (communication, response to ELT, operations)
Abt Associates | pg 7

Key Study Features: Schedule

YEAR 1 Late summer/early fall: begin district IRB submissions Late fall/early winter: site visits to new ELT sites Winter/spring: collection of student extant data from state/district Spring: selection of matched comparison sites interviews with principals YEAR 2 Fall: student and teacher surveys THEREAFTER Annual student and teacher surveys Bi-annual site visits

Abt Associates | pg 8

Analysis
 Comparisons between Citizen Schools and Matched Comparison Schools
Student outcomes (achievement, attendance, and discipline) Student perceptions/experiences on survey items Teacher perceptions/experiences on survey items

 Descriptions of ELT implementation

Administrator interviews Citizen Schools staff interviews Site visits

Abt Associates | pg 9

Implications
Successful completion of the study depends upon YOU!
 With your help, Abt Associates and Citizen Schools can:
Identify Best Practices in Citizen Schools ELT implementation; Identify the impact of Citizen Schools ELT program on student learning and engagement; Advance and inform ELT as a school improvement and turnaround strategy; Inform development of a new structure for schools with:
A longer school day A second shift of educators Real world learning/academic practice
Abt Associates | pg 10

Questions?
Alyssa Rulf Fountain Project Director alyssa_rulf_fountain@abtassoc.com Beth Gamse Principal Investigator beth_gamse@abtassoc.com

Abt Associates | pg 11