FRIT 7237: Evaluation of Educational Needs and Programs

Evaluation Plan: Braxton County, Georgia

Alison Geigerman
Kayla Metheny
Kelsey Prentice
Anna Maudie Saxon

Implementation Evaluation
 The goal of this project is to prepare teachers to effectively teach New State Standards

for Mathematics and integrate technology. Therefore, to effectively evaluate this project, the

team will need to use a mixed methods approach.

Implementation Questions Activities Duration

What is the quality of the
initial experience and the
follow up activities?
1. Questionnaires will be given1.
to teachers after each training
session
2. Multiple observations will 2.
occur during all PD sessions
Throughout the five-day
workshop and post workshop
meetings
Each workshop during the
five day training

Did the program activities 1. Pre-survey for teachers to 1.
provide quality instruction provide baseline data
and model appropriate 2. Post-survey for teachers to 2.
classroom implementation? determine instructional
growth 3.
3. Questionnaire after each
session on the quality of the
presenter and content
Beginning workshop on June
25th
Immediately after workshop
ends. No later than January.
Throughout the workshop.
After each training session

What methods were used to 1. List of all participants 1.
ensure a variety of program enrolled for the workshop
participants? 2. Brief questionnaire to 2.
determine basic demographic
information
Provided by Ms. Lawton no
later than June 20th
Questionnaires will be given
on the first day of the
workshop, June 25th.

Did the programs follow-up1. Interviews with teachers to 1. Mid-implementation meeting

activities provide enough
support to ensure correct
implementation? 2.
provide insight into strengths2. During the Fall Semester
and weaknesses 2015
Two observations per teacher
to demonstrate fidelity in
implementation

The quality of the initial experience will be evaluated using questionnaires and

observations. After the training sessions, teachers will be asked to take a brief questionnaire

about the quality of their workshop. Each session will also be observed by two people on the

project team. Each team member will submit their workshop notes at the end of the session.
Also, teachers will be given a pre- and post-survey to determine their knowledge growth about

New Mathematics Standards.

Participants for this workshop were selected by Ms. Lawton. She used email and paper

mailings to invite these teachers to participate in the summer workshop. Ms. Lawton has agreed

to provide a list of participants prior to June 20th. When the participants arrive, they will conduct

a brief interview with a project team member to gather some basic demographic information,

such as gender, race, age, years in this field of study, years in the profession.

During the mid-implementation workshop, teachers will participate in a brief interview

about the areas in which they are excelling and the areas that they feel they need more assistance.

After gathering this data, teachers will receive two unannounced observations by a project team

member. These observations will happen after the mid-implementation workshops.

Data Collection Schedule

Date Data Collected: Instruments Measures: Responsible

used: Party:

May 2014 Student Georgia Student Project Team

Mathematics Milestones achievement in member
Scores on a mathematics
standardized test

June 20, 2015 Participants Google Doc Variety of Ms. Lawton

attending providing each participants
workshop participant's
name

June 25, 2015 Pre-Survey for Use of Google Background Teachers and
teachers Forms to knowledge of Project Team
complete survey participants on Member
PBL and NSSM

June 25, 2015 Demographics Google Doc Variety of Teachers and

Survey from Ms. participants Project Team
Lawton to be Member
completed by
 teachers

June 25-29, 2015 Workshop Use of Google Quality of Teachers and

Quality Survey Form to sessions Project Team
complete survey member

June 29, 2015 Post-Survey for Use of Google Academic Teachers and
Teachers Forms to growth of Project Team
complete survey teachers about Member
PBL and NSSM

September 2015 Teacher Interview Teacher Project Team

Interview Questionnaire knowledge on Member
effective
implementation

October 2015 Teacher Observation Teacher Project Team

Observation #1 Checklist knowledge on Member
PBL, NSSM,
technology

December 2015 Teacher Observation Teacher Project Team

Observation #2 Checklist knowledge on Member
PBL, NSSM,
technology

May 2016 Student Georgia Student Project Team

Mathematics Milestones achievement in member
Scores on a mathematics
standardized test

Summative Evaluation

Questions Objective Addressed Assessment tools

Were teachers able to create Objective 1: create PBL Teacher lesson plans
PBL modules based on modules for mathematics Observation checklist
examples from local based on examples from local
businesses and industries? businesses and industries.

Were teachers able to Objective 3: integrate Teacher lesson plans

integrate technology in PBL available instructional Observation checklist
modules? technology into PBL
experiences.

Were teachers able to create, Objective 2: create PBL Teacher lesson plans
implement, and evaluate PBL
modules addressing NSSM?
modules, which address Observation checklist
NSSM. Teacher interview
Objective 4: implement and
evaluate the learning modules
created.

The summative project questions above are linked to an objective listed in the proposal

for this professional development project. Each question will be answered with an assessment

tool. The project team will meet at the end of the project to evaluate the impact of this project on

teacher implementation and student achievement. The data collected throughout the workshop

will demonstrate a growth or lack of growth in both student achievement in mathematics and

teachers subject knowledge/implementation of NSSM. The project team will compile a report of

the data to determine if this project was successful in achieving the four objectives listed in the

proposal. This report will include strengths and weaknesses of the project and provide insight

into future professional development opportunities of this nature.