Running head: EVALUATION OF EDUCATIONAL NEEDS AND PROGRAMS 1

Evaluation of Educational Needs and Programs

Jamila Colbert

Lyndsay T. Goeckeritz

Donald McFatridge

Tamala J. Thomas

FRIT 7237

Fall 2016
EVALUATION OF EDUCATIONAL NEEDS AND PROGRAMS 2

Implementation Evaluation

The project of problem-based learning (PBL) and the New State Standards for

Mathematics (NSSM) are a result of a collaboration with Great Southern University (GSU) and

the Braxton County School System. An implementation plan for evaluation should be completed

to measure if the goals of this project are being met during initiation that comply with what has

been set forth in the initial plan. The implementation evaluation for this project will then have to

focus on the queries noted in the chart below.

To ascertain the conditions of the questions in the chart, methods for collecting

implementation data will focus on analysis of documents, as well as, focusing on surveys and

interviews of the participants. To thoroughly provide inside thoughts and information, surveys

will be used with participants realized needs as it relates to the workshop content. These surveys

will also be used to aid any further planning support or extra activities acknowledged by the

participants. Eventually, interviews and more formal focus groups will give data that is more

inclusive of the quality of the workshop and support activities and if they were aligned with the

programs initial inception plan.

Implementation Activities Timeline/Frequency

Questions

Were the initial Informal evaluations will be
experiences and follow conducted during professional
ups implemented as development.
planned? Teachers will perform self-
evaluations of learning
modules.
June 25, 2015 - Introduction and
NSSM.
June 26, 2015 - Identification of
Mathematics in content.
Fall 2015 - Teachers Self-
evaluation

What is the quality of the Math reviews, math standards, June 27, 2017 - PBL and
initial program activities? math industries, and electronic Instructional Design.
communications will be used. Identification and review of
mathematics in content.
June 28 - 29, 2015 - Instructional
 EVALUATION OF EDUCATIONAL NEEDS AND PROGRAMS 3

Technology, idea sharing, PBL

module creation, planning for
implementation, and evaluation.
July 2-20, 2015 - Refinement of
PBL modules through electronic
communication between GSU
and teacher participants.

Who were the Participants for this Recruitment took place during
participants and how professional development were the 2015-2016 school year from
were they recruited? teachers, faculty, consultants, a pool of elementary, middle, and
local businesses, industries, high school educators.
and GSU.
All participants were recruited
through email and paper
mailing.

What is the quality of Teachers will do self- Fall 2015 or early 2016 -
follow up and support evaluation surveys and Post workshop debriefing
activities? activities. meetings and follow up
interactions.

Summative Evaluation

The summative evaluation will help answer the following questions:

To what extent were teachers able to develop PBL modules that were connected to local

businesses and industries, aligned with NSSM, and incorporated appropriate uses of technology?
To what extent were teachers able to implement and evaluate those modules?

The first question above is based on the first 3 objectives and the second question above

is based on the 4th objective described in the initial program plan. The data sources that will be

used for the outcome evaluation will be the Module Evaluation Rubric, NSSM Standards, and

participant surveys. The summative evaluation will take place in fall 2015 after full

implementation of PBL Modules and implementation data has been compiled.

Evaluation Questions Objective Indicator Data Source

EVALUATION OF EDUCATIONAL NEEDS AND PROGRAMS 4

To what extent were teachers Create PBL Modules pull from Module
able to develop PBL modules Modules based on content and evaluation
that were connected to local local businesses and processes from rubric.
businesses and industries, industries. local businesses and
aligned with NSSM, and industries.
incorporated appropriate uses of
technology? (Objective 1)

To what extent were teachers Create PBL Content of Modules Module

able to develop PBL modules Modules aligned including tasks and evaluation
that were connected to local with NSSM assessments are rubric; NSSM
businesses and industries, Standards. aligned with the standards.
aligned with NSSM, and appropriate NSSM
incorporated appropriate uses of standard.
technology? (Objective 2)

To what extent were teachers Integrate Effective use of Module

able to develop PBL modules technology into technology is evaluation
that were connected to local PBL experiences. incorporated into rubric.
businesses and industries, PBL Modules.
aligned with NSSM, and
incorporated appropriate uses of
technology? (Objective 3)

To what extent were teachers Implement and then Recording of Participant

able to implement and evaluate evaluate PBL implementation and interviews and
those modules? (Objective 4) Modules. self-evaluations. surveys; Focus
groups; Likert-
scale
questionnaire.

Data Collection Schedule

Data Set Date of Collection Collected Outcomes measured:

Collection Method by:

Pre-Workshop Fall 2014 Google Form GSU Baseline data; assessing

Survey survey response Faculty teachers prior knowledge
format. of PBL (math & NSSM).

Post-Workshop July 2015 Google Form GSU Growth data; measuring

Survey survey response Faculty teachers learning and
format. knowledge of PBL (math
& NSSM).
EVALUATION OF EDUCATIONAL NEEDS AND PROGRAMS 5

Project Leaders July 2015 Responses GSU Project Leaders

and Participant recorded via Faculty perspective on the training
Interviews Google Doc. and feedback from
participants; incorporating
technology.

Analysis of Fall 2014 Digital Rubric Evaluation Effectiveness of training

Teacher Produced Team and learning outcomes;
Lesson Plans July 2015 knowledge of PBL (math
& NSSM); incorporating
technology.

Participant Focus Fall 2015 Responses Evaluation Collaborative discussion

Groups recorded via Team and clarification of
July 2015 Google Doc. misconceptions; progress
monitoring; incorporating
technology.

Module July 2015 Digital Rubric Evaluation Participant feedback;

Evaluation Rubric Team conceptual understanding
of PBL.