6613

2
Table of Contents
Flowcharts
Figure 1.. Flowchart of Basic Webcourses Features. 3
Figure 2.. Flowchart of Instructional Unit(s). 4
Storyboards
Learning Module Storyboard. 6
Scenarios Storyboard. 7
Scenario 1 Storyboard 8
Scenario 1: Discussion Board... 9
Scenario 1: Assessments Storyboard.. 10
Scenario 2 Storyboard.11





3

Flowcharts
The figures below outline the navigation that students will follow upon entering Webcourses as well as the
instructional interactions that will occur in Unit 6: Formulate Evaluation Questions.

Figure 1. Flowchart of Basic Webcourse Features
The flowchart below depicts the navigation of the basic Webcourses features that students will utilize when
working online during PAD 6327. Expansion of the items Learning Modules (5000) and Assessments (11000)
continues in Figure 2. Storyboards detailing the navigation of this section are detailed later in this document.
_____________________________________________________________________________
_____________________________________________________________________________
The flowchart below outlines the navigation of the basic Webcourses features that students will interact with upon
entering the web-based portion of PAD 6327. Expansion of the items Learning Modules (5000) and Assessments
4

(11000) continues in Figure 2. Storyboards detailing the navigation of this section are detailed later in this
document.
Figure 2. Flowchart of Instructional Unit(s)
The figure below outlines the basic structure and sequence of Module 6: Evaluation Issues and Questions. After
navigating through the course home page, students will then access their instructional content through the
Learning Modules (5000) feature and subsequently each Unit thereafter. Upon Accessing Module Unit 6 (5600)
students will be presented with a scenario that culminates around the topical area.
______________________________________________________________________________________________

*Dotted line arrows in flow chart means that assessment will not be available until after the satisfactory
completion of previous assessment.

5

Storyboards
The next several pages depict the storyboards for the flowcharts in Figures 1 and 2. Each storyboard illustrates a
page in the flowchart. The frame number in the storyboard indicates what page on the flowchart the storyboard is
referencing. The storyboards are divided into scenarios. Each scenario contains at least one storyboard which
outline the content for each of the scenario main pages, the resources for the scenario, and the assessment to be
completed at the end of each scenario. Each storyboard contains major aesthetic components, placement of
objects and general settings used by the design team when creating PAD 6327.

6

Learning Module Storyboard

Project Title: PAD 6327 Unit 6: Formulate Evaluation Questions Page: 1 of 1
Date: 3/20/14
File Name: Modules.html
Frame #: 5000
Script:

[Header]: Course Modules

[Body]: Links to Units

UNIT 1:
Examine Major Concepts in Program Evaluation
UNIT 2:
Identify Social and Cultural Aspects of Evaluation Research
UNIT 3:
Examine Needs Assessment
UNIT 4:
Examine Process Evaluation
UNIT 5:
Examine Outcome Evaluation
UNIT 6:
Formulate Evaluation Questions
UNIT 7:
Apply Principles of Research Design to Public Evaluation
UNIT 8:
Apply Analytical Techniques in Program Evaluation
Links
Links From Screen: Course Content Home
Links To Screens: 5100, 5200, 5300, 5400, 5500,
5600, 5700, 5800, 5900

Screen Description: Shows the Units that are
accessible in the Course Modules
Screen Layout:

Background:
images/canvas/header_canvas_logo.png
Color Schemes: Gray, White, Black
Text Attributes: Helvetica; Headings 20; body 13
Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: n/a
Developers Notes:
Screen Layout was built within Canvas. Italicized and underlined fonts on screen layout are links to
other pages. Content for text in brackets are contained in Script Box.

7

Scenarios Storyboard

Date: 3/20/14
File Name: Scenarios.html
Frame #: 5600
Script:

[Header]: Scenarios

[Body]: Links to Units

SCENARIO 1:
Stakeholder Identification
SCENARIO 2:
Purpose of Program Identification
SCENARIO 3:
Program Logic Model Factors
SCENARIO 4:
Summary Question Items
SCENARIO 5:
Summary Question Criteria Factors
Links
Links From Screen: Course Content Home
Links To Screens: 5610,5620, 5630, 5640, 5650

Screen Description: Shows the Scenarios
available in Unit 6
Screen Layout:

Background:
images/canvas/header_canvas_logo.png
Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: n/a
Developers Notes:
other pages. Content for text in brackets are contained in Script Box. Scenarios that are locked until
assessments are deleted should be grayed out.

8

Scenario 1 Storyboard

Date: 3/20/14
Lesson Title: Scenario 1: Stakeholder Identification
File Name: Scenario1.html
Frame #: 5610
Script:
Unit Title Header: Unit 6: Formulate Evaluation Questions
Font Type: Helvetia, Size: 20.
Introduction: Stakeholders are individuals, groups, or organizations having a
significant interest in how well a program functions. They include: policymakers and
decision makers, program sponsors, evaluation sponsors, target participants, program
managers and staff, program competitors, contextual stakeholders (e.g., public officials
or citizen groups), evaluation and research community. In this module you will learn
how to identify stakeholders for an evaluation.
[Scenario Title:]
Scenario 1: Stakeholder Identification
[Challenge Text:]
This module will revolve around the storyline of the town of Smithville, a city which
has seen an increase in whooping cough cases. The introduction page will contain the
story and will also state the reason and purpose of the mission.

The cover story will be delivered at the beginning of the module. The following is a
synopsis of the story that the students will read about:

The town of Smithville is a large town of about 10,000 residents. Whooping cough had
not been an issue within the town until recent years. In fact, there were only two cases
of whooping cough reported from 2005-2012. In 2013, seven new cases of whooping
cough in young children (from infancy to five years old) were identified within a six-
month period. This may be due in part to residents fear of vaccinating their
children. The Health Department of Smallville formed a Whooping Cough Support
Program to aid in the prevention and control of the illness.

The goal of the evaluation is to determine if the Whooping Cough Support Program
has been effective in preventing further outbreaks of whooping cough in children from
infancy to five years old. Additionally, the evaluation will examine if the Whooping
Cough Support Program is performing optimally and if the program should be
expanded and possibly replicated for future use.

The evaluation team consists of a Whooping Cough Support Program nurse, who works
at the clinic and can easily access data. Additionally, a member of the health
department will review plans and will act as a liaison between you and the health
department. Lastly, a local community leader, Anna, who has a background in social
work, will participate to ensure the evaluation is appropriate for the community,
members of Smithville.

Your Mission:
The fictitious city of Smithville has seen an increase in whooping cough cases over the
past several years. The health commissioners implemented a program to address the
increase in incidences reported. They need your help with writing an evaluation plan to
address whether or not the program should continue to receive funding.
Links
Links From Screen: 5600
Links To Screens:
https://canvas.instructure.com/courses/847215/quizzes
Screen Description: Shows the
Scenario 1 Main Page that
mirrors the format of all other
scenario screens. Displays
goals and mission.
Screen Layout:

Background: n/a
Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: Stakeholder.jpg
Developers Notes:
other pages. Content for text in brackets are contained in Script Box. Scenarios that are locked
until assessments are deleted should be grayed out. Blue, underlined words indicate hot links to
URLS.

9

Scenario 1: Discussion Board

Date: 3/20/14
Lesson Title: Scenario 1: Stakeholder Identification
Frame #: 5610
Script:

Discussion 1: Identify Stakeholders
All students will take on the role of a research administrator, who has
been hired to evaluate the effectiveness of the Whooping Cough
Support Program, in its ability to reduce the number of outbreaks
within the community. In this module you learned the required skills
of implementing an evaluation plan by identifying stakeholders.
Write a discussion post defining how you identify stakeholders for a
Public Program Evaluation.
Links
Links To Screens: 5600

Screen Description: This storyboard details the
discussion board.
Screen Layout:

Background: n/a
Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: Stakeholder.jpg
Developers Notes:
other pages. Content for text in brackets are contained in Script Box.

10

Scenario 1: Assessment Storyboard
Project Title: PAD6327 Unit 6: Formulate Evaluation Questions Page: 4 of 4
Lesson Title: Scenario 1: Stakeholder Identification Date: March 28, 2014
File Name: Canvas.instructure url: https://canvas.instructure.com/courses/847215/quizzes

Frame #: 11100
Script:

The quiz for scenario one is multiple choice. There is only one
correct answer for each question.
1. Of the following choices, who is a member of the
"Whooping Cough Support Program" evaluation team:

All of the choices

the Research Administrator

a child who has contracted whooping cough

the support program nurse
2. Possible stakeholders in a public program can be
_____________.
Mark the best answer.

Program administrators

Evaluation sponsors

All choices are possible stakeholders in a public program.

Intended program beneficiaries

3. In what year were there a surprising seven new cases of
whooping cough in Smithville in infants and children up to
age 5?

2005

1991

2012

2013

Links
Links From Screen: 5610, 11000

Screen Description:

This demonstrates the initial layout navigation
for the Scenario 1 assessment:

Quiz 1 - Stakeholder Identification
Screen Layout:

Background: Canvas default assessments background
Color Schemes: Canvas default assessments colors
Text Attributes: Canvas default assessments text attributes

Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: n/a
Developers Notes:

Use Instructure software to upload questions into Canvas course
Students have 30 minutes and two attempts for this quiz highest of two grades is counted
Access to Scenario 2 is based on 100% completion of this quiz
After 100% completion, student will receive instructor feedback and correct answers
Blue, underlined words indicate hot links to URLS

11

Scenario 2

Project Title: PAD 6327-Unit 6 Formulate Evaluation Questions Page: 1 of 2
Lesson Title: Scenario 2: Evaluation Questions Date: 3/21/14
File Name: Scenerio2 .html
Frame #: 5620
Script:

Introduction: Understanding the goals of a program are essential for
success. We need to understand what questions we will need to ask
to identify the purpose of the program. When you have completed
this unit you will be able to analyze the program and identify its
goal.

In Unit Six, you were introduced to the town of Smithville and the
concern surrounding the increased number of whooping cough
cases. In Scenario 2, you will focus on value of the program and
whether it is meeting its goal. When you have completed this unit,
you will be able to analyze the case study and correctly identify the
purpose of platform. After analyzing the case study, you will also
be able to independently determine the issues surrounding the
study. Resources you will need to complete this unit include your
course textbook and an imagination. You will be asked to assume
that you are part of a commission sent to determine the usefulness
of the program for the city. The city is depending on you to
determine if the prevention program has been effective in stopping
the spread of whooping cough.

Links
Links To Screens:
https://canvas.instructure.com/courses/847215/ass
ignments/2695736

Screen Description: Shows the Scenario 2 Main
Page that mirrors the format of all other scenario
screens. Displays goals and mission.
Screen Layout:

Background: n/a
Color Schemes: Gray/White/Black
Text Attributes: Helvetica, Headings 20, Body 13

Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: Group Discussion jpg
Developers Notes:

Screen Layout was built within Canvas. Italicized and underlined fonts on screen layouts are linked to
other pagers. Content for text in brackets are contained in Script Box. Scenarios are locked until
assessments are deleted and should be grayed out.

12


Project Title: PAD2367 Unit 6: Formulate Evaluation Questions Page 2 of 2
Lesson Title: Scenario 2: Purpose of Program Identification Date: March 29, 2014
File Name: Canvas.instructure url:
https://canvas.instructure.com/courses/847215/assignments/2695736
Frame #: 11200
Script:

Given that you are both a theoretical researcher as a student in
PAD6327, and an actual researcher (the research administrator
conducting an evaluation of the "Whooping Cough Support
Program") - you must address your work from both roles.
As a student, you are aware that the research administrator in the
field must be clear on the purpose of the program in order to
adequately evaluate it.
Who will you interview in order to get the most accurate picture
of the purpose of the program and why?
Rubric:

You have interviewed members of the health commission that
implemented the "Whooping Cough Support Program."

You have interviewed the "Whooping Cough Support Program
team" nurse.

You have interviewed local pediatricians and pediatric nurse in
private practice and at the public clinic.

You have interviewed Anna, a community leader with a
background in social work who is part of the evaluation team.

You have interviewed the member of the health department who
acts as liaison between her department and the "Whooping Cough
Support Program."

You have sufficiently explained why a thorough interview of the
above stakeholders will lead to an accurate articulation of the
purpose of the Whooping Cough Support Program.
Links

Screen Description:
This demonstrates the initial layout navigation for
the Scenario 2 assessment:
Scenario 2 - Identifying the purpose of the
Whooping Cough Support Program

Screen Layout:

Background: Canvas default for background
Color Schemes: Canvas default for color schemes
Text Attributes: Canvas default for text attributes

Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: n/a
Developers Notes:

Students have one week for this assignment
Access to Scenario 3 is based on 100% completion of this quiz
After 100% completion, student will receive instructor feedback and correct answers
13

Scenario 3

Project Title: PAD 6237-Unit 6 Program Logic Model Factors Page: 1 of 2
Lesson Title: Scenario 3-Factors in Logic Model Date: 3/21/14
File Name: Scenario3.htlm
Frame #: 5630
Script:

Introduction: One of the tasks in accessing a program is to
determine if the goal is being accomplished. Each element of the
program is considered and the effectiveness evaluated. In this
module you will determine if each of the factors in the program are
valuable.

Smithville needs you. Please turn your attention to a new mission.
More Whooping Cough cases are coming in every day so in
Scenario 3, you will focus on factors that surround the programs
model. You will determine if the logic model they are currently
using is supporting the goal of the mission. When you have
completed this scenario, you will be able to analyze the case study
and correctly identify elements in the platform. After analyzing the
case study, you will also be able to independently determine the
factors in the logic model. Resources you will need to complete this
unit include your course textbook and an imagination. You will be
asked to assume that you are part of a commission sent to determine
factors of the logic model. The city is depending on you to
determine if the prevention program has been effective in stopping
the spread of whooping cough.

Links
Links To Screens:
ignments/2695736

Screen Layout:

Background: n/a

Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: Factors jpg
Developers Notes:

assessments are deleted and should be grayed out. Blue, underlined words indicate hot links to URLS.

14

Project Title: PAD6327 Unit 6: Formulate Evaluation
Questions Page: 2 of 2
Lesson Title: Scenario 3: Program Logic Model
Factors Date: March 26, 2014
File Name:

Frame #: 11300
For this assignment you will identify each item in a list as being in a particular category;
some items will fall under more than one category you will receive full credit if you
identify at least one correct category per item:

Expenditure for the Whooping Cough Support program mark as an E.
A resource of the Whooping Cough Support program mark as an R.
An activity sponsored by the Whooping Cough Support program mark as an A.
A tangible output of the Whooping Cough Support program - mark as TO.

For full credit, you must identify at least 4 of the items as particularly important
components of the Whooping Cough Support program and explain why.

-Medical supplies donated to the Whooping Cough Support program by a retiring
pediatrician
-The cost of renting a public space for the health fair where free DTaP (diphtheria, tetanus
and pertussis) shots will be given.
-The quarterly health fair at which the Whooping Cough Support program nurse gives free
DTaP shots
-The number of new cases of whooping cough reported to the Smithville health department
-Cash from state funds earmarked for the salary of the nurse who staffs the clinic in
Smithville that gives free DTaP shots
-The cost of electric, water and telephone for the clinic in Smithville that gives
-The annual charity ball that raises money for the Whooping Cough Support program free
DTaP shots
-The number of children given free DTaP shots at Smithville health fairs
-Grant money earmarked for pamphlets that advertise the Whooping Cough Support
program and Smithville health fairs where free DTaP shots are given
-Fees paid to an actor who filmed a pubIic service announcement for free DTaP shots
-Phone calls made to all the local pediatricians surveying them for information about
parents who were afraid to have their children given the DTaP vaccine
-The incidence of sick days taken by parents who worked in Smithville being reduced
during the campaign to provide free DTaP shots to all children
-Donated paper appropriate for printing posters advertising the Smithville Health Fair
-The cost of training and supplies for volunteers who went to all the day care centers in
Smithville to hand out posters and pamphlets advertising free DTaP shots at Smithville
clinic
-There were less than 5 cases of diphtheria reported in the U. S. in the last ten years.
-The delivery of posters and pamphlets advertising free DTaP shots at Smithville clinic to
all day care centers in Smithville

Links
Screen Description:
This demonstrates the
initial layout navigation
for the Scenario 3
assessment:
Scenario 3 Assignment
for Logic Plan
Screen Layout:

Background: n/a
Text Attributes: n/a
________________________________________
Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: Questions
jpg Developer Notes:
-Use Instructure software to upload questions into
Canvas course
-Students have one week for this assignment
-Access to Scenario 3 is based on 100%
completion of this assignment
-After 100% completion, student will receive
instructor feedback and correct answer

15

Scenario 4

Project Title: PAD 6237-Unit 6 Summary Questions Items Page: 1 of 2
Lesson Title: Scenario 4- Question Items Date: 3/21/14
File Name: Scenario4.htlm
Frame #: 5640
Script:

Introduction:
Determining the needs of a program and the effectiveness of the
program is essential. In order to identify the validity, summary
questions are developed and applied to the particular program. In
this module, you will learn how to formulate essential summary
questions for programs.

As of yet, there is no clear answer and the town of Smithville is
struggling. In Scenario 4, your focus will be to develop questions
that you feel will bring light to the program. You will create
summative and formative questions to determine the needs of the
program and if the program is supporting the goal of the mission.
When you have completed this scenario, you will have developed
questions that apply to the program that will aid you in determining
the validity of the platform. Resources you will need to complete
this unit include your course textbook and an imagination. You
will be asked to assume that you are part of a commission sent to
determine factors of the logic model. The city is depending on you
to develop summary questions for the prevention program.

Links
Links To Screens:
ignments/2700790

Screen Layout:

Background: n/a
Text Attributes: n/a

Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: Questions jpg
Developers Notes:

assessments are deleted and should be grayed out. Blue, underlined words indicate hot links to URLS.

16

Project Title: PAD6327 Unit 6: Formulate Evaluation Questions Page: 2 of 2
Lesson Title: Scenario 4: Summary Question Items Date: March 28, 2014
Frame #: 11400
Script:
Goals and interviews:
In a perfect world, the Whooping Cough support program would reduce cases of the
disease to zero. Given the constraints found in Smithville, list a reasonable and
observable number of new cases per year that would signal success for the program (this
is your desired status). Next make sure that you have an accurate number of new cases
for 2013 and 2014 (this will be your actual status). Last, compose at least one question
for each of your stakeholders that will shed light on how to close the gap between the
two.

You will survey all stakeholders in the Whooping Cough Support Program: the nurse,
who works at the clinic and can easily access data, the member of the health department
reviews plans and acts as a liaison between you and the health department, all parents
and guardians of children living in Smithville ages 2 months to 5 years, and a local
community leader, Anna, who has a background in social work, who ensures the
evaluation is appropriate for the community, members of Smithville.

Your first question will be what are the three most urgent issues for the Whooping
Cough Support Program to address in order to close the gap between the current number
of new cases and the realistic goal that has been set? Your next question will be, what
are the three most important characteristics of the local children from age 2 months to
age 5 that make them vulnerable to lack of vaccination? Finally, you will ask each of
the decision makers, from your personal experience, what is the single most effective
action the program can take to improve the effectiveness of the program? With this last
question, try to prompt your interviewee to be as explicit and detailed as possible.

You will survey all stakeholders in the Whooping Cough Support Program in an open
meeting with the following questions (make every effort to encourage all those in
attendance to share their ideas):
-Are there additional children who can be helped by our services?
-Are there any adverse side-effects inadvertently resulting from our services?
-Do we need to make criteria for service broader or narrower?
-Are resources being acquired and used in a cost effective manner?
-Are there other vendors who may be able to provide equivalent services as a lower cost?

In order to receive full credit for this assignment, you will need to add three questions to
this list addressing issues related to controlling whooping cough outbreaks.

Links

Screen Description:

This demonstrates the initial layout
navigation for the Scenario 4 assessment:

Scenario 4: Assignment for Summary
Question Items
Screen Layout:


Audio: n/a
Video: n/a
Animated Gifs:
n/a
Graphic Stills:
n/a
Developers Notes:

Access to Scenario 5 is based on 100% completion of this assignment
After 100% completion, student will receive instructor feedback and correct answer

17

Scenario 5

Project Title: PAD6327- Unit 6: Formulate Evaluation Questions Page: 1 of 2
Lesson Title: Scenario 5 Criteria Factors Date: 3/22/14
Frame #: 5650
Script:

Introduction:
Determining if the goals of the program are being met,
one must look at the factors and the criteria that surround
the goal. In this module, you will learn how to determine
if the questions are relevant for making that
consideration.

Here we are formulating questions that discuss the
program concerned with Whooping Cough in Smithville.
In Scenario 5, your focus will be to determine if the
summary questions you have created are actually
measuring the effectiveness of the program. At the end of
this mission, you will have developed questions that
surround and evaluate the criteria specified in the
platform. Resources you will need to complete this unit
include your course textbook and an imagination. You
will be asked to assume that you are part of a commission
sent to determine if the questions are relevant for the
module. The city is depending on you to determine if the
prevention program has been effective in stopping the
spread of whooping cough. Dont let them down; they are
counting on you.

Links
Links From Screen:5650
Links To Screens:
ignments/2701585

Screen Description:
Shows the Scenario 5 Main Page that mirrors the format
of all other scenario screens. Displays goals and mission.
Screen Layout:

Background: n/a

Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: Summary jpg
Developers Notes:

Screen Layout was built within Canvas. Italicized and underlined fonts on screen layouts are linked to other
pagers. Content for text in brackets are contained in Script Box. Scenarios are locked until assessments are
deleted and should be grayed out. Blue, underlined words indicate hot links to URLS.

18

Project Title: PAD6327- Unit 6: Formulate Evaluation Questions Page: 2 of 2
Lesson Title: Scenario 5: Summary Questions Criteria Factors Date: March 29,
2014
Frame #: 11500
Script:
Scenario 5: Summary Question Criteria Factors
Given that evaluation questions must be reasonable,
appropriate, observable, measurable and answerable:
Part 1 - Mark each example of the following evaluation
questions: T (question is in line with acceptable
performance-indicating dimensions) or F (it is not).
A. Are the entries made in the program bookkeepers
journal neat and current?
B. What are the causes of improvements in the number
of new cases of whooping cough in cities other than
Smithville (but similar in size and demographics)?

C. Are 90% of children between the ages of 2 months
and 5 years, living within Smithville city limits and
who have been identified by our health clinic as
being at-risk for not receiving their shots, being
given the vaccinations required for their age group
since signing up with our program?

D. Are we reaching those between 65 and 75 years
of age?

Part 2- In 2 or 3 sentences justify why you decided
which questions were in line with acceptable
performance-indicating dimensions and which were not.

Links

Screen Description:
This demonstrates the initial layout navigation for the
Scenario 5 Assessment:
Scenario 5 Assignment for Summary Questions Criteria
Factors.
Screen Layout:


Audio: n/a
Video: n/a
Animated Gifs: n/a
Graphic Stills: n/a
Developers Notes:

After 100% completion, student will receive instructor feedback and correct answers.
Blue, underlined words indicate hot links to URLS.s

6613

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

6613

Uploaded by

Copyright:

Available Formats

2

You might also like