Professional Documents
Culture Documents
PROGRAM EVALUATION AS
AN OPERATIONAL TOOL
Edna M. Jones
A look at the double role that locally derived data should play in evaluation
of national programs for social change.
Academic furors usually evolve when describe in depth the changes in indi- tion data is the most economical and
science or technology is called upon in vidual lives. logical means of progressive improve-
a matter of urgency, but is unable to Some persons argue that only "out- ment of program operation. It would ap-
respond in any organized fashion. In re- siders" to a program can evaluate it; pear that a useful purpose would be
cent years, few issues have caused such other insist outsiders cannot gain suf- served by examining some fundamentol
a furor in the behavioral sciences as has ficient understanding to conduct useful concepts about evaluation and their ap-
the issue of evaluation of national pro- evaluation. There have even been some plication at the broad base or operations
grams to improve the human condition. who carry the concept of "maximum level of national programs.
Social ferment has boiled forth on feasible participation" to the point of in- Evaluation as a System Process
all fronts as change is demanded in the sisting that only the poor and the cul- National programs for social change
life conditions of the poor. National dol- turally deprived are qualified to conduct can be viewed as large and rather com-
lars and energies have been poured out evaluation of programs to improve their plex systems. The concept can be illustra-
in massive amounts to bring about life conditions. ted by examining a simplified structure
change. Neither the politicians nor the At a more academic level, Ferman ( 1 ) of the U.S. Department of Agriculture'S
respective program managers nor the defines two basic types of evaluation Expanded Food and Nutrition Educa-
scientists have had any readily available applicable to national social welfare pro- tion Program (ENEP), a program which
and practical means of demonstrating grams. He describes the first as diagnos- Cook described in this journal. (2) (See
what change was occurring in response tic and seeking to explain why the Figure 1.)
to which program or action, and at pre- program objectives and goals are or are The heart of the ENEP system is the
cisely what cost. They have not had any not being achieved. This type provides people -to -people relationship between
way of knowing with assurance what guidelines for improved operational ef- the nutrition aides who are delivering the
should be done to sustain isolated gains fectiveness of national programs. He educational service and the clients -
that might have been identified. describes the second type as system an- homemakers, youth, families - who re-
Suddenly there is this great breach alytic in nature and seeking to describe ceive that service. This broad base, made
between the sciences and the world they the cost-effectiveness aspects of the pro- up of hundreds of thousands of such re-
purport to serve. All manner of re- gram. This type provides a basis for de- lationships, constitutes the operations
searcher has rushed forward to fill the cisions on funding and funds allocation. level of the system. All organizational
void. Some argue that evaluation should Attention appears to have been con- entities above this broad base function
be experimental oJ quasi-experimental, centrated on the problems of evaluation in support of operations. These higher
e.g., that studies of malnutrition like as they relate to national management- echelons provide funds, policy, guidance,
studies of dental cavities must have a to what kinds of data can be assembled materials, and services such as training
"control group." Researchers accus- and in what ways they can be manipu- and administration. But, it is the opera-
tomed to working with case histories lated and analyzed for use by higher ting base of the system that delivers the
argue that evaluation of national change echelons of the program. educational service.
should be flexible and should seek to This failure to focus on evaluation as Evaluation must be viewed as a proc-
an operational tool is somewhat start- ess which permeates all echelons or lev-
THE A UTHOR is Director of Social ling since the local level-down there els of the system. Program personnel may
and Educational Systems Research, "where it is all happening"-is the only not be aware of it, but the intended cli-
Datagraphics, Inc., Allison Park, Pa. logical source of data for national pro- entele whom they seek to serve are evalu-
15101. gram evaluation. Local use of evalua- ating the program. Homemakers and