Professional Documents
Culture Documents
Orientation Workshop on
Results Based Management
Rifat Shams
DAY 1
SESSION 1
Find someone:
1. Who has visited at least two countries
2. Who reads one book each month
3. Who reads news paper daily
4. Who uses face book for networking
5. Who loves one game and sportsman
6. Who plays one musical instrument
7. Who had enjoyed 5 minutes of fame in life
4
Let us build the orientation
workshop with your
expectations, level and work
nature
5
Join Permanent groups
Mingle Exercises and Line Up Shoot!
Age Wise
Experience Wise
`Your height
Date of birth
Expectation Tree!
Where are you on Outcomes on
branches
the RBM Tree?
Process on truck
And where do
you want to be? Key learning
on roots 7
7
At the end of this three days workshop the participants will be able
to:
Understand the basics of RBM and result based planning,
monitoring , evaluation & Reporting System;
Get familiar with the components of RBM System and relevance
to phases of project cycles
Use logical frameworks to plan, monitor, evaluate & report
projects;
Help staff link RBM with the family planning projects
Understand the need and importance of FP 2020 and indicators
for monitoring and reporting of projects
Ground Rules
1. We will participate and play games!
2. Participate and voice their ideas and
let others to do the same
3. Respectfully listen when others
presenting.
4. Attend all sessions - & on time!
5. Others .?
9
Meet your
Mentor Exercise
10
Best Participant Award
12
DAY 1
SESSION 2
14
Why This Session?
Understand the complexes and process of
PCM
The Project Cycle Management and Logical
Framework Approach are two instruments
used by the donor community for
development projects
These instruments give a logical structure to
analyze and address complex problems of
whatever nature
15
What Is a Project?
A project is a series of activities aimed
at bringing about clearly defined
objectives within a precise time-period
and a determined budget
16
What Is a Project?
18
Clarifying some Basic
Terminologies
Vision
Mission/ Goal
Organization
Project/ Program
Structure
System
Processes
Objective and Result chain
19
Project Cycle Management
Project Cycle Management is a term used to
describe the management activities and decision-
making procedures used during the life-cycle of a
project
20
What is PCM Method?
21
Project Cycle Management
Evaluation Programming
& Audit
Implementation Identification
Formulation 22
Why Using the PCM?
It makes sure that the projects are
23
Development of PCM
Background of PCM Method
Late 1960s: USAID produces the Logical Framework
1970s: International Organizations begin to
research/introduce the Logical Framework
Early 1980s: GTZ develops ZOPP Method
24
Development of PCM
Late 1980s: European countries adopt the
ZOPP Method
Early 1990s: FASID starts research and
development of PCM Method
1994: JICA begins full-scale introduction of
the PCM Method
1996:FASID develops Evaluation model
Up to the present: around 13,000 people
have completed PCM training course by
FASID
25
The Cycle
Programming
Evaluation &
Auditing Identification
Implementation Formulation
26
The Cycle
Programming
Evaluation &
Auditing Identification
Country Strategy Paper
Implementation Formulation
27
The Cycle
Programming
Evaluation &
Auditing Identification
Pre-feasibility Study
Financial Proposal
Implementation Formulation
28
The Cycle
Programming
Evaluation &
Auditing Identification
Feasibility Study
Financial Agreement
Implementation Formulation
29
The Cycle
Programming
Evaluation &
Auditing Identification
Monitoring reports
Annual plans (budget,
resource schedules,)
Implementation Formulation
30
The Cycle
Programming
Evaluation &
Auditing Identification
Final Evaluation
Audit Reports
Implementation Formulation
31
Project / Programme cycle
Describe four phases
of result based
management:
1. Initial
Assessment
2. Planning
3. Implementation &
Monitoring
4. Evaluation
32
Phases of Project Cycle
Six stages are typically identified in the project
cycle (Figure 2). They are:
1. Identification: generation of the initial project
idea and preliminary design
2. Preparation: detailed design of the project
addressing technical and operational aspects
3. Appraisal: analysis of the project from
technical, financial, economic, gender, social,
institutional and environmental perspectives
33
Phases of Project Cycle
4. Proposal preparation, approval and financing:
writing the project proposal, securing approval
for implementation and arranging sources of
finance
5. Implementation and monitoring:
implementation of project activities, with on-
going checks on progress and feedback
6. Evaluation: periodic review of project with
feedback for next project cycle
34
Linkages between Approach and
Stages in Project Cycle
Stage in the Project Cycle
Identification: How can a project be identified
in a participatory manner?
Design: How can a project be designed so that
it meets the practical and strategic needs of the
stakeholders, especially the poorest of the poor
and those who are usually excluded from
development projects?
Appraisal: How can appraisal address the social
and gender dimensions of a project?
35
Cont.
Proposal preparation: How does a proposal
reflect the gender and socio-economic
dimensions of a project?
Implementation and monitoring: How can a
target community participate in project
implementation and monitoring?
Evaluation: How does an evaluation establish
whether a project meets its objectives especially
the needs of disadvantaged people?
36
Country Strategy Paper
(CSP)
Based on:
Organizational objectives
Partner and government policy
Are instrument for:
Guiding, managing, reviewing donor assistance
programs
Includes:
National policy agenda, analysis of political situation,
past and on going donor cooperation programmes,
and donor response strategy
37
DAY 1
SESSION 3
39
Two important things
to remember:
Result = Change
Cause Effect
40
Features of Results
41
What is Results Based
Management?
42
Why RBM?
Accountability
Result of pressure to demonstrate efficient,
effective use of public funds.
Effectiveness
Effective program and project management;
extent of achievement of project objective
43
RBM SYSTEM
1. Logical Framework Analysis
2. Performance Measurement
45
Logical Framework
The design methodology is a rigorous process, which if used as
intended by the creators will impose a logical discipline on the
project design team. If the process is used with integrity the
result will be a high quality project design. The method is not
without it's limitations, but most of these can be avoided with
careful use of different techniques. Many things can go wrong
in the implementation phase of a project, but if the design is
flawed, implementation starts with a severe handicap. A few
steps are as follows:
Situation analysis
Stakeholder analysis
Problems analysis
Objective Analysis
SWOC analysis
Risk analysis
46
Situation Analysis
47
Stakeholder or Participation
Analysis
48
focus on direct Partner
Key concept is
boundary partners
The individuals,
groups, and
organizations you
work with directly and
anticipate
opportunities for
influence
49
spheres of influence
50
= boundary partners
Stakeholders Analysis
Stakeholder: any individual, group of people,
institution or firm that have a relationship with
the project
The aim is to maximize benefit and minimize
negative impact
To be done in the initial phase of the design
Always include gender differences
Ideally prepared in a workshop
51
Stakeholders analysis
52
Level of participation
53
Level of participation
To be consulted on problems, needs and strategies to be
adopted, often means that participants voice their opinions
but do not have responsibility or ownership for the
outcomes of the consultation. Donor agencies, government
or senior management are not necessarily accountable for
incorporating the views of the stakeholders into the design of
programmes or processes.
To be part of decision-making means that stakeholders are
empowered to make appropriate decisions, to organize
themselves, identify and implement solutions to their
problems and take responsibility for the results.
Adapted from Two Halves Make a Whole: Balancing Gender
Relations in Development, Canadian Council for International
Cooperation, Ottawa, 1991 54
WHAT DOES THE TERM REACH
REFER TO?
55
Project Stakeholders Analysis
Stakeholder Characteristics Interests & Cross cutting Potentiality Implications
expectation issues & &
s deficiencies conclusions
EC Positive Promotion Particular Long Keen to
attitude toward of Human interest in experience in work in the
support of civil Rights gender the area area
society Increase equality Good Interested
59
Problem Analysis
If there is no agreement between participants on the
statement of the problem, it is unlikely there will be
agreement on the solution. This stage therefore seeks
to get consensus on the detailed aspects of the
problem.
The first procedure in problem analysis is
brainstorming.
All participants are invited to write their problem
ideas on small cards.
The participants may write as many cards as they
wish.
The participants then group the cards or look for
cause-effect relationship between the themes on the
cards by arranging the cards to form a problem tree. 60
Effect Effect Effect
Main Problem
WHY? WHY? WHY?
61
Project Problem Tree
Civil society is not Workers human
sufficiently strong rights are
violated
Many workers 62
are not aware of
trade unions
Low resilience to disaster risks Low resilience to health-related risks Economic situation deteriorates
65
Project Objective Tree
Civil society
Civil societyplays
is not
an Workers
Workers human
human rights are
sufficientlyrole
important strong rights are violated
guaranteed
Workers workers
Pakistani are not are
aware
of theirabout
aware rights
their rights
Workers APFOLisiscapable
APFOL not fully
of New laws
Need forregarding
new
Pakistaniare
Insufficient trained to
citizens
leadership
leadership and capable to workers
safeguarding workers rights are drawn
laws regarding
capabilities
are not aware
amongof
advocacy safeguard workers
rights and implemented
workers rights
workers
their rights
rights
Higher
Low literacy Traditional
Traditional APFOL number
Insufficient
Increasing Workers
Workers right
right
literacy
rate rate acceptance
acceptance ofof potentiality
number
of unionsof trade
not
formed not
not a priority of
a priority of
difficult working
difficult working fully developed
union and trade govt agenda
govt agenda
condition
condition union members
Workers are
Many workers Local sections are established in 66
generally aware
are not aware of each APFOL regional office plus
of trade
trade unions
unions Sialkot and Gadoon Amazai
Developing Objectives Suggested Solution
Increased opportunities for womens
Overall health and well-being
participation in social and economic activities
improved
Improved capacityCommunity
in the Eastern District to Governement
School capacity capacity building
reduce deaths and injuries from disasters capacity building
building strategy strategy strategy
Improved capacityCommunity
in the Eastern District to Governement
School capacity capacity building
reduce deaths and injuries from disasters capacity building
building strategy strategy strategy
Low Sufficient
Household Household Sufficient Community Sufficient Clinics have
rainfall functioning
H&S H&S functioning capacity to health regular staff
does not sanitation
water manage facilities built
training knowledge limit facilities
points facilities or
provided increased overall
improved rehabilitated
water
supply
70
Capacity of the government does not deteriorate
71
Activities Planning
72
Where to start?
73
DAY 2
SESSION 1
75
Logical Bridge Exercise Instructions
1. Your team will be provided with straws, tape, string, and scissors.
76
Logical Framework Analysis
Key Terms:
1. Inputs/Activities
2. Results: Impact, Outcome, Outputs
3. Indicators
4. Assumptions and Risks
77
Logical Framework Red Crescent
Goal
Outcomes
Outputs
78
UNDP MODEL
79
CIDA Model
80
Increased resilience Increased resilience to Economic situation
to disaster risks health-related risks improves
People in the community have no new demands on their time External factors
which may
possibly affect 81
Access to the villages is possible (good road quality) feasibility
How?
Horizontal logic
Project risks
Impact
Outcome
82
Output
Vertical logic How?
Impact
Outcome 2
Outcome 1
Results & Indicators
Results & Indicators
Output 1 Output 2
Output 3 Output 4
Result & Result &
Result & Indicators Result & Indicators
Indicators Indicators
Activities
Activities Activities Activities
83
Results Chain
84
Objectives hierarchy
GOAL (IMPACT)
OUTCOMES
OUTPUTS
ACTIVITIES
INPUTS
85
Inputs
86
Activities
87
Levels of Results
Output Results (short-term)
88
Characteristics of Effective
Results
Specific
(in relation to beneficiaries, gender, location)
Measurable
Achievable
Relevant
Time bound 89
Results statements
Normally expressed in
terms such as:
Increased
Decreased
Improved
Enhanced
Strengthened
90
Some Relevant example
91
Output Results
The developmental
changes that are the
logical consequence of
project activities.
92
Output Result
Immediate, visible, concrete developmental
change that is the tangible consequence of
project inputs/activities
94
Outcome Results
The developmental
changes that are the
logical consequence of
achieving a combination
of output results.
95
Outcome Result
The developmental change in the beneficiaries
of the project
96
Outcomes
Question: In real life, what may be the primary
outcome you want to achieve with the bridge?
Answer: Increase trade and social interaction
between two towns.
97
Impact Result
98
Impact
Result
The higher level, long-term effects that are
usually not measurable until after a project
ends
100
Results Chain
101
Results
chain
Impact
Output Outcome
Long
Activities Short Medium
Result of other
Within control Effect of Several
Variables
Output Results
Activities Individual
Country Region
Group Institution
Society
Organization
Activities Community
102
Results Chain
Improved education
Increased capacity of
at provincial level
teachers 103
Goal
All individuals and couples
in target areas enjoy good
reproductive health
Purpose
Increased use of RH services
by all individuals in target
areas
Output Output
Comprehensive RH services
available for all individuals Client-oriented RH services are
in target areas available
Output
Increased availability of financial management tools for
planning, monitoring and reporting
106
107
Indicators are like the dashboard
of a car
Indicator Dashboard
Total kilometers driven
Speed 12400 km Petrol
Oil
110
Indicators
Quantitative indicators:
Measures of quantity
Examples: # of, % of, frequency of .
Qualitative indicators:
Involve peoples perceptions about a subject
Examples: quality of, extent of, degree of
111
Should be a Balance
Between
Qualitative indicators
Judgments & perceptions
regarding a given situation or
subject e.g., quality of, extent to
which, degree of, satisfaction
with
&
Quantitative indicators
Measures of quantity
e.g. # of, % of, frequency of
112
Indicators Selection Criteria of
UNFPA
Direct: The indicators should closely track the result they are
intended to measure.
Objective: There should be no ambiguity or confusion about
what is being measured and what data is being collected.
Practical: Choose indicators that are reasonable with respect
to cost, frequency and timeliness of data collection.
Adequate: The number of indicators tracked for a given
results should be the minimum necessary to ensure that
progress toward the expected result is sufficiently captured. 113
Measuring Results
Indicators must be identified to measure
output and outcome results.
An indicator is a pointer, measurement, a
number, a fact, an opinion, or a perception
that helps you to measure the progress
towards achieving results.
Indicators are to be used during
implementation to monitor progress toward
the achievement of expected results
114
Quantitative indicators Qualitative indicators
115
Examples of Indicators
Result: Improved awareness among 300 married
couples about the use of FP methods and techniques
in district XYZ
Indicators:
# of awareness session held with married women and
men
# of training conduction for married women and men
# of couples attending awareness sessions
Level of interest shown by the trainees during sessions
and training
# and type of material developed and distributed 116
Establish Baseline
Information & Targets
Baseline information tells you what the situation is
now in a programme or management area.
For example:
How many people need services or training on
FP;
What is the health status in a community or
region for a specific target group;
What is the level of understanding among staff
117
about their responsibilities.
15 Core FP2020 Indicators
Indicator 1: Contraceptive Prevalence Rate,
Modern Methods (mCPR)
Indicator 2: Total number of contraceptive
users by method
Indicator 3: Percent of women whose
demand for modern
contraception is satisfied
Indicator 4: Percentage of women with an
unmet need
118
Indicator 5: Annual expenditure on FP from
government domestic budget
Indicator 6: Couple Years of Protection (CYP)
Indicator 7: Number of unintended
pregnancies
Indicator 8: Number of unintended
pregnancies averted due to
contraceptive
Indicator 9: Number of maternal deaths
averted due to contraceptive use
Indicator 10: Number of unsafe abortions
averted due to contraceptive use
119
KEY: Measured by PMA2020 Surveys; Measured indirectly with PMA2020 inputs; Not measured by PMA2020
Indicator 11: Percent of women who were
provided with information on
family planning during their last
visit with a health service
provider
Indicator 12: Mean score on Method
Information Index
120
KEY: Measured by PMA2020 Surveys; Measured indirectly with PMA2020 inputs; Not measured by PMA2020
Indicator 13: Percent of women who make
family planning decisions
alone or jointly with their
husbands/partners or jointly
with provider
Indicator 14: Adolescent Birth Rate
Indicator 15: Percent informed of
permanence of sterilization
121
KEY: Measured by PMA2020 Surveys; Measured indirectly with PMA2020 inputs; Not measured by PMA2020
FP2020 Core Indicators
Indicator Name Definition Data Source and Conceptual Disaggregation Links to Other
Initiatives
Availability Framework
Category
Indicator 1a: The proportion of Surveys such as the Outcome When possible (in Contraceptive
Contraceptive women of prevalence
Demographic and years with a DHS
reproductive
Prevalence Rate, or rate (any
Health Surveys
Modern age who are using method) is a
(DHS), PMA2020) by:
(or whose partner is
Methods (mCPR) tracking indicator
the CDC-assisted wealth quintile,
using) a modern for
age,
contraceptive Reproductive Health
MDG 5 target 5B:
method at a marital status,
Surveys (RHS), MICS
Achieve, by 2015,
particular point in urban/rural,
time. and other nationally ethnicity, universal access
to
etc.
reproductive
health.
sponsored surveys. Included in draft
WHO 122
Service Statistics
indicator shortlist
Indicator 1b: The proportion of Surveys such as the Outcome
total family
Percent Demographic and
planning
distribution of users by Health Surveys
users using each
modern method (DHS),
modern method of
family planning. the CDC-assisted
Reproductive Health
sponsored surveys.
123
Indicator 2: Number The number of additional Service Statistics Output
of additional family women (or their
planning users
partners) of reproductive age
currently
compared to 2012.
Indicator 3: The percentage of fecund Surveys such as Output When possible (in The proportion of
Percentage of women of reproductive age who the DHS, RHS, women
years with a DHS
want no more children or to MICS, and other
women with an or PMA2020) by: (married/union)
postpone having the next nationally
unmet need for with an
method, wealth
child, but are not using a sponsored
modern unmet need for
contraceptive method. surveys. Service quintile
contraception family planning is a
Statistics comparing the
tracking indicator
lowest to the
for MDG 5
highest quintile),
target 5B: Achieve,
age, marital
by 2015 universal
status, parity,
access to
urban/rural,
reproductive health.
ethnicity, etc.
Included in draft
WHO indicator
shortlist
124
Indicator 4: Percent The percent of women (or Surveys such as Outcome When possible The proportion of
of women their partners) the Enabling (in demand for family
whose demand is who desire either to have DHS, RHS, Environment years with a planning that is
satisfied with no further children or to MICS, and DHS or satisfied
a modern method other nationally PMA2020) by: (any method) is a
Indicator 5: Annual postpone the next child
expenditure sponsored wealth quintile tracking
who are currently using a
on FP from surveys. (comparing indicator for the
government modern contraceptive
domestic budget Service the lowest Global
method. Total annual public
Statistics to the highest Strategy for
sector recurrent COIA, NIDI, KFF quintile), age,
expenditures on family Country marital Womens and
planning. This availability will Childrens Health.
includes expenditures by all status,
levels of government. depend on
urban/rural,
COIA and
ethnicity, etc.
NIDI
implementatio
n.
All 69 countries
are
expected to be
available at
some point.
125
Indicator 6: The estimated protection Service Statistics Output USAID
Couple-Year of provided by family planning
services during a one year
Protection
period, based upon the
(CYP)
volume of all contraceptives
126
Indicator Name Definition Data Source Conceptual Disaggregation Links to Other
and Initiatives
Indicator 7: The number of Framework
pregnancies that Availability
Number of unintended Category
occurred at a time when
pregnancies Estimated using
women (and their Impact
partners) either did not modeling
Impact
want additional children
Estimated using
or wanted to delay the
next birth. Usually modeling
measured with regard to
last or recent
pregnancies, including
current pregnancies.
Indicator 8:
The number of
Number of unintended
unintended pregnancies
pregnancies averted due
that did not occur during
to contraceptive use
a specified reference
by contraceptive use
during the reference
127
period.
Indicator 9: Number The number of maternal Estimated using Impact
of maternal deaths deaths that did not occur
modeling Impact
averted due to during a specified reference
period as a result of the Estimated using
contraceptive use
protection provided by
modeling
Indicator 10:
contraceptive use during the
Number of unsafe
reference period.
abortions averted
The number of unsafe
due to contraceptive
abortions that did not occur
use
during a specified reference
128
(14) Indicators that will be reported annually for a subset of 10 countries and in years with a DHS
Percent of women provider. The contact could occur in PMA202 Process wealth quintile, Included in
either a clinic or community setting. 0 Survey age, draft WHO
who were provided Information DHS in marital status, indicator
could have been provided via a select and parity
with information on number of mechanisms, including years Disaggregate shortlist
family planning counseling, IEC materials or where possible
talks/conversations about FP. (in years with
during their last visit An index measuring the extent to a DHS or
with a health service which women were made aware of PMA2020)
alternative methods of contraception by wealth
provider and were provided adequate
information about them. quintile, age,
marital status,
The index is constructed from three
Indicator 12: Method (3) questions (Were you informed and parity
Information Index
about other methods? Were you
informed about side effects? Were
you told what to do if you
experienced side effects?)
The index score is created by summing
the number of women who respond
yes to all three questions.
Information will also be available for
each indicator independently.
129
Indicator 13: Percent The percent of women who make PMA2020 Survey Process Disaggregate where The adolescent
of women who make decisions on matters, such as birth rate
DHS in select years Impact possible (in years with
family planning whether and when to initiate and
(ages 15-19) is a
decisions alone or terminate contraceptive use and PMA2020 Survey Output a DHS or PMA2020) by
tracking
jointly with their choice of contraceptive method,
husbands/partners either by themselves or based upon DHS, MICS, RHS in wealth quintile, age,
indicator for
consensus joint decision-making MDG 5
select years and parity
with their husband/partner.
PMA2020 Survey
Disaggregate where target 5B:
DHS is select years Achieve, by
Indicator 14: possible (in years with
The number of births to adolescent (and 2015, universal
Adolescent birth rate
females, aged 15-19 occurring during a DHS or PMA2020) by access to
select countries-not
Indicator 15: Percent a given reference period per 1,000
a wealth quintile, age,
adolescent females. reproductive
informed of
standard question) health.
permanence of marital status, and
Among women who said they were
sterilization.
using male or female sterilization, parity
the percent who were informed by
the provider that the method was
permanent.
130
Standard Indicator Levels
ACTIVITY
PROCESS Measure the activities (processes), i.e.
attendance at the activities.
Assumptions
Outputs
Assumptions
Activities
Assumptions
135
And then
Inputs think upwards
Risks Analysis
Risks are the negative factors that hamper the project progress
Risk analysis identifies how likely it is that the conditions
necessary to achieve the expected results will not be present.
Risk analysis allows you to consider strategies to manage the
risks you identify. Some external factors may be beyond your
control, but other factors will be manageable with slight
adjustments in the project or approach. It is recommended
that stakeholders take part in the risk analysis as they offer
different perspectives and may have key information about the
context.
The risks associated with achieving Outputs are generally low
because project managers can make changes as needed to
ensure that results are achieved.
136
DAY 2
SESSION 2
Introduction to Performance
Measurement Framework
Monitoring and Evaluation
(M&E)
140
Monitoring and Evaluation
(M&E)
Why monitor activities?
Tracks inputs and outputs and compares them
to plan
Identifies and addresses problems
Ensures effective use of resources
Ensures quality and learning to improve
activities and services
Strengthens accountability
Program management tool
141
Monitoring and Evaluation
(M&E)
Through monitoring the project manager ensures that:
INPUTS are available on time;
WORKPLANS are followed as closely as possible;
PROBLEMS are identified and resolved;
EVERYONE concerned is kept informed;
RESOURCES are used efficiently;
STAFF and PARTICIPANTS are carrying out their
responsibilities.(WIPER)
142
Monitoring and Evaluation (M&E)
Evaluation
Periodic and time bound; `episodic assessment`
Can be internal, often external
Responsibility of evaluator with staff and management
Periodic feedback
149
Monitoring and Evaluation (M&E)
Types of evaluation
Type Purpose
Formative Initial assessment of the target populations and
contextual environment. Determines concept and
design
Process Seeks to identify the extent to which planned
activities have been achieved and assesses the
quality of the activities/services
What does this mean? What are results? And why are we
focusing on RBM?
151
Traditional vs RBM
Traditional M&E focuses on the monitoring and evaluation of
inputs, activities, and outputs (i.e., on project or program
implementation).
152
Reasons for Measuring Results
A way to tell success from failure
Seeing success means ability to reward
it
Identifying succes gives opportunity to
learn
Identifying failures gives opportunity
for correction 153
156
Monitoring Results
157
Monitoring Results
158
Monitoring Results
159
Monitoring Systems
Frameworks for inspiration
WHY M&E SYSTEM
M&E should be part of the design of a program
Ensures systematic reporting
Communicates results and accountability
Measures efficiency and effectiveness
Provides information for improved decision
making
Ensures effective allocation of resources
Promotes continuous learning and improvement
161
Measuring what is beyond our
control
163
Monitoring and Evaluation (M&E)
M&E Framework
Donors
Partners
166
Implementing
Agency
The Information Trap
167
Information
168
What we want to know
Define what we want to know
Be clear on What I need this information for.
Clarify if I have access to this information.
Be clear on How will I gather it?
170
How?
175
176
While carrying out M&E, recognize
that change is
Continuous
Complex
Non-linear
Multidirection
al
Not
controllable
177
Looking at the Bigger Picture
Seeing
yourself as
a part of a
interconnect
ed
web of
relationships
and systems 178
Monitoring Results
179
180
DAY 3
SESSION 1
Understanding FP 2020:
Performance Accountability &
Monitoring Tool
Bill & Melinda Gates
Institute
for Population and
Reproductive Health
Responds to:
Need for more frequent data to mark
progress
183
PMA 2020 Overview
Objectives:
10 countries planned
Year 1: Ethiopia, DR Congo, Ghana, Kenya,
Uganda
Year 2: Burkina Faso, India (UP), Indonesia,
Nigeria, Cote dIvoire
permanent?
Measuring access, equity, quality,
choice
SDP Survey (56 questions/42 on FP)
Service Accessibility
How many days a week is FP offered? Are services
offered today?
What methods are counseled? Provided? Referred?
Charged?
Have any methods been out of stock in the last 12
months? Which methods?
193
Measuring access, equity, quality,
choice
SDP Survey (56 questions/42 on FP)
If implants provided, are there trained
personnel to insert? Remove? Are key
supplies in place? (repeated for IUDs)
Are unmarried adolescents counseled,
offered, referred for contraceptive
methods?
Are CHWs supported from facility? If so,
how many? What FP services do they 194
offer?
Measuring access, equity, quality,
choice
SDP Survey (56 questions/42 on
FP)
Has mobile outreach team worked from facility? How
many times in last year?
Does facility charge fees for FP services? How much by
method?
Service Quality
Does facility have system for client feedback? Ask to see.
Has there been change?
When was the last time a supervisor from outside this 195
facility came here to visit?
Measuring access, equity, quality,
choice
SDP Survey (56 questions/42 on
FP)
Integrated services
197
15 Core FP2020
Indicators
Indicator 1: Contraceptive Prevalence Rate,
Modern Methods (mCPR)
Indicator 2: Total number of contraceptive
users by method
Indicator 3: Percent of women whose
demand for modern
contraception is satisfied
Indicator 4: Percentage of women with an 198
unmet need
KEY: Measured by PMA2020 Surveys; Measured indirectly with PMA2020 inputs; Not measured by PMA2020
15 Core FP2020
Indicators
Indicator 5: Annual expenditure on FP from
government domestic budget
Indicator 6: Couple Years of Protection
(CYP)
Indicator 7: Number of unintended
pregnancies
Indicator 8: Number of unintended
pregnancies averted due to
199
contraceptive
KEY: Measured by PMA2020 Surveys; Measured indirectly with PMA2020 inputs; Not measured by PMA2020
15 Core FP2020 Indicators
use Indicator 9: Number of maternal deaths
averted due to contraceptive use
Indicator 10: Number of unsafe abortions
averted due to contraceptive use
Indicator 11: Percent of women who were
provided with information on
family planning during their last
visit with a health service
provider
Indicator 12: Mean score on Method
Information Index 200
KEY: Measured by PMA2020 Surveys; Measured indirectly with PMA2020 inputs; Not measured by PMA2020
15 Core FP2020
Indicators
Indicator 13: Percent of women who make
family planning decisions alone
or jointly with their
husbands/partners or jointly with
provider
Indicator 14: Adolescent Birth Rate
Indicator 15: Percent informed of permanence
of sterilization
201
KEY: Measured by PMA2020 Surveys; Measured indirectly with PMA2020 inputs; Not measured by PMA2020
PMA2013/Ghana
Round 1 Results
202
mCPR Trends: 1988-2013
(Among Married Women, aged 15-49)
203
204
Unmet Need for Family Planning
(Married Women, age 15-49)
205
Current Use & Unmet Need, by Wealth Quintile
(Among Married Women)
206
Fertility Indicators
207
Total Fertility Rate Trends: 1988-2013
208
Indicators of Access, Equity, Quality & Choice
among current female users
209
210
211
212
213
Service Delivery Points
(n=149: 106 Public, 43 Private)
214
Service Delivery Points
(n=149: 106 Public, 43 Private)
215
Contraceptive Stock Outs: past 12 months
216
mCPR and Unmet Need by Region:
where use is low, unmet need is high and vice-versa
217
218
219
T hank you!
Day 3
Session I continues
Reflecting results in progress
reports
Using Performance
Information
Reflecting Results
Use performance information to
examine strategic trade-offs
Reach Results
Resources 222
Illustration shows how expected results,
resources and reach must be balanced.
If you want to increase the reach of the
programme with the same resources,
then you may have to reduce your
expectations for results.
Use performance information to
strengthen cause - effect links
Programme
Management based
on:
- Valid and reliable
information on
Outputs Purposes Goal
performance and risk
- Stakeholders Indicators Indicators Indicators
participation in review
and decision making
- Review of strategies
Programme Programme
Resources Activities Management decisions to allocate or reallocate 224
resources and and review strategies
How does RBM apply to reporting?
226
A Simple RBM Model
227
Day 3
Session II
Developing Strategic Result Framework for FP and RH
Jointly by Health and Population Welfare Departments
Some Relevant
Examples
Developing Strategic Result Framework for FP and RH
MYFF 2000-2003 Results FrameworkUNFPA Goals, Outputs, Indicators and Strategies
Goal Goal Indicators Outputs Output Indicators
1) All Couples and (a) Unmet need for i) Increased (a) Percentage of service delivery points (SDPs)
individuals enjoy good family planning availability of offering at least three of the following
reproductive health, (b) Maternal mortality comprehensive reproductive health services:
including family ratio reproductive health - Modern family planning methods;
planning and sexual (c) Proportion of births services. - Maternal health and assisted delivery;
health, throughout life. assisted by skilled - Prevention and management of RTIs,
attendants including STDs, and HIV/AIDS;
(d) Adolescent fertility - Management of the consequences and
rate complications of unsafe abortion;
(e) HIV prevalence in - Information, education and counselling on
persons aged 15-24 human sexuality and reproductive health, including
(f) Infant mortality rate family planning
(g) National mechanisms (a) Percentage of SDPs offering information,
to monitor and reduce education, counselling and access to services to
sexual violence adolescents
RISK INDICATORS
Outcomes Performance Assumptions - Risk Indicators
Indicators
Developing Implementation
plan for operationaling RBM
How should RBM be operationalized?
238
Building Capacity for RBM
239
What does it mean to manage for
results?
For UNFPA, managing for results entails the following:
Establishing clear organizational vision, mission and
priorities which are translated into a four-year (long
term) framework of goals, outputs, indicators,
strategies and resources;
Encouraging an organizational and management
culture that promotes innovation, learning,
accountability and transparency;
Delegating authority and empowering managers and,
at the same time, holding managers accountable for
results;
Adopting a participatory and team-based approach to
programme and organizational management;
240