You are on page 1of 92

External Evaluation of

UN-HABITAT’s Water and


Sanitation Trust Fund
PART 1: Synthesis Report

2011
External Evaluation of
UN-HABITAT’s Water and
Sanitation Trust Fund
PART 1: Synthesis Report

Stein-Erik Kruse Anton Rijsdijk Zozan Kaya Hugo Roche

United Nations Human Settlements Programme


Nairobi 2011
ii External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

First published in Nairobi in 2011 by UN-HABITAT.


Copyright © United Nations Human Settlements Programme 2011

All rights reserved


United Nations Human Settlements Programme (UN-HABITAT)
P. O. Box 30030, 00100 Nairobi GPO KENYA
Tel: 254-020-7623120 (Central Office)
www.unhabitat.org

HS Number: HS/071/11E
ISBN Number (Volume): 978-92-1-132365-8

Disclaimer

The designations employed and the presentation of the material in this publication do
not imply the expression of any opinion whatsoever on the part of the Secretariat of the
United Nations concerning the legal status of any country, territory, city or area or of its
authorities, or concerning the delimitation of its frontiers of boundaries.

Views expressed in this publication do not necessarily reflect those of the United Nations
Human Settlements Programme, the United Nations, or its Member States.

Excerpts may be reproduced without authorization, on condition that the source is


indicated.

Editors: Dominic O’Reilly and James Ohayo


Design & Layout: Irene Juma

Photos © UN-HABITAT
Part 1: Synthesis Report iii

Acronyms

List of Abbreviations
AfDB African Development Bank
AMCOW African Ministers Council of Water
APMCHUD Asia Pacific Ministerial Conference on Housing and Human
Settlement
CA Cooperation Agreement
ENOF Enhanced Normative & Operational Framework
LVW Lake Victoria Water and Sanitation
MDG Millennium Development Goal
M&E Monitoring & Evaluation
Microsan Micro credit for Sanitation
MoU Memorandum of Understanding
MSF Multi Stakeholders Forum
MTSIP The Medium Term Strategic and Institutional Plan
NGO Non Governmental Organization
OIOS Office of Internal Oversight Services
SEAMEO South-East Asia Ministers of Education Office
UNDP United Nations Development Programme
UNON United Nations Office in Nairobi
WAC Water for African Cities Programme
WAC The Water for Asian Cities Programme
WASH Water, Sanitation and Hygiene
W&S Water and Sanitation
WSTF Water and Sanitation Trust Fund
WATSAN Water and Sanitation
iv External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund
Part 1: Synthesis Report v

Executive Summary

During the WSTF’s Advisory Board meeting The evaluation used four different
in 2010, the Government of Norway methods to collect data and information:
announced its intention to undertake (a) review of documents, (b) interviews
an external evaluation of its support with UN-HABITAT staff and key
to the Trust Fund. Subsequently, the stakeholders, (c) visits to selected regions
Governments of Norway, Spain and and countries (Mekong, Lake Victoria
the Netherlands, in collaboration with and India) and (d) a web-based survey
UN-HABITAT, decided to undertake the obtaining feedback from staff and
evaluation jointly. partners in all partner countries.

The purpose is to “to contribute The team was requested to prepare a


to refinement, adjustments and short synthesis. Such a report will not do
improvements in the Trust Fund’s justice to the broad and rich experience
directions and practices”. The evaluation of the Trust Fund. The synthesis seeks to
should be formative and forward looking, focus on issues of strategic importance.
strategically-focused, build on existing Hence, it is supplemented by regional and
information and evaluations and recognize country studies providing more in-depth
the special situation for the Trust Fund – information and analysis. The studies can
as funding from 2011 has been severely be found in Part 2 of the report and a
reduced and the Fund needs to reassess summary in Annex 6 in this synthesis.
its role and make decisions about future
direction.

The report consists of four chapters


discussing to what extent WSTF has
four characteristics which determine its
performance:

• The ability to articulate and maintain


an identity reflecting the purpose
and strategies of WSTF and the
comparative advantage of UN-
HABITAT.
• The ability to organize and establish
effective systems and procedures
and ensure that human and financial
resources are adequate.
• The ability to work effectively with
and through partners.
• The ability to deliver and achieve
results.
The final chapter presents the main
conclusions and recommendations.
vi External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Main Conclusions in the operational work.

Given the limited financial resources,


Policy and Strategy WSTF currently revolves around too
many thematic areas and focus is
The WSTF strategy and activities are
somewhat blurred between normative
highly relevant by focusing on water and
and operational activities, learning/
sanitation - fundamental prerequisites
documentation, software and hardware,
in urban slum development, targeting
global and regional/country programmes.
the vulnerable and often neglected
populations in small urban centers and
poverty pockets in larger cities, forging a
wide range of partnerships, focusing on Processes and
innovation, learning and replicable models
for dissemination and use and operating Resources
at global, regional and country level with The Trust Fund has helped establish a
combined operational and normative strategic programmatic approach with
interventions. agreed and simplified planning and
reporting procedures.
WSTF was originally designed as
a demonstration and pilot-testing The Trust Fund has secured significant
programme but has spread its resources contributions from bilateral donors since
more widely, making it difficult to achieve 2004 (approximately USD 120m million)
impact in a few areas and in areas most and 75 per cent of the funds have been
relevant for learning and replication. provided as un-earmarked resources
providing WSTF with important flexibility.
WSTF has prioritizEd the roles as model
The expected budget for 2011 was
tester and service provider at community
approx. USD 15million, but has been
and municipal level in the Water for Cities
reduced with two thirds to USD 5million.
programme and the two replicable model-
setting initiatives. The withdrawal of support from the
Government of Spain creates considerable
The programme has played other roles to
reputational risks for the programme.
a varying extent:
WSTF has signed agreements which will
• Gradually been involved at national either have to be cancelled or drastically
level in sector reform processes, but reduced.
sporadically and not as part of a
The multi-donor support to the Trust Fund
strategic effort.
has gradually been eroded as only the
• Successfully supported regional and Norwegian Government provides currently
country network building – using its core resources to the Fund.
“convening power” as a UN agency.
WSTF is project- and activity-driven, partly
• Been more involved in the application as a result of how the programme is
and testing of tools and methods funded. Country strategies are missing
than in applied research and and these would provide an overview of
generation of new knowledge. what WSTF does, why, with whom, how
• Maintained a strong operational focus and where.
in country and regional programmes,
WSTF does not have a strong global
while the learning aspects have been
monitoring and evaluation system which
weaker and not sufficiently integrated
Part 1: Synthesis Report vii

would be learning tools to assess progress measured by means other than numerical
and performance on a regular basis in indicators and long-term MDG impact.
order to analyse what works and what
doesn’t. Major stakeholders rate WSTF’s
performance as very high. A general
response is that projects are making a
substantial and direct impact from a
Partnerships relatively small investment. The projects
WSTF has successfully established a broad are considered good value for money
range of partnerships with governments, and a leverage effect on follow-up and
civil society, private sector, development complementary investments.
banks and other donors. The programme has supported several
However: global normative activities. Another type
of evaluation would have been required
• There is scope for strengthening to measure results of global and regional
WSTF’s participation in development advocacy activities and documenting the
partner coordination at country level. results of capacity building.

• WSTF could have played a stronger WSTF has prioritized and achieved the
role as “strategic influencer” at best results as a model tester and service
national and sector level. provider at community and municipal
level. The programme has achieved
• The partnerships between WSTF
significant results at community and
and the regional banks have been of
municipal level.
mutual benefit and importance but
more in programmatic than financial However:
terms. The programme has helped
fast track loans and given them more There is no information on long-term
pro-poor qualities. impact - mostly on outputs and outcomes
• WSTF should maintain its autonomy at project level. It is not feasible to
in all partnerships to analyse critically measure aggregate results at country,
what works and what doesn’t and regional and country levels.
support innovative learning. WSTF has supported a broad range
• WSTF has, to a large extent, of training events and prepared and
established its own presence in introduced technical tools and guidelines
countries with Chief Technical
Advisors and kept only formal
communication lines with RTCD and
UN-HABITAT’s regional and country
offices.

Achievements and
Results
What UN-HABITAT can do is to “facilitate
and catalyse” change. The contribution
of UN-HABITAT should, in many cases, be
viii External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

* A re-establishing approach –
with the aim to identify new
donors and mobilise new
resources in order to re-establish
the programme at the “normal”
level of funding. In this scenario,
the current profile and balance
between roles and interventions
will be maintained including the
number of staff.
* A status quo – but lower level
approach - with the aim to
continue with the same profile
and mix of programmes, but
at a much lower level. Some
activities may be cancelled, but
most normative and operational
programmes will continue.
* A re-focussing strategy – with
but with limited systematic information the aim to identify a few core
about impact. programmes in which WSTF
should invest its resources while
The level of involvement in research and a large number will be left out.
generation of new knowledge is relatively
• This evaluation recommends the third
limited, but with interesting examples.
strategy and advices WSTF to consider
The Lake Victoria Programme has the following options:
successfully continued in a new phase * Reduce the number of
with a new donor with replication in other operational regional and country
towns. However, there is no systematic programmes, in particular the
information about model replication size of the capital investment
in other programmes and countries components.
which would have been interesting in a
programme with model replication as an * “Regionalise” and make the
explicit objective. operational programmes
more autonomous in close
consultation with the Regional
Offices.
Recommendations
* Maintain the field testing and
“real life” laboratory function
To WSTF Senior Management: in cooperation with research
• Prepare a paper to be discussed with institutes in a few selected
the Advisory Board assessing the geographic and thematic areas.
current status of the programme and * Reinforce efforts to establish a
presenting alternative scenarios. system for global and national
• Consider the advantages and monitoring of W&S indicators
disadvantages of three alternatives and achievement of MDGs.
future directions:
Part 1: Synthesis Report ix

* Strengthen the learning and * Continue partnerships with


documentation component of the regional banks, while
the programme in cooperation maintaining its independence
with universities and research and integrity as a UN
institutes. organisation.
* Strengthen global advocacy, * Review existing human resource
networking and preparation of capacity and expertise based on
guidelines and technical tools. the requirements of the new
If necessary, reduce the direct strategic priorities.
involvement in capacity building.
For UN-HABITAT and WSTF Senior
* Intensify engagement with other Management
UN partners in formulation of
programmes. • Review the existing organisational
and divisional structure and explore
* Strengthen the involvement in
how the Urban Water and Sanitation
national policy and sector reform
Branch can maintain its strengths and
processes.
develop stronger horizontal linkages
* Don’t do what NGOs and with other parts of the organisation.
others can do better and more
• Restate and if necessary rephrase the
efficiently.
importance of water and sanitation
* Continue with capacity building within the broader agenda for
of local partners, preferably sustainable urban development.
through long-term coaching
• Discuss the role and viability of
rather than short-term training
Trust Funds in general and WSTF in
sessions
particular.
x External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

For the WSTF Advisory Board • Continue funding (of particular


importance for the Government
• Ensure that WSTF’s future role of Norway) in order to protect
in UN-HABITAT is discussed in investments and ongoing activities,
the Committee for Permanent reduce negative effects and allow a
Representatives and other appropriate repositioning of the Trust Fund.
fora.
• Discuss the future viability of the
• Provide professional and financial Water and Sanitation Trust Fund.
support to ensure a smooth change/
transition of the programme.
Part 1: Synthesis Report xi

Table of Contents

Executive Summary v
Main Conclusions vi
Processes and Resources vi
Partnerships vii
Achievements and Results vii
Recommendations viii

CHAPTER 1: Introduction 1
1.1 Background and Purpose 1
1.2 Analytical Framework 1
1.3 Team and Methods 2
1.4 Limitations 3

CHAPTER 2: Policies and Strategies 4


2.1 Relevance of the Strategy 4
2.2 WSTF Roles 5

CHAPTER 3 : Processes and Resources 12


3.1 The Role of the Trust Fund 12
3.2 Institutional Structure 13
3.3 Planning and Reporting Systems 14
3.4 Financial Resources 15

CHAPTER 4: Partnerships 18
4.1 Partnerships with Governments and Donors 18
4.2 Partnership with Regional Development Banks and other UN Agencies 19
4.3 Partnerships with Private Sector and Universities 21
4.4 Internal Coordination 22

CHAPTER 5: Achievements and Results 24


5.1 Evidence of Results 24
5.2 Capturing UN-HABITAT’s Contribution to Change 31
5.3 Performance Indicators 32

CHAPTER 6: Conclusions and Recommendations 33


6.1 Conclusions 33
6.2 Recommendations 36
xii External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Annex 1: Terms of Reference 38


External Evaluation of the Operations of the Water and Sanitation Trust Fund 38
1.1 Introduction and background 38
1.2 Mid-term Review of the Water and Sanitation Trust Fund Activities 39
1.3 The Trust Fund Strategic Plan (2008-2012) 40
1.4 Impact Study of Trust Fund Activities 40
1.5 OIOS Audit of Trust Fund Activities 41
2. The Purpose of the Evaluation 41
4. Scope of the Evaluation 43
5. Evaluation Methodology 43
6. Evaluation Team Composition and selection 44
Policies – The Ability to Maintain an Identity Reflecting the Purpose,
Comparative Advantage, Values and Strategies of the WSTF 45

Annex 2: Analytical Model 45


Processes – The Ability to Organize and Establish Effective Systems and
Procedures and Ensure That Human and Financial Resources are Available 46
Partnership – The Ability to Respond and Adapt to new Demands and Work
Effectively With and Through Partners 46
Products – The Ability to Provide Services and Products. 47

Annex 3: Overview of Programme 48


Background 48
Description of the Programme 48

Annex 4: Resource Materials and Conferences 54

Annex 5: Self Assessment Survey 59

Annex 6: Summary of Country Studies 72


Ethiopia and India 72
Lake Victoria (LVWatsan) 74
The Mekong Region Water and Sanitation Initiative 75
The Latin America and Caribbean Region 77
Part 1: Synthesis Report 1

1 Introduction

1.1 Background and audit was carried out recently.

Purpose • Building on existing information and


evaluations – in particular the Mid-
During the Water and Sanitation Trust Term Review, the more recent impact
Fund’s Advisory Board meeting in April studies and available progress reports.
2010, the Government of Norway
announced its intention to undertake • Recognizing the special situation for
an external evaluation of its support the Trust Fund – as the funding from
to the Trust Fund. Following this call, 2011 has been severely reduced and
the Governments of Norway, Spain and the programme needs to reassess its
the Netherlands, in collaboration with role and make decisions about future
UN-HABITAT, decided to undertake the direction.
evaluation jointly.

According to the Terms of Reference1, 1.2 Analytical


the purpose of the evaluation is to “to
contribute to refinement, adjustments Framework
and improvements in the Trust Fund’s The team prepared a framework for
directions and practices”. It should also structuring the evaluation process
provide UN-HABITAT, the Trust Fund’s suggesting that the Water and Sanitation
donors, recipient countries and other Trust Fund needs four key abilities to
stakeholders with recommendations for achieve its overall objectives2:
future action.
• The ability to articulate and maintain
The assessment should encompass the an identity reflecting the purpose
entire Trust Fund activities from 2004- and strategies of WSTF and the
2010, including the global normative comparative advantage of UN-
activities, the Lake Victoria Water and HABITAT. It is essential that the
Sanitation Initiative and Mekong Region programme articulates clearly what
Water and Sanitation Initiative. it wants to achieve including its
“added value”. The programme
The evaluation should be:
should be relevant, technically sound
• Formative and forward looking – and sufficiently focused with an
synthesise and assess results and appropriate balance between various
lessons learned until now, but also roles and activities.
suggest changes in design, mode • The ability to organize and establish
of implementation, governance and effective systems and procedures
management. and ensure that human and
• Strategically-focused - assess the financial resources are adequate.
relevance and effectiveness of It is important that WSTF has
policies, processes, partnerships and effective systems and procedures for
results and not specific interventions. translating objectives into activities.
Issues of financial management The programme must also have
should not be discussed since an access to sufficient financial resources
Annex 1.
1
The framework is explained in more detail in Annex 3.
2
2 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

and the “right” staff in order to A Steering Group commissioned the


effectuate a pro-poor, gender and evaluation and has been responsible for
rights-based programme. its oversight. The group consisted of the
Director of WSTF, representatives from
• The ability to work effectively with
the Governments of Norway (chair),
and through partners. With limited
the Netherlands and Spain. They have
resources, the Trust Fund needs a
reviewed and accepted the Inception
broad range of partners – donors
Report, discussed and commented on
for providing financial resources,
the draft report and approved the final
technical partners providing advice
report. The WSTF provided logistical and
and coordinating and implementing
administrative support to the evaluation
agencies. In order to succeed as a
team.
catalytic and innovative initiative, the
selection of partners is crucial. The evaluation has used the following
• The ability to deliver and achieve methods for collecting data and
results. Good policies, processes information:
and partners are necessary, but no
• Review of documents before and
guarantee for making a difference
during the review.3
at national and local levels. The
Trust Fund should be able to deliver, • Interviews with UN-HABITAT staff and
measure and document short- and key stakeholders.
long term results.
• Visits to selected countries and
programmes4.

1.3 Team and Methods • A web-based survey obtaining


feedback from staff and partners in
The evaluation has been carried out by all partner countries5.
a team of four international and two
regional consultants: The evaluation process started with
reviewing relevant documents. The team
• The Government of Norway selected then prepared an Inception Report –
the Principal Consultant (Stein-Erik presenting the consultant’s interpretation
Kruse) responsible for the overall of its task, aiming to focus the assessment
coordination and preparation of the on a set of strategic issues and questions.
synthesis report. He was supported by
another Norwegian evaluator (Zozan The team then met in Nairobi to agree
Kaya). on a common approach to the evaluation
and conduct the initial interviews with UN-
• The Government of the Netherlands
HABITAT staff.
selected an international consultant
(Anton Rijsdijk) responsible for Lake Four regional/country visits were carried
Victoria and the Mekong regions out: 6
supported by consultants in the
respective regions (Susan Keyatta and • The Lake Victoria programme –
Danh Soan). including visits to Kenya, Uganda and
Tanzania.
• The Government of Spain identified
the international consultant
3 Annex 2
responsible for Latin America and the 4 All the case studies are presented in Part II. A summary
Caribbean (Hugo Roche). can be found in Annex 6 of this report.
5 A summary of the feedback of the survey can be found
in Annex 5.
6 See case studies: Part 2
Part 1: Synthesis Report 3

• The Mekong programme – including external validity of the findings. However,


visits to Laos, Vietnam and Cambodia. the response rate was relatively low. The
feedback is interesting, but there are
• The Latin American programme –
limitations in using self-assessments.
including visits to Bolivia, Nicaragua
and Mexico7. Several projects are still being
• The India programme – including implemented. Hence, it is premature to
visits to Delhi, Indore, Bhopal and expect long-term objectives to be achieved
Gwalior. and that impact is fully documented.
Impact is often the result of complex non-
Team members briefly visited Ghana and linear processes that require a longer time
Zanzibar and attended the African Water to be properly assessed and understood.
Week in Addis Ababa in November 2010.
The assessment of results depends to a
large extent on the availability and quality
The Principal Evaluator prepared the draft of data and information. The short country
synthesis report based on regional and visits were not sufficient to compensate
country studies which was subsequently for gaps and weaknesses in existing data.
reviewed by all team members and However, the team sought to check and
discussed in the Steering Committee. The verify information through the country
final report was completed based on their visits.
comments.
The team was requested to prepare a
short synthesis report. This will not do
justice to the broad and rich experience
1.4 Limitations of the Trust Fund. The synthesis seeks to
focus on issues of strategic importance.
The team has not visited all countries
Hence, it is supplemented by regional and
supported by WSTF. Consequently, the
country reports providing more in-depth
analysis, findings and conclusions may not
and specific information and analysis.
be applicable to all programme countries.
The comprehensive web-based survey was The evaluation has focused more on
supposed to provide global feedback from regional and country experiences than
all programme countries and increase the the global normative activities and the
role of WSTF vis-à-vis other international
7 The regional report from Latin America is included
in Part 2, but was submitted too late to inform the agencies in the W&S sector.
synthesis report.
4 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

2 Policies and Strategies

This chapter seeks to discuss to what • Delivering sustainable services for the
extent the policies and strategy for WST poor.
are relevant, clear, well-balanced and
• Ensuring synergy between the
focused – providing a solid basis for
artificial and natural environment.
implementation.
• Monitoring the MDGs and beyond.
• Integrating infrastructure and
2.1 Relevance of the housing.
Strategy The Trust Fund was originally set up to
The overall objective of the Water and create a symbiotic relationship between
Sanitation Trust Fund is: “To promote, operational and normative activities.
facilitate and demonstrate an enabling “The work of the Trust Fund follows
environment for increased access to two approaches – normative work
affordable water and sanitation services (mainly applied research) leading to the
and related infrastructure by the urban identification and development of new
poor in partner countries”. operational activities and operational
programmes leading to the identification
The challenge has been to target problems and development of normative tools”.
related to water and sanitation in new In other words, the Trust Fund was
urban areas and in peri-urban settlements, primarily conceived as a pilot testing
housing the urban poor. This is particularly and demonstration programme in order
pressing because estimates indicate that, to identify innovations in the water and
by 2020, approximately 60 per cent of the sanitation sector, test and demonstrate
world’s population will live in urban areas. their viability in real life situations and
Today, one billion urban residents in the disseminate models with potentials for
world live in slum conditions, and more broader replication.
than 90 per cent of slums are in cities in
the developing world, where urbanization The Strategic Plan has three outcomes
has become virtually synonymous with for defining success and measuring
slum formation. Accordingly, a rapidly- performance:
growing number of medium to large • Increased institutional capacity in
cities are striving to meet the demands for partner countries for advocating and
water from distant and degraded sources implementing pro-poor water and
and finding new ways of responding to sanitation initiatives and policies with
rapid changes. focus of gender.
Pollution, lack of water supplies and • Increased flow of investment into
management are factors that contribute water and sanitation sector catalyzed
further to the escalating urban water by WSTF interventions.
crisis. In this context of changing urban/
peri-urban and socio-economic challenges, • Improved MDG monitoring
the Trust Fund has prioritized the following mechanisms in place in partner
four areas: countries, with improved
benchmarking of water and
sanitation service providers.
Part 1: Synthesis Report 5

The team finds the strategy highly relevant improve sustainable water and sanitation
for a number of reasons: service development for the urban poor in
cities and towns and in improving sector
• By focusing on water and sanitation, information is widely recognized” (Main
which are fundamental prerequisites Report Impact study 2010).
in urban slum development.
A similar conclusion can be drawn from
• By targeting the vulnerable and often
the regional/country studies which were
neglected populations in small poor
conducted as part of this evaluation.
urban centres and poverty pockets
Partners are unanimously satisfied with
in larger cities. Reaching the W&S-
UN-HABITAT. They emphasize that the
related MDG is a massive challenge in
international clout by virtue of being a
such areas.
UN organization opens doors to other
• By promoting pro-poor governance networks. UN- HABITAT has been able
strategies and building models of to attract both technical and normative
good practice (such as community- expertise which gives it a role as
based sanitation, water-demand facilitator, network builder and catalyst.
management, innovative water Eighty per cent of all the respondents in
and sanitation approaches and the stakeholder survey either agreed or
capacity building of communities) strongly agreed that WSTF has a strategy
for up scaling and replication by which helps to clarify priorities and
national governments and regional addresses priority needs of the urban poor.
development banks.
Despite these overall positive conclusions,
• By forging a wide range of there are dilemmas in the way the
partnerships with civil society, purpose of the Trust Fund has been
municipalities and utilities, local operationalized. More precisely, the
and national governments and programme has not focused sufficiently
development partners. on its original innovative model-building
• By focusing on innovation, learning nature and drifted much further than its
and software development addressing original objectives supporting useful, but
barriers for reaching the poor with not essential activities for WSTF. These
sustainable services for widespread questions will be discussed through an
dissemination and use. analysis of roles which WSTF has sought to
perform.
• By operating at global, regional
and country level with combined
operational and normative
interventions, like programme 2.2 WSTF Roles
support, demonstration projects, The MTSIP Peer Review suggested
capacity building, advocacy and defining what roles UN-HABITAT should
resource mobilization. play and identify results in each of them
– recognizing the different criteria of
The recent impact studies concluded that
success and helping UN-HABITAT to focus
the “WSTF mission is compelling and the
on results within its own special mandate.
scale of need is tremendous. Its focus on
This evaluation selected five country level
solutions to improve sustainable WATSAN
and four global roles in order to discuss
service development for the urban poor in
themost important roles for WSTF, where
cities and towns and in improving gender
it has invested most time and resources,
equality and sector information is widely
and if the balance between roles has been
recognized. WSTF’s focus on solutions to
6 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

“right” and in line with what WSTF can • Capacity builder, whereby WSTF
and should do as a UN programme. becomes involved in training
and strengthening of national
institutions in order to prepare for
Country level roles: implementation of pro-poor policies
• Model builder or innovator, and replicable models.
whereby WSTF becomes engaged • Service provider, whereby WSTF
in innovative and applied research provides administrative capacities
in order to identify and develop and/or financial support for the
new social and technical models for implementation of projects in order to
potential replication. This is not the provide and scale up W&S services.
same as doing research, but rather
to initiate and fund, to follow closely
and receive the results from partners Global roles:
and pilot schemes of an applied • Network builder, whereby WSTF
research character. starts and initially convenes and
• Model tester, whereby WSTF coordinates a regional and/or global
identifies promising technical and initiative bringing together partners in
social models and brings them the area of water and sanitation for
out for reality testing in specific sharing of experiences and learning.
country settings. The purpose is • Advocacy is a role, whereby UN-
not to deliver services, but learn HABITAT proactively tries to influence
from pilot experiences through the global agenda in water and
systematic monitoring, evaluation and sanitation and external partners.
documentation of experience.
• Monitoring, whereby WSTF seeks to
• Policy influencer, whereby WSTF establish and strengthen national and
becomes engaged in national policy global mechanisms for monitoring
and sector reform processes in order MDG progress and achievements.
to promote pro-poor policies and
models that have proved themselves • Resource mobilizer, whereby WSTF
promising. leverage catalyzes increased flow
of investment into the water and
sanitation sector.

Roles 1 2 3 4
Country Level:
Model builder x
Model tester X
Policy influencer x
Capacity builder X
Service provider x
Global:
Network builder X
Advocacy X
Monitoring x
Resource mobilization X
Part 1: Synthesis Report 7

What roles have WSTF prioritized and entry points for a community-based and
where has it achieved most results? The community-led approach. Linked to this is
table summarizes the team’s assessment the importance of partnerships with local
(1= low – 4= high): government authorities, with NGOs and
with community groups themselves” (Mid-
Term Review 2007).
Focus on local level model
testing and operational There is evidence that WSTF has gradually
service delivery been more involved at national level
and in broader sector reform processes.
WSTF has prioritized the role as model There is also regional variation, but the
tester and service provider at community “upstream” focus was a secondary
and municipal level through the Water for concern both in the mid-term review and
Cities programme and the two replicable the subsequent strategy. That key staff
model setting initiatives. The emphasis has a strong programmatic interest and
has been “down stream”. The largest engineering background has also been
share of resources has been invested at important in shaping the profile of the
sub-national level – in communities, small programme.
towns and cities. Sixty per cent of the total
budget in 2009 was spent on country-level
operations and 11 per cent on global Regional and country
normative work. There has also been a network building
focus on delivering water and sanitation
services. In Lake Victoria, physical WSTF has successfully supported regional
implementation has absorbed 86 per cent and country network building – using its
of the budget but capacity building only 5 “convening power” as a UN agency. The
per cent. In the Mekong region, the ratio programme has initiated and coordinated
is 84 per cent and 3 per cent. several regional and country conferences
and provided technical inputs in others.
Acknowledging regional and country UN-HABITAT has established itself as
variation, the impact studies compared the urban water and sanitation agency,
WSTF’s work “to that of a highly effective also through the Global Water Operator
NGO, using its flexibility to seek out Partnership.
interesting and relevant projects and
focusing on immediate impacts on the
Examples of regional conferences
ground, rather than proceeding from a
- 1st Meeting of East African Community Ministers
thought-out strategy and operating as the of Water and the Development partners of the UN-
government’s lead partner in addressing HABITAT Lake Victoria Region Water and Sanitation
the medium- to longer-term challenges Initiative, Nairobi, Kenya, 2008.
of the urban poor” (Main Report Impact - Ministerial Conference on “Scaling Up of the Lake
Study 2009). Victoria Water and Sanitation Initiative” Entebbe,
Uganda, 22 – 23 April 2000.

This local-level community focus is, - African Water Weeks (26-28 March 2008, Tunis,
Tunisia; 09-13 November 2009, Johannesburg, South
to a large extent, in line with the Africa; Addis Ababa, Ethiopia, 22-26 November 2010.
recommendations from the Mid Term
review which preceded the preparation
of the new strategy. The review
recommended strongly “the need to The Global Water Operators
maintain a very clear focus around the Partnership Alliance (GWOPA)
key theme of good governance, with
water and sanitation projects acting as The launch of the Global Water Operators
8 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Partnership Alliance (GWOPA) was a


Examples of capacity building and tools
major milestone. GWOPA provides an
international platform aimed at promoting - Capacity Building Workshop on Partnerships for
Improving the Performance of Water Utilities in the
and increasing the institutional capacity Africa Region (2006).
of urban water and sanitation utilities. - Regional Media Workshop from 2006 in New Delhi,
The idea is that, through twinning, better- India.
performing utilities can share their skills - South-South Collaboration for Training and Capacity
and practices to other utilities in order to building on innovative Sanitation Technologies,
collaboration with Sulabh International - November
adequately serve their citizens.
2006.

The efforts in previous years to anchor - Water Safety Plan Training in Morocco - 20-21 Jan.
2010 (Rabat, Morocco).
WOPs platforms in the various regions,
- Rainwater Harvesting and Utilisation, Blue Drop Series.
particularly Latin America and the
- The World of Water - African Adventures of a Water
Caribbean and Africa, have resulted Drop (2005.)
in a growing number of twinning - Navigating Gender in African Cities: Synthesis Report
arrangements. More specifically, in 2010, of Rapid Gender and Pro-poor Assessments in 17
a total of 1,206 individuals from 162 African Cities (2006).
utilities benefited directly from WOPs and - Framework for Gender Mainstreaming in Water and
training programmes implemented under Sanitation for Cities (2006).
the WOPs’ umbrella. - Social Marketing of Sanitation (2006).

In addition to the growing number of


activities being implemented, WOPs,
through GWOPAs, have a leveraging prepared and disseminated.
impact. Accordingly, an increasing number
of partner organizations worldwide are In the Lake Victoria region, the project
supporting or engaging in the WOPs has made good progress towards
approach. UN-HABITAT’s budget shows capacity building and development
that new allocations for GWOPA in of stakeholders. This is particularly
2011 amounts to USD 194 95TOTAL evident regarding the capacity
MAKES NO SENSE – PLEASE CLARIFY, training of local partners such as WSP,
whereas the total budget allocation is municipalities and local NGOs/CBOs.
USD 1,213,707(UN-HABITAT Summary of For instance, as can be seen in the
Allocations 2010-2011). Lake Victoria Study, the performance
of the WSP has incrementally
• Forged strong partnerships with improved, on operational levels as
regional banks, civil society and well as on management capacity.
private sector More specifically, the water
production has increased, the amount
WSTF has established partnerships of non-revenue water has been
with all the regional banks and reduced and the income generated by
“leveraged” resources to national selling water has increased. Indeed,
and regional programmes. This is the improvement in performance
discussed further in Chapter 4.2. by the WSPs is seen as one of the
• Capacity building and preparation main assets of the UN-HABITAT
of technical and normative tools initiative. In Mekong, the capacity
and institutional development has
WSTF has organized and supported included a number of training courses
a broad range of training events. and workshops, targeting water
Several technical guidelines and utilities, municipal authorities, CBOs
normative tools have also been and NGOs.
Part 1: Synthesis Report 9

• Support for innovation and The Sanitation Microcredit


research Revolving Fund
The programme has supported The Sanitation Microcredit Revolving
research but has not been Fund scheme is a strategy for bringing
systematically involved in applied transformation and improved delivery
research and the generation of system for sanitation services in the
knowledge. WSTF has been more urbanizing communities settled around
involved in the application and Lake Victoria and in the Mekong region.
testing of existing models than in The overall objective of the scheme is to
the identification and formulation of establish a sustainable revolving sanitation
new ideas. It is not UN-HABITAT’s role credit fund to meet the credit needs of
to do research but the programme poor female headed households to build
can support this area and forge their improved sanitation.
partnership with researchers and
research institutes in order to move The driving force for this strategy is ‘social
the frontier both in the social and marketing’ that creates ‘social demand’
the technical fields and, not least, be for services. Development of a revolving
perceived as a broker of new ideas fund for sanitation allows the target
and a knowledge-based programme. beneficiaries to come together and help
each other to construct sanitation facilities
The following are four examples of on credit that can be paid collectively. This
interesting research efforts: has the effect of all members in a group
having the opportunity to access funds to
put up sanitation facilities, as the culture
Low-Cost Monitoring of
of ‘merry-go-round’ is not new to the
Bacterial Water Quality in targeted communities.
East Africa
Low-cost, manageable systems for
Multi Stakeholder Forums
monitoring water quality have been
lacking due to the high cost, technical This is a structure introduced by UN-
complexity and time associated with HABITAT to engage all local stakeholders
available methods. This is a primary reason with different backgrounds to participate
for the low awareness among health actively in the design, planning,
workers and communities of the linkage implementation and monitoring of
between water quality and disease. programme activities. Its main role is to
WSTF is involved in research on low-cost ensure that project plans are implemented
methods for water testing in the East in an effective manner.
African region. Public health officers and
volunteers were trained and equipped In Kenya, the forum brought together
to carry out town-wide water testing. representatives of the Lake Victoria
The approach has strong potential for South Water Service Board, water and
replication in developing countries around sanitation companies, community service
the world, particularly because it facilitates providers, water users association and
community understanding of water quality health inspectors. It seems that the forum
which will lead to a decrease in water- has been very effective in running and
related diseases. managing water and sanitation initiatives
motivating members of the community
to make contributions such as provision
of labor and construction materials as
10 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

their initial contribution to the project. the rehabilitation of the water supply
The forum has been involved in providing systems was found to be solid, but not
advice to distribution of resources, innovative. Most of the implementation
involvement in the selection of locations was based on well-known and established
for stand pipes, public and schools latrines technologies. As such, there are elements
and assist in identifying vulnerable groups of applied research and innovation in the
to benefit from the project. However, programme, but more dominant is the
the involvement of MSF in micro-credit implementation of well-established models
schemes was rather low (Rijsdijk 2011). and approaches.

• Learning and documentation


H2.O Monitoring Services
There has been an operational
to Inform and Empower
focus in the country and regional
Initiative programmes. Capital investments
One of the weaknesses in the WSS have absorbed between 60 and 80
sector is the absence of reliable data for per cent of total expenditure – much
understanding level of service provision more than required for a pilot and
for the poor and providing information model building programme. The
to enable consumers, service providers, learning aspects – the continuous
policy makers and donors to act more monitoring and assessment
decisively and to monitor the impact of of experience - have not been
interventions. sufficiently integrated, not only of
inputs and outputs, but of outcomes
WSTF has been leading an initiative which and early impact. Systematic analysis
tests innovations in sector monitoring and documentation of experience
in order to put in place powerful and and lessons learned should have been
effective monitoring systems of the more prominent in a model building
urban environment at a global scale. The and testing programme. WSTF’s
work builds on approaches developed by argument is that service delivery
UN-HABITAT’s Monitoring and Research should feed into the normative work
Division and by WSIB in the Lake Victoria and that normative work should be
region by using tools and approaches based in practical field experience.
developed by Google for geo-referencing However, the scale of the investments
and in making this data universally seems to be much higher than
accessible. Access to reliable, specific and necessary for a model and learning-
well-presented visual information on WSS based experiment.
services can improve sector advocacy, and
accountability between service providers
and consumers. “The Victoria initiative (2 % of the budget for M&E) has a
fairly extensive list of indicators, both on input, objective
and sustainability. This gives the programme an overview
Concluding Remarks of the progress and might be suitable for a conventional
project. However, as a model, it should have had higher
Some of the models are not new as such standards on performance tracking, with clear definitions
of the indicators on each of the experimental components
with examples being community led
(for example, support to the WSP and microsan).
development, participatory multi sector Especially impact indicators could facilitate the lessons
forums and micro-credit for women, learned and promote the model to third parties. The MEK-
but they may have been innovative WATSAN initiative developed an impressing database
system for M&E, but as a model and learning exercise
in the water and sanitation sector in for partner countries, standardizing of impact indicators
the respective countries. In the Lake would be recommended” (Rijsdijk, 2011).
Victoria initiative, the approach to
Part 1: Synthesis Report 11

• Attention to policy and sector has not been sufficiently used as a


reform work basis for “upstream” policy work.
The involvement in national policy • Global Monitoring
and sector reform processes, like
participation in sector working The global monitoring efforts as
groups, strategic advocacy and explained above were promising,
awareness raising has been uneven, but this important area of work
but with an increasing number for UN-Habitat lost some of its
of examples of WSTF as a policy momentum when the funding
influencer. from Google stopped last year.
The project monitoring MDGs and
The impact study explains that improve benchmarking of water and
“UN-HABITAT may not always sanitation service providers was fully
have achieved the right balance funded by Google.org with a total
between normative and pilot project allocation of US$ 1.8 million. There
implementation work in Kenya. is a possibility that the work can
Given its relatively small capital continue soon with another private
programme, it is suggested that sector donor.
greater weight be given to its role
as a strategic influencer and source
of expert knowledge, rather than Concluding Remarks
an implementer of services. Many The critical questions are: to what extent
stakeholders expect UN-HABITAT to the balance between roles has been
play a leading role in helping guide right taking into account the available
the development of ideas that might resources and the original strategic
work at scale”. direction of WSTF and has there been an
In Nepal, “it has been noted that UN- appropriate balance between normative
HABITAT is determined to shift the and operational, capital investments and
style of its operations from that of a learning/documentation, software and
highly effective entrepreneurial NGO hardware models, global and regional/
focusing on immediate impact on the country programmes? In hindsight,
ground to that of a strategic partner possibly not. We are not questioning the
and influencer of future directions in usefulness of WSTF activities in terms of
the sector. UN-HABITAT’s approach meeting various country needs, but to
to start the implementation of the what extent the programme has selected
WSTF operations with a few direct and supported the most relevant activities
interventions in selected poor urban for a UN programme.
communities, rather than embarking
It should also be kept in mind that what
on a high-flying and generic advocacy
was the right mix of roles five years ago
exercise, has been sound. By using
may not be optimal in the future. The last
such a direct intervention approach,
chapter discusses what the changes in
the country teams were able to test
focus and roles could be. Fewer resources
out and demonstrate a few pro-poor
will reduce the ability to support capital
support principles. This provided
investments but will have much less
valuable experience on how to
effect on the software and normative
tackle the challenge of serving the
components of the programme.
urban poor” (Main Report Impact
Study 2010). In other words, WSTF’s
valuable “downstream” experience
12 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

3 Processes and Resources

This chapter seeks to discuss selected in line with the agreed strategy.
internal organisational issues which
are important determining factors of Is the Trust Fund arrangement still valid?
performance. However, the Inception The multi-donor base has been gradually
Report decided to give more attention to eroded (see chapter 3.4). At the moment
external and less to internal dimensions, it is only the Norwegian Government that
so this organisational review is only partial. provides core resources. This is partly the
result of changing donor preferences, but
possibly also due to limitations in the trust
fund model itself. A recent report from the
3.1 The Role of the UN points to an overall increase in number
Trust Fund of trust funds within the UN system, but
also to some of their weaknesses (OIOS,
The question is to what extent the Trust Posta&Terzi 2010).
Fund mechanism has been effective and
will be viable for the future? The Water The report mentions that there is no
and Sanitation Trust Fund was launched common definition of what Trust Funds
on World Habitat Day in 2002 in order “to are, but they are set up to provide extra-
follow a well coordinated programmatic budgetary resources to an organization on
approach with strategic impetus allowing the basis of specific agreements with the
donors to improve their aid effectiveness donors for specific purposes, accounted
by contributing to a consolidated fund for and reported to the donors separately.
dedicated to a clear set of objectives”
(Strategic Plan p. 32). The Trust Fund WSTF has provided UN-HABITAT with
has been supported with contributions earmarked resources for water and
from various donor countries including sanitation, both core resources to the
Canada, Sweden, Norway, Poland and the Trust Fund and targeted to programmes
Netherlands. like Mekong and Lake Victoria. As
mentioned, the Trust Fund has supported
The Trust Fund has helped establish a a programmatic orientation, simplified
strategic programmatic approach with planning and reporting systems and
an agreed and simplified planning and predictable resources to a priority area for
reporting procedure vis-à-vis the donors UN-HABITAT. On the other hand, certain
for activities within the Trust Fund. It limitations and weaknesses were identified
has also provided long-term, relatively during the evaluation:
predictable and generous funding.
The Advisory Board has been a forum • The strategic approach has been
for discussing important strategic and limited to the Trust Fund. The
programmatic issues. However, not existence of a strong and well
all the resources have been granted as resourced Trust Fund has distorted
core resources. A significant amount has overall organisational priorities within
been earmarked specific programmes UN-HABITAT.
and projects. As such, the Trust Fund’s • The advisory board for WSTF has, to
flexibility has been partial. It has, to a large some extent, established a parallel
extent, been required to accommodate governing structure within UN-
individual donor preferences more or less
Part 1: Synthesis Report 13

HABITAT with strong donor influence the programme has started. Such a
and few members from the South. change in donor preferences may affect
the credibility of UN-HABITAT as a partner.
• The relative abundance of resources
The change could have been implemented
has created a culture of autonomy
more incrementally and in consultation
and self-sufficiency within WSTF with
with stakeholders and thus reduced the
weak incentives for coordination
negative effects.
and information sharing with other
divisions and units. The reallocation of resources from one
programme (water and sanitation) to other
The most recent and dramatic change for
strategic priorities within UN-HABITAT is
WSTF was the loss of its expected core
inconsistent with a more coordinated,
support for 2011 from the Government of
priority-based planning approach. That
Spain. When the new Executive Director
would have required an allocation of
came to UN-HABITAT he was in need of
resources based on decisions in governing
resources to support his five new strategic
bodies and been reflected in the biannual
priorities: urban mobility, urban planning,
programme and budget. Otherwise, the
urban economy and urban legislation.
pattern of earmarking remains, just to
Hence, he approached the Government
other priorities. The Peer Review of the
of Spain with a request to derestrict its
MTSIP strongly recommended UN-HABITAT
contribution to the Water and Sanitation
to “establish one unified planning and
Trust Fund and reallocate the same
reporting system for decision making,
resources to the new areas. Spain agreed
resource mobilization and reporting
to do so and WSTF lost USD 8 million ,
to all donors” and “define clearly and
representing two-thirds of its budget for
transparently in the biennial programme
2011.
and budget what UN-HABITAT policy and
It can be argued that the Trust Fund has programme priorities are for the short-
been a well-funded programme with a and long-term – how scarce resources will
large budget within a relatively small and be allocated between competing priorities
resource constrained organisation (USD between and within focus areas” (MTSIP
15 million) for WSTF compared to a USD Peer Review 2010).
20 million core budget for the entire
organisation in 2008). Such an internal
imbalance has been perceived as unfair 3.2 Institutional
and not in line with corporate interests. As
such, WSTF has been a victim of its own Structure
success in terms of mobilizing resources.
The Strategic Plan explains that the
More importantly, the reallocation is
Water, Sanitation and Infrastructure
perceived as consistent with the MTSIP’s
Branch was transferred from Global
aim of establishing a more integrated,
Division to the Human Settlements
priority-based planning approach for the
Finance Division, together with the Urban
entire organisation.
Finance Branch. The purpose was to bring
However, this evaluation has found increased coherence to the organisation
reputational risks for UN-HABITAT as a and the opportunity to integrate
result of the unexpected and sudden loss infrastructure and slum upgrading “to
of resources. WSTF has signed agreements more effectively contribute to the overall
with governments and partners which will goal of sustainable human settlements
either have to be cancelled or significantly development”. The Director for the Water
changed – in Latin America even before and Sanitation and Infrastructure Branch
14 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

has been the Acting Director for the entire also information from a broad range of
Division. activities and projects at regional and
country level. The Annual Reports from
Was it a sensible decision to establish WSTF to the Advisory Board consist of a
such a Division? The MTSIP Peer Review range of individual project achievements
discussed briefly if the Human Settlement – interesting examples of country progress
Finance Division should include both the and success. However, there is less
Urban Finance Branch and Water and information at the intermediate levels –
Sanitation under one umbrella. Or if it aggregate impact from countries and/
would have been better to have them as or from thematic areas - in particular
separate units since they perform very quantitative progress indicators for the
different functions. entire project portfolio.
A final conclusion was not reached, but WSTF is a programme, but to a large
the marriage between the two Branches extent project- and activity-driven. This is
has been perceived as arranged without partly the result of how the programme is
clear benefits for either. Hence, there funded (by donors still supporting specific
is a need to find another “home” for activities). However, the programme could
the Water, Sanitation and Infrastructure have prepared short and concise country
Branch taking into account the greater strategies – providing an overview of
attention to energy and transport. There is what WSTF does, why, with whom, how
also a perception that WSTF has pursued and where – not only for providing easier
a too “vertical” approach focusing on understanding and buy in from external
specific W&S interventions. Hence, it stakeholders, but also to explain how
is important to explore new horizontal Water and Sanitation is part of and relates
linkages within an overall urban planning to a broader urban planning agenda.
framework, when a new organisational
structure is decided based on the premise It could also have provided the basis for a
that W&S is a core priority for UN- more strategic selection of interventions.
HABITAT. This is particularly important since WSTF
is to some extent perceived as self-
contained, with vertical activities not
sufficiently linked to other sectors, and
3.3 Planning and an integral part of an urban planning
Reporting Systems framework.

This section discusses two aspects of the The Impact studies pointed to the need
planning and monitoring/reporting system. for clearly articulated country strategies,
The analysis would have been stronger if a developed and discussed with sector
broader perspective had been applied but stakeholders. In the case of Kenya,
the limits of this report would also have the WSTF projects take place under
been exceeded. two different umbrellas (Lake Victoria
Region Water and Sanitation Initiative
(LVWATSAN)) and Water for African Cities
Global Policies and Multiple (WAC), but no coherent country strategy
Country Activities has been developed. In Nepal, the project
WSTF has several global and regional portfolio has until now contained a large
policy and strategy documents providing number of small projects. However,
overall direction. Such documents are the need for more coherence, stronger
important and easily available. There is coordination and the development of a
sector-wide approach is recognized.
Part 1: Synthesis Report 15

It should also be mentioned that WSTF A pilot and demonstration programme


would have benefited from a Project would also need a solid system for
Management Information System – a documenting lessons learned. The Global
data base with key data for all projects Reports disseminate such experience,
and also monitoring information. The but there is a need to document
current database with “Agreements experience also from individual projects.
of Cooperation” is not sufficient. The WSTF emphasizes the practical hands
agreements are more “what to do” on approach but the experience is not
document and do not provide the design sufficiently systematized. It is difficult for
information and basic baseline data which outsiders to fully grasp the substance and
is required to support a sound outcome value of the innovations.
and impact assessment.
Some reports are well written, but many
suffer from convoluted UN language, such
The Monitoring and as “enhanced development practitioners’
Documentation System facilitation skills for the capacity-building
of disadvantaged women”. However,
WSTF was, as mentioned, conceived more important is the need for systems
as a pilot and demonstration project – and capacity within the programme to
testing the viability of innovative models, collect relevant information, analyze
demonstrating their potential for large findings and present results in well-
scale replication and disseminating the written and easily accessible reports.
lessons learned. There are elements of such learning and
documentation but considerable scope for
As such, WSTF should have a strong
improvement.
monitoring and evaluation system –
learning tools to assess progress and
performance on a regular basis, analyse
what works and what doesn’t and 3.4 Financial Resources
act on the basis of recommendations.
This is to a large extent missing. In the The Trust Fund has received significant
microcredit programme for constructing contributions from several bilateral donors
latrines in Lake Victoria, for instance, since 2004. The totals amounts are (2004-
there is no systematic data collection 2009) presented in the table below. It
for tracking coverage, repayments and confirms that 75 per cent of the funds
user satisfaction in order to identify the have been given as general unearmarked
resources providing WSTF with flexibility
weaknesses and issues pointed out in the
in the utilisation of funds. In addition,
case study (Rijsdijk 2011). Most of the
the Government of the Netherlands has
monitoring covers financial inputs and
provided soft earmarked resources to
physical outputs which are necessary but
the two model setting initiatives in the
not sufficient from a learning perspective.
Lake Victoria and Mekong regions. WSTF
has also been supported with small, but
“The provision of onsite sanitation (construction of
important earmarked contributions from
latrines) to the poor shows a mixed result. The project private sector companies such as Coca-
targeted the poor informal areas of the towns and made Cola, Google, Cadbury and BASF.
some impact on the MDGs, but the beneficiaries were
often relatively well to do as the costs of latrines were The historical overview of donors and
beyond the reach of the poorest, party by technical and
regulatory reasons. However, the main problem was the their contributions becomes much less
finance through the micro credit system as the pay –back favorable when looking at trends (from
rate was very poor (Rijsdijk, 2011). 2004 to 2009) and assessing the current
financial situation.
16 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

General WSTF Amounts (Mill USD)


Spain 35.877
Norway 23.191
Canada 12.455
The Netherlands 11.760
Sweden 5.573
Poland 3
Sub-total general 88,862

Earmarked contributions:
Lake Victoria Initiative (Netherlands) 20.720
Mekong Initiative (Netherlands) 6.600
Private sector 2.558
Sub-total earmarked 2.558
GRAND TOTAL WSTF 118.740

• The Governments of Canada, The Trust Fund has lost 75 per cent of its
Sweden and Poland stopped their core support. Its total operating budget
contributions before 2008. for 2011 was expected to be in the range
of USD 15 million, but is reduced to
• The Netherlands phased out all its
approximately USD 5 million There are
support to UN-HABITAT from 2008
some other pipeline contributions, but
while WSTF was allowed to use
the WSTF will have to cope with a serious
remaining funds for the two regional
budget deficit. An additional challenge is
initiatives in 2009 and 2010. Most of
that most of the resources are tied up to
the funds are now depleted.
cover recurrent expenses (approximately
• The Government of Spain decided USD 3.6. million for project staff salaries
in 2010 to move all its general alone) – leaving marginal funds for any
contributions to other strategic activities. Below is a summary of the
priorities in UN-HABITAT (discussed in 2010 – 2011 allocations as at March
chapter 3.1.). 2011.
• Google has phased out its support There are some new donors in 2010 and
and the Coca-Cola project in India is 2011 including The Catalan Agency for
also coming to an end. Development Cooperation, allocating USD
• The Government of Norway remains 122,809 in 2010-2011, The European
as the only donor to WSTF’s core Investment Bank (USD 60,846) and the
budget. Government of France, whose total
budget allocation amounted to USD
The funds received for 2009 were (in 46,269. These are positive developments,
thousands? Millions? of USD): however not sufficient to change the
downward trend.
Spain 13.323
Norway 2.177
Opening balance 930
Total 17.431
Part 1: Synthesis Report 17

General Trust Fund 2010 2010 2010 Budget 2011 New 2011 Total
Sub-Allotment Allocation Expenditure balance c/d to Allocation budget
2011 Allocation
Global Normative 911 912 893 197 18 715 910 362 929 077
Water for African Cities 1 887 500 1 743 811 143 689 350 000 493 689
Water for Asian Cities 1 887 500 1 263 527 623 973 350 000 974 926
Water for Cities in Latin 2 000 000 1 753 121 246 879 350 000 596 879
America and Caribbean
(W007)
Solid Waste Management 500 000 477 805 22 195 350 000 372 195
Programme (W007)
Urban Energy Section 150 000 28 196 121 804 - 121 804
Mekong Region Water and 500 000 499 046 954 150 000 150 000
Sanitation Initiative
Lake Victoria Water and 500 000 425 546 74 454 150 000 224 454
Sanitation Initiative
Transport Section (W007) 150 000 2 892 147 108 - 147 108
Global Water Operators 2 339 934 1 321 183 1 018 751 194 956 1 213 707
Partnership Alliance (W007
& W026)
Personnel W039 (incl. Interest 2 520 950 2 217 875 303 075 2 356 500 2 356 500
allocation) for 2011
Personnel (W026) WOPS only - - - 690 000 690 000
for 2011
Information, monitoring and 244 508 206 465 38 043 53 580 91 623
evaluation (W002, W007,
W028)
Administrative costs (W007) - - - 136 811 136 811
W005 (refunded to Sweden) - (10 726) 10 726 - -
Total General Trust Fund 13 592 304 10 821 940 2 770 364 6 042 209 8 498 771
(W002, W007, W026, W028)
18 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

4 Partnerships

This chapter discusses the partnerships (2007)8, they were discussed extensively
between UN-HABITAT and external in the recent impact studies. However,
organizations, but also other divisions there is no systematic information from
and units of the organisation. One of all partner countries making an aggregate
UN-HABITAT’s comparative advantages is assessment possible.
said to be the ability to build partnerships
with a broad range of stakeholders. The It was found that WSTF in Kenya had over
organisation can attract and collaborate time developed a stronger partnership
with development banks, universities, with sector investors but, whilst the Lake
governments, municipalities, civil society Victoria Region Water and Sanitation
and private sector. The question is to Initiative (LVWATSAN) is well integrated
what extent WSTF is able to use such an with national and local institutions, the
advantage effectively. project portfolio does not consistently
support core national strategic sector
reform processes. The same applies to the
Mekong region. There is also scope to
4.1 Partnerships with strengthen UN-HABITAT’s participation in
Governments and the coordination between development
partners. The absence of a process to
Donors develop a country strategy means that
Kenyan institutions have not been fully
In recent years, there has been increasing
engaged in UN-HABITAT’s strategic
emphasis on issues of development
choices and UN-HABITAT may not
effectiveness. Development partners
always be sufficiently harmonized with
should work more effectively together
other stakeholders regarding country
(harmonization) and in line with country
programme design.
priorities and procedures (alignment) in
order to create a more country owned It was also pointed out that WSTF
and country led development process and does not always have the accountable
consequently reduce the fragmentation government institutions as implementing
of aid. partners. WSTF seems to prefer
Cooperation Agreements with NGOs.
Within the UN, the “One UN policy” has
Such a practice misses the opportunity to
provided the basis for working towards
strengthen the capacity of government
better country-level coordination – one
institutions9.
programme, one budgetary framework
and one set of management practices for The interventions in Nepal were found
all UN organizations to address the MDGs to be well-integrated with relevant
in a more coherent and effective way. authorities, institutions, and development
partners at national and municipality level.
The question is: to what extent WSTF has
However, there is still too much focus on
become involved in national sector and
donor coordination mechanisms including 8 Possibly because the review focused mostly on the local
and community level aspects of development – a change
the One UN efforts? While issues of from below perspective and less on national policies and
harmonization and alignment hardly were systems.
9 Findings from other regions e.g. Mekong show a
of much concern in the Mid Term review different pattern – much closer cooperation with
government structures.
Part 1: Synthesis Report 19

individual pilot projects. It was said that from being independent from a
that WSTF needs to give greater weight to heavy bureaucratic process – even if
UN-HABITAT’s role as a strategic influencer, the long term aim is to incorporate
drawing from a clear vision about what and replicate proven models within
is needed to address the challenges of national sector programmes.
pro-poor urban WATSAN reforms. This
will require increased engagement in In other words, WSTF could play a
national policy dialogue and involve key stronger role as a “strategic influencer”
government policy makers. in national reform processes as a credible
and “neutral” UN organisation, but avoid
UN-HABITATis further advised to play full cooptation in such processes. WSTF
a more central role in coordinating would benefit from maintaining certain
donors to the urban WATSAN sector, autonomy in order to analyze critically
since the agency is well-positioned to what works and what doesn’t support
enhance donor harmonization as a innovative learning.
respected adviser to the government in
the urban sector. Unfortunately, we lack
sufficient information to assess the role
and reputation of WSTF among other 4.2 Partnership
international W&S agencies. with Regional
In a thematic paper to the Advisory Development Banks
Board (March 2009), issues of aid
harmonization are discussed. There is a
and other UN
long list of examples in which WSTF has Agencies
supported One-UN processes and signed
declarations and MoUs in order to improve WSTF has currently MoUs with the
aid effectiveness. WSTF has clearly moved African Development Bank, the Asian
in such a direction. However, the paper Development Bank, the Inter-American
presents also some of WSTF’s limitations Development Bank and the European
and reservations towards full integration Investment Bank. The collaboration
and harmonization: started with undertaking joint missions
to countries, followed by annual
• UN-HABITAT is a non-resident UN consultations and support to assignments
agency facing capacity constraints and studies carried out during the loan
when it comes to participation pre-investment phase.
in national level coordination
mechanisms The importance and contributions of WSTF
have been:
• UN-HABITAT is primarily a technical
agency and is not able to make long- • Speeding up project design and
term financial commitments to sector implementation by providing critical
funding support in the pre-investment phase
(support for completing business
• WSTF has been able to focus on the development plans for water service
urban poor in informal settlements providers, baseline studies, impact
- often left out of sector investment monitoring frameworks, capacity
programmes building of utilities, participatory
• WSTF invests limited funds in methods involving the poor)
testing experimental innovative • Taking part in project formulation
approaches. Such work benefits missions
20 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

• Influencing bank policies and There are interesting questions pertaining


approaches: supporting pro- to WSTF’s future cooperation with the
poor approaches in smaller urban development banks. So far, WSTF has
settlements and towns, promoting provided “free” technical services to
integrated/holistic designs and the banks since funds for technical
gender by using WSTF assessment assistance have been available from the
tools and guidelines (water demand Lake Victoria and Mekong programme
management, urban catchment budget. Such funds are not any longer
management, utility benchmarking, there. The questions are: to what extent
micro-finance, etc.) WSTF will remain an interesting partner
for the banks in the future and will the
• WSTF’s regional approach has
banks be willing to pay for UN-HABITAT
been of interest to the banks, e.g.
involvement?
UN- HABITAT’s ability to provide
cost effective capacity building on There is an ongoing negotiation between
a regional basis and address cross- WSTF and the European Development
border issues, such as environmental Bank about phase two of the Lake
protection and sustainability. Victoria Programme in which WSTF may
• Assist the banks to work across be contracted to carry out the capacity
sectors and involve civil society and building and monitoring component10.
other local actors From one perspective, this will ensure
WSTF’s continued involvement in the
The Trust Fund claims to have leveraged programme and replication of the
(or “catalyzed”) USD 464 million (Progress programme in new towns. Institutional
Report 2010) in matching grants and loans memory and experience will be utilized
to improve water and sanitation but it is and UN-HABITAT can access much needed
uncertain how this figure is calculated and resources.
what it means.
However, UN-HABITAT needs to maintain
The partnerships between WSTF and its independence and integrity as a
the regional banks have been of mutual UN organization. With a contractual
benefit and of great importance – possibly arrangement between WSTF and a
more in programmatic than in financial development bank, UN-HABITAT will be
terms. That UN-HABITAThas “leveraged” responsible for implementing an agreed
resources could mean that WSTF has programme component on behalf of
secured additional resources that would another organization and will become an
not have been mobilized without UN- operator on a competitive consultancy
HABITAT’s intervention. An alternative and market and may lose its independence and
equally important but less presumptuous potential critical voice.
interpretation of “leveraging”, is that
WSTF has helped fast track loans and
given them more pro-poor characteristics.
According to a source in AfDB, “UN-
HABITAT’s pre-investment capacity building 10 The recent progress report for 2010 states that: “The
activities in Kenya have helped to fast approval of a USD 110 million grant by the African
Development Bank in December 2010, for a second
track approval of USD 71.5 million loan phase of the Lake Victoria Region Water and Sanitation
OR LOANS? provided by the AfDB” and Initiative, marked an important milestone in the scaling
up of the Programme. The grant agreement includes
also improved design by protecting the an allocation of funds to enable UN-HABITAT to provide
technical assistance for the implementation of the
interests of urban poor”. project in the 15 towns, new towns, and capacity
building and training to ensure the sustainability of the
investments”.
Part 1: Synthesis Report 21

The Added Value of UN- actors engaged in pursuing long term


Habitat achievement of the MDGs.

What exactly are the potentially unique


and distinct attributes of UN-HABITAT in
the water and sanitation field? There are 4.3 Partnerships with
other players as well within the sector, Private Sector and
besides NGOs there are also UN agencies
supporting WATSAN programmes. UNICEF, Universities
for instance, works in more than 90 There are several examples of partnerships
countries around the world to improve between WSTF and private companies.
water supplies and sanitation facilities in Two of the most significant have been
schools and communities, while UN Water Coca-Cola and Google.
works with coordination and coherence
among UN entities dealing with issues Coca-Cola
related to all aspects of freshwater and
sanitation. The latter is, however, not an UN-HABITAT and Coca-Cola India and
implementing agency. South West Asia (Coca-Cola INSWABU)
entered into a partnership and signed
We have seen examples of overlap where an agreement in 2007. This initiative is
WSTF has supported activities more in unique in the sense that it represents
line with UNICEF’s mandate, but it has one of the first public private business
not been presented as a major problem. partnerships for water and sanitation. UN-
It could be argued that UN-HABITAT’s HABITAT and Coca-Cola INSWABU each
added value is its mix of operational committed USD 150,000 over a period of
and normative work, coupled with the three years (2007-09) for implementing
focus on the urbanization of poverty, pilot demonstration projects in India and
and small and intermediate towns. Other Nepal, aiming at reaching more than one
programmes include these categories, but million people. The key objective of this
do not specialize on problems of small partnership was to provide access to safe
towns. drinking water and basic sanitation to the
urban poor and slum dwellers. The project
There are economic, social and political
will benefit nearly 20,000 children directly,
forces behind urban poverty, thus facing
besides the communities around these
the growing magnitude of the slum
schools. The MEK-Watsan initiative is
problem which requires a multifaceted
preparing a partnership with Coca-Cola.
approach. While UNICEF has had some
focus on basic urban services, such as An important success factor is the
in India, it has not yet initiated large “ripple effect “, in which a project
programmes in other countries (Mid Term starting with two has expanded to 12
Review, 2010, 24). partners, providing new investments
and multi-dimensional partnerships in
By linking normative and operational
various regions. The partners have been
work, WSTF has created a certain niche.
active in advocacy and awareness - a
Whereas most other actors in the sector
media campaign where Coca-Cola India
(World Bank, UNICEF, regional banks.
cooperated with other partners. The
etc.) mainly work to achieve immediate
campaign focused on capacity building,
contributions to coverage, the Trust Fund
promoting water conservation, sanitation
seeks to concentrate on models and
and hygiene education infrastructure in
tools that may be replicated by various
rural and semi urban schools.
22 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Google Org and the h2.0 are interesting approaches that may be
Initiative developed further and UNHABITAT should
seek more cooperation of similar kind.
The h2.0 Initiative is testing innovations
in water and sanitation monitoring and
seeks to put in place monitoring systems
on a global scale. The vision is not only 4.4 Internal
to provide tools which service providers Coordination
can use, but also to create a platform in
the public domain from which citizens WSTF has not only external, but also
can access meaningful information on internal partners. This section discusses
WSS service provision and so enter into various aspects of progress and challenges
dialogue with service providers on their in strengthening coordination between
improvement. Google.org uses Google’s WSTF and other parts of UN- HABITAT.
strengths in information technology to There is a perception that UN- HABITAT
build products and advocate for policies at Headquarters level is involved in
that address global challenges. In the global normative work whilst regional
h2.0 initiative Google has provided the and country offices focus on operational
software platform. activities. The country focus is perceived as
being weak with relatively few and under-
There are, however, few formal links resourced country offices. These were
with research institutions, universities two of the reasons why the MTSIP called
and think tanks. Rather than UN- for the development of an Enhanced
HABITAT doing basic research, there is Normative and Operational Framework
an untapped potential for the latter to (ENOF), described as “an integrated
be a catalyst in such processes, building approach to support Governments and
strategic partnerships with such inventors. their development partners to achieve
Existing connections with universities more sustainable urbanization”.
such as Twente University (for the H2O
initiative), the TERI Institute in India and However, this has not been the case for
the collaboration with Bob Metcalfe from WSTF. The concern of ENOF – combining
California State University (on water normative and operational approaches -
testing) provide examples but there is a was a strong element in WSTF’s strategic
need for more of these trans-disciplinary plan from the beginning. It has also
and innovative partnerships. The event remained a key characteristic of the
“Water for African Cities”, arranged on programme. However, WSTF has, to a
a yearly basis by UN-HABITAT, is a useful large extent, established its own presence
platform for dialogue and platform to in countries with Chief Technical Advisors
promote such partnerships across the keeping only formal communication
W&S sector. lines with RTCD11 and UN-HABITAT’s
regional and country offices. There have
For instance, at the “Water for African been considerable regional variations
Cities” in Addis Ababa, Ethiopia, in and increasing integration but WSTF
November 2010, innovative examples is still perceived as a self-contained
of research were presented in the field programme with a cautious approach to
of sustainable water management, full integration.
renewable energies and ecological
sanitation. An online toolbox has been 11 RTCD is the Division in UN-Habitat with coordinating
developed which gives practical examples responsibility for regional and country level activities
- a key instrument for implementing the enhanced
of concepts of sustainable WATSAN. These normative and operational framework. It is organized as
a separate Division.
Part 1: Synthesis Report 23

The Peer Review asked to what extent originality and creativity that comes from
it was appropriate that the Water and the unique opportunities the Trust Fund
Sanitation Infrastructure Branch carried presents” (MTSIP Peer Review).
out operational activities at the country
level, or if such activities could be Internal coordination is an issue beyond
transferred to the Regional Offices with the scope of this evaluation and requires
commensurate funding. The Branch further analysis. WSTF has so far been
responded by noting that “WSTF is one able to support strong country activities
of the only units in UN-HABITAT that implemented through a range of country
truly undertakes a mix of normative and partners, but will most likely not be able to
operational work. We provide the model sustain country programmes at the same
of integration where normative work level in the future. Hence, one alternative
would be to use UN-HABITAT’s regional
drives project formulation and vice versa. structure more as is already the case in
Transferring the work of the WSTF to Latin America.
the regional programmes would kill the
24 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

5 Achievements and Results

The last and most difficult questions are 5.1 Evidence of Results
to what extent WSTF has produced its
expected results and are they sustainable? Stakeholders Perceptions
The progress reports, impact studies and
the regional and country studies carried WSTF stakeholders were asked to assess
out as part of this evaluation document achievements and results and the overall
all a broad range of achievements response from the survey was positive and
and results. They prove that most of reflects what is found in other studies.
programmes and activities have been This is that major stakeholders perceive
implemented – despite certain delays. WSTF as a relevant programme and that
There is also evidence of change. performance is rated highly. However,
the responses are based on subjective
It is not feasible in a short chapter to perceptions from people involved in the
summarize the aggregate results of programme and not neutral observers.
WSTF at global and country level. Neither
is sufficient data available to answer Findings from the Case Studies
questions about national and global and Progress Reports
impact. WSTF has not established a system
for monitoring core process and outcome A general finding from all the studies is
indicators across countries and regions that institutional capacity has increased,
to facilitate such type of reporting. There however, at various levels. This has been
is a lot of data on a project-by-project achieved through a mix of operational
basis, but less for aggregate reporting and programmes, coupled with training,
comparative analysis, such as how many capacity building and hands on technical
people have got access to improved water assistance targeting the urban water and
and sanitation in various countries. sanitation and municipal councils. Under
the LVWATSAN, an estimated 64,000
The chapter starts by presenting how persons have been provided with access
stakeholders perceive WSTF’s contribution to safe drinking water, while 75,000
to change and the main findings and persons have benefited from access to
conclusions from the regional/country basic sanitation. Furthermore, during
reports, the impact studies and other 2010 solid waste management systems
available reports – providing concrete have been operationalized in eight towns,
evidence of results. benefiting an estimated 160,000 persons
(UN-HABITAT Progress Report 2010, 7).

Results areas % response


The programme has been innovative 90%
The programme has contributed to changes in national policy 61%
The programme has contributed to strengthening knowledge and capacity among partners 87%
The programme has strengthened national and international networks 84&
Normative tools have been utilized 79%
The programme has been replicated in other settings 66%
The programme has created visible results at the level of beneficiaries 83%
The programme has contributed to achievement of the W&S MDG targets 87%
Part 1: Synthesis Report 25

Lake Victoria Region programme in utility management shows


the average increase in revenue since the
In general, partners appreciated the start of the programme to be over 300%,
activities of UN-HABITAT in the Lake while non-revenue water has dropped
Victoria region. The fast track and roll-out from an average of 63 per cent to about
approach of bringing resources to the 44 per cent.
target towns, combined with capacity
building and a pro-poor focus received The customer base of the utilities is also
high marks from the stakeholders. The expanding with an average increase in
combination of water supply, sanitation, the number of water connections to more
storm flow and solid waste was also than 70 per cent (UN-HABITAT Annual
valued. Progress Report, 2010, 9). The WSP
further improved its reporting capacity and
The Lake Victoria initiative has made one can conclude that the WSPs are slowly
good progress towards capacity strengthening their capacity to maintain
building. A comprehensive capacity the system.
building and training programme in
utility management, urban catchment India
management and pro-poor governance
Programme outcomes in India reflect
an increased institutional capacity for
“In the fast track component, the existing customers pro-poor W&S, a strengthening in
benefitted more from the support to the WSP’s than the collaborative and strategic partnerships
people in informal areas. This is caused by the necessary and increased flow of investments.
rehabilitation of the upstream part of the WS before any
extension to informal areas could be carried out” (Rijsdijk
As regards the impact of operational
2011). programmes, the number of people
that benefited from the WAC in India
and Nepal during 2010 is estimated to
be 120,400 and 47,000 respectively
was launched during 2010 in ten towns. A (Progress Report 2010, 7). Further, of the
total of 928 persons (of whom 32 per cent four cities targeted under the WAC in
were women) from these ten towns were India, a total of 95 per cent of households
trained in various aspects of W&S service living in poverty pockets now have
delivery, including water governance and access to improved water source (2006,
community and household water systems. UN-HABITAT WAC Brochure). In a similar
The beneficiaries included 81 managerial vein, community managed solid waste
and technical staff from the water utilities management has become operational
(UN Habitat Progress Report 2010, 9). in five wards of the city of Jabalpur
benefiting a population of 49,000,
Results were particularly noticeable as through house-to-house collection of
regards the Water Service Providers. waste (UN-HABITAT Annual Progress
The performance of the WSP improved Report, 2010, 12).
both at the operational level as well
as in management capacity. The water The close linkage between the
production increased, the amount of non- operational programmes and the strategic
revenue water was reduced and income partnerships with governmental agencies,
from the sale of water went up. A recent NGOs, research institutes and private
performance assessment of the six water sector in India has arguably been crucial
utilities in the larger Lake Victoria towns in achieving progress. There is without
that benefited from the capacity building doubt clear indication that partners are
satisfied with UN-HABITAT in discussions
26 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

with partners and beneficiaries, they programmes also related to gender


emphasized UN-HABITAT’s international mainstreaming.
clout by virtue of being a UN organization,
its ability to attract expertise and its role Mekong Region
as facilitator and network builder and
In the Mekong region, about 100,000
catalyst.
people have benefited through the
A reason for India’s success in establishing Mekong Region Water and Sanitation
a more advanced programme is the Initiative (MEK WATSAN) and the Water
effective cooperation with government on for Asian Cities Programme (WAC). The
national and local level, and the fact that initiative performs well, utility performance
the programme is well anchored within is enhanced, and about 30 per cent of the
national and local government systems. utilities are covering their operational and
There are also several examples where UN- maintenance costs. The MEKWATSAN
HABITAT, through its partners, has been programme outcome also includes greater
able to advise and expertly guide national accountability and transparency through
and municipal governments ensuring institutionalization of Project Performance
that its models can be taken up on a Monitoring and Evaluation framework
sustainable basis. (PPME). In Cambodia, Government has
requested that UN- HABITAT provide the
UN-HABITAT’s approaches have also PPME software so that this framework
been influential in the making of a legal could be institutionalized and replicated
framework in local government on in other projects (UN-Habitat Annual
issues such as water charges collection, Progress Report, 2010, 9, 10).
rainwater harvesting and environmental
sanitation in slums as well as in the Beneficiaries and authorities in the three
preparation of city sanitation plans. countries confirmed their appreciation
of UN-HABITAT and wished for the
India shows further good results from continuation and extension of its activities
the capacity building programme. in more or less the same way, especially
There has been continuously work on the disbursement of funding directly
building capacity of municipal staff, to implementing agencies rather than
through capacity enhancement training channelled through several bureaucratic
Part 1: Synthesis Report 27

layers. As one minister stated “UN- activities in order to improve water


HABITAT is small, but beautiful”. management.

The approach on village/small town level Capacity and institutional development


is based on community sensitization and is particularly evident as regards the
community participation. This, well tested WOPS-LAC. The latter has promoted 13
methodology appears to have good joint initiatives between several watsan
results in the region. MEK-WATSAN did operators in the LAC region. Another
not introduce innovations, other than the example of institutional development
micro credit for the investment in water is found in Bolivia, with two projects
supply and sanitation (Rijsdijk 2011). cooperating with the Municipality of La
Paz and the Municipality of Cochabamba.
Latin American Region In the field of gender mainstreaming, ten
workshops have been completed, and
The Water for Cities Programme in Latin
WatsanLAC is contributing to a “Gender
America and the Caribbean (WatSan-
Resource Book” in Spanish.
LAC) is a regional operational initiative
that was initiated in Mexico and Bolivia In terms of results and achievements,
in 2008. During 2009-2010, the most projects are in a first stage of
Programme concentrated its attention on implementation and, as such, it is
consolidating the local programmes in premature to assess the impact on
Mexico and Bolivia and started its activities infrastructure and hygiene awareness,
in other countries of Central America or health benefits. However, PTAR-D
(Nicaragua, El Salvador) and the Andean (Decentralized Treatment Plant for
Region (Peru, Ecuador, Colombia) as well. WasteWater) is already installed and
ready to operate in Cochabamba. In
The main objective of the WatSAn-LAC is
addition, the introduction of models such
to contribute to the sustainable access to
as vulnerability mapping in Mexico, the
safe drinking water and basic sanitation
development and future implementation
for the poor, particularly in the urban and
of Water Safety Plans in Mexico
peri-urban areas, and the Programme
and Bolivia, and Citizens and Water
focuses on the following areas: pro-poor
Observatories to monitor WATSAN in
urban water governance, integrated urban
Mexico and Bolivia illustrates some of UN-
environmental sanitation, implementation
HABITAT’s innovative approaches.
of integrated water resource management
in urban settings, democratic governance, In summary, the programme is well-valued
decentralization and empowerment, by the national and municipal authorities
capacity building, water, sanitation and and WatSanLAC is well-aligned with
hygiene education and strengthening national and municipal programmes.
water operators. This has been confirmed in field visits
and interviews. Although in its early
The software approaches introduced by
stages, the consultant thus concludes
UN-HABITAT in the region include the
that the WatsanLAC country programmes
development of monitoring mechanisms
are promising. A crucial weakness is,
for the integration of gender-related
however, the heavy financial reliance on
issues in ongoing projects, community
the Government of Spain, one which
development tools such poverty mapping,
can only be solved by finding other and
as well as Human Values Based Water,
new donors for financing activities in the
Sanitation and Hygiene Education,
region.
advocacy, awareness-raising and education
28 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Conclusions from the Impact The Impact of Global


Studies Normative Activities
The two impact studies carried out last Normative activities supported by the Trust
year reached more or less the same Fund provide a basis for policy dialogue
conclusions: UN-HABITAT’s activities on among water and sanitation providers,
the ground are making a substantial, users, utilities and governments. There
strategic and direct impact from a are various activities that can be described
relatively small investment. The projects as normative; the key theme for the
are good value for money and have an normative activities is, however, pro-poor
impressive leverage effect on follow-up governance work. Other cross-cutting
and complementary investments. elements of the programme include
monitoring and evaluation activities,
The impacts of the interventions in Nepal water-demand management, urban-
on the achievement of the MDGs are catchment management, values-based
limited in terms of tangible increase in water education, advocacy, awareness-
WSS coverage but the programme has raising and information exchange, pro-
achieved significant improvements in poor sanitation as well as capacity building
quality and relevance. More specifically, and gender mainstreaming.
the interventions are well-integrated
with relevant authorities, institutions As part of its normative work UN-HABITAT
and development partners at national has also disseminated a large amount
and municipality level, as stated in the of information including policy options,
impact study. The main achieved impacts norms, standards and management
in Nepal from 2005 to2008 include the toolkits. This includes, but is not limited
development of strategic approaches, to, pricing policy, water demand
policy reforms, training and tools in management, rainwater harvesting,
partnership with the Government and advocacy, education and so on.
demonstration of pro-poor community
based management mechanisms in Three global reports covering water
selected pilot communities, helping and sanitation issues, several source
achieve the WSS MDGs in cooperation books and technical guidelines, capacity
with NGOs , municipal authorities and the building, advocacy and networking have
stakeholders (Impact Study, 2010). Hence, been produced. The investment is small
the actual value added and impacts made compared to the regional and country
by the first generation pilot projects programmes.
provide a solid base for future large-scale
The three global reports are rated highly.
replication.
Key staff members have contributed to
The Kenya impact study points out that regional and global policy debates through
the Kenyan programme performance engagement in political processes, such
is less clear in its coordination than in as the African Ministers’ Council of Water
Nepal, however, it emphasizes that the (AMCOW), the Asia-Pacific Ministerial
combination of water-supply infrastructure Conference on Housing and Human
works with “software” activities, in Settlement (APMCHUD) and UN-Water.
particular the MSF seen in LWATSAN, is a
WSTF has also advocated for pro-poor
good model programme, (Kenya Impact
urban water and sanitation issues in
Study, 2010,60).
several international conferences and
Part 1: Synthesis Report 29

events. This evaluation has not been able but continuing external support is
to assess the results of such activities. essential to ensure that the benefits of
Another type of evaluation would have the project will last. The fact that the
been required to measure results of global WSP’s are still not sustainable does not
and regional advocacy activities. The same imply any mismanagement or under-
applies to documenting the results of estimation of the tasks by UN-HABITAT.
capacity building at all levels. Time series In view of the gigantic challenges the
data are required to assess change over WSPs faced at the start of the project, it
time. would be unrealistic to assume everything
could be solved within a few years. It is
Sustainability noteworthy that the “best performing”
WSP of Uganda (and Uganda’s showcase
The projects reviewed suggest that of proper management), the National
UN-HABITAT is able to attract the right Water & Sewage Corporation, is still not
partners and support a wide range of sustainable at present (Rijsdijk 2011).
initiatives. Whilst the programmes in India
are phasing out, Mekong, LWATSAN and Building viable models for future large-
the activities in Latin America need further scale replication was a major motive for
resources and time to draw conclusions on WSTF. There is evidence that WSTF models
the level of sustainability of the projects. and approaches have been adopted and
replicated in other settings, as seen in
That said, there is still room for India, but no systematic information.
improvements. The Google H20 platform It would be useful to incorporate this
illustrates a promising and innovative element into reporting systems and
initiative in which sustainability could assessments of impact and outcomes
have been considered more strongly. The incrementally by country, subject areas and
project is not being continued due to to allow for country comparisons.
a lack of financing, and the databases
created have so far not been developed The present approach of the MEK-
further. As the Impact study concluded, WATSAN initiative has the potential for
experiences from the development of replication, although the system of grants
similar databases suggest that finding a and revolving loans should be reviewed as
sustainable long-term host- institution and this is not sustainable in its present form.
creating incentives which enable database The social and institutional sustainability
to be used and maintained are critical appears to be good, while the technical
success factors (Impact Study 2010, 21). sustainability of the watsan investments is
satisfactory, although the some technical
The most critical question is perhaps not constructions have minor flaws (Rijsdijk,
to what extent WSTF-supported activities 2011).
will continue without external support,
but whether the benefits and outcomes It should also be emphasized that
are adopted, disseminated, used and the sudden cut in resources pose a
replicated. The general feedback on the considerable risk to the sustainability of
relevance of global normative activities is projects that are not completed. The
very positive, but inadequate systematic self assessment survey shows that only
information is available about use, 12.5 per cent of the respondents believe
adoption rates and replication. that an exit strategy is prepared while
75 per cent of the respondents replied
A key conclusion from the Lake Victoria that they don’t know. In line with the
study is that the performance of the Water recommendations made in the Mid Term
Service Providers improved considerably,
30 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Review, there is a need to formulate partnerships with both governmental


exit strategies that help to ensure and non government partners
sustainability.
• WSTF has supported a broad range
Concluding Remarks of training events and prepared
and introduced technical tools
The assessment of the team is positive and guidelines but there is limited
– WSTF’s ability to achieve results is systematic information about their
recognized, but the conclusions are more use and impact.
nuanced than from the stakeholders: • The level of involvement in research
and generation of new knowledge
• The overall rate of implementation
is limited but with interesting and
is good – despite certain delays and
promising examples
underexpenditure
• The programme has not prioritized
• The feedback from stakeholders on
involvement in national policy and
relevance is positive
sector reform processes, such as
• There is also significant evidence of participation in sector working
successes and results at programme groups, strategic advocacy and raising
and project level awareness even if there are increasing
examples of such involvement
• There is no information on long
term impact – on changes in socio- • The global monitoring efforts were
economic conditions, health status, promising but lost some momentum
etc. Available data are mostly at
project output and outcome level.
• WSTF has prioritized and achieved 5.2 Capturing
the best results as a model tester and
service provider at community and
UN-HABITAT’s
municipal level through the Water Contribution to
for Cities programmes and the two
replicable model setting initiatives. Change
There has been a “downstream” This evaluation has tried to document
emphasis through the introduction achievements and results based on existing
of new social and technical models data and information and verify such
in cities and small towns. WSTF findings through regional and country case
has achieved significant results at studies. However, the concept of results
community and municipal level. and impact and capturing UN-HABITAT’s
• WSTF has successfully supported contribution to change is complex. An
regional and national network everyday understanding of impact would
building – using its “convening be: “What difference has the Trust Fund
power” as a UN agencyWSTF has made to the intended beneficiaries and
successfully established productive their partners?” or “To what extent has
partnerships with all the regional the Trust Fund helped to achieve the
banks, helping to fast track MDGs – that is, reduced the number of
investments and promoting the pro- people without sustainable access to safe
poor agenda in design processes drinking water and basic sanitation”.

• WSTF has made successful progress More technical definitions would


in capacity building through focus on the uniqueness of the effect
Part 1: Synthesis Report 31

An alternative understanding of impact


starts by assuming that social, economic,
technical and political change rarely comes
about through the actions of a single
external agent. When a government
receives advice, it first of all has to decide
whether or not it is interested in advice
and, once received, has to decide to
follow up. “Beneficiaries” are not passive
and the most that advisors, capacity
builders and the like can achieve is to
“facilitate and catalyze” change. This
is consistent with the Paris Declaration
and the Accra Agenda for Action and
much development oriented thinking.
One conclusion is that most activities of a
WSTF are more understandable within the
second understanding of impact than the
first.

The MTSIP Peer Review recognized that


UN-HABITAT has the understanding that
results are those changes that occur
above and beyond the level of outputs
– even if results, to a large extent, are
still described in terms of activities and
outputs. However, there is a much weaker
achieved by posing the counter-factual understanding that there are various
question: “would this have happened categories of results and that there
anyhow, without the intervention of needs to be different indicators for each
UN- HABITAT?” Such a question begins category.
to highlight some of the difficulties in
The performances - or success criteria -
demonstrating UN-HABITAT‘s impact,
are different between research, capacity
in particular the contribution of
building, advocacy and scaling up.
“beneficiaries” and partners to impacts
Results in the final category are best
that occur.
captured in coverage indicators while
Yet, colloquially having an impact implies success in research is assessed in terms of
that an actor such as WSTF brings quality, relevance, replicability, etc. The
about change in the world. UN-HABITAT contribution of UN-HABITAT should, in
has influence while the “target” of a many cases, be measured by other means
service is relatively passive. There is a than numerical indicators and long-
chain implied that leads from inputs to term MDG impact. WSTF has primarily
outputs, outcomes and in the longer-term a catalytic role while large-scale impact
“impacts”. This perspective on “impact” should be the responsibility of partners.
leads to questions about needs, the The further out in the results chain, the
deployment of resources, an assessment more unlikely it is that changes can and
of outputs, how efficiently outputs have should be attributed to UN-HABITAT
been produced and the effects this has for alone.
“beneficiaries”.
32 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

5.3 Performance
Indicators
The WSTF Strategic Plan has identified
three performance indicators or measures
of success. The ultimate aim is to achieve
MDG Goal 7 and “increase number
of urban poor provided with access to
affordable and environmentally sustainable
water and sanitation compared to
baseline”, but the outcome measures are
at another level:

• Increased institutional capacity in


partner countries for advocating/
promoting and implementing pro-
poor water and sanitation initiatives
and policies with focus on gender
• Increased flow of investment into the
water and sanitation sector catalyzed and provision of services and basic
by WSTF interventions infrastructure
• Improved MDG monitoring • Countries demonstrating increased
mechanisms in place in partner and sustainable access by the urban
countries, with improved poor to adequate clean water,
benchmarking of water and improved sanitation and waste
sanitation service providers management\\
In other words, WSTF wants to make a • Cities with strategies to minimise and
difference and look for results in three deal with climate change effects
areas – institutional strengthening, level
of investments and global monitoring It is unfortunate that UN-HABITAT
mechanisms – that are considered operates with two sets of performance
important preconditions for achieving the measures for water and sanitation.
MDGs and areas in which UN-HABITAT However, the MTSIP approach and
can make an important contribution. indicators are less in line with the
understanding of results and impact
MTSIP has formulated other and different advocated for in this chapter. The
types of performance indicators for Focus indicators are focusing on numbers
area 4: Environmentally sound basic urban and increase in coverage without
infrastructure and services which would be considering sufficiently the catalytic and
an agreed number of: model-building nature of the water and
sanitation programme. The indicators from
• Countries and cities adopting the WSTF strategic plan are more relevant
improved infrastructure governance for capturing WSTF’s contribution to
frameworks change. It would most likely be impossible
• Urban centres, including secondary to collect valid and reliable data for the
and small towns, adopting MTSIP indicators – to agree on precise
environmentally sound and energy operational definitions, establish a baseline
efficient technologies in construction and gather reliable data.
Part 1: Synthesis Report 33

Conclusions and
6 Recommendations

6.1 Conclusions on its original innovative model building


nature supporting useful, but less essential
Policy and Strategy activities for WSTF.

The WSTF strategy and programmes are WSTF has prioritised roles differently:
highly relevant:
• Emphasized the roles as model tester
• By focusing on water and sanitation and service provider at community
- fundamental prerequisites in urban and municipal level in the Water
slum development for Cities programme and the two
replicable model-setting initiatives
• By targeting the vulnerable and often
neglected populations in small urban • Gradually been involved at national
centers and poverty pockets in larger level in sector reform processes, but
cities sporadically and not as part of a
strategic effort
• By promoting pro-poor governance
strategies and building models of • Successfully supported regional and
good practice (e.g. community- country network building – using its
based sanitation, water demand “convening power” as a UN agency
management, innovative water
and sanitation approaches and
capacity building of communities)
for up-scaling and replication by
national governments and regional
development banks
• By forging a wide range of
partnerships with civil society,
municipalities and utilities, local
and national governments and
development partnersBy focusing on
innovation, learning and software
development addressing barriers for
reaching the poor with sustainable
services and replicable models for
widespread dissemination and use
• By operating at global, regional
and country level with combined
operational and normative
interventions, like programme
support, capacity building, advocacy
and resource mobilization

WSTF has spread its resources widely both


thematically and geographically. The
programme has not focused sufficiently
34 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

• Been more involved in the application Sanitation and Infrastructure Branch


and testing of tools and methods and the Urban Finance Branch. The
than in applied research and two branches perform different
generation of new knowledge functions and there are no clear
benefits from such a merger.
• Maintained a strong operational
focus in the country and regional • WSTF is project and activity driven
programmes while the learning partly as a result of how the
aspects have been weak and programme is funded. Country
not sufficiently integrated in the strategies are missing – providing an
operational work overview of what WSTF does, why,
with whom, how and where.
• Lost momentum in the global
monitoring of MDG efforts • WSTF is perceived by other parts of
UN-HABITAT as too self-contained,
• Been involved in global advocacy but
with vertical activities not sufficiently
not to any large extent
linked to other sectors.
Based on the premise that WSTF is an
• WSTF does not have a strong global
experimental, model-building programme,
monitoring and evaluation system
there has been an imbalance between the
– learning tools to assess progress
various parts of the programme: normative
and performance on a regular basis
and operational, capital investments and
in order to analyse what works and
learning/documentation, software and
what doesn’t.
hardware, global and regional/country
programmes. • The Trust Fund has received
significant contributions from several
Processes and Resources bilateral donors since 2004 (approx
USD 120million). Seventy-five per
• The Trust Fund has helped establish a cent of the funds have been provided
strategic programmatic approach with as un-earmarked resources, providing
an agreed and simplified planning WSTF with significant flexibility.
and reporting procedure vis-à-vis the
donors. It has also so far provided • The expected budget for 2011 was
long-term, relatively predictable and approximately USD 15 million but
generous funding. has been reduced by two-thirds.
Marginal resources will be available
• The multi-donor support to the Trust for operational activities when salaries
Fund has gradually eroded - only the are covered.
Norwegian Government currently
provides core resources. Partnerships
• The sudden withdrawal of support
• The partnerships between WSTF
by the Government of Spain creates
and the regional banks have been of
reputational risks for the organisation.
mutual benefit and importance, but
WSTF has signed agreements which
more in programmatic than financial
will either have to be cancelled
terms. The programme has helped to
or significantly changed. A more
fast track loans and given them more
incremental change in consultation
pro-poor characteristics.
with stakeholders could have reduced
such risks. • WSTF should maintain its autonomy
in all partnerships in order to analyse
• The Human Settlements Finance
critically what works and what
Division consists of the Water,
Part 1: Synthesis Report 35

doesn’t and support innovative


learning.
• There are promising examples of
partnerships with private sector
companies.
• There is scope for strengthening
WSTF’s participation in development
partner coordination.
• WSTF could have played a stronger
role as “strategic influencer” at
national and sector level.
• WSTF has to a large extent
established its own presence in
countries with Chief Technical
Advisors keeping only formal
communication lines with RTCD and
UN-HABITAT’s regional and country
offices. basis for large scale replication in the
future.
Achievements and Results • WSTF has prioritized and achieved
• Most programmes and activities have the best results as a model tester
been well implemented. and service provider at community
and municipal level. The programme
• Major stakeholders rate WSTF’s has achieved significant results at
performance as high. A general community and municipal level.
response is that projects are making
a substantial and direct impact from • WSTF has successfully supported
a relatively small investment. The regional and national network
projects are considered as good value building – using its “convening
for money and a leverage effect power” as a UN agency.
on follow-up and complementary • WSTF has successfully established
investments. productive partnerships with all the
• The programme has supported a regional banks, helping to fast track
range of global normative activities. investments and promoting the pro-
Another type of evaluation would poor agenda in design processes.
have been required to measure results • WSTF has supported a broad range
of global and regional advocacy of training events and prepared
activities and documenting the results and introduced technical tools and
of capacity building. guidelines, but with limited systematic
• It is often not possible to measure information about impact.
increase in WSS coverage and • UN-HABITAT‘s added value is to
much less the contribution to “facilitate and catalyse” change.
MDG achievements, but the Social, economic, technical and
programme has achieved significant political results rarely come through
improvements in quality and the actions of a single external
relevance of projects building the organisation.
36 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

• The contribution of UN-HABITAT between roles and interventions


should in many cases be measured will be maintained including the
by other means than numerical number of staff.
indicators and long-term MDG
* A status quo – but lower-level
impact. WSTF has a catalytic role
approach - with the aim to
while large scale impact should be the
continue with the same profile
responsibility of partners.
and mix of programmes, but
• There is no information on long-term at a much lower level. Some
impact - mostly on outputs and activities may be cancelled but
outcomes at project level. It is not most normative and operational
feasible to measure aggregate results programmes will continue.
at country, regional and country
* A re-focussing strategy ,
levels.
which would involve sharpening
• The level of involvement in research the programme and selecting a
and generation of new knowledge is few core programmes in which
relatively limited, but with interesting WSTF should invest its resources.
and promising examples. This would mean that a large
number of activities will have to
• The programme has not prioritized
be left out.
involvement in national policy and
sector reform processes. • This evaluation recommends to
pursue the refocusing strategy and
consider the following options:
6.2 Recommendations • Reduce the number of operational
To WSTF Senior Management regional and country programmes
in particular the capital investment
• Prepare a paper to be discussed with components“Regionalize” and make
the Advisory Board assessing the the operational programmes more
current status of the programme and autonomous and country-specific in
presenting alternative scenarios. The close consultation with the Regional
purpose of the paper is to secure the Offices and CTAs – if possible with
benefits of what has been invested, support from previous and new
reduce negative impacts of budget donors. Also ensure that the regional
cuts and stimulate reflection on programmes are assessed for their
alternative approaches. actual impact in the concerned
country and for each region.
• In order to ensure the sustainability
of the WSTF, the team feels that it • Maintain the field testing and
would be important to consider the “real life” laboratory function in
following three scenarios/options: cooperation with research institutes
in a few selected geographic and
* A re-establishing approach thematic areas
– with the aim to identify
new donors and mobilise new • Reinforce efforts to establish a system
resources in order to re-establish for global and national monitoring of
the programme at the “normal” W&S indicators and achievement of
level of funding (15-18 Mill MDGs
USD). In this scenario, the • Strengthen the learning and
current profile and balance documentation component of
Part 1: Synthesis Report 37

the programme by seeking more how the Urban Water and Sanitation
cooperation with universities and can maintain its strengths and
research institutes develop stronger horizontal linkages
with other parts of the organisation.
• Strengthen global advocacy,
networking and preparation of • Restate and if necessary rephrase the
guidelines and technical tools. importance of water and sanitation
If necessary, reduce the direct within the broader agenda for
involvement in capacity building. sustainable urban development.
• Strengthen the involvement in • Discuss the role and viability of
national policy and sector reform Trust Funds in general and WSTF in
processes particular.
• Don’t do what NGOs and
others can do better and more For the WSTF Advisory Board
efficientlyContinue with capacity
• Ensure that WSTF’s future role
building of local partners, preferably
in UN-HABITAT is discussed in
through long-term coaching rather
than short-term training sessions the Committee for Permanent
Representatives and other appropriate
• Continue partnerships with the fora.
regional banks while maintaining its
independence and integrity as a UN • Provide professional and financial
organisation support to ensure a smooth change/
transition of the programme.
• Review existing human resource
capacity and expertise based on the • Continue funding (of particular
requirements of the new strategic importance for the Government
priorities. The premise should be that of Norway) in order to protect
a more knowledge-based programme investments and ongoing activities,
requires new expertise. reduce negative effects and allow a
repositioning of the Trust Fund.
For UN-HABITAT and WSTF
• Discuss the future viability of the
Senior Management Water and Sanitation Trust Fund
• Review the existing organisational including the role of the Advisory
and divisional structure and explore Board as a forum for strategic and
programmatic analysis and discussion.
38 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

1 Terms of Reference
Annex

External Evaluation of Development, which added a target on


“reducing by half the proportion
the Operations of the of people without access to basic
sanitation by 2015”.
Water and Sanitation
Trust Fund The Trust Fund’s activities are directed
at creating an enabling environment
Programme UN-HABITAT Water and Sanitation Trust for increased investment in water and
Title: Fund sanitation targeted to the urban poor.
Region: Africa, Asia, Latin America and the The Trust Fund-supported Water and
Caribbean Regions Sanitation Programme of UN-HABITAT
Title: External Evaluation of the UN-HABITAT seeks to establish investment oriented
Water and Sanitation Trust Fund collaborative arrangements with regional
Duration: Three months’ work spread over five and international financing institutions
months with a view to promote increased flow of
investments to the water and sanitation
sector in the participating cities. The
programme supports four inter-linked sets
1.1 Introduction and of activities:
background • Three regional water and sanitation
During the Water and Sanitation Trust programmes in Africa, Asia and
Fund Advisory Board meeting held in Latin America and the Caribbean,
Nairobi, Kenya, on 16 April 2010, the which facilitate pro-poor investments
Government of Norway announced in partnership with regional and
its intention to undertake an external multilateral financing institutions
evaluation of its support to the Trust Fund • Replicable model-setting initiatives
over the last 8 years. It also encouraged targeting secondary urban centers
other Trust Fund donors to collaborate in the Lake Victoria and the Mekong
in undertaking the external evaluation. regions
Following this call, the Governments of
Norway, Spain and the Netherlands, in • Normative activities which focus on
collaboration with UN-HABITAT, plan to developing pro-poor and gender
jointly undertake an external evaluation sensitive governance frameworks,
of activities supported by the Water and including policy options, norms,
Sanitation Trust Fund. standards and management toolkits
for the urban water and sanitation
The Trust Fund was launched by UN- sector
HABITAT in October 2002 in response to
• Monitoring progress towards the
two major international calls: Millennium
achievement of MDG and WSSD
Development Goal 7, Target 10 which
targets related to water and
aims “to reduce by half the proportion
sanitation
of people without sustainable
access to safe drinking water by the The external evaluation will cover all
year 2015”; and an appeal in 2002 the water and sanitation activities of
at the World Summit on Sustainable
Part 1: Synthesis Report 39

UN-HABITAT from 2004-2010, including operation and the programme, and


the Lake Victoria Water and Sanitation to propose improvements in these
Initiative (LVWATSAN) and the Mekong structures and procedures
Region Water and Sanitation Initiative
(MEKWATSAN). The Mid-Term Review confirmed that
the Trust Fund’s goal of contributing
to the achievement of the Millennium
development goals remains valid and
1.2 Mid-term Review relevant. It noted that the programme
of the Water and addresses key barriers to the expansion
of services to the urban poor and to small
Sanitation Trust urban areas apart from making a direct
contribution to improved coverage in
Fund Activities those locations where the programme
In early 2007, UN-HABITAT undertook is operational. The Trust Fund’s work
a mid-term review of the Trust Fund in developing tools (poverty mapping
activities to assess how well the Fund and small community-managed piped-
is achieving its objectives, its potential water supply among others), models
impact and to explore modalities for and processes which advance pro-poor
ensuring long-term sustainability of the governance was lauded by development
Fund. Specific objectives of the Mid-Term banks such as the African Development
Review were to: Bank as one of its most useful
contributions.
• Review the already-delivered outputs
and outcomes and the trends towards The Mid-Term Review also noted that,
delivering the planned outputs and although most projects, especially in
outcomes of the programme to Africa, are in early stages of development
achieve the goal and objectives of and implementation, some country
WSTF programmes are showing signs of
promise. It concluded that assured long-
• Review whether the strategies term funding and a field management
adopted by the WSTF are relevant to retention policy should enable continuity
its stated objectives, and to assess the and enhance the prospects of sustainable
extent to which possibilities for self- impact.
sustainability have emerged
• Review the current scope of the These terms of reference is built on the
Water and Sanitation Programme experiences gained in the Mid-Term
under the Trust Fund and determine Review. It provides a good opportunity
whether or not it is still valuable, to compare the findings and track
appropriate and can yield the
expected results
• Carry out a forward-looking appraisal
and develop a strategy to ensure
continued relevance, efficiency,
effectiveness and sustainability of the
WSTF
• Analyze the existing structure and
procedures for reporting, follow-up
and monitoring of the Trust Fund
40 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

the achievements made by the Trust • Improved Millennium Development


Fund since the Mid-Term Review was Goals monitoring mechanisms in
conducted. place in partner countries, with
improved benchmarking of water and
sanitation service providers
1.3 The Trust Fund Activities supported by the Trust Fund fall
Strategic Plan under Focus Area 4 (FA4) of the MTSIP
on “environmentally sound basic urban
(2008-2012) infrastructure and services”. FA4 reflects
UN-HABITAT’s vision of urban water and
Based on the findings and conclusions
sanitation as part of wider processes of
of the Mid-Term Review, UN-HABITAT
human settlement development and
developed the UN-HABITAT Water and
improvements in the living environment
Sanitation Trust Fund Strategic Plan 2008-
of the urban poor, in particular. This
2012. The Strategic Plan also benefited
vision corresponds to the four established
from the UN-HABITAT Medium Term
focus areas of the Trust Fund’s Strategic
Strategic and Institutional Plan (MTSIP) for
Plan for the period 2008–2012. These
the period 2008-2013 and guidance of
are delivering sustainable services for the
recipient countries, development partners
poor; ensuring synergy between the built
and UN-HABITAT field staff.
and natural environment; monitoring
The purpose of the Strategic Plan is to the Millennium Development Goals and
guide Trust Fund work in addressing beyond and integrating infrastructure and
challenges of the internationally-agreed housing.
water and sanitation goals and UN-
The management framework for the
HABITAT mandates, including the overall
Trust Fund has shifted to a more results-
goals of Shelter for All and Sustainable
oriented approach, under which work
Human Settlements Development, as
plans and targeted outcomes are being
embodied in The Habitat Agenda and the
guided by both the Trust Fund Strategic
UN-HABITAT Medium Term Strategic and
Plan for 2008-2012 and the UN-HABITAT
Institutional Plan (MTSIP) for the period
Medium-Term Strategic and Institutional
2008-2013.
Development Plan, 2008-2013.
The Strategic Plan envisages a focus on
consolidation of activities and modest
expansion. It envisions three key
outcomes:
1.4 Impact Study of
Trust Fund Activities
• Increased institutional capacity in
partner countries for advocating/ The impact evaluation of the Water and
promoting and implementing Sanitation Trust Fund was carried out by
pro-poor water and sanitation a team of three international consultants
initiatives and policies with focus on from October 2009 to January 2010. It
gender equity, renewable energy marks the first phase of a plan to regularly
and efficiency and environmental assess the impact of activities supported
sustainability by the Trust Fund, in accordance with
the recommendations of the Trust Fund
• Increased flow of investment into Advisory Board.
water and sanitation sector catalysed
by Water and Sanitation trust fund The Impact Study focused on three
interventions components of the WSTF programme:
Part 1: Synthesis Report 41

• Country impact study on UN- partners. However, it also noted the


need to strengthen the arrangements
HABITAT’s Kenya initiatives for oversight and support for activities
• Country impact study of UN- both at Headquarters and project field
HABITAT’s Nepal initiatives operations in Laos, Nepal, India, Tanzania
and Senegal.
• A global impact study of UN-
HABITAT’s gender operations The audit recommended the development
of a comprehensive Operational Field
The findings of the impact evaluation Manual accompanied with adequate
were presented and discussed during training in all administrative matters,
the sixth session of the WSTF Advisory and that a delegation of administrative
Board meeting held in Nairobi, Kenya responsibilities be established in the areas
on 16 April 2010. Overall, the impact of signing CAs and streamlining and
evaluation concluded that “UN-HABITAT’s improving the approval and execution
project activities on the ground are of most administrative actions currently
making a substantial, strategic and direct delivered through UNON and UNDP.
impact from a relatively small investment.
The projects are good value for money It also recommended the use of a more
and have an impressive leverage effect decentralized approach to improve local
on follow-up and complementary operations, increasing responsiveness
investments.” and quality delivery of services in the field
offices, such as granting of delegation of
The external evaluation will complement authority to project offices by establishing
the findings and recommendations of a regional (or sub-regional) operational
the Impact Study. A review of the Impact framework.
Study reports and interviews with the
former consultants will provide a good
starting point for the external evaluators.
2. The Purpose of the
Evaluation
1.5 OIOS Audit of Trust This Evaluation will contribute to the
Fund Activities refinement, adjusting and improvement of
the Trust Fund’s directions and practices.
OIOS conducted an audit of Water It will also provide useful information for
and Sanitation Trust Fund activities in UN-HABITAT, the Trust Fund’s contributing
August 2009. The overall objective of donors, recipient countries and other
the audit was to assess the adequacy sector stakeholders on what is working
of the arrangement for ensuring that and what is not working well and why. It
water and sanitation project activities will also explore modalities for ensuring
are implemented in accordance with long-term sustainability of the Trust Fund.
the approved project documents and
cooperation agreements (CAs). The specific objectives of this evaluation
are to:
The audit noted that the Trust Fund’s
activities in various countries in Asia and • Assess the extent to which both
Africa were well received and appreciated normative and operational activities
by all major stakeholders, including supported by the Trust Fund in
beneficiaries, local government authorities partner countries has had an impact
and local communities and implementing on individual beneficiaries and
42 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

communities, both in terms of service A. Effectiveness: Extent to which the


coverage and increased skills and objectives of the Trust Fund have been
knowledge base related to water and achieved.
sanitation
• Which activities are potentially most
• Determine the extent to which the effective in contributing to the
UN-HABITAT water and sanitation achievement/non-achievement of
programme is integrated into stated objectives of the Trust Fund,
the national sectoral and donor what are the characteristics of these
coordination mechanisms, including activities and to what extent could
“One UN” processes they have been replicated in other
• Capture the perception of local regions or thematic areas?
counterparts and other partners on • To what extent are the management
the contribution that the Trust Fund is and coordination mechanisms used
making to the sector by UN-HABITAT in supporting the
• Determine the volume of follow- Trust activities effective?
up investments, specifically by the • To what extent is the Trust Fund’s
regional development banks (in monitoring mechanism able to
context of the MoU with UN- effectively measure and present the
HABITAT), realised at the country effectiveness, results and efficiency
level as a result of the Trust Fund’s of the programme and report it to
interventions UN-HABITAT and the Water and
• Show the results of advocacy and Sanitation Trust Fund Advisory Board?
related normative work with regional
B. Efficiency: The optimal transformation
political processes and international
of inputs into outputs.
events in promoting models of good
practice and in raising the profile of • To what extent are funding
pro-poor urban water and sanitation patterns, mechanisms and dynamics
services commensurate with the level of effort
• Assess how sustainable the Trust Fund s and resources expected to achieve
interventions are both at the national the intended results?
and local level including ownership at • To what extent are delivery
the community level mechanisms of activities efficient?
• Document lessons learned, success • What are the most efficient areas of
stories and good practices in order to operation for the Trust Fund activities
maximize the experiences gained (by country, region or thematic area
• Provide recommendations on how of work)?
to build on the achievements of the • Are the ongoing activities cost-
Trust Fund and ensure that they are efficient?
sustained by the relevant stakeholders
• To what extent has UN-HABITAT
In view of the purpose of the Evaluation as efficiently allocated resources
described above, the following issues are between countries and activities?
expected to be important in the design of
the Evaluation C. Impact and Replicability: An
assessment of the changes that can be
attributed to Trust Fund interventions and
Part 1: Synthesis Report 43

the replicability of the Trust Fund approach 4. Scope of the


and results.
Evaluation
• What are the main outcomes of the
normative and operational activities The Evaluation will encompass the entire
supported by the Trust Fund? Trust Fund activities from 2004-2010,
including the Lake Victoria Water and
• To what extent has the Trust Fund Sanitation Initiative and the Mekong
made a significant contribution to Region Water and Sanitation Initiative. It
the strengthening of national and will examine selected cities to validate
local institutional capabilities of the the extent to which the programme has
participating countries? had an impact on individual beneficiaries,
• Can the Trust Fund approach and communities and partner countries. Inputs
results be replicated and scaled up by from cities and local stakeholders will be
national partners? incorporated into the evaluation wherever
possible.
• What role has UN-HABITAT and Trust
Fund donors played to encourage The consultants for the evaluation will
further replication of activities make recommendations on how to
supported by the Trust Fund? improve the operations of the Trust Fund,
keeping in mind the objectives outlined
• What would be the conditions in the previous section.. The consultants
necessary to further replicate Trust will be expected to undertake missions to
Fund interventions? selected cities.
D. Sustainability: An assessment
of the institutional and financial
sustainability of Trust Fund
interventions
5. Evaluation
Methodology
• To what extent was sustainability
considerations taken into account The Evaluation process will require
in the execution and conduct of the a combination of multiple and
Trust Fund’s activities? What steps complimentary approaches. The detailed
have been taken by UN-HABITAT methodology should be outlined in the
to ensure institutional and financial inception report, including approaches
sustainability? to measure impact and defining the
counterfactual (statistical designs, theory
• Are the programme results, based approaches, expenditure mapping,
achievements and benefits likely comparison countries/cities/groups,
to be durable? Are these anchored reconstruction of baseline when baselines
in national institutions and can the are not available, triangulation etc. should
partners maintain them financially at be discussed). Approaches to be used will
end of the programme? include:
• What are the major factors that could
• Desk review of relevant programme
potentially influence the achievement/
documents, including those furnished
non-achievement of sustainability of
by UN-HABITAT
the programme? For example, what
are the current lessons learned? • Briefing meetings and further
discussion with relevant staff
• Interviews with key informants/
44 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

stakeholders/partners at all levels (to


be identified as part of the planning
and implementation arrangements
and should include representatives
from Governments, Utilities, NGOs
and Communities)
• Field and mission visits

6. Evaluation Team
Composition and
selection
It is proposed that the evaluation be
carried out by a team of four international
consultants to be identified and supported
by the Governments of Norway,
Netherlands and Spain. Local consultants
will be selected to work with the
international consultants in Lake Victoria
and the Mekong regions. Responsibilities into account professional expertise and
of the donors in the identification and proven experience in evaluation and
selection of consultants will be as follows: review processes. Gender balance will be
considered in composing the team.
• Government of Norway will select
the Principal Consultant whose The evaluators are required to disclose
responsibility will be the overall in writing any past experiences, of
coordination of the Evaluation. It will themselves or their immediate family,
also select an international consultant which may give rise to a potential
in charge of the evaluation exercise in conflict of interest, and to deal honestly
Africa and Asia. in resolving any conflict of interest
• Government of the Netherlands will which may arise. The evaluators are also
select an international consultant required to familiarize themselves with the
responsible for Lake Victoria and United Nations Evaluation Group Norms,
the Mekong regions. Two local Standards and Code of Conduct for
consultants will also be selected Evaluation in the UN system (attached).
to work in Mekong and Lake
• A programme for visits and
Victoria respectively. The two local
consultation meetings
consultants will work directly under
the supervision of the international • A methodological framework for
consultant responsible for the Lake assessing impact of the country
Victoria and the Mekong regions. programmes, including a draft set of
criteria and indicators
• Government of Spain – will select an
international consultant responsible • Interview protocols for different
for Latin America and the Caribbean. stakeholders, including specific
questions to the Trust Fund
The selection of the consultants will
Management and/or Advisory Board
be on a competitive basis and will take
Part 1: Synthesis Report 45

Annex
2 Analytical Model

The analytical framework seeks to present for how to reach these objectives and how
a structure for the evaluation and the final the programme has utilized and built on
report. The framework suggests that the emerging opportunities.
Water and Sanitation Trust Fund needs
four key abilities to achieve its overall The key questions are:
objective related to policies, organisational
• Is the strategy clear?
processes, partnerships and results. Each
of them covers the usual evaluation * Are key objectives for pro-
criteria, such as effectiveness, efficiency, poor governance, gender
impact, relevance and sustainability. The mainstreaming, replicable model
framework is comprehensive and covers building etc, clearly defined and
more questions and issues than listed understood in the same way?
below, but the most relevant are selected.
We suggest that most attention is given to • Is the current strategy relevant?
the policy, partnership and product/results * Does it address the priority needs
questions and less on questions about of the urban poor?
processes.

Simplified Model

Internal Dimensions External Dimensions


Policies (Relevance) Partnership (Replication,
Leverage)
Processes (Efficiency) Products (Effectiveness,
Sustainability)

POLICIES – THE ABILITY TO


MAINTAIN AN IDENTITY
REFLECTING THE PURPOSE,
COMPARATIVE ADVANTAGE,
VALUES AND STRATEGIES
OF THE WSTF
It is essential to assess first what WSTF
wants to achieve – both in terms of a
long-term vision and more short-term
objectives and targets including its “added
value” compared to other programmes.
It is further crucial to look at the strategy
46 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

* Does it build on UN-HABITAT’s PROCESSES – THE ABILITY


strengths (comparative
advantage)? TO ORGANIZE AND
* Is it technically sound? ESTABLISH EFFECTIVE
* Is it environmentally sound, SYSTEMS AND PROCEDURES
socially acceptable and
sustainable?
AND ENSURE THAT
• Is the strategy well balanced?
HUMAN AND FINANCIAL
* Is there an appropriate balance
RESOURCES ARE AVAILABLE
between building replicable Clear objectives are necessary, but
models versus providing and capacity and capability are also essential in
scaling up services? order to organize and establish effective
systems and procedures for translating
* What is the significance of
objectives into activities and results. The
upstream policy advocacy and
WSTF further require human and financial
development at national and
resources to implement its policies. Lastly,
international level versus local
the “right”staff, appropriate systems and
operational activities?
working methods are needed in order to
* Has the programme effectively achieve a pro-poor, gender and rights-
combined normative and based programme.
operational activities?
The key questions are:
• Is the strategy sufficiently focused?
• Is the Trust Fund an effective
* Are scarce resources spread on
organisational model?
too many countries, thematic
areas and programmes? * What are the strengths and
weaknesses?
* What are the plans for future
expansion/consolidation? • Does WSTF have adequate systems
for planning, monitoring and
evaluation?
Part 1: Synthesis Report 47

* Are priorities realistic and (government, municipalities,


targeted? private sector, NGOs)?
* Are activities adequately * How and on the basis of what
monitored and reported on? principles does WSTF choose its
partners?
* Are evaluations carried out in
order to learn from successes • Are the WSTF programmes
and mistakes? coordinated with other partners
(level of harmonization) and aligned
• Does the programme have an
with country systems and priorities,
effective organisational structure?
national and local programmes?
* Does the organisational structure
• Does WSTF become involved in new
have a clear and effective
areas of work and responds to new
division of responsibilities at all
needs?
levels?
* Is the programme cost efficient?
• Does the programme have access to PRODUCTS – THE ABILITY
sufficient and sustainable resources? TO PROVIDE SERVICES AND
* How much resources have been
mobilized from donors compared
PRODUCTS.
to additional leveraged sources? Last, but not least, good policies,
processes and partners are necessary, but
* Has funding been stable and not guaranteed to make a difference. The
predictable? programme should be able to provide,
measure and document short- and long-
term results.
PARTNERSHIP – THE ABILITY
The key questions are:
TO RESPOND AND ADAPT TO
• Do partners perceive the programme
NEW DEMANDS AND WORK to be relevant and beneficial?
EFFECTIVELY WITH AND • What are the WSTF’s results and
THROUGH PARTNERS achievements in various areas12:?
With limited resources, the WSTF * Beneficiary level
needs a broad range of partners – * Introduction and promotion of
donors to provide financial resources, innovations/models
technical partners to provide advice and
coordinating and implementing partners. * Normative tools (e.g. manuals
In order to succeed as a catalytic and and guidelines) developed,
innovative initiative, the selection of disseminated and utilized
partners is crucial.
* Evidence of replication
The key questions are: * Awareness and policy impact
• Does the programme have the right • What is the potential for future
partners? sustainability?
12 It is important to keep in mind that the results are not
* What are the main partners global aggregates, but to a large extent builds on the in
depth thematic and geographic studies in this evaluation.
48 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

3 Overview of Programme
Annex

Background for pro-poor investments and in WATSAN


issues in developing countries.
UN-HABITAT’s overarching aim is “to
ensure an effective contribution to
sustainable urbanization”. In the area
of Water and Sanitation, the goal is to Description of the
contribute to the achievement of the Programme
internationally-agreed goals related
to water and sanitation in human 1. Regional Operational
settlements, with particular focus on Programmes:
the urban poor in order to facilitate
an equitable social, economic and UN–HABITAT started out with quite a
environmental development (Kenya Impact broad basis and geographical reach for
Study Report, 2010, 7). its activities in the WSTF. The Trust Fund
supports three regional programmes:
More specifically, the target is “to reduce Water for African Cities (15 countries),
by half the proportion of people without Water for Asian Cities (five countries) and
sustainable access to safe drinking water Water for Cities in Latin America and the
and sanitation by the year 2015”. To Caribbean (WatSan-LAC, five countries,
reach this target, UN-HABITAT seeks to See Annex 5). The stated objective of the
support developing countries’ access to regional programmes is to support partner
environmentally sound basic infrastructure countries to improve management of
and services with a special focus on the urban water supply and sanitation.
un-served and under-served populations.
These programmes combine policy
In 2002, The Water and Sanitation Trust dialogue and normative work with on-the-
Fund (WSTF) was established, with the ground pilot and demonstration water and
overall aim of helping governments to sanitation projects focusing on pro-poor
meet their commitment to the water water and sanitation service delivery. In
target of the Millennium Development short, they represent a mix of operational
Goals (MDGs). The decision to arrange and normative activities. The regional
programmes have a multi-faceted strategy
activities through the mechanism of a
to programme formulation but mainly
Trust Fund was meant as a means to serve
target poverty pockets in large urban areas
as “a fast track mechanism for reaching
and medium sized cities, as well as large
out to the urban poor”.
rural areas with urban characteristics.
In this sense, it was thought that the Trust
Overview of the thematic areas:
Fund would be a bridge to access benefits
from city-wide improvements and offer Water for African Cities (Now in Phase
contributors an opportunity to target a II), focuses on the following six key
high-priority sector with maximum impact thematic areas and activities:
by taking advantage of the mandate and
demonstrated core competencies of UN- • Pro-poor governance and follow-
HABITAT (Trust Fund Info Brochure, 2004, upImproved sanitation for the urban
2). Another main objective of the Trust poor
Fund is to create an enabling environment
• Urban catchment management
Part 1: Synthesis Report 49

• Water demand management the programme then rolls out at city level,
lastly, through information and knowledge
• Water education in schools and
sharing, the so-called ‘consolidation
communities
and dissemination phase’ ensures the
• Advocacy, awareness-raising and anchoring of the enhanced capacity at city
information exchange and regional levels (UN–HABITAT Internal
Impact Assessment and Performance
Similarly, the Water for Asian Cities Review of the Water for African Cities
focuses on the following thematic areas Programme, Phase II, 2010, 8-9)
and activities:
The various countries are however at
• Pro-poor water and sanitation different levels of their activity stages for,
governance while India is in the process of completion,
• Urban water conservation and the programmes in Latin America are
demand managementIntegrated in early stages of development and
urban environmental sanitation implementation, having only been initiated
in 2007.
• Income generation for the urban poor
through community-based water 2. Replicable Initiatives
and sanitation services (WAC Annual
Report, 2009, 2). In addition to the regional programmes,
there are “Special replicable model
The WAC programmes seek to achieve setting initiatives”. The latter supports
their main objectives by mobilizing political the adoption of a “learning by doing
will; raising awareness through advocacy, approach” that combines investment
information and education; providing in physical infrastructure with capacity-
training and capacity building, promoting building activities (UN-Habitat Strategic
new investments, demonstrating Plan, 2008-2002, 43).
innovative approaches and monitoring
progress towards the achievement of One example is the Lake Victoria Regional
MDGs (WAC Annual Report 2009, 2). Initiative (LVWATSAN), a joint project
involving UN- HABITAT, the Governments
The idea is to use a top-down approach of Kenya, Tanzania, Uganda, Rwanda
to encourage and support national and Burundi. The initiative is designed
governments in the development of as a model to support partner countries
policies, regulations and legal frameworks, and local authorities to achieve MDGs
and a bottom-up approach to build through relatively modest investment in
capacity in local authorities to encourage infrastructure rehabilitation and capacity
institutional development. WAC has been building in urban centers around the Lake
designed with the ambition of scaling up Victoria region. The other replicable model
and replicating at country levels, as such, setting initiative is the Mekong Region
has focused on cooperation agreements Water and Sanitation Initiative, which is
with national partners, regional and operational in four countries (China, Lao
financial institutions. PDR, Vietnam, and Cambodia). The latter
similarly targets poverty pockets in urban
The initial phase concentrates on sharing areas and middle sized cities.
knowledge, raising awareness and
exchanging information, followed by A key component of the above initiatives
the formulation phase, to get attention is capacity building and training at local
from national and local stakeholders. An level. Consultations with the communities
implementation and investment phase of and multi stake holder approaches
50 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

ensures ownership of the process, both and South East Europe. In short, GWOPA
at political and community participatory can be described as being a broker,
level. Further activities include advocacy, advocate and networker.
awareness raising and information
exchange, values-based water education, Normative Activities
gender mainstreaming and demonstration The regional operational programs and the
activities. replicable initiatives are complementing
elements and the combination of them
A main feature of the replicable initiatives facilitates the achievement of the water
is also the emphasis on immediate and sanitation MDG targets. The two are,
interventions with the aim of making however, underpinned by a number of
quick fixes yet providing significant cross-cutting activities, some of which are
enhancements in WATSAN services developed through these activities.
provision. This is done by fast-tracked
rehabilitation and implementation of cost- Among them are normative activities,
effective measures that arguably make a monitoring and evaluation activities as
crucial difference to the service provision. well as other initiatives as described below
The latter is also beneficial for the poor. (Mid-Term Review, 2007, 8). Normative
The rationale of replicable initiatives is to activities supported by the Trust Fund
serve as pre-investment interventions so as provide a neutral forum for policy dialogue
to be followed by larger- scale investments among water and sanitation providers,
by donors or by regional or international users, utilities and governments. There
financial institutions. are various activities that can be described
as normative; however, the over-arching
3. Water Operators’ theme for the normative activities is pro-
Partnerships poor governance work.

The decision to establish the Global Water Pro-Poor Governance Work The
Operators’ Partnerships (GWOP) Alliance phenomenon of pro-poor governance
mechanism originates from concerns refers to supporting change in
about missing water and sanitation governance, so that low-income people
targets in the MDGs. The GWOP Alliance in poor communities are given a voice
was launched during the World Water in collective decision-making leading
Week in Stockholm in 2007, with the to improved access to for example
goal of providing a basis for collaboration good quality drinking water and basic
among water and sanitation operators sanitation. This is done by directly
and other stakeholders - civil society, effecting policy, regulatory, legal and
NGOs, regulators, financial institutions institutional instruments, and indirectly
and research facilities in order to help spurring pro-poor follow-up investment
support operators who deliver water (i.e. investments targeted to improve
and sanitation services to improve their service delivery and coverage for the
performance. poor) in water and basic sanitation to
benefit those without access (UN–
This is done by sharing information, HABITAT Internal Impact Assessment
promoting effective tools and experiences and performance review of the water for
and establishing a web-based platform to African Cities Programme, Phase II, 2010,
facilitate sharing and exchange of lessons 10).
and experience for water operators in
Africa, Arab countries, Asia and the This also includes disseminating
Pacific, Latin America and the Caribbean information on water and sanitation
issues and developing pro-poor and
Part 1: Synthesis Report 51

gender sensitive governance frameworks, Plan of Implementation (JPOI) targets.


including policy options, norms, standards The activities include liaison with WHO/
and management toolkits which include UNICEF Joint Monitoring Program (JMP) in
but are not limited to pricing policy, streamlining definitions for the monitoring
water demand management, rainwater indicators for targets 10 and 11 of the 7th
harvesting, advocacy, education and so MDG. They also include the development
on. of GIS-based methodologies for poverty
mapping and for tracking progress
As part of its normative work, UN- towards the MDGs.
HABITAT has disseminated a large amount
of information with global reports having Other cross-cutting activities that
been published on the themes: “Water underpin the regional operational work
and Sanitation in the World’s Cities:  Local and the replicable model initiatives are
Action for Global Goals 2003”, “Financing water demand management (WDM),
Urban Shelter” (2005), “Meeting the urban catchment management and
Development Goals in Small Urban values-based water (now water, sanitation
Centres: Water and Sanitation in the and hygiene WASH) education. In South
World’s Cities 2006” and “Solid Waste Asia, pro-poor sanitation is a separate
Management in the World’s Cities: Water theme (Mid Term Review, 2007, 10).
and Sanitation in the World’s Cities 2010”.
Water Demand Management (WDM)
A major contribution in global efforts is aimed at reducing the high levels of
to manage human waste, wastewater unaccounted-for water and high water
sludge and biosolids sustainably was losses experienced in urban areas. In other
made in September 2008 when UN- words, WDM is an approach designed
HABITAT published the ‘Global Atlas of to positively influence water-use and
Excreta, Wastewater Sludge, and Biosolids contribute to effective water governance.
Management: Moving Forward the WDM strategies and tools allow for
Sustainable and Welcome Uses of a Global efficient, equitable and sustainable use
Resource.’ UN-HABITAT also contributes of water, improving cost-recovery and
to the World Water Development Report.  facilitating the extension of existing
Further, as members of the UN-Water supplies to the urban poor, rather than
Wastewater Management Task Force, embarking upon the expensive option of
UN-HABITAT and the United Nations developing new resources.
Environment Programme (UNEP)
launched a rapid assessment report Urban Catchment Management
entitled ‘Sick Water: The Central Role of refers to an integral component of
Wastewater Management in Sustainable Integrated Water Resources Management,
Development’ during the global incorporating not only water quality and
celebrations of the 2010 World Water quantity perspectives, but socio-economic
Day in Nairobi, Kenya.  development and ecological integrity
aspects as well. The aim is to protect
Lastly, a triennial report series on ‘Water and secure water resources in the urban
and Sanitation in World’s Cities’ as well catchment, and better co-ordinate water
as contributions towards selected global management with upstream/downstream
level activities, including the World users.
Development Report has been published.
To achieve this aim the WAC II programme
Monitoring and Evaluation Activities has developed and implement strategies,
focus on progress towards achievement including livelihood programs, which
of WATSAN related MDG/Johannesburg
52 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

would directly improve the living Another normative focus is Pro-poor


conditions of the poor. Accordingly Sanitation, which comprises sustained
therefore, it applies the principles of access to, and maintenance and use of
integrated water resources management safe excreta facilities by all members of the
(IWRM). poor and poorest families. Sometimes, the
promotion of safe human excreta disposal
Values-based Water Sanitation and and solid waste disposal in other parts of
Hygiene Education seeks to create a new the city is included.
ethic among children, utility staff and the
community-at-large on the sustainability Three more areas of activity were added
and cost of water supplies through water, during the Third Advisory Board meeting
sanitation and hygiene education - ‘Using in January 2007: addressing the operation
the value-based approach brings in and regulation needs of water and
changes in people’s perceptions of water sanitation utilities; exploring the linkages
and sanitation, and attitudes towards between energy, water and sanitation
water usage and hygienic living, and and the focus on water and sanitation as
proper utilization’ (HVWSHE Brochure). a strategic entry point to slum upgrading
and financing of urban development of
The programme was requested by a the poor (Mid-Term Review, 2007, 11).
Ministerial Advisory Group of six countries
during a WAC meeting in 2000. The Capacity Building and Gender
approach was participatory from the start. Mainstreaming are cross-cutting
Ministers and high-level staff involved elements of the programme. The Training
in curriculum development took part in and Capacity Building Programme
the formulation and planning in both was initiated in the first phase of
Africa and Asia. In South-East Asia, a WAC Programme, in response to a
joint declaration in support of values recommendation of the Ministerial
based education in water and sanitation Advisory Group meeting in The Hague
has been issued by the Ministers of in 2000. In short, it involves assistance
Education of the region, and UN-HABITAT to local authorities and civil society
has a cooperation agreement with the organizations to build core skills in
South-East Asia Ministers of Education competencies in diverse areas including
Office (SEAMEO) and has developed the leadership, financial management, local
initiative. economic development, participatory
planning and conflict management.
Advocacy, Awareness Raising and Topics have included Water Demand
Information Exchange This component Management, Pollution Prevention and
entails support to regional communication Control and Water Awareness.
and media with the aim to encourage
behavioral changes in people’s attitudes On the Technical supply side, capacity
regarding pro-poor governance, water building has been aimed at utility
demand management, improved staff at various levels, policy makers,
sanitation gender mainstreaming, and local authorities and politicians but
so on. It also seeks to promote the some activities also target WSTF’s
programme so as to influence national own programme staff as well as
policy and gain political will and also to those of partner NGOs. In the utilities,
sensitize local communities and mobilize capacity building has targeted middle,
their participation (WSTF Info Brochure senior and top-level staff. Capacity
2004, 7). building programs have incorporated
a participatory and applied approach,
Part 1: Synthesis Report 53

starting with an introduction, followed by effective use of social capital, formation


subject specific sessions, lastly, design of and strengthening of self-help groups and
action plans to improve local conditions. participation in project development and
implementation (Mid-Term Review, 2007).
On the demand side, the programme
entails subjects such as nurturing the

Annex 5. Regions, countries and cities under the WAC Program

Region Country Cities Program


East Africa Ethiopia Addis Ababa, WAC I+II
Harar, Dire Dawa WAC II
Kenya Nairobi, WAC I + II
Kisii, Kisumu, Homa Bay LVWSI
Mozambique Maputo WAC II
Rwanda Kigali WAC II
Tanzania Dar-e-Salaam WAC I + WAC II
Bukoba, Muleba, LVWSI
Uganda Kampala WAC II
Masaka, Kyotera LVWSI
Zambia Lusaka WAC I + II
West Africa Burkina Faso Ouagadougou WAC II
Cameroon Douala, Yaounde WAC II
Ghana Accra WAC I+II
Ivory Coast Abidjan WAC I+II
Mali Bamako WAC I+II
Nigeria Jos WAC II
Senegal Dakar WAC I + II
South Asia India Bhopal, Indore, Jabalpur, Gwalior WAC
Nepal Kathmandu Valley Peri-Urban Communities, WAC
other municipalities and small towns*
South East Asia
Lao PDR Luang Prabang, Sayabouly, Phine, and 12 WAC +MRWSI
towns in the northern-central region including
Vientiane
China Nanjing, WAC +MRWSI
Puer, Jinhong
Cambodia MRWSI
Vietnam Cam Ranh, Ca Na, Gia Nghia, Thap Cham, WAC +MRWSI
Song Cau
Latin America and the Mexico, Peru, Choco(Colombia),Patacamaya and Cochabamba WATSAN-LAC
Caribbean Colombia, Bolivia, (Bolivia)
El Salvador

LVWSI=Lake Victoria Water and Sanitation Initiative; MRWSI= Mekong Region Water and Sanitation Initiative; WAC-I=First Phase of
Waster for African Cities; WAC-II=Second Phase of Water for African Cities: WAC-Water for Asian Cities.
*20 projects in a total of 7 municipalities, 3 small towns and 4 R4 cities, mostly connected with the ADB program
54 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Resource Materials
Annex

4 and Conferences

General UN-HABITAT and WaterAid, undated.


Baseline survey: Analysis of the baseline,
UN Habitat Water and Sanitation Trust conditions in the poverty pockets, Bhopal.
Fund Strategic Plan, 2008-2012 (2008). Bhopal: UN-HABITAT and WaterAid
Nairobi, Kenya
WaterAid India, undated. Slum
Office of International Oversight Services environment Sanitation Initiative: Progress
(OIOS) (2009). Audit of water and Report. Bhopal: Water Aid India, Regional
sanitation trust fund activities in the Office West
United Nations Human Settlements
Programme Mahila Chetna Manch, undated. Training
of women SHG leaders on water and
UN-HABITAT (2010).Kenya Country Impact sanitation management under gender
Study, Nairobi, Kenya mainstreaming strategy initiative for Water
for Asian Cities Programme. Module.
UN-HABITAT (2010). Nepal Country Impact Bhopal, MP, India: Mahila Chetna Manch
Study, Kathmandu, Nepal and New Delhi: UN Habitat
UN-HABITAT Sixth Meeting of the Advisory Mahila Chetna Manch, 2006. Training
Board (2010). Nairobi, Kenya Workshops for gender mainstreaming
in WAC programme in four cities of MP,
UN-HABITAT Water and Sanitation Trust
India. Bhopal, Mahila Chetna Manch and
Fund (2009). Financial Progress Report and
UN-Habitat
2010 Budget, Nairobi, Kenya

Wright, A., Naranyanan, R. Sijbesma, C Program Reports Latin


(2007). Report of Mid Term Review of the America
Operations of the Water and Sanitation
UN – HABITAT(2010) Water and Sanitation
Trust Fund
in the Latin America and the Caribbean
UN-HABITAT (2009). Water for Asian Cities
UN-HABITAT and UN-WWAP (2010).
(WAC) Water & Sanitation Trust Fund
Water for Sustainable Urban Human
Annual Report
Settlements – Joint Publication
UN-HABITAT (2008). Water for Asian Cities
UN-HABITAT (2008). Sanitation: A Human
(WAC) Water & Sanitation Trust Fund,
Rights Imperative
Annual Report
UN-HABITAT (2007). Manual on the Right
UN-HABITAT (2004). Water & Sanitation
to Water and Sanitation
Trust Fund, Information Brochure
UN-HABITAT (2006). Social Marketing of
Programme Reports Africa
Sanitation
Harar Water & Sewerage Authority,
Framework of Action for Meeting MDGs
Project Completion Report Small Scale
in Asia-Pacific Region - Outcome of
Community Based Water Supply and
APMCHUD-I, 2006
Sanitation Improvement Project for
Dehoch Community in Harar (2009).
Part 1: Synthesis Report 55

Issue Paper on Water, Sanitation and UN-HABITAT, Mahila Chetna Manch


Human Settlements, WUF3, Vancouver, Bhopal and the Government of MP -Water
2006 for Asian Cities (2006). Madhya Pradesh,
India, Mainstreaming Gender, Water and
UN-HABITAT (2005).Blue Drop Series on Sanitation, Strategy and Action Plan
Rainwater Harvesting - Policy Makers – I
Policy Paper 1, undated, UN - Habitat and
UN-HABITAT (2005).Blue Drop Series on Directorate of Urban Administration and
Rainwater Harvesting - Capacity Building Development, Government of Madhya
– II Pradesh, Community Managed System For
Operation, Billing & Collection of Water
UN-HABITAT (2005). Blue Drop Series
Charges
on Rainwater Harvesting - Implementing
Agencies – III Policy Paper 2, undated, UN - Habitat
and Directorate of Urban Administration
Publications Regional and Development, Government of
Madhya Pradesh, Measures for Ensuring
UN-HABITAT (2005).WAC Programme
Sustainability of Rainwater Harvesting
Brochure
Policy Paper (2006). UN – Habitat, Bhopal
UN-HABITAT (2003). WAC Programme
Municipal Corporation and Water Aid,
Brochure, 2003
Poverty Mapping-A
UN-HABITAT (2003). WATER - Public
Situational Analysis of Poverty Pockets in
Awareness Campaigns
Bhopal
UN-HABITAT (2003). WATER - Training and
Policy Paper (2006). UN – Habitat, Indore
Capacity building
Municipal Corporation and Water Aid,
Publications Asia Poverty Mapping-A Situational Analysis of
Poverty Pockets in Gwalior
Water for Asian Cities (WAC) Programme
and Mekong Region Water and Sanitation Policy Paper (2006). UN – Habitat, Bhopal
Initiative (MEK-WATSAN). Vision and Municipal Corporation and Water Aid,
Strategy-2008-2012. Poverty Mapping-A Situational Analysis of
Poverty Pockets in Indore
Water for Asian Cities –Annual Report
South Asia (2010) UN-HABITAT and Government of Madhya
Pradesh (2006). Guidelines on Revolving
WaterAid India (2009). Baseline Survey Funds for establishing guidelines for
- Status of Water and sanitation in the revolving fund on Community Managed
Slums of Bhopal (AIF CIF component of Water Supply Schemes and Construction
Project Uday) of Household Toilets in Urban
Slums,Madhya Pradesh, India
WaterAid India (2009). Baseline Survey
- Status of Water and sanitation in the UN –HABITAT and Water Aid, undated,
Slums of Gwalior (AIF CIF component of Slum Environmental Sanitation Brochure
Project Uday)
Global Reports
WaterAid India (2009). Baseline Survey
- Status of Water and sanitation in the UN-HABITAT (2003). Water and Sanitation
Slums of Indore (AIF CIF component of in the World’s Cities:  Local Action for
Project Uday) Global Goals
56 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

UN-HABITAT (2005). Financing Urban Social Marketing of Sanitation (2006).


Shelter
Guidelines and Standards
UN-HABITAT (2006). Meeting the
Development Goals in Small Urban A Guidebook for Local Catchment
Centres: Water and Sanitation in the Management in Cities (2005).
World’s Cities
Human Values-based Water, Sanitation
UN-HABITAT (2010). Solid Waste and Hygiene Classrooms: Facilitators and
Management in the World’s Cities: Water Trainers Guide Book (2006).
and Sanitation in the World’s Cities
Human Values-based Water, Sanitation
Annual Reports and Hygiene Classrooms: Facilitators and
Trainers Guide Book (2006).
Water & Sanitation Trust Fund 2009,
Annual Report A practical Method for Rapid Assessment
of the Bacterial Quality of Water, a field
Water & Sanitation Trust Fund 2008, based guide (2010).
Annual Report
Global reports
Water & Sanitation Trust Fund Strategic
Plan (2008-2012) Water and Sanitation in the World’s Cities: 
Local Action for Global Goals 2003
Water & Sanitation Trust Fund 2006,
Annual Report Financing Urban Shelter (2005).

Water & Sanitation Trust Fund 2004, Meeting the Development Goals in Small
Information Brochure Urban Centres: Water and Sanitation in
the World’s Cities (2006).
Toolkits and Source Books
Solid Waste Management in the World’s
Rainwater Harvesting and Utilisation, Blue Cities: Water and Sanitation in the World’s
Drop Series, Book 1: Policy Makers (2005). Cities (2010).

Rainwater Harvesting and Utilisation, Blue Global and Regional Conferences


Drop Series, Book II: Beneficiaries and
Capacity Builders (2005) Conferences initiated and coordinated
by WSTF:
Rainwater Harvesting and Utilisation, Blue
Drop Series, Book III: Project Mangers and 1st Meeting of East African Community
Implementing Agencies (2005) Ministers of Water and the Development
partners of the UN-HABITAT Lake Victoria
The World of Water - African Adventures Region Water and Sanitation Initiative,
of a Water Drop (2005). Nairobi, Kenya, Kenya, (2008).

Navigating Gender in African Cities: Ministerial Conference on “Scaling Up of


Synthesis Report of Rapid Gender and the Lake Victoria Water and Sanitation
Pro-poor Assessments in 17 African Cities Initiative” Entebbe, Uganda, 22 – 23 April
(2006). 2000

Framework for Gender Mainstreaming in Conferences with significant technical


Water and Sanitation for Cities (2006). inputs from WSTF:
Part 1: Synthesis Report 57

African Water Weeks (26-28 March 2008, Global and Regional


Tunis, Tunisia; 09-13 November 2009, Processes and Events
Johannesburg, South Africa; Addis Ababa,
Ethiopia, 22-26 November 2010) African Ministers Council on Water
(AMCOW) Meetings.
15th International African Water
Congress, due to take place in Kampala Asia-Pacific Ministerial Conference
from the 15th– 18th March 2010 on Housing and Human Settlements
meetings.
3rd Arab Countries Water Utilities
Association (ACWUA) Best Practice Major Global and Regional
Conference and Exhibition - Non-Revenue Training and Capacity
Water Management in the Arab Region Building Activities
(Jan. 2010).
Training modules and approaches for
Commission on Sustainable Development thematic priorities:
World Water Forum Training modules on Utility Management
under Fast Track Capacity Building
WSSCC Global Forum, Dakar Senegal: 29
Programme of Lake Victoria
November – 5 December 2005
Water and Sanitation Initiative
UN Conference on Small Island Developing
Training modules under the Training and
States (SIDS): 10-15 January 20005
Capacity Building Programme of Water for
6th Global Forum and International African Cities Programme
Innovation Exhibition (InnoEx 2005): Seoul,
Korea 22-28 May 2005 Global/regional Training
Events
World Toilet Summit 2007 (WTS-2007)
- organised by the Sulabh International Capacity Building Workshop on
Social Service Organisation from 31st Partnerships for Improving the
October to 3rd November 2007 in New Performance of Water Utilities in the Africa
Delhi Region (Nairobi, 6-8 December 2006)

UN-Water (Global) meetingsGlobal Regional Media Workshop from 11-12


commemoration of World Water Day December 2006 in New Delhi, India
2010 (22 March)
South-South Collaboration for Training
World Water Week in Stockholm – and Capacity building on innovative
2005/2006/2007/2008/2009/2010 Sanitation Technologies, collaboration with
Sulabh International - November 2006
Singapore International Water Week 28 -
June – 02 July 2010 A capacity building workshop for
Journalists from Iran and other CIS
The Pacific Water Conference & Expo Countries in partnership with the United
(PWC), Port Moresby, Papua New Guinea Nations University UNW-DPC (Bonn,
from 13 to 15 September, 2010. Germany) and the Regional Centre for
Urban Water Management (under the
auspices of UNESCO) in Tehran from 26-
28 November 2007.
58 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Water Safety Plan Training in Morocco - Sanitation and Energy, (2009).


20-21 Jan. 2010 (Rabat, Morocco)
Sanitation: A Human Rights Imperative,
Research Initiatives Supported (2008).
by WSTF
Manual on the Right to Water and
Energy audit exercise for water and Sanitation, (2007).
sanitation service providers in sub-Saharan
Framework of Action for Meeting MDGs
African and Asian cities.
in Asia-Pacific Region - Outcome of
Climate vulnerability analysis and APMCHUD-I, 2006
infrastructure assessment for the
HIV/ AIDS Checklist for Water and
catchment area and associated rivers of
Sanitation Projects, (2006).
Lake Victoria.
Strategy for Addressing HIV/ AIDS, (2006).
Water for Asian Cities
Programme Issue Paper on Water, Sanitation and
Human Settlements, WUF3, Vancouver,
Annual Report 2009 – South Asia, 2010 (2006).
Local Actions for Sustainable
Brochures
Development, 2007
WAC Programme Brochure (Spanish
Proceedings of WAC Regional
language), (2006).
Consultations in New Delhi, 2002
WAC Programme Brochure, (2005).
Water for Sustainable Urban Human
Settlements – Joint Publication of UN- WAC Programme Brochure, (2003).
HABITAT and UN-WWAP, 2010
WATER - Public Awareness Campaigns,
Framework for the Pacific WASH Coalition, (2003).
(2009).

Asian Sanitation Data Book 2008 -


Achieving Sanitation for All, (2009).
Part 1: Synthesis Report 59

Annex
5 Self Assessment Survey

SUMMARY: The evaluation included a 51.9 per cent agreed and 25.9 per cent
self-assessment among UN-HABITAT’s strongly agreed. Respondents were also
staff and partners. The team developed asked if the programme is well focused -
a questionnaire on the web using the on a few thematic and geographic areas
software “Survey Monkey” for the - and a majority of 74.1 per cent said that
distribution of questions. The Team it was.
followed up with three reminders but
the response was not overwhelming. The HUMAN RESOURCES: Perhaps
following represents a brief summary of unsurprisingly, the programme is thought
the main findings. to have the right staff and expertise (48.1
per cent agreed), while 33.3 per cent
UN-HABITAT’s staff and partner perceived the staff composition to be
organizations are based in Africa, Latin gender balanced and 29.6 per cent did
America and Asia. In this survey,44.4 not know.
per cent of the implementing partners
have responded and 25.9 per cent are ORGANIZATIONAL PROCESSES: On the
UN-HABITAT staff, while 22.2 per cent are question of timeliness, there is scope for
government partners (UN-HABITAT Focal improvement, as 29.6 per cent disagreed
Point, City Managers). Not surprisingly, and 7.4 per cent strongly disagreed that
an overall finding is that UN-HABITAT is projects are carried out in a timely manner.
considered a valued partner as 34.6 per Another important area is monitoring,
cent strongly agreed that WSTF has a which a majority of 59.3 per cent agreed
strategy which helps to clarify priorities, is satisfactory and 25.9 per cent strongly
while 46.2 per cent agreed. agreed.

POLICY AND STRATEGY: Some 37 per FINANCIAL RESOURCES: As regards


cent of the respondents found that key financial resources, there
terms like pro-poor governance, replicable appears to be slightly more variation
model setting and so on are clearly as 37 per cent agreed that effective
defined in the strategy while 18.5 per cent financial systems are in place, while 14.8
didn’t know. Evaluating the need for a per cent strongly disagreed and 11.1
change in direction, 37 per cent disagreed, per cent disagreed. Similarly, only 22.2
while 29.6 per cent agreed that a change per cent agreed that funds are available
or adjustment is needed. Just over half when needed for planned activities while
of the respondents, or 51.9 per cent, as much as 33. 3 per cent disagreed and
strongly believed that the programme 18.5 per cent strongly disagreed.
addresses the needs of the urban poor,
PARTNERSHIPS: The perception of the
and only 7.4 per cent disagreed. A total
survey respondents regarding partnerships
of 48.1 per cent of respondents also
is that the programme works effectively
agreed that the programme interventions
with NGOs, private sector and local
are technically sound while 7.4 per cent
government/municipalities as only 4.2
disagreed and 11 per cent didn’t know.
per cent disagreed with this statement.
A majority of respondents answered that
A majority perceived the programme to
the programme does well on combining
be owned by and anchored in national
normative and operational activities as
government as well as incorporated in
60 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

national W&S sector plans. The results are relatively positive regarding
sustainability as well as 43.5 per cent
RESPONSIVENESS: As regards answered that they agree that programme
responsiveness, 43.5 per cent thought the results and benefits are likely to be
programme has expanded and become durable, while 43.5 per cent strongly
involved in new areas of work while 43.5 agreed.
per cent didn’t know. On the question
of whether an exit strategy has been KEY RESULTS: There appears to be a
prepared, 75 per cent do not know. general and relatively strong belief that
the programme is relevant and beneficial.
On RESULTS AND IMPACT, 54.2 per cent Respondents in general perceiveD UN-
of the respondents also indicated that HABITAT to be a valued partner, with
the programme is innovative and 37.5 a focused programme that addresses
per cent strongly agreed. Some 43.5 per the needs of the urban poor and which
cent believed that the programme has has a good balance of activities that are
contributed to changes in national policy contributing to achieving the MDGs.
while 30.4 per cent do not know. Half of
the answers suggest that the programme
has created visible results at the level of
beneficiaries.

What is your position

50%
44.4%

40%

30%
25.9%
22.2%

20%

11.1%
10%

0
UN-HABITAT Staff Coordinating/ Government Funding partner
implementing partner (UN-
partner HABITAT Focal
Point, City
Manager
Part 1: Synthesis Report 61

WSTF has a atrategy which helps to clarify priorities (what to do)?


50%
46.2%

40%
34.6%

30%

20%
15.4%

10%
3.8% 3.8%
0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

There is a need to adjust or change direction


50%

40% 37.0%

30% 29.6%

20%
14.8%
11.1%
10% 7.4%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

The programme interventions are technically sound


50% 48.1%

40%

29.6%
30%

20%

11.1%
10% 7.4%
3.7%
0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
62 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

The programme addresses priority needs of the urban poor

60%

51.9%
50%

40%
33.3%
30%

20%

10% 7.4% 7.4%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

The programme is well focused (on a few thematic and geographic areas)

80%
74.1%
70%

60%

50%

40%

30%

20%
14.8%

10% 3.7% 7.4%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
Part 1: Synthesis Report 63

The programme combines well normative and operational activities

60%

51.9%
50%

40%

30%
25.9%

20%

11.1%
10% 7.4%
3.7%
0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

Attract people with relevant experience and professional skills


50% 48.1%

40%

29.6%
30%

20%
14.8%

10%
3.7% 3.7%
0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

Ensure that staff composition reflects a fair gender and equity policy
50%

40%
33.3%
29.6%
30%
22.2%
20%

10% 7.4% 7.4%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
64 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

Carry out plans and projects in a timely manner


50%

40% 37.0%

29.6%
30%

20% 18.5%

10% 7.4% 7.4%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

Monitor and report on activities

60% 59.3%

50%

40%

30%
25.9%

20%

10% 7.4%
3.7% 3.7%
0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
Part 1: Synthesis Report 65

Resources are effectively leveraged from partners (Governments, Banks, etc.)

60%
55.6%

50%

40%

30%

20% 18.5% 18.5%

10% 7.4%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

Funds are available when needed for planned activities


50%

40%
33.3%
30%

22.2%
20% 18.5%
14.8%
11.1%
10%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
66 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

The programme is owned by and anchored in national governments


50%

41.7%
40%

30%
25.0% 25.0%

20%

10% 8.3%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

The programme works effectively with local government/municipalities


50%
45.8%
41.7%
40%

30%

20%

10% 8.3%
4.2%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
Part 1: Synthesis Report 67

The programme has expanded and become involved in new areas of work
50%
43.5%
43.5%
40%

30%

20%

10% 8.7%
4.3%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

The programme is incorporated in national W & S sector plans


50%
44.0%
40% 36.0%

30%

20% 16.0%

10%
4.0%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
68 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

The programme has been innovative

60%
54.2%

50%

40% 37.5%

30%

20%

10% 8.3%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

An exit strategy is prepared

80%
75.0%

70%

60%

50%

40%

30%

20%
12.5%

10% 8.3%
4.2%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
Part 1: Synthesis Report 69

The programme has been replicated in other settings


50%
45.8%

40%
33.3%
30%

20.8%
20%

10%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

The programme has contributed to changes in national policy


50%
43.5%
40%

30.4%
30%

20% 17.4%

10% 8.7%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
70 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

The programme has contributed to achieving the W & S MDG targets


50% 47.8%

39.1%
40%

30%

20%
13.0%
10%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

The programme has created visible results at the level of beneficiaries

60%

50.0%
50%

40%
33.3%
30%

20%
12.5%

10%
4.2%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
Part 1: Synthesis Report 71

The programme provides assistance in ways that support self-sustaining local


organizations
50%
41.7%
40% 37.5%

30%

20.8%
20%

10%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree

The programme results and benefits are likely to be durable


50%
43.5% 43.5%
40%

30%

20%
13.0%
10%

0%
Strongly Disagree Agree Strongly Agree Don’t know
disagree
72 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

6 Summary of Country Studies


Annex

The following present some of the main targeting peri-urban areas, informal
findings and conclusions from the four settlements and slum areas that are
regional/country studies. frequented by many people on a daily
basis and often neglected by authorities.
Programmes in India are, however, more
advanced than is the case in Ethiopia.
ETHIOPIA AND INDIA
Introduction Products and Services

The main objective of the Water for Under the umbrella of WAC in
African Cities is to tackle the urban water Ethiopia, public water points have been
crisis through efficient and effective water constructed, serving an estimated number
demand management, build capacity of 5,400 people. Moreover, 15 rainwater
to mitigate the environmental impacts harvesting tanks have been constructed as
of urbanization on freshwater resources well as public toilet complexes. In addition,
and boost awareness and information awareness raising, training and water and
exchange on water management and sanitation education has been carried
conservation. In Ethiopia, implementation out in schools, in poor communities and
of WAC II started in 2005. The among policy decision-makers.
programmes in Ethiopia are focused
on improving sustainable water and
sanitation services in informal settlements
in peri-urban areas, raising awareness and
water and sanitation education.

In India, The Water for Asian Cities


Programme (WAC) is a collaborative
initiative of UN-HABITAT, the Asian
Development Bank (ADB) and the
Government of India. The programme
was launched in March 2003. The
stated objective is to promote pro-poor
investments in water and sanitation to
support MDGs in Asian cities, specifically
promoting pro-poor governance, water
demand management, increased attention
to environmental sanitation and income
generation for the poor linked to water
supply and sanitation.

Policies and Strategy/


Relevance
The programme in both countries
addresses the needs of the poor by
Part 1: Synthesis Report 73

In India, UN-HABITAT, under the WAC, had an impact on local and national level.
is supporting initiatives in four cities. The Gender Mainstreaming Strategy and
The pivotal activities relate to urban the Rapid Gender Assessment formulated
environmental sanitation, pro-poor water for the WAC has been adopted and
and sanitation governance, water demand approved by the government of MP for
management, gender mainstreaming use at local level in 2007.
and capacity building by involvement
of communities. In terms of general This suggests that, through its partners in
outputs, WAC in India has provided the India, UN-HABITAT has been able to advise
installation of 400 demonstration toilets, and expertly guide national and municipal
20 community toilets in each city, rooftop governments to ensure that its models
rain water harvesting in 20 schools and 20 can be taken up on a sustainable basis.
school toilet blocks. Other achievements In Ethiopia, community-led approaches
include the creation of water points, and gender mainstreaming are also
the extension and repair of piped water progressing, but arguably at different rates
supply systems, awareness programmes and effectiveness.
in schools and capacity training and
workshops for selected representatives Partnership and
of top- and middle-level Municipal Responsiveness
Corporation personnel.
UN-HABITAT’s choice of partners in
In India, programmes are in the process projects in Ethiopia, and especially India,
of being phased out, while Ethiopia is in a seems well balanced with a mix of local
different stage of implementation. As such NGOs and governmental authorities in
it is possible to draw more conclusions on the former, with the latter having a wider
the impacts in the former than in the latter spectrum of partnerships including various
country. local and national governmental agencies,
research institutes, NGOs and pioneering
Indeed, India has come a long way. its Private–Public Partnership with Coca-
Elements that mark the work in India is Cola.
the strong emphasis on community–led
approaches through establishing self Partners seem unanimously satisfied with
help groups, focusing on a pro-poor UN-HABITAT. In discussions with partners
governance framework and capacity and beneficiaries in India, they emphasize
building for government and municipal how the international clout by virtue of
officials. An indication that the being a UN organization opens doors to all
programme is well anchored within networks, UN-HABITAT’s ability to attract
national and local governments is that expertise (technically and normative) by
the State Government and Municipal means of its UN identity gives it a role
Corporations have made use of UN- as facilitator and network builder and
HABITAT’s poverty-mapping data in their catalyst.
preparation of Municipal Action Plans for
Poverty Reduction. An added value of the programme in
India is the combination of strong local
Furthermore, UN-HABITAT’s UN-HABITAT leadership led by Chief
recommendations made on water-demand Technical Advisors (CTA’s) and relevant
management have been crucial in policy and good local partners. A major part of
papers regarding the municipal water the India programme’s success can also be
charges collection. Gender mainstreaming attributed to the expertise of the staff on
is also well developed in India, and has ground as well as the latter’s cooperating
and networking capabilities, which is
74 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

essential in what the Mid-Term Review and rapidly growing peri-urban areas and
calls “achieving last mile delivery”. settlements, often neglected by policy
makers.
Results and Achievements
A general programmatic finding is that
India can show to a broader programme LAKE VICTORIA (LVWATSAN)
which is more in line with national and
municipal priorities and policies. The fact Introduction
that impacts are more noticeable and The LV-initiative was launched in 2004, the
profound in India is perhaps not a surprise MoUs with the three governments were
given that the projects in India are being signed in 2006, and the project effectively
phased out. started in 2007 with the preparation of
The WAC II projects in Ethiopia on the needs assessment studies of the towns.
other hand, have only been implemented The LV-Watsan has identified the following
for some years and given the need of five key areas for intervention: attaining
long-term focus it can be more difficult the water and sanitation related MDGs
to assess these impacts. It should be in smaller urban centers; urban poverty
noted, however, that it is problematic to and health; integrating infrastructure and
quantitatively compare the results from physical planning; capacity building in the
the two countries as the frame conditions WSS sector and solid waste management
are different and, likewise, the scope and drainage. The total budget of the LV-
and objectives and resources of the Watsan is USD 5.888 million.
implementing and cooperating partners.
Policies and Strategy/
In short, the overall findings in India
and Ethiopia suggest that WSTF has Relevance
made a commendable attempt to fulfill The LV-Watsan interventions, especially
its objectives, encapsulating various public standpipes and toilet facilities,
programmes, vast thematic areas and benefit the poor and vulnerable people
geographic regions. The programmes are such as single-headed households and
relevant in a context of poor, unstable
Part 1: Synthesis Report 75

orphans. In general, the stakeholders Partnership and


appreciated the activities of UN-HABITAT Responsiveness
in the LV region. The fast track + roll out
approach by bringing resources to the The LV-WATSAN programme cooperates
target towns, combined with capacity with an impressive number of partners
building and a pro-poor focus, received which are national, regional and
high marks from the stakeholders. Also, international, such as the national
the approach to combine water supply, governments of Uganda, Tanzania and
sanitation, storm flow and solid waste was Kenya; NGOs and well as municipal
valued. councils in the various towns of the region
to mention but a few.
Products and Services
Results and Achievements
Some of the achievements of the initiative
include the construction of 2,408 new The LV-WATSAN initiative operates in
latrines, with an estimated number an environment of densely-populated
of beneficiaries of 27,870 persons. small towns around Lake Victoria. This is
Concerning water supply, LV-Watsan has challenging, however, the response from
focused on strengthening of the water the stakeholders has been largely positive.
supply companies by the rehabilitation of
the upstream part of the network such A general finding is that LV-Watsan has
as water intakes, treatment plants, main acted mainly as a service provider and
pipelines and so on. Furthermore, the capacity builder, to a lesser degree as a
coverage of safe water increased from 23 model tester and occasionally as a model
per cent to 55 per cent. builder. One of the most successful new
approaches is the creation of the MSF. The
The project has introduced several MSF has facilitated the acceptance of the
interesting social innovations, such as programme; it has encouraged gender
the creation of the local MSFs and the mainstreaming and ensured ownership of
concept of micro loans for sanitation. the water supply infrastructure.
Although these ideas are not completely
new and not always very successful, the
experiments are relevant in the present
situation. On the technical site, the THE MEKONG REGION
programme is not seen as very innovative WATER AND SANITATION
other than experimenting with Ecosan
latrines. INITIATIVE
On software areas, LV-Watsan has
Introduction
concentrated on capacity building for The MEKWATSAN initiative was
the management and has made good formulated in response to the Greater
progress in the capacity training of local Mekong Sub Region (GMS) initiative as a
partners such as WSP, municipalities and collaborative effort between UN-HABITAT,
local NGOs/CBOs. More specifically, the Governments of the Greater Mekong
the water production has increased, the Sub-region and ADB. The objective of this
amount of non-revenue water has been initiative is to support the participating
reduced, and the income generated by countries in attaining their water and
selling water has increased. Indeed, the sanitation related to the MDGs. The
improvement in performance of the WSPs budget of the initiative is USD 8.6 million.
is seen as one of the main assets of the
UN-HABITAT initiative.
76 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

MEK-WATSAN promotes pro-poor their appreciation of the activities of MEK


urban water governance, urban water watsan initiative.
conservation and demand management,
integrated urban environmental sanitation Products and Services
and income generation for the urban
poor through community-based water The team finds that the initiative is making
and sanitation services. This is attained progress in providing safe water supply
by extending water and sanitation and sanitation in villages and small towns.
systems, enhancing institutional and When interviewed, families confirmed
human resource capacities at local and that they understood the health effects of
regional levels to sustain water and proper hygiene. The project put as initial
sanitation services, supporting economic targets for the roll out phase 1 of 90,775
development in secondary towns through and 190,365 beneficiaries for water resp
improved water and sanitation and WHAT DOES ‘RESP.’ MEAN, PLEASE?. Later
related income-generating activities, on these figures have been increased to
gender mainstreaming and social Inclusion 97,252 and 200,539. These figures are
and MDG monitoring as well as other according to the Contribution Agreements
activities. signed between UN-HABITAT and the
implementing partners. The fast track
Policies and Strategy/ resulted in 37,690 beneficiaries for water
Relevance and 45,310 for sanitation (Dec 2010) and
it still in progress.
MEK-WATSAN is found as being relevant
in view of the poor coverage of water and On the software side, capacity and
sanitation in the small towns, comparing institutional development has included
the coverage in the rest of the countries. a number of training courses and
Furthermore, stakeholders ranging from workshops, targeting water utilities,
ministry to beneficiary level expressed municipal authorities, CBOs and NGOs.
Part 1: Synthesis Report 77

Partnership and Mexico and Bolivia and started its activities


Responsiveness in other countries of Central America
(Nicaragua, El Salvador) and the Andean
The Mekong Initiative has a balanced Region (Peru, Ecuador, Colombia) as well.
partner selection. Partnerships range from
formalized cooperation agreements with The main objective of the WatSAn-LAC is
the following ministries on national level: to contribute to the sustainable access to
MIME in Cambodia, MPWT in Lao PDR safe drinking water and basic sanitation
and with MoC in Vietnam. In addition, for the poor, particularly in the urban and
UN-HABITAT cooperates with local NGOs peri-urban areas, and the Programme
and provincial water supply utilities in focuses on the following areas: pro-poor
Cambodia, Lao and Vietnam and is urban water governance, integrated urban
formulating agreements with the private environmental sanitation, implementation
sector such as Coca-Cola. of integrated water resource management
in urban settings, democratic governance,
Results and Achievements decentralization and empowerment,
capacity building, water, sanitation and
Beneficiaries and authorities in the three hygiene education and strengthening
countries confirmed their appreciation water operators.
about the activities of UN-HABITAT and
their preference for the continuation Policies and Strategy/
and extension of its activities in more or Relevance
less the same way. The most frequently
cited strong points were community The strategy was found relevant in Mexico
participation and contribution, the and in Bolivia because the projects and
relatively fast project implementation, activities seem to target peri-urban and
the connection of all levels in society urban poor areas, strengthening software
and good cooperation with the project developments, improving the efficiency
management. of WatSan providers and promoting
community-led approaches.
However, similar to the conclusion drawn
from the Lake Victoria study, the MEK- Products and Services
Watsan is seen mainly as a service provider
and capacity builder and, to a lesser In terms of on the ground results and
degree, as a model tester and occasionally achievements, most projects are in a
as a model builder. first stage of implementation; as such,
it is too early to assess the impact on
infrastructure and hygiene awareness, or
health benefits. During visits to projects in
THE LATIN AMERICA AND Cochabamba-Bolivia, however, the team
CARIBBEAN REGION observed advances on the ground, both
hardware and software improvements.
Introduction For instance, on one of the sites, a
PTAR-D (Decentralized Treatment Plant
The Water for Cities Programme in Latin for WasteWater) was already installed and
America and the Caribbean (WatSan- ready to operate.
LAC) is a regional operational initiative
that was initiated in Mexico and Bolivia In terms of capacity and institutional
in 2008. During 2009 and 2010, the development, the programme is
Programme concentrated its attention on implementing several initiatives that aim
consolidating the local programmes in to build capacity of WatSan Operators and
78 External Evaluation of UN-HABITAT’s Water and Sanitation Trust Fund

increase the institutional development of water utilities and operators. WatSan LAC
national and municipal activities. has supported a combination regional
and normative activities and policy
This is particularly evident with the dialogue work with on-the-ground pilot
WOPS-LAC. The latter has promoted 13 and demonstration water and sanitation
joint initiatives between several watsan projects focusing on pro-poor water and
operators in the LAC region. Another sanitation service delivery. This illustrates
example of institutional development that UN-HABITAT is promoting several
is found in Bolivia, with two projects region networks that are developing
cooperating with the Municipality of La synergies and complementarities between
Paz and the Municipality of Cochabamba. countries and institutions.
In the field of gender mainstreaming,
ten workshops have been delivered and Results and Achievements
WatsanLAC is contributing to a “Gender
Resource Book” in Spanish. That said, Although in its early stages, the team
measuring normative progress is not finds that the WatsanLAC country
straight forward as the WatSanLAC is in a programmes are promising. According to
phase of consolidation. the consultant, assured long-term funding
and a field management retention policy
Partnership and should enable continuity and enhance the
Responsiveness prospects of sustainable impact. A crucial
weakness is, however, the heavy financial
The programme has forged strong reliance on the Government of Spain, an
partnerships with different governments, issue which can only be solved by finding
with the IADB and international NGOs, other and new mechanisms of financing
local organizations, technological activities in the region.
institutions and national and municipal
HS Number: HS/071/11E
ISBN Number (Volume): 978-92-1-132365-8

UNITED NATIONS HUMAN SETTLEMENTS PROGRAMME


P.O.Box 30030,Nairobi 00100,Kenya;
Tel: +254-20-7623120;
Fax: +254-20-76234266/7 (Central office)
infohabitat@unhabitat.org
www.unhabitat.org/publications

You might also like