This document discusses the development of a Water Wellbeing Indicator to more accurately measure the impact of water programs, especially among pastoral populations with complex water use. It proposes using emotional response as the basis for the indicator. Research in Ethiopia found water collected did not differ seasonally but emotional responses did, showing conventional measures do not capture impacts. The indicator toolkit developed includes simple, intermediate, and complex tools to serve various assessment needs. The project aims to have partners adopt the survey instrument to demonstrate its value, with the long term goal of broader adoption.
Introduce myself – lecturer CU and PI
Project – title and length of project 18 months – Development Frontiers – new thinking/agenda setting and radical
Partners – Cranfield, IRC and IWMI – have engaged Oxfam and FSA throughout life of project
Plan is to start by pitching relevance of the project in the language of policy and practitioner stakeholders – that is in the context of monitoring and evaluation gaps.
BIG PICTURE: Impacts from WASH projects hard to measure – this leads to inappropriate monitoring – and a focus on more easy to measure outcome measures such as presence of infrastructure which can be especially problematic for certain populations as these do not seem to associate with positive impacts among these communities. For example, the provision of a borehole in a region can lead to over concentration of population and livestock in small areas leading to overall worst outcomes.
Moreover, monitoring through conventional approaches – such as those employed by government and in SDGs – leads to a focus on household or close to household supplies, which leads to big blind spots for measuring quality of pastoralist water use as they use many water points over large rangelands. These are often seasonal and dynamic so very hard to measure through conventional approaches.
Instead, WEEP started from a premise we can measure an impact-level proxy indicator which will be affected by good or bad water security.
So we set ourselves the following challenge – propose and test an indicator that was robust but simple to use, tells us something that other indicators do not, helps improve understanding of pastoralist experience but basic structure could be applied elsewhere.
We focused on the idea of an experience-based measure and began to explore the idea of using discrete emotional responses
We undertook an inductive study of wellbeing and emotion in three pastoralists communities in December which included freelisting and acting out emotions (at this time the study was not focused on water), we then categorised those emotions in the matrix in Fig 2 along 2 main axis – arousal and valence – this was then taken back to the community to test and refine.
We then adapted a survey tool to provide water security statements and a balance of possible emotional responses before administering that in the communities. We are now in the process of analysis and write-up.
An example result
Data from people on water quantity – are people happy with amount of water collected in each season? If you look at the volume collected by households which is a conventional approach then there is no difference.
However, if you ask about emotional response – there is significant difference. Fatigue, despair and grief being associated with dry season and calm and content in rainy season. What is happening is that in dry season people are having to collect water to also provide to animals which means they are getting less water themselves, as in rainy season animals water themselves.
Big difference
Listening to NGO partners we have developed a plan to go from here development of a toolkit type approach
Something quite simple and crude which is needed for basic implementation monitoring
Something more complex for needs assessments
Something probably just for research
We have adapted our methodology to be step-wide with ability to jump in at different levels
Genuinely coproduced – early career researcher so NGO more senior
Get content to work with partners in their own programme – great potential for impact
Next generation is the big profile people