SlideShare a Scribd company logo
1 of 12
Accountability Research
      Kenya case study
Discussion on interim findings with Christian Aid in Kenya
                   Andy Featherstone, 25 February 2013
Itinerary
Day         Activity

Sunday       Contextualising methodology
             induction with translator
Monday       Meeting with UCCS
             Trial exercise with community – Kyawango location
Tuesday      Meeting with Prog Mgt. Com. – Itoleka location
             Meeting with mixed group
Wednesday    Meeting with PMC – Mutulu location
             Meeting with mixed group
Thursday     Meeting with PMC – Kalawani location
             Meeting with mixed group
Friday       Meeting with PMC – Kithungu location
             Meeting with mixed group
Saturday     Meeting with 4 groups – Ukanga location
             Return to Nairobi
Context and partner profile
• Makueni County in Eastern
  Kenya
• Communities practice small
  scale rain fed agriculture
• Unreliable and erratic
  rainfall associated with
  water scarcity has led to
  increased frequency of
  droughts
• UCCS is CA‟s main partner in
  the East and has been
  operating in Kitui Machakos
  and Garissa since 1987

•    Action plans developed out of the PVCA process led to the prioritisaiton of
    a project partnering the community to construct sand dams that will not
    only serve the livestock and crops but also help in shortening the distance
    that people take to access water for domestic use, particularly women.
The approach
 A methodology was developed which mixed quantitative
  and qualitative approaches and was used fairly
  consistently throughout the research

 Scorecards and opinion ranking exercises were used to
  describe accountability mechanisms and as entry points
  to wider discussions about their contribution to project
  quality

 All of the exercises were translated into Kikamba and
  the discussions were facilitated by a translator

 Each community meeting lasted between 2.5 – 3.5 hours
Participation

Total male
participants = 63

Total female
participants = 87




Discussions were held in mixed groups of 10-
15 people. Typically a meeting was held with
the Management Committee in the morning
and with a selection of youth, female or
mixed groups in the afternoon. Participation
was disaggregated by gender (although the
results of the exercises were not)
Lessons about the methodology
 It took time to get the language right and to ensure that
  the correct meaning was translated
 Fast-tracking the methodology to allow for shorter
  meetings significantly eroded the utility of the results
 Strong facilitation (as opposed to translation alone) was
  key to the success of the discussions
 Using the exercises as a foundation for each of the
  discussions ensured active engagement and strong
  participation from all community members
 The meetings were long but they were also fruitful and
  community participation was excellent
Initial findings – accountability
 „Information-sharing‟ was scored fairly strongly across the
  groups – the control projects tended to know less (although
  also over-exaggerated the extent of their knowledge).

 „Participation‟ was routinely strong across all groups, built on
  the foundation provided by the PVCA but maintained through
  strong community support to implementation and
  participation in monitoring

 Knowledge and use of „feedback‟ and „complaints‟ was
  weakest in the control where the management committee
  tended to have a far better understanding than others. For
  non-control groups, there was a good understanding of the
  mechanism and confidence in it. Non-members affected by
  the projects were not well served
Accountability in
 action
Contribution to project quality
 There was generally a good understanding of the causal link
  between accountability mechanisms and project quality
  although it was at times difficult to capture this

 „Trust‟, „ownership‟ and „motivation‟ were all considered to
  be far greater where there were well-functioning
  accountability mechanisms

 Examples were given to show how the perceived clarity about
  and utility of UCCS‟ accountability mechanism lay the
  foundation for good quality projects

 In the broadest terms, the case study provided evidence for
  the hypothesis that functioning accountability mechanisms
  tend to produce good quality projects
Community voices
 “Because we participated in choosing the project, it is ours
  and so we will give more of our time and value the
  intervention”

 “Information sharing has helped people come together to
  work in the project”

 “[when we selected the project] we prioritised the dry areas
  and so we made a choice about who was most in need. In
  doing this we influenced a better outcome as we know the
  community and the needs”

 “Before UCCS came, other programmes have failed because
  they lacked accountability and there was corruption.
  Accountability is a key part of the success of the programme”
Issues for the research
 The difficulties associated with designing a methodology relevant to
  projects along the development continuum – the long-term nature
  of UCCS‟ relationship with the community meant that groups tended
  to score the partnership as a whole rather than judge it according to
  a single „project‟

 The need to focus on the „spirit‟ of HAP rather than the specifics for
  development projects - The focus of UCCS on supporting their
  groups (rather than those most in need) and directing their
  accountability mechanisms accordingly is an example.

 The importance of discussions to temper the results of the exercises
  – at times the community was „apologetic‟ that they gave a low
  score. At other times follow-up discussions suggested they
  exaggerated the scores

 The importance of facilitation in the success of the research – while
  the use of the exercises ensured good participation, sound
  explanation and facilitation was essential to the exercise.

 The challenge of how to analyse and present the evidence
  coherently
Questions & discussion

More Related Content

What's hot

Masterclass on Radical Thinking, Change and Transformation for London leaders...
Masterclass on Radical Thinking, Change and Transformation for London leaders...Masterclass on Radical Thinking, Change and Transformation for London leaders...
Masterclass on Radical Thinking, Change and Transformation for London leaders...NHS Improving Quality
 
Participatory approaches manjuprakash
Participatory approaches manjuprakashParticipatory approaches manjuprakash
Participatory approaches manjuprakashmanjuprakashpatil
 
Planning the future of openness in Scotland
Planning the future of openness in Scotland Planning the future of openness in Scotland
Planning the future of openness in Scotland Niamh Webster
 
The New Extensionist
The New ExtensionistThe New Extensionist
The New ExtensionistMEAS
 
Collaborative Research@CWN: Who do Scientists Network with?
Collaborative Research@CWN: Who do Scientists Network with?Collaborative Research@CWN: Who do Scientists Network with?
Collaborative Research@CWN: Who do Scientists Network with?Dima Dimitrova
 
Research Impact Case Study 2: College of Life Sciences & Medicine, University...
Research Impact Case Study 2: College of Life Sciences & Medicine, University...Research Impact Case Study 2: College of Life Sciences & Medicine, University...
Research Impact Case Study 2: College of Life Sciences & Medicine, University...Aberdeen CES
 

What's hot (7)

S6 action planning
S6   action planningS6   action planning
S6 action planning
 
Masterclass on Radical Thinking, Change and Transformation for London leaders...
Masterclass on Radical Thinking, Change and Transformation for London leaders...Masterclass on Radical Thinking, Change and Transformation for London leaders...
Masterclass on Radical Thinking, Change and Transformation for London leaders...
 
Participatory approaches manjuprakash
Participatory approaches manjuprakashParticipatory approaches manjuprakash
Participatory approaches manjuprakash
 
Planning the future of openness in Scotland
Planning the future of openness in Scotland Planning the future of openness in Scotland
Planning the future of openness in Scotland
 
The New Extensionist
The New ExtensionistThe New Extensionist
The New Extensionist
 
Collaborative Research@CWN: Who do Scientists Network with?
Collaborative Research@CWN: Who do Scientists Network with?Collaborative Research@CWN: Who do Scientists Network with?
Collaborative Research@CWN: Who do Scientists Network with?
 
Research Impact Case Study 2: College of Life Sciences & Medicine, University...
Research Impact Case Study 2: College of Life Sciences & Medicine, University...Research Impact Case Study 2: College of Life Sciences & Medicine, University...
Research Impact Case Study 2: College of Life Sciences & Medicine, University...
 

Similar to Accountability impact research - results from the kenya pilot study

Evaluating a community media approach to promote nutrition in Niger
Evaluating a community media approach to promote nutrition in NigerEvaluating a community media approach to promote nutrition in Niger
Evaluating a community media approach to promote nutrition in NigerJSI
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationMEASURE Evaluation
 
The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...
The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...
The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...The Transfer Project
 
Social learning for collective action on climate change
Social learning for collective action on climate changeSocial learning for collective action on climate change
Social learning for collective action on climate changeweADAPT
 
Triple-S Research on Systemic Change
Triple-S Research on Systemic ChangeTriple-S Research on Systemic Change
Triple-S Research on Systemic ChangeIRC
 
Crossing boundaries: from evidence to impact? Some reflections.
Crossing boundaries: from evidence to impact? Some reflections.Crossing boundaries: from evidence to impact? Some reflections.
Crossing boundaries: from evidence to impact? Some reflections.RENEWAL-IFPRI
 
Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...
Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...
Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...CIAT
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...John Mauremootoo
 
Multistakeholder processes
Multistakeholder processesMultistakeholder processes
Multistakeholder processesMarc Manthey
 
Working with end users of research
Working with end users of researchWorking with end users of research
Working with end users of researchAberdeen CES
 

Similar to Accountability impact research - results from the kenya pilot study (20)

Improving impact - do accountability mechanisms deliver results
Improving impact - do accountability mechanisms deliver resultsImproving impact - do accountability mechanisms deliver results
Improving impact - do accountability mechanisms deliver results
 
Evaluating a community media approach to promote nutrition in Niger
Evaluating a community media approach to promote nutrition in NigerEvaluating a community media approach to promote nutrition in Niger
Evaluating a community media approach to promote nutrition in Niger
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in Evaluation
 
The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...
The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...
The Implementation of Ethiopia’s Productive Safety Net Programme's Gender Pro...
 
Social learning for collective action on climate change
Social learning for collective action on climate changeSocial learning for collective action on climate change
Social learning for collective action on climate change
 
Making energy efficiency research relevant
Making energy efficiency research relevant Making energy efficiency research relevant
Making energy efficiency research relevant
 
Thinking through ‘knowledge translation’
Thinking through ‘knowledge translation’Thinking through ‘knowledge translation’
Thinking through ‘knowledge translation’
 
Gta nc hki event_afrina
Gta nc hki event_afrinaGta nc hki event_afrina
Gta nc hki event_afrina
 
Triple-S Research on Systemic Change
Triple-S Research on Systemic ChangeTriple-S Research on Systemic Change
Triple-S Research on Systemic Change
 
Crossing boundaries: from evidence to impact? Some reflections.
Crossing boundaries: from evidence to impact? Some reflections.Crossing boundaries: from evidence to impact? Some reflections.
Crossing boundaries: from evidence to impact? Some reflections.
 
Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...
Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...
Knowledge Management Strengthens Decision Making: The Case of the “Knowledge ...
 
Affinity Symposium Presentation - CES
Affinity Symposium Presentation - CESAffinity Symposium Presentation - CES
Affinity Symposium Presentation - CES
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
 
Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #1
Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #1Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #1
Peer-to-Peer Webinar Series: Success Stories in EIDM 2018 / Webinar #1
 
Multistakeholder processes
Multistakeholder processesMultistakeholder processes
Multistakeholder processes
 
Sahi membership strategy
Sahi membership strategySahi membership strategy
Sahi membership strategy
 
It wouldn’t be KMb without KB
It wouldn’t be KMb without KBIt wouldn’t be KMb without KB
It wouldn’t be KMb without KB
 
Participatory Policy Making
Participatory Policy MakingParticipatory Policy Making
Participatory Policy Making
 
Working with end users of research
Working with end users of researchWorking with end users of research
Working with end users of research
 
pepe632
pepe632pepe632
pepe632
 

Accountability impact research - results from the kenya pilot study

  • 1. Accountability Research Kenya case study Discussion on interim findings with Christian Aid in Kenya Andy Featherstone, 25 February 2013
  • 2. Itinerary Day Activity Sunday  Contextualising methodology  induction with translator Monday  Meeting with UCCS  Trial exercise with community – Kyawango location Tuesday  Meeting with Prog Mgt. Com. – Itoleka location  Meeting with mixed group Wednesday  Meeting with PMC – Mutulu location  Meeting with mixed group Thursday  Meeting with PMC – Kalawani location  Meeting with mixed group Friday  Meeting with PMC – Kithungu location  Meeting with mixed group Saturday  Meeting with 4 groups – Ukanga location  Return to Nairobi
  • 3. Context and partner profile • Makueni County in Eastern Kenya • Communities practice small scale rain fed agriculture • Unreliable and erratic rainfall associated with water scarcity has led to increased frequency of droughts • UCCS is CA‟s main partner in the East and has been operating in Kitui Machakos and Garissa since 1987 • Action plans developed out of the PVCA process led to the prioritisaiton of a project partnering the community to construct sand dams that will not only serve the livestock and crops but also help in shortening the distance that people take to access water for domestic use, particularly women.
  • 4. The approach  A methodology was developed which mixed quantitative and qualitative approaches and was used fairly consistently throughout the research  Scorecards and opinion ranking exercises were used to describe accountability mechanisms and as entry points to wider discussions about their contribution to project quality  All of the exercises were translated into Kikamba and the discussions were facilitated by a translator  Each community meeting lasted between 2.5 – 3.5 hours
  • 5. Participation Total male participants = 63 Total female participants = 87 Discussions were held in mixed groups of 10- 15 people. Typically a meeting was held with the Management Committee in the morning and with a selection of youth, female or mixed groups in the afternoon. Participation was disaggregated by gender (although the results of the exercises were not)
  • 6. Lessons about the methodology  It took time to get the language right and to ensure that the correct meaning was translated  Fast-tracking the methodology to allow for shorter meetings significantly eroded the utility of the results  Strong facilitation (as opposed to translation alone) was key to the success of the discussions  Using the exercises as a foundation for each of the discussions ensured active engagement and strong participation from all community members  The meetings were long but they were also fruitful and community participation was excellent
  • 7. Initial findings – accountability  „Information-sharing‟ was scored fairly strongly across the groups – the control projects tended to know less (although also over-exaggerated the extent of their knowledge).  „Participation‟ was routinely strong across all groups, built on the foundation provided by the PVCA but maintained through strong community support to implementation and participation in monitoring  Knowledge and use of „feedback‟ and „complaints‟ was weakest in the control where the management committee tended to have a far better understanding than others. For non-control groups, there was a good understanding of the mechanism and confidence in it. Non-members affected by the projects were not well served
  • 9. Contribution to project quality  There was generally a good understanding of the causal link between accountability mechanisms and project quality although it was at times difficult to capture this  „Trust‟, „ownership‟ and „motivation‟ were all considered to be far greater where there were well-functioning accountability mechanisms  Examples were given to show how the perceived clarity about and utility of UCCS‟ accountability mechanism lay the foundation for good quality projects  In the broadest terms, the case study provided evidence for the hypothesis that functioning accountability mechanisms tend to produce good quality projects
  • 10. Community voices  “Because we participated in choosing the project, it is ours and so we will give more of our time and value the intervention”  “Information sharing has helped people come together to work in the project”  “[when we selected the project] we prioritised the dry areas and so we made a choice about who was most in need. In doing this we influenced a better outcome as we know the community and the needs”  “Before UCCS came, other programmes have failed because they lacked accountability and there was corruption. Accountability is a key part of the success of the programme”
  • 11. Issues for the research  The difficulties associated with designing a methodology relevant to projects along the development continuum – the long-term nature of UCCS‟ relationship with the community meant that groups tended to score the partnership as a whole rather than judge it according to a single „project‟  The need to focus on the „spirit‟ of HAP rather than the specifics for development projects - The focus of UCCS on supporting their groups (rather than those most in need) and directing their accountability mechanisms accordingly is an example.  The importance of discussions to temper the results of the exercises – at times the community was „apologetic‟ that they gave a low score. At other times follow-up discussions suggested they exaggerated the scores  The importance of facilitation in the success of the research – while the use of the exercises ensured good participation, sound explanation and facilitation was essential to the exercise.  The challenge of how to analyse and present the evidence coherently