An academic poster from the 2017 PHE Annual Conference. We outline how evaluating the wider value of contemporary health promotion programmes is challenging because of the complex and overlapping relationship between individuals and the wider environmental context. Commissioners of evaluations need to ensure the involvement of relevant stakeholders throughout the evaluation process1. An approach that was sensitive to the realities of the people who experience and implement programmes was devised to establish meaningful and relevant outcomes of a small grants health promotion programme.

1. Working with communities to implement and evaluate a community health promotion
programme
Background
Evaluating the wider value of contemporary health promotion
programmes is challenging because of the complex and
overlapping relationship between individuals and the wider
environmental context. Commissioners of evaluations need to
ensure the involvement of relevant stakeholders throughout the
evaluation process1. An approach that was sensitive to the
realities of the people who experience and implement
programmes was devised to establish meaningful and relevant
outcomes of a small grants health promotion programme.
Methods
A Social Return on Investment (SROI) methodology was implemented to provide a mechanism for the involvement of
stakeholders (those funding and receiving funds) and beneficiaries (those participating in funded activities) in the development
of an evaluation framework (Figure 1). Qualitative storyboard workshops (n = 3) were conducted with beneficiaries (those
participating in funded projects) and stakeholders (in = 34, including those in receipt of funding and elected councillors). Data
concerning the applications for funding made by stakeholders (n=404) during the main study period (November 2014 to
October 2016) was used to establish the nature and scope of the projects and refine the conceptual model. Data were
analysed using a grounded theory2,3 approach to establish a theory of change following which outcome indicators (n = 11) were
developed. These were assessed via pre and post surveys (n = 135) with beneficiaries to assess changes over time. Interviews
with stakeholders (n=27) and beneficiaries (n=22) investigated process and outcome factors.
Conclusions
The SROI methodology provided a means of engaging with
community stakeholders at different levels and ensured a full
range of stakeholders, beneficiaries, outcome indicators and
contextual factors were included in the evaluation. This
represents an innovative evaluation approach that helps
understand the wider societal impacts of health promotion
programmes which are often neglected due to methodological
constraints.
References
1 WHO (2013). WHO evaluation practice handbook. Geneva: World Health Organization.
2 Charmaz, K. (2009) Shifting the grounds: Constructivist grounded theory methods. In: J. M. Morse, P. N. Stern, J. Corbin, B. Bowers, K. Charmaz, and A. E. Clarke (Eds.), Grounded theory: the second
generation (127-193). Walnut Creek (CA): Left Coast Press Inc.
3 Hutchison, A. J., Johnston, L. H. and Breckon, J.D. (2010) ‘Using QSR-NVivo to facilitate the development of a grounded theory project: An account of a worked example’. International Journal of Social
Research Methodology, 13, 283–302.
Contact: cmbaker@glos.ac.uk This study was funded by Gloucestershire County Council Public Health.
Baker, C.,1 Courtney, P.,1 Kubinakova, K.,1 Crone, D.,1 & Billingham, D.2
1 University of Gloucestershire. 2 Gloucestershire County Council Public Health.
Figure 1: Key study phases
Results
SROI Model: three main conceptual domains emerged: (1)
community connections and resources (2) education and skills
(3) health and wellbeing. These articulated the nature of
outcomes as experienced by beneficiaries participating in
community activities funded by the small grants programme.
Stakeholders evaluation: stakeholders who had received funding
identified simplicity and flexibility, rapid access to funding and
sustainability and development opportunities as principal
benefits. Working with councillors to develop applications raised
awareness of the public health agenda with elected members
and fostered good relationships and trust in the community.
Beneficiaries: the funded activities provided nearby and
accessible opportunities for physical activity. People felt socially
connected and motivated. The projects transformed participants’
perceptions of physical and social spaces.
Key messages
An SROI approach can be used for monitoring and evaluating
programmes as they evolve and is recommended in a time when
services are stretched and funding is hard to come by.
Public events and workshops to engage with people during the
evaluation process ensure that stakeholders and those
benefitting from programmes understand what it is about, the
role of evaluation, and their role within it.