Presented on Monday 2 November at NCVO/BWB Trustee Conference 2015.
Sally Cupitt, Head of NCVO Charities Evaluation Services
How to identify your impact at 20 paces
If you would like to find out more about our 2016 Trustee Conference email us at ncvoevents@ncvo.org.uk or call us on 020 750 3153.
1. Organised by: Lead Partner:
Media Partner:
Sponsors:PM5: HOW TO IDENTIFY YOUR
IMPACT AT 20 PACES
SALLY CUPITT
HEAD OF NCVO CHARITIES
EVALUATION SERVICES
2 NOVEMBER 2015
Drinks sponsor:
2. 2
CES’ MAIN WORK AREAS
External
evaluation
Capacity
building
Training Resources
3. WHY SHOULD TRUSTEES BOTHER WITH
IMPACT?
• Planning
• Evaluation
• Communication
• Fundraising
3
5. PLANNING TOOLS: LOGIC MODEL
5
Resources
used to
create the
services
offered
What is done
with the inputs,
to enable it to
develop and
deliver its
outputs
Products,
services or
facilities that
result from
activities
The changes,
benefits,
learning or
other effects
that result from
what the
project or
organisation
makes, offers or
provides
Broader or
longer-term
effects of a
project’s or
organisation’s
activities,
outputs and
outcomes
Input Process Output Outcome Impact
6. EMPLOYMENT PROJECT
6
Funding
Staff time and
skills
Premises
Utilities
Partners’
resources
Building
relationships with
partners
Developing
relationships with
users
Developing
training
Developing
employer
relationships
Workshops
One to one
sessions
Job brokerage
Work
placements
Taster days
Advice
Guidance
Referrals
Improved
knowledge of the
job market
More experience
Improved skills
Improved
confidence
Increased access
to employment
More care
leavers are in
sustainable and
satisfying
employment
Input Process Output Outcome Impact
7. CES PLANNING TOOLS: CES PLANNING TRIANGLE
7
Outputs
Outcomes
Impact
Overall aim
The broader, longer
term change you want
to contribute to
Specific aims
The changes you want to
create
Objectives
The work you do
8. THE MENTAL HEALTH
PROJECT
8
To
improve the
mental health of
older people
living in Lambeth
To reduce isolation among
older people
To increase older people’s
understanding of mental
health issues
To increase the take-
up of mental health
services by older
people
To run outreach
events
To organise social
events
To offer information
Overall aim
Objectives
Specific aims
9. www.community-links.org
Reduced loneliness in
older people
More services
targeting
loneliness
Better use of
existing services
Activities
Outcomes
Impact
Higher quality
services
HWBs committed
to tackling the
issue
Loneliness framed as
a health issue
Providers’
knowledge/
commitment
increases Providers more
able to reach
most lonely
Lobbying activities
Supporter network
created
Enhanced evidence
base for providers/
purchasers
Support local action
Commission and
publicise research
Key influencer support
increases
Develop and promote
campaign messages
Develop tools to identify /
measure those needing
supportTarget audience through
events and resources
PLANNING:THEORY
OFCHANGE
10. “NCVO CES offers consultancy, training and
resources to the voluntary sector and its
funders.
This increases knowledge and skills in
evaluation, and helps people collect better
data to inform their decision making.
This helps them improve their services
which improves the lives of vulnerable
people at the frontline.”
10
10-MINUTE THEORY example
11. Organised by:
Lead Partner:
Media Partner:
Sponsors:
GROUPWORK: 10-MINUTE THEORY
• You have 3 minutes to write your own 10-
minute theory, in three sentences:
1. Describe what you do
2. The changes you bring about
3. The long-term, wider change that your
work contributes to
Max 20 words a sentence!
• Share it with your neighbour
• See if you can help improve each others’
11
12. DEVELOPING IMPACT-FOCUSED EVALUATION
• Plan the work
• Set up the evaluation framework
• Develop tools and systems
• Pilot and review
• Analysis, reporting
• Use
12
13. MONITORING AND EVALUATION FRAMEWORK
13
CORNERSTONE OF (SELF) EVALUATION:
Aims Outcomes Outcome
indicators
Information
collection
methods
When and by
whom
How to
report and
use
Objectives Outputs Output
indicators
Information
collection
methods
When and by
whom
How to
report and
use
14. GOOD IMPACT REPORTING
• Speaks to the audience
• Context
• Narrative
• Engage and inspire
• Scale
• Appropriate length, proportionate detail
• Clear and accessible
• Transparent and verifiable
14
15. WHAT HAVE WE LEARNT IN 25 YEARS?
15
1. Planning
• Bring stakeholders with you
• Systems need to be flexible
• Go to them - embed within existing systems
• It takes time
2. What and how
• Be cautious with ‘off the shelf’
• Horses for courses - appropriateness
• Size does matter - proportionality
• Need other information to understand outcomes
• Allow for unexpected and negative outcomes
• You may only need to measure outcomes, not impact
• Qualitative ways to assess impact
3. Focus on use
16. Organised by:
Lead Partner:
Media Partner:
Sponsors:
APPLYING THIS
• What difficulties might this
present for your charity?
• What opportunities does this
present?
17. DESPERATE FOR MORE?
17
NCVO CES: www.ces-vol.org.uk
NCVO KnowHow NonProfit: http://knowhownonprofit.org/
Inspiring Impact: www.inspiringimpact.org
Principles of good impact reporting:
www.cfg.org.uk/resources/~/media/Files/Resources/CFDG%2
0Publications/SME330%20CFDG%20Impact%20Report_v6.pdf
Defining terminology: www.jargonbusters.org.uk