Annual Conference A3: How the best leaders use impact and evaluation | NCVO
•Download as PPTX, PDF•
1 like•563 views
Presentation from Annual Conference, 20 April 2017 Sally Cupitt
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Annual Conference A3: How the best leaders use impact and evaluation | NCVO
Similar to Annual Conference A3: How the best leaders use impact and evaluation | NCVO (20)
More from NCVO - National Council for Voluntary Organisations
More from NCVO - National Council for Voluntary Organisations (20)
Recently uploaded
Recently uploaded (20)
Annual Conference A3: How the best leaders use impact and evaluation | NCVO
- 1. HOW THE BEST LEADERS USE IMPACT AND EVALUATION Dinner sponsors: Media partner: Partner sponsor: SPEAKER SALLY CUPITT HEAD OF NCVO CHARITIES EVALUATION SERVICES
- 2. NCVO CHARITIES EVALUATION SERVICES Theory of change Training courses Independent evaluation Mentoring Free online resources Capacity building
- 3. WORKSHOP OUTLINE 1. What we mean by evaluation and impact 2. Using evaluation and impact for: • Decision making • Better outcomes • More funding • Improved communications 3. Next steps 4. Taking down barriers 5. Top tips
- 4. SORTING THE LANGUAGE Dinner sponsors: Media partner: Partner sponsor:
- 5. WHAT CAN BE EVALUATED?
- 6. WHY SHOULD LEADERS CARE ABOUT IMPACT AND EVALUATION? Dinner sponsors: Media partner: Partner sponsor:
- 7. EVALUATION AND IMPACT: 1. Funders increasingly expect it 2. Accountability 3. As a sector we need to better demonstrate our impact to the public 4. Charity regulation WHY BOTHER? THE STICKS
- 8. EVALUATION AND IMPACT: 1. Better information for decision-making 2. Better outcomes for users 3. Better communications 4. More funding 5. More motivated and engaged stakeholders WHY BOTHER? THE CARROTS
- 9. BETTER DATA FOR DECISION-MAKING Stronger strategic planning Deliver the right services More informed scaling up Put your limited funds to best use Making service improvements
- 10. BETTER OUTCOMES FOR USERS • Knowing what works, what doesn’t work • Knowing who it works for • Sharing outcomes information can motivate users to change
- 11. MORE EFFECTIVE FUNDRAISING Evidence your achievements Explain your intended impact Show you are a learning organisation Describe evaluation plans Evidence of need
- 12. BETTER COMMUNICATIONS Internally: • Shared understanding of goals • Agreement on how best to achieve those goals Externally: • Clearer and simpler explanations of what you are trying to achieve • More engaging publicity for you or your cause • Policy change • Gaining credibility
- 13. NEXT STEPS Dinner sponsors: Media partner: Partner sponsor:
- 14. WHAT DOES IT NORMALLY INVOLVE? • Identifying and agreeing on clear goals • Often using a tool like theory of change or the CES planning triangle Organisation planning • Identifying what to collect information on • How that information will be collected • When and by whom Evaluation planning • Routine systematic data collection • Usually regularly checked against plans • Ideally of output, outcome and user satisfaction at a minimum Monitoring • Done internally by your staff, perhaps yearly • Using monitoring and other information (eg census data) • To make judgements about your progress Self evaluation • Using some external agency; Usually based on your data and new data • Periodic, perhaps every 3-5 years • Greater focus on process, outcome and impact, more complex Independent evaluation
- 15. A SUGGESTED PROCESS Occasional external evaluation Regular self-evaluation using monitoring data Develop internal evaluation systems, pilot Build internal capacity Develop an evaluation plan Get support if you need it Identify and skill up an internal champion
- 16. TAKING DOWN BARRIERS: Dinner sponsors: Media partner: Partner sponsor: GROUPWORK
- 17. TOP TIPS: WHAT HAVE WE LEARNT IN 26 YEARS? 1. Planning • Bring stakeholders with you • Systems need to be flexible • Go to them - embed within existing systems • It takes time • Integrate with everything 2. Methods • Be cautious with ‘off the shelf’ • Horses for courses - appropriateness • Size does matter - proportionality • Need other information to understand outcomes • Allow for unexpected and negative outcomes • You may only need to measure outcomes, not impact • Qualitative ways to assess impact
- 18. TOP TIPS: WHAT HAVE WE LEARNT IN 26 YEARS? 3. Reporting • Part of evaluation plan • Know your audience • Multiple methods for multiple audiences • Don’t forget analysis • Summarise, keep relevant and focused • Be careful of inappropriate generalisation or attribution • Clear, actionable recommendations 4. Use it! • Provide useful information • Of high quality • On time • And then reinforce
- 19. RESOURCES Reading Our new impact section on Knowhow Nonprofit has information to help you develop effective impact and evaluation practices in your organisation knowhownonprofit.org/organisation/impact Contact us www.ncvo.org.uk/charities-evaluation-services Twitter: @CESOnline Tel: 020 7520 3193 Email: ces@ncvo.org.uk Dinner sponsors: Media partner: Partner sponsor:
Editor's Notes
- Focus of today: Why you - as leaders of future leaders - should care about evaluation and impact – the stuff we do Not about the how to in any detail, but I want you to go away enthused, and with some ideas about how to enthuse others, or at least to bring to persuade people to give it a chance. At the end I’ll give you some sources of support if you do want to get on with this Step 4 – scary role play!
- Make sure we have the language right
- Sticks aka drivers Alex: The accountability should also include the lack of trust in charities at the moment – the public don’t believe that charities are doing what they claim nor spending money wisely. Evaluation – amongst other things – combats this & helps change perceptions.
- Now going to talk about some of these in more detail
- Eg: Fairbridge – variation of outcome according to throughput – so set targets accordingly Family action – 20 sessions achieved same outcomes as 10, so reduced to 10, enabling them to work with more families Motivation – I used to work in homelessness; 6 months in clients couldn’t often remember where they had come from – arrived in chaos etc. (But yto be used with care – reliving trauma etc etc) That DV initiative – better outcomes if interview women NOT in police station LOOK UP Sons and friends article LOOK UP
- Note HoL report – suggested all should do indep evaluation; not so sure. But certainly mustn’t downplay the role of self-evaluation
- Don’t report everything! Recs rooted in the data