Evaluation for Change presentation at the Berlin Change Days 2009. Made and presented by Karstein Haarberg (karstein@haarbergconsulting.com), Haarberg Consulting, www.haarbergconsulting.com.

1. Evaluation for Change By Karstein Haarberg Haarberg Consulting

2. What is Evaluation? Evaluations and Reviews Main goal seems to be to verify that the activity are in line with project documents and agreements Evaluation is both control but also a tool for the organization/project Often evaluations and reviews are compulsory part of accessing external funding Often done under budget and time constrains

3. Present Situation

4. Summary of Differences What's the Difference?

6. The Framework

7. Framework description Existing information: Already a considerable body of knowledge exist, like project/programme documents Hard core data collection: Several tools and methods are at hand for collecting data to verify and identify results and findings. Typically web-based surveys and mobile phone surveys are tools that can be used under time, budget and hardship constraints. Improves outreach and quality. Participatory data collection: Believing that the stakeholders themselves possess knowledge, experience and ability to solve own problems is a basis. Participatory methods and approaches, that utilizes the stakeholders competence and unique insight to analyse own situation and possibilities. Improves ownership. Analysis: At the core we have analytical skills tools and methods available to analyse all these sources of knowledge in a way that benefit the evaluation.

8. Priciple 1: Let everyone be heard! Why? The evaluation does not have the right and complete picture before everyone has been heard How? Surveys ( web-based, mobile phones) and participatory methods

9. Prinicple 2: Learn from successes! Why? Successes giver more information than problems How? Appreciative Inquiry (AI) …used in both surveys and participatory sessions

10. Principle 3: Analysis have alreadystarted! Why? Analysis both conscious and unconscious shape the evaluation at all stages, already before Terms of references are written How? Be aware! Embed analysis reflections on all stages

11. Benefits A richer understanding of what actually was achieved Better and more realistic understanding of possibilities better recommendations More representative findings, as a broader set of stakeholders have been heard

12. Challenges Evaluator, the team (and the principal) must be familiar with more tools Technically there may be challenges in undertaking surveys, response rates, incorrect contact details (e-mail addresses)

13. Thank you! KarsteinHaarberg Vestgrensa 26, NO-0851 Oslo Phone: +47 91641338 Skype: karstein67 E-mail: karstein@haarbergconsulting.com Web: www.haarbergconsulting.com Follow me on Twitter: Karstein67