Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Theory of Change and Outcome Mapping

Presentation by Simon Batchelor (IDS) on Theory of Change and Outcome mapping methodologies for intermediary work, given at a virtual workshop on M&E for I-K-Mediary Network members, March 30 2010.

  • Login to see the comments

Theory of Change and Outcome Mapping

  1. 1. Monitoring and Evaluation Some thoughts on Theory of Change and Outcome Mapping Simon Batchelor Interim Impact and Learning Team manager Date:29/3/10
  2. 2. Theory of Change <ul><li>Simply put its about writing down what change you expect to happen? </li></ul><ul><li>And how that change might come about? </li></ul>
  3. 3. Theory of Change (TOC) vs. Logical Framework (LF)! <ul><li>Some people will be familiar with Logical Frameworks </li></ul><ul><li>Donors tend to ask for Logical Framework (LF) </li></ul><ul><li>Is this the same as a Theory of Change? </li></ul><ul><li>Not quite. </li></ul><ul><li>Both are suppose to help project design </li></ul><ul><li>The idea of “Theory of Change” is growing </li></ul><ul><li>People talk about TOCs and LFs but dont mean the same thing </li></ul><ul><li>Limited knowledge on how to use TOC </li></ul><ul><li>TOC and LFs can “blend” into each other </li></ul>
  4. 4. Theories of Change <ul><li>Outcomes-based </li></ul><ul><li>Causal model </li></ul><ul><li>Articulate underlying assumptions </li></ul><ul><li>Logical Frameworks graphically illustrate program components, and creating one helps stakeholders clearly identify outcomes, inputs and activities </li></ul><ul><li>Theories of Change link outcomes and activities to explain HOW and WHY the desired change is expected to come about </li></ul>
  5. 5. Long-term Outcome Necessary Pre- condition Necessary Pre- condition Necessary Pre- condition Necessary Pre- condition Necessary Pre- condition All outcomes that must be achieved BEFORE long-term Explain WHY here Show activities here also
  6. 6. So explain the HOW and the WHY <ul><li>Explain how your work will affect people and make a change </li></ul><ul><li>Explain why your work will affect people and create a change </li></ul>
  7. 7. Clarifying the difference <ul><li>Logic Models usually start with a program and illustrate its components </li></ul><ul><li>Theories of Change may start with a program, but are best when starting with a goal, before deciding what programmatic approaches are needed </li></ul><ul><li>Logic Models require identifying program components , so you can see at a glance if outcomes are out of sync with inputs and activities, but they don’t show WHY activities are expected to produce outcomes </li></ul><ul><li>Theories of Change also require justifications at each step – you have to articulate the hypothesis about why something will cause something else (it’s a causal model, remember!) </li></ul>
  8. 8. Explaining the outcome <ul><li>How often do students need to attend the after-school program in order for their reading tests scores to improve? </li></ul><ul><li>A Logic Model would tell you that the after school program is an activity and improved reading scores is an outcome. It might tell you that attendance at the after school program is an intermediate outcome. </li></ul><ul><li>But it wouldn’t tell you that: </li></ul><ul><li>“ students need to attend after-school programs at least 3 days per week for a minimum of 60 days, and the curricula must focus on love of reading and literacy, IN ORDER FOR test scores to rise” </li></ul>
  9. 9. When to Use? <ul><li>Logical Frameworks are great when you need to: </li></ul><ul><li>Show someone something they can understand at a glance </li></ul><ul><li>Demonstrate you have identified the basic inputs, outputs and outcomes for your work </li></ul><ul><li>Summarize a complex theory into basic categories </li></ul><ul><li>Theories of Change are best when you need to: </li></ul><ul><li>Design a complex initiative and want to have a rigorous plan for success </li></ul><ul><li>Evaluate appropriate outcomes at the right time and the right sequence </li></ul><ul><li>Explain why an initiative worked or did not work, and what exactly went wrong </li></ul>
  10. 10. Summary Logical Frameworks Theories of Change Representation List of Components Descriptive Critical Thinking Pathway of Change Explanatory
  11. 11. So how does this apply to I K Mediary Network? <ul><li>In IDS we found this exercise useful. </li></ul><ul><li>You can find our thinking on our own theory of change. </li></ul><ul><li>(Note a Google search on Theory of Change will lead you to the “superwoman” project - It’s a good example to start with.) </li></ul>
  12. 12. At IDS we said <ul><li>Access to information cannot be viewed as an end in itself but as a contributor to development processes and social change. </li></ul><ul><li>Individual stories from users of the MK4D programme have helped to develop a framework to guide our work and improve planning, evaluation, analysis and targeting of services. </li></ul><ul><li>The resulting theory of change sets out how the programme contributes to information use in development and the model will evolve as it is tested, debated and used in planning, evaluation and research. </li></ul>
  13. 13. At its most simplistic, we see our influence as having a number of layers:
  14. 16. TOC maps out your initiative through 5 stages <ul><li>Identifying long-term goals and the assumptions behind them </li></ul><ul><li>Backwards mapping and connect the preconditions or requirements necessary to achieve that goal. </li></ul><ul><li>Identifying the interventions that your initiative will perform to create your desired change. </li></ul><ul><li>Developing indicators to measure your outcomes to assess the performance of your initiative. </li></ul><ul><li>Writing a narrative to explain the logic of your initiative. </li></ul>
  15. 17. Or to put it another way…. <ul><li>What are you trying to achieve? </li></ul><ul><li>What changes in people do you expect to see? </li></ul><ul><li>How will these changes come about? </li></ul>
  16. 18. Theory of Change led to talking about Outcomes <ul><li>Changes in the behaviour, relationships, activities and/or actions of our target groups that can be logically linked to our programme (although they are not necessarily directly and solely caused by it). </li></ul><ul><li>Outcomes are changes we would like to see in other people, and are thus not entirely within our control. We have broadly divided our theory of change into immediate, intermediate and longer term outcomes. </li></ul><ul><li>Our intermediate outcomes around understanding and influence sit between access to information and the end use of that information. It is about both the understanding and knowledge that results from engaging with information, and the influence that the kinds of information we promote can bring. </li></ul><ul><li>Higher level outcomes are the changes in behaviours of development actors in which we hope to see information influence development processes and interventions. </li></ul>
  17. 19. And thinking about Outcomes led us to Outcome mapping <ul><li>Championed by IDRC, Outcome mapping focuses on outcomes and fits with the theory of change process. </li></ul><ul><li>It challenged the direct causality of the logic model </li></ul><ul><li>It recognises the world is a complex place! </li></ul><ul><li>And it therefore focuses on a range of possible outcomes (hence the term map rather than route). </li></ul>
  18. 20. Last time on these sessions you discussed Policy Mapping – lots of questions <ul><li>What policy, practice or discourse are you seeking to influence by communicating to this audience? </li></ul><ul><li>What attitudes or beliefs might impede influence? </li></ul><ul><li>What kind of knowledge can most effectively influence this audience? </li></ul><ul><li>Which are the best mediums for reaching this audience? </li></ul><ul><li>What is your objective in engaging with policy? </li></ul><ul><li>What kind of policy actors would be most likely to use your resources? </li></ul>
  19. 21. It talked about mapping who talked to who
  20. 22. Key messages of Outcome mapping <ul><li>Seeing yourself as a part of a interconnected web of relationships and systems </li></ul><ul><li>Recognizing that change is Continuous, Complex, Non-linear, Multidirectional, Not controllable </li></ul><ul><li>Keeping your eyes wide open - Being attentive along the journey is as important as the destination </li></ul><ul><li>Contribution not attribution - your influence on a better world - you can influence but not control change in your partners </li></ul>
  21. 23. In other words…… <ul><li>Whatever you are trying to achieve, you have to work with people? </li></ul><ul><li>It would be great to know who those people are – but its not simple. </li></ul><ul><li>You cant control those people – but you might influence them. </li></ul>
  22. 24. Focuses on the who <ul><li>Key concept is « boundary partners » </li></ul><ul><li>The individuals, groups, and organizations you work with directly and anticipate opportunities for influence </li></ul><ul><li>boundary partners have boundary partners </li></ul><ul><li>Therefore network mapping comes into play </li></ul>
  23. 25. Boundary partners are those that engaged with you Example Portal specialising in NGO issues ?
  24. 26. Boundary partners are those that engaged with you Example Portal specialising in NGO issues ? Boundary actors for the portal
  25. 27. Boundary partners are those that engaged with you Example Portal specialising in NGO issues ? Boundary actors for the NGOs engaged in policy process
  26. 28. In other words….. <ul><li>You engage with some people (Boundary partners) </li></ul><ul><li>They engage with others </li></ul><ul><li>Ideas flow from one to the other hopefully creating change (outcomes) </li></ul>
  27. 29. Outcome mapping talks about “progress markers” <ul><li>A graduated set of statements describing a progression of changed behaviours in the boundary partner </li></ul><ul><li>Describe changes in actions, activities and relationships leading to the ideal outcome </li></ul><ul><li>Shows story of change by articulating the complexity of the change process </li></ul><ul><li>Can be monitored & observed </li></ul><ul><li>Permit on-going assessment of partner’s progress (including unintended results) </li></ul><ul><li>Talks about an Outcome Journal </li></ul><ul><ul><li>Story of change and reasons for change </li></ul></ul><ul><ul><li>Unexpected changes </li></ul></ul><ul><ul><li>The actors and factors that contributed to that change </li></ul></ul><ul><ul><li>How we know the change occurred </li></ul></ul><ul><ul><li>Learnings (what? how? why?) </li></ul></ul>
  28. 30. Or to put it another way…. <ul><li>What are you trying to achieve and in who? </li></ul><ul><li>What changes do you expect to see in those people (and how might you “see” them)? </li></ul><ul><li>And who might they tell about the new ideas and what changes might you expect in them. </li></ul>
  29. 31. How can Outcome mapping help? <ul><li>focus more on contribution to outcomes, rather than attribution! </li></ul><ul><li>understanding the boundary partners and strategic partners attitudes and approach is essential </li></ul><ul><li>move from boundary partners to outcome challenges to progress markers to strategy maps in a participatory fashion </li></ul><ul><li>use Organisational Practices systematically to ensure strategies are tailored to existing organisational contexts </li></ul><ul><li>use journals to address the crucial M&E gap </li></ul><ul><li>use the flexibility of OM to combine with other compatible methodologies </li></ul><ul><ul><ul><ul><li>Ben Ramalingam 2005 </li></ul></ul></ul></ul>
  30. 32. Questions for discussion <ul><li>So do you think you can apply Theory of Change to your work? </li></ul><ul><li>Outcome mapping relies on knowing your Boundary partners – do you know your users, and do you know what change you expect in them? </li></ul><ul><li>User surveys can seek the outcome stories of change – do your existing surveys ask about how users used the information you gave them? </li></ul>