Monitoring, Evaluation and Learning        Preparing the foundations -Theory of Change and Log frames: the DFID           ...
Four Foundation Stones of MEL1. Understand your                  2. Understand your MELprogramme                          ...
DFID Log framePROJECT NAME           Development Project XXXXXIMPACT                 Impact Indicator 1                   ...
Theory of Change definition  Theory of change is a process which   applies critical thinking to the design,implementation ...
Key aspects of a theory of change•Context,•The current state of the problem,•Long-term change,•Process/sequence of change,...
Theory of change process 1      Context          Current state of the   Desired long term  Social, political,        probl...
Theory of change process 2                                                      Impact/                                Bas...
Results ChainInput             Process             Output          Outcome           Impact                            Con...
Theory of Change: Case study –    Accountability Tanzania (AcT) 1• www.accountability.or.tz• Funded by DFID• Aim: to suppo...
Theory of Change: Case study – Accountability Tanzania (AcT) 2         Headline Theory of Change‘Supporting civil society ...
Theory of Change: Case study – Accountability Tanzania (AcT) 3Longer ToC narrative – enabling identification of inputs, pr...
Impact                         MDGs achieved                        Increased accountability andOutcome                   ...
Exercise: Creating a Theory of Change1. What issue/problem are you trying to address?2. What are you trying to achieve?3. ...
Exercise: Creating a Theory of Change3. Break down your theory of change (and create a resultschain) Inputs               ...
Assumptions      • Challenges to logic      • If not identified can        undermine a        programme e.g.        nutrit...
4              3Assumptions                  2                          1                              16
Assumptions 1                                     INPUTS‘If civil society grantees are carefully selected and respond to i...
Assumptions 2                                  PROCESSESto develop targeted strategic interventions which are sensitive to...
Assumptions 3                                     PROCESSES     CSOs implementing programmes will engage in a range of kno...
Assumptions 4                                  OUTPUTSSome participatory activities build directly into citizen action and...
Exercise: Thinking about assumptions1. What assumptions might you be making about your project or programme?2. To which le...
DFID Log Frames 1• Allows harmonised reporting across DFID• Promotes stakeholder consensus• Summarises and communicates un...
DFID Log Frames 2• Impact – not intended to be achieved by the  project – the higher level situation that the  project wil...
Useful LinksWorld Bank Impact Evaluation Toolkit: http://web.worldbank.org/Http://go.worldbank.org/IT69C5OGL0DFID Theory o...
Upcoming SlideShare
Loading in...5
×

Effectiveness workshop - Monitoring, Evaluation and Learning - Caroline Hoy, DFID

1,131

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,131
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
38
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Effectiveness workshop - Monitoring, Evaluation and Learning - Caroline Hoy, DFID

  1. 1. Monitoring, Evaluation and Learning Preparing the foundations -Theory of Change and Log frames: the DFID approach Dr Caroline Hoy Civil Society Department Department of International Development c-hoy@dfid.gov.uk 1
  2. 2. Four Foundation Stones of MEL1. Understand your 2. Understand your MELprogramme needs and demandsa. What is the need for the a. Learning and improvementprogramme? b. Accountability and impactb. How will the programme respond c. Respond to donorsto the identified need? d. Stakeholdersc. Theory of change e. Beneficiaries3. Plan your MEL approach 4. Manage your evaluationa.Structure and monitor your a. Roles and responsibilitiesprogress (log frame) b. Financeb.Key evaluation questions c. Timeframec.Methods d. Capacityd.Analysis e. Dissemination ande.Learning and feedback communication 2
  3. 3. DFID Log framePROJECT NAME Development Project XXXXXIMPACT Impact Indicator 1 Baseline Milestone 1 Milestone 2 Target (March 20??) Planned Achieved SourceOUTCOME Outcome Indicator 1 Baseline Milestone 1 Milestone 2 Target (March 20??) Assumptions Planned Achieved Source Outcome Indicator 2 Baseline Milestone 1 Milestone 2 Target (March 20??) Planned Achieved Source Outcome Indicator 3 Baseline Milestone 1 Milestone 2 Target (March 20??) Planned Achieved Source Outcome Indicator 4 Baseline Milestone 1 Milestone 2 Target (March 20??) Planned Achieved SourceINPUTS (£) DFID (£) Govt (£) Other (£) Total (£) DFID SHARE (%)INPUTS (HR) DFID (FTEs)OUTPUT 1 Output Indicator 1.1 Baseline Milestone 1 Milestone 2 Target (March 20??) Assumptions Planned Achieved Source Output Indicator 1.2 Baseline Milestone 1 Milestone 2 Target (March 20??) Planned Achieved SourceIMPACT WEIGHTING (%) RISK RATINGINPUTS (£) DFID (£) Govt (£) Other (£) Total (£) DFID SHARE (%)INPUTS (HR) DFID (FTEs) 3
  4. 4. Theory of Change definition Theory of change is a process which applies critical thinking to the design,implementation and evaluation of initiatives and programmes intended to support change in their contexts.The description of a sequence of events that is expected to lead to change 4
  5. 5. Key aspects of a theory of change•Context,•The current state of the problem,•Long-term change,•Process/sequence of change,•Assumptions,•Evidence or logic base,•Diagram and narrative summary… … and the voice of the beneficiary.•But … 5
  6. 6. Theory of change process 1 Context Current state of the Desired long term Social, political, problem change environmental … Diagram andSequence of change Assumptions narrative summary 6
  7. 7. Theory of change process 2 Impact/ Baseline Outcomes Context Current state of the Desired long term Social, political, problem change environmental … Diagram andSequence of change Assumptions narrative summary Inputs, activities, ? Information for output … or log frame results chain 7
  8. 8. Results ChainInput Process Output Outcome Impact Context and Assumptions • Funds, expertise, time, staff • Activities, actions … (Education strategy, resourcing plans) • Specific deliverable of the project and which provide conditions necessary for outcome(s) to be achieved (schools built) • What will change/who will benefit (children receiving quality education to primary school level yr5) • Overall goal to which the project will contribute (literacy levels) 8
  9. 9. Theory of Change: Case study – Accountability Tanzania (AcT) 1• www.accountability.or.tz• Funded by DFID• Aim: to support citizens to make government more transparent, accountable and responsive to citizens, by working with civil society organisations in Tanzania• Provides funding and technical support to CSOs 9
  10. 10. Theory of Change: Case study – Accountability Tanzania (AcT) 2 Headline Theory of Change‘Supporting civil society partners to implement context-specific strategic interventions willenable them to influence positive change in theattitudes and behaviour of citizens, civil society and government, making government as a whole more responsive and accountable.’ 10
  11. 11. Theory of Change: Case study – Accountability Tanzania (AcT) 3Longer ToC narrative – enabling identification of inputs, process, outputs and outcomes•‘If civil society grantees are carefully selected and respond to individual support tailored totheir programming and internal systems, they will be able to utilise grants to developtargeted strategic interventions which are sensitive to changes over time and in the broaderpolitical economy, as well as their geographic location, their sector, institutional mandate andvalues. INPUTS, PROCESS•And if grantees also commit to systematic learning individually and collectively the work theydo will be more the effective. PROCESS•CSOs implementing programmes will engage in a range of knowledge and informationgenerating and disseminating activities as well as developing the capacity of otherstakeholders to articulate their roles and responsibilities. PROCESS OUTPUTS•Some participatory activities build directly into citizen action and civil societystrengthening, whereas others focus on influencing the behaviour of elected and appointedofficials and of the judiciary – at local and national levels. OUTPUTS•Influencing activities can be formal or informal, inside track or outside track, and CSOsbecome more adept at selecting which is going to be most effective under what circumstances.•The result of the behaviour changes on the part of key stakeholders is the impact level of theprogramme: ‘Increased responsiveness and accountability of government through astrengthened civil society.’ OUTCOME•The super impact of the programme is the increasing ability of Tanzanian to claim andexercise their rights as citizens’ (Achievement of MDGs 3&8 gender equality/women’sempowerment and partnership in development). IMPACT
  12. 12. Impact MDGs achieved Increased accountability andOutcome responsiveness of Government Behaviour changeOutputs Citizens Government Civil Influence on behaviour of Citizen society elected representatives, strengthen action govt. offices, judiciary edProcessoutputs Knowledge Capacity generated Information disseminated built Targeted strategic interventionsProcess Individual and shared learningInputs Selection, tailored support, grants 12
  13. 13. Exercise: Creating a Theory of Change1. What issue/problem are you trying to address?2. What are you trying to achieve?3. What are you doing? 13
  14. 14. Exercise: Creating a Theory of Change3. Break down your theory of change (and create a resultschain) Inputs Outputs Process Outcome Process Outputs Impact 14
  15. 15. Assumptions • Challenges to logic • If not identified can undermine a programme e.g. nutrition in Bangladesh • May result in fundamental alterations to a project or programme 15
  16. 16. 4 3Assumptions 2 1 16
  17. 17. Assumptions 1 INPUTS‘If civil society grantees are carefully selected and respond to individual support tailored to their programming and internal systems, they will be able to utilise grants 1 ASSUMPTIONS: INPUTS TO PROCESS•AcT has a successful selection process that can identify organisations committedto change rather than administering money with a governance spin•AcT has skills and judgement to provide support, manage risk and the portfolio•CSOs have sector and area specific knowledge and understanding•CSO can develop familiarity with, and confidence in, working in changing politicaleconomy and develop to work with this 17
  18. 18. Assumptions 2 PROCESSESto develop targeted strategic interventions which are sensitive to changes overtime and in the broader political economy, as well as their geographic location, their sector, institutional mandate and values. And if grantees also commit to systematic learning individually and collectively the work they do will be more the effective. 2 ASSUMPTIONS: PROCESSES TO OUTPUTS•Systematic learning enables CSOs to grow and move beyond ‘business asusual’; copycat approaches and ‘chasing the money’•CSOs become aware of the positive and negative lessons developed by others•CSOs monitor their own effectiveness and make changes as appropriate•CSOs document and embed learning•CSOs maintain ethics and integrity 18
  19. 19. Assumptions 3 PROCESSES CSOs implementing programmes will engage in a range of knowledge and information generating and disseminating activities as well as developing the capacity of other stakeholders to articulate their roles and responsibilities. 3 ASSUMPTIONS: PROCESS OUTPUTS TO OUTPUTS•Citizens are stimulated to respond to knowledge and information•Citizens see the value of taking action on information, knowledge andparticipation in capacity building•Participatory processes are empowering and stimulate action•Citizens overcome fear and apathy and stimulate others to join in•Decision makers recognise that they will not retain power unless they respond totheir citizens•Decision makers are open to citizen and civil society action 19
  20. 20. Assumptions 4 OUTPUTSSome participatory activities build directly into citizen action and civil societystrengthening, whereas others focus on influencing the behaviour of elected and appointed officials and of the judiciary – at local and national levels. Influencing activities can be formal or informal, inside track or outside track, and CSOs become more adept at selecting which is going to be most effective under what circumstances. 4 ASSUMPTIONS: OUTCOME TO IMPACT•Individual elected representatives, appointed officials and member of thejudiciary are able to influence the politics and systems that frame theiractions•Legislation, state systems and official processes are open to change 20
  21. 21. Exercise: Thinking about assumptions1. What assumptions might you be making about your project or programme?2. To which level of your results chain/ logic model do they apply?3. What are the implications for your project or programme? Can you do somethingabout these or simply acknowledge issues through e.g. risk planning? 21
  22. 22. DFID Log Frames 1• Allows harmonised reporting across DFID• Promotes stakeholder consensus• Summarises and communicates unambiguously• Allows comparison of planned and actual results• Also includes indicators and milestones. Indicators are performance measures which tell us what we are going to measure, not what we are going to achieve• Importance of baselines• Importance of disaggregation of information e.g. by gender 22
  23. 23. DFID Log Frames 2• Impact – not intended to be achieved by the project – the higher level situation that the project will contribute towards achieving.• Targets should be Specific, Measureable, Achievable, Relevant and Time-bound• Source – the list of information you will need to demonstrate what has been accomplished• Impact weighting – a percentage for the contribution each output is likely to make to the achievement of the overall impact 23
  24. 24. Useful LinksWorld Bank Impact Evaluation Toolkit: http://web.worldbank.org/Http://go.worldbank.org/IT69C5OGL0DFID Theory of Change:http://www.dfid.gov.uk/r4d/Output/190843/Default.aspxTheory of Change Community:https://www.theoryofchange.org/Kellogg Foundation Handbook:http://www.wkkf.org/knowledge-center/resources/2010/W-K-Kellogg-Foundation-Evaluation-Handbook.aspx 24
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×