Your SlideShare is downloading. ×
0
Sharing information to improve evaluation
How to navigate the maze ofevaluation methods and approaches                   A BetterEvaluation Podcast                 ...
The Challenge:Overwhelming number anddiversity of PME tools
Wikipedia page for Evaluation Methods
Steps Taken:Tools are just too many, focus onLog Frame and Outcome Mapping
Image: Michael Heilemann. http://www.flickr.com/photos/heilemann
Image: 8lettersuk. http://www.flickr.com/photos/8lettersuk/
Image: Lottery Monkey. http://www.flickr.com/photos/lotterymonkey/
Image: Simon Kneebone. http://simonkneebone.com/
Image: Susan Kistler. http://aea365.org
Image: Reven. http://www.flickr.com/photos/reven/
Image: russelldavies. http://www.flickr.com/photos/russelldavies//
Image: nickherber. http://www.flickr.com/photos/nickherber/
Simple organisational cycle                  Plan   Assess            Act
CIPP Model         ContextInputs   Process   Product
Image: meg_riordan. http://www.flickr.com/photos/meg_riordan/
Evaluation is the activity ofsystematically collecting, analyzingand reporting information so that itcan be used by approp...
•   Who carries out the ‘activity’?•   Who or what is an evaluator?•   How does an activity become ‘systematic’?•   What a...
Rainbow Framework     Over 200 methods/optionsrelated to 35 tasks   in 7 clusters
Rainbow Framework     Over 200 methods/optionsrelated to 35 tasks   in 7 clusters
BetterEvaluation.org
See IOCE.net for a list ofnational evaluation societies
Evaluation Competencies1. Reflective Practice2. Technical Practice3. Situational Practice4. Management Practice5. Interper...
Evaluation Standards1. Utility Standard2. Feasibility Standards3. Propriety Standards4. Accuracy Standards5. Evaluation Ac...
How to navigate the maze ofevaluation methods and approaches                   A BetterEvaluation Podcast                 ...
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
How to navigate the maze of evaluation methods and approaches
Upcoming SlideShare
Loading in...5
×

How to navigate the maze of evaluation methods and approaches

339

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
339
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • There is increasing recognition of the importance of evaluation. But when NGOs or government agencies start to plan an evaluation, or to engage an evaluator, it is difficult to find accessible, comprehensive and credible information about how to choose the right combination of evaluation methods, and how to implement them well – or how to manage these issues with a potential evaluator. Many guides to evaluation focus on only a few types of data collection methods and a few types of research designs. Few guides cover newer types of data collection (such as GIS logging on mobile phones, or tracking social media mentions), designs and strategies that can be used when experimental or quasi-experimental research designs are not feasible or appropriate, and methods to address issues such as clarifying and negotiating the values that should underpin the evaluation. There is information about some of these available on various web sites, but they can be difficult to locate, of varying quality, and not co-ordinated. And much of the information is partisan for particular methods, or does not include examples from practice.
  • There is increasing recognition of the importance of evaluation. But when NGOs or government agencies start to plan an evaluation, or to engage an evaluator, it is difficult to find accessible, comprehensive and credible information about how to choose the right combination of evaluation methods, and how to implement them well – or how to manage these issues with a potential evaluator. Many guides to evaluation focus on only a few types of data collection methods and a few types of research designs. Few guides cover newer types of data collection (such as GIS logging on mobile phones, or tracking social media mentions), designs and strategies that can be used when experimental or quasi-experimental research designs are not feasible or appropriate, and methods to address issues such as clarifying and negotiating the values that should underpin the evaluation. There is information about some of these available on various web sites, but they can be difficult to locate, of varying quality, and not co-ordinated. And much of the information is partisan for particular methods, or does not include examples from practice.
  • There is increasing recognition of the importance of evaluation. But when NGOs or government agencies start to plan an evaluation, or to engage an evaluator, it is difficult to find accessible, comprehensive and credible information about how to choose the right combination of evaluation methods, and how to implement them well – or how to manage these issues with a potential evaluator. Many guides to evaluation focus on only a few types of data collection methods and a few types of research designs. Few guides cover newer types of data collection (such as GIS logging on mobile phones, or tracking social media mentions), designs and strategies that can be used when experimental or quasi-experimental research designs are not feasible or appropriate, and methods to address issues such as clarifying and negotiating the values that should underpin the evaluation. There is information about some of these available on various web sites, but they can be difficult to locate, of varying quality, and not co-ordinated. And much of the information is partisan for particular methods, or does not include examples from practice.
  • Transcript of "How to navigate the maze of evaluation methods and approaches"

    1. 1. Sharing information to improve evaluation
    2. 2. How to navigate the maze ofevaluation methods and approaches A BetterEvaluation Podcast Simon Hearn & Ron Mackay
    3. 3. The Challenge:Overwhelming number anddiversity of PME tools
    4. 4. Wikipedia page for Evaluation Methods
    5. 5. Steps Taken:Tools are just too many, focus onLog Frame and Outcome Mapping
    6. 6. Image: Michael Heilemann. http://www.flickr.com/photos/heilemann
    7. 7. Image: 8lettersuk. http://www.flickr.com/photos/8lettersuk/
    8. 8. Image: Lottery Monkey. http://www.flickr.com/photos/lotterymonkey/
    9. 9. Image: Simon Kneebone. http://simonkneebone.com/
    10. 10. Image: Susan Kistler. http://aea365.org
    11. 11. Image: Reven. http://www.flickr.com/photos/reven/
    12. 12. Image: russelldavies. http://www.flickr.com/photos/russelldavies//
    13. 13. Image: nickherber. http://www.flickr.com/photos/nickherber/
    14. 14. Simple organisational cycle Plan Assess Act
    15. 15. CIPP Model ContextInputs Process Product
    16. 16. Image: meg_riordan. http://www.flickr.com/photos/meg_riordan/
    17. 17. Evaluation is the activity ofsystematically collecting, analyzingand reporting information so that itcan be used by appropriate people toanswer their questions so that theycan make decisions about the future ofa project or program.
    18. 18. • Who carries out the ‘activity’?• Who or what is an evaluator?• How does an activity become ‘systematic’?• What activites and skills do ‘collecting, analysing and reporting’ involve?• How do you go about ‘collecting, analysing and reporting’?• Is that an exhaustive list of ‘the activity’ that is called ‘evaluation’• What kind of ‘information’ is being referred to?• What is the thing or things you collect information about?• Who should be involved in an evaluation?• Who are the ‘appropriate people’ who ‘use’ the ‘information’ supplied by an evaluation?• And for what purposes can they ‘use’ this information?• What kinds of questions can they ask?
    19. 19. Rainbow Framework Over 200 methods/optionsrelated to 35 tasks in 7 clusters
    20. 20. Rainbow Framework Over 200 methods/optionsrelated to 35 tasks in 7 clusters
    21. 21. BetterEvaluation.org
    22. 22. See IOCE.net for a list ofnational evaluation societies
    23. 23. Evaluation Competencies1. Reflective Practice2. Technical Practice3. Situational Practice4. Management Practice5. Interpersonal Practice Competencies for Canadian Evaluation Practice, Canadian Evaluation Society
    24. 24. Evaluation Standards1. Utility Standard2. Feasibility Standards3. Propriety Standards4. Accuracy Standards5. Evaluation Accountability Standards The Program Evaluation Standards developed by the JCSEE
    25. 25. How to navigate the maze ofevaluation methods and approaches A BetterEvaluation Podcast Simon Hearn & Ron Mackay
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×