Successfully reported this slideshow.

Miw Slides Week 3 Real Eval (Versie 7)


Published on

  • Be the first to comment

  • Be the first to like this

Miw Slides Week 3 Real Eval (Versie 7)

  1. 1. Evaluation of the Intervention!orRealisticEvaluationafteryourtakingaction in the problemsituation<br />
  2. 2. Twoperspectivesonreality<br />Politician<br />PrisonsWork!<br />Evaluator<br />What is it in the infinite complex social system of prisonsthatmakepeoplechangetheirbehaviour<br />
  3. 3. Fallacies of Experimental Evaluation<br />Whatcausessomething to happen has nothing to do with the number of timesit happens (Sayer, 1992, p.165)<br />Sayer, A.R., ‘Method in social science, a realist approach’, Routledge, London, 1992<br />
  4. 4. PrisonsWork!<br />Succesionisticregularity, <br />butwhatworks?<br />
  5. 5. Trivial?<br />ICIS, December 2007<br />MISQ, December 2004<br />
  6. 6. Why Realist Evaluation<br />Departure: Social problems are embedded in a stratified reality<br />Rationale: Not repeating programs as a craft, but evaluating program theories as epistemic devices<br />Generative causality: Knowing what works for whom in what circumstances (resources and reasoning)<br />Realistic: Don’t study the program, study the inner workings<br />
  7. 7. Theory-drivenEvaluation<br />C<br />M<br />x<br />y<br />R<br />GenerativeRegularity<br />Pawson, R. and Tilley, N., ‘RealisticEvaluation’, Sage, ThousandOaks, California, 1997<br />
  8. 8. PrisonWorkings!<br />C<br />M<br /> Prison education (x) leads a reduction in recidivism (y)<br /> Reasoning or Resources<br /> M1: self-realization •<br /> M2: last chance<br /> M3: second chance<br /> M4: social acceptability •<br /> M5: moral or civic responsibility<br /> M6: cognitive change<br /> ‘Certain type of prisoner’<br /> C1: Disadvantaged •<br /> C2: The crime committed (pedophilia, pyromania)<br /> C3: First Offenders<br /> C4: Youth prisons, Isolation Cells, Federal Prisons, Death sentenced<br />• mediocre hypothesis<br />x<br />y<br />R<br />Pawson, R. and Tilley, N., ‘RealisticEvaluation’, Sage, ThousandOaks, California, 1997<br />
  9. 9. Another Wicked Problem: Multiple Explanations<br />Making sense of it:<br />Theory adjudication<br /> weeding out rival explanations, with focus on improvement<br />Configurational<br /> application in practice<br />Middle-range<br /> transferability; patterns of repeat victimization<br />Provisional<br /> tested but not proven; soft system and wicked problems<br />Pawson, R. and Tilley, N., ‘Realist Evaluation’, in S Mathison (ed.), Encyclopedia of Evaluation, Sage, Thousand Oaks, California, 2004<br />
  10. 10. Fitness for MIW<br />The upside of Realistic Evaluation<br /><ul><li>Dealing with real or wicked problems
  11. 11. Design needs Evaluation</li></ul>Did the intended outcome actually materialize?<br />The downside<br /><ul><li>No clear-cut recipe
  12. 12. Difficult language and concepts</li></li></ul><li>Camera-surveillance in Car Parks<br />A form of situational crime prevention<br />Visual surveillance technology monitoring variety of environments/activities<br />Growth estimated at 15-20% per year (Davies, 1996)<br />In car parks CCTV is used to prevent and reduce crime<br />
  13. 13. Opdracht<br />ExperimenteleEvaluatie<br />Camera’s werken!<br />RealistischeEvaluatie (opdracht): <br />Wat is het in cameratoezichtwaardoormensenhungedragaanpassen<br />Bedenk de mechanismes<br />Bedenk de contexten<br />
  14. 14. Realistische Analyse<br />Context<br /><ul><li>Criminal clustering
  15. 15. Style of usage
  16. 16. Lie of the land
  17. 17. Alternative targets
  18. 18. Resources
  19. 19. Surveillance Culture</li></ul>Mechanismen<br />Caught in the act<br />You’ve been framed<br />Nosyparker<br />Effectivedeployment<br />Publicitymechanism<br />Time for crime<br />Memory jogging<br />Appeal to becautious<br />
  20. 20. Do youbelievethat<br />Hypothesizingaboutcontexts, mechanisms and outcomes and testing these empirically<br /> Is more valuablethan<br />Comparing the rates of crime before and afterCCTV<br />Then we succeeded<br />