Mindset - A Clash of Mindsets Part 1


Published on

Published in: Health & Medicine, Technology
  • Be the first to comment

Mindset - A Clash of Mindsets Part 1

  1. 1. A clash of mindsets finding a middle way between different impact methodologies Joy Mackeith, Triangle, Joy@triangleconsulting.co.uk Neil Reeder, London School of Economics, n.b.reeder@lse.a.uk Social Impact Analysts Association annual conference, December 2013
  2. 2. Aims of session • Lessons from practical experience • Outline of findings from academic research project • Initiate debate on key issues arising from different mindsets
  3. 3. Objectivity and subjectivity (or direct and indirect measurement) Direct measures (often end outcomes) Indirect measures (often intermediate outcomes) Things that can be directly observed, eg housing, offending Things that cannot be directly observed but have an impact on directly observable behaviour, eg confidence, improved relationships Associated with direct cost savings Associated with sustainability of outcomes
  4. 4. Objectivity and subjectivity: Middle ground Use both! Bring objectivity into indirect outcomes through tools for standardising professional judgement or subjective report ie psychometric tools Direct measures Indirect measures
  5. 5. The Outcomes Star
  6. 6. Research on validity, reliability and practical application Dickens et al (2012) “Recovery Star: validating user recovery” in the Psychiatrist Dr Helen Killaspy (2012) “Psychometric properties of Mental Health Recovery Star in British Journal of Psychiatry Harris and Andrews (2013) “Implementing the Outcomes Star well in a multi-disciplinary environment” RMIT University, Australia (Homelessness Star, Drug and Alcohol Star and Empowerment Star) York Consulting (2013) “Family Star Evaluation” published by Family Action
  7. 7. Standardised systems versus case by case approaches Standardised systems Case by case approach Provides a shared framework for use across many projects or people Responds to the uniqueness of each project or person Can be aggregated Captures all impacts and reflects values and language of those being measured
  8. 8. Standardised systems versus case by case approaches : Middle ground Frameworks that allow case by case approaches to be analysed within a standardised system (eg BSC) Tools that are modified for different client groups (eg Outcomes Star) Standardised systems Case by case approach
  9. 9. Example: Big Society Capital Outcomes Matrix Outcome Area Employment Education and Training Housing and Local Facilities Income and Financial Inclusion Physical Health Mental Health Family Friends and Relationships Citizenship and community Arts, Heritage, Sports and Faith Conservation of the Natural Environment Individual Community, Sector and Society
  10. 10. Example: Outcome Star versions Recovery Star (mental health) Life Star (Learning Disabilities) Work Star Older Person’s Star Youth Star Empowerment Star (domestic violence) Teen Star Well-being Star (long-term health conditions) Spectrum Star (Autistic spectrum) Family Star Community Star Shooting Star (schools) Homelessness Star Alcohol Star Music Therapy Star Drug and Alcohol Star
  11. 11. Experimental versus exploratory approaches Experimental Exploratory Simplify complexity by isolating one variable and identifying its impact (ie RCT) Explore relationships between variables and recognise complexity of systems and relationships (eg St Mungo’s work) Can produce very persuasive evidence Cheaper and can produce richer insights into cause and effect
  12. 12. Experimental versus exploratory approaches : Middle ground Look when each approach is appropriate. Perhaps experimental approaches appropriate when sufficient exploration carried out and in very stable environments Experimental Exploratory
  13. 13. Comprehensive versus pragmatic
  14. 14. Comprehensive versus pragmatic: Middle ground Comprehensive provides good intellectual framework but measurement in practice must be pragmatic. Walk first, run later! Comprehensive Pragmatic