Ss evaluation workshop presentation

1,128 views
925 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,128
On SlideShare
0
From Embeds
0
Number of Embeds
68
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  •    
  • Ss evaluation workshop presentation

    1. 1. Outcomes- Based Evaluation: what we can learn from museums? Suzanne Spicer [email_address]
    2. 2. Today’s programme <ul><li>Background to outcome-based evaluation in museums </li></ul><ul><li>What can we learn from museums? </li></ul><ul><li>Using these lessons to develop an evaluation plan </li></ul>
    3. 3. The cultural change in museums <ul><li>‘ A Common Wealth: Museums and Learning in the UK ’, A report to the Department of National Heritage, Jan 1997 </li></ul><ul><li>“ Education, education, education” </li></ul><ul><li>Change from “Education” to “Learning” </li></ul><ul><li>Desire to become 21 st century learning organisations </li></ul><ul><li>Launch of quality framework by MLA (Museums, Libraries & Archives Council) </li></ul>
    4. 4. Inspiring Learning for All A good practice framework based on 4 key principles www.inspiringlearningforall.gov.uk
    5. 5. Evidence of the impact on learners <ul><li>External drivers eg funding, public policy, regulatory </li></ul><ul><li>Practical planning benefits </li></ul><ul><li>Support continual improvement </li></ul><ul><li>Demonstrate what can contribute to learning agenda </li></ul><ul><li>“ turning fuzzy anecdotal evidence into credible data for advocacy and service development” </li></ul>
    6. 6. Generic Learning Outcomes: measure impact on learning
    7. 7. Generic Social Outcomes measure impact on social & community life Health and well-being Stronger and safer communities Strengthening public life
    8. 8. What do the GLO/GSOs offer museums? <ul><li>Provide a common conceptual framework and a systematic approach </li></ul><ul><li>Provide agreed categories for classification </li></ul><ul><li>Enable move from ‘anecdote’ to ‘evidence’ </li></ul><ul><li>Is used to describe breadth and depth of outcomes </li></ul><ul><li>Links quantitative and qualitative research </li></ul><ul><li>Useful planning tool </li></ul><ul><li>Generated confidence in undertaking evaluation </li></ul>
    9. 9. Evaluation planning: Writing an evaluation plan <ul><li>Overarching aim ( what do you want to achieve ) </li></ul><ul><li>Objectives (SMART) </li></ul><ul><li>Evaluation questions you want to answer (outcomes/indicators) </li></ul><ul><li>Methodology (techniques & the mosaic approach) </li></ul><ul><li>Evidence (information you will collect) </li></ul><ul><li>Analysis (coding and grouping your information) </li></ul><ul><li>Reporting (lessons learned) </li></ul>
    10. 10. COLLECTING COMMENTS Answer phone, letters, fax Post-Its Comment books, boards, boxes Staff Graffiti Wall DATA COLLECTION OBSERVATION Accompanied visits Behavioural mapping Tracking Recording (audio/video) EVIDENCE-BASED DATA Diaries Pictures, logs Outputs TASK-ORIENTED Talking Creative activity Drama INTERVIEWS Focus groups Individual Personal Meaning Mapping Structured/unstructured QUESTIONNAIRES Mail, e-mail, phone, web Self-completion, face-to-face
    11. 11. Ask for comments creatively; on a washing line or post-its on walls Voluntary Arts Wales evaluation guidance publication: Tear Up Your Tick Boxes Encourage doodles What did you enjoy most today? Why did you enjoy it so much?
    12. 12. Mosaic approach - triangulation Spaces to Play: more listening to young children using the mosaic approach , Alison Clark & Peter Moss (2005), London, National Children’s Bureau <ul><li>The mosaic approach: </li></ul><ul><li>Uses different methods to build a picture of the project </li></ul><ul><li>Combines quantitative and qualitative data </li></ul><ul><li>Includes visual methodologies </li></ul><ul><li>Avoids reliance on the written or spoken word </li></ul>Event Adult questionnaire Child’s drawings Staff graffiti wall
    13. 13. Useful links ESRC Communications Toolkit http://www.esrc.ac.uk/ESRCInfoCentre/CTK/default.aspx RCUK Practical Guide to dialogue with the public http://www.rcuk.ac.uk/cmsweb/downloads/rcuk/scisoc/dialogue.pdf RCUK Evaluation Guide http://www.rcuk.ac.uk/cmsweb/downloads/rcuk/publications/evaluationguide.pdf AHRC Guide to Self-Evaluation http://www.ahrc.ac.uk/FundedResearch/Documents/Understanding%20Your%20Project.pdf EPSRC Good Practice Guide http://www.epsrc.ac.uk/SiteCollectionDocuments/form-notes/ppe-goodpracticeguide.pdf RCMG, University of Leicester http://www.le.ac.uk/ms/research/rcmg.html Inspiring Learning for All www.inspiringlearningforall.gov.uk

    ×