More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (7)
Similar to Unawe evaluation session thursday 10th october 2013
Similar to Unawe evaluation session thursday 10th october 2013 (20)
Recently uploaded
Recently uploaded (20)
Unawe evaluation session thursday 10th october 2013
- 1. UNAWE evaluation Session aims To explain the UNAWE Evaluation approach To show the UNAWE Evaluation handbook materials To show examples of UNAWE evaluation evidence Grace Kimble gkimble@ioe.ac.uk
- 5. 1.3 To learn about evaluation research and examples -Research about evaluation and examples (GK) Programmes have the same issues “Furthermore, due to budget and time constraints, the evaluation of initiatives is often limited. The interconnections between initiatives are very rare which effectively eliminates the possibilities for scaling-up and for the dissemination of the new ideas: the dynamics of “economy of scale” and the huge potential for real impact are simply not being exploited”. http://ec.europa.eu/research/science- society/document_library/pdf_06/report-rocard-on- science-education_en.pdf
- 6. 1.3 To learn about evaluation research and examples -Research about evaluation and examples (GK) local human agency perspective Integration with structural perspectiveCategorisation for communication
- 7. Perspectives Criteria Ontological perspective: Structure Human Agency Function Control, supervision, accountability Learning, understanding Goal Standardisation, universality Variance, difference, diversity and peculiarity Frame Structural/ macro perspective Diagnostic i.e. pupil level Focus Products, conceptual definitions Processes, local meanings Benefit Sorting, accountability Strengthening, autonomy Outcomes Knowledge/professionalism Strengthening/ autonomy Methodology Scientific, quantitative, RCT Responsive, diversified Inquiry Analytic Holistic Locus External Internal Levin-Rosalis et al., 2009:191
- 8. Context Child Group Class Parent Teacher Group of parents Group of teachers Intervention Resource E Learning programme Enrichment Programme Curriculum Informal learning organisation Cluster of schools Network of (in)formal learning organisations Regional policy National Policy International Policy Structural perspective Human agency perspective
- 9. Evaluation strategy: triangulation Teacher surveys for many; mixture of quantitative and qualitative information Level of insight Number of people Pupil drawings/ surveys Qualitative information analysed quantitatively Observations/ interviews Qualitative information analysed quantitatively and reported both qualitatively and quantitatively
- 10. Journey: UNAWE evaluation materials Project initiation: Project goals March 2012: Collaborative goals Aug 2012: Summative evaluation materials produced Nov 2012: NPMs amend framework March 2013: UNAWE Evaluation materials published
- 11. Journey: UNAWE evaluation materials
- 12. Journey: UNAWE evaluation materials
- 13. National Science Foundation Basis: UNAWE evaluation materials
- 14. Generic Learning Outcomes Basis: UNAWE evaluation materials
- 15. Basis: UNAWE evaluation materials
- 17. Domains of active learning Objectives Evidence Curiosity Tenacity Enjoyment Inspiration -Children are doing the tasks with pleasure -Children seem enchanted -Children react with diligence in front of the proposed activities -Children demonstrate attention -Children apply perseverance / tenacity -Children manifest inquisitiveness -Children introduce some complex questions Motivation
- 18. Objectives Evidence Develop Scientific Thinking & Problem Solving Techniques; Planning & Conducting Investigations Observation, Identification, Classification, Making interconnections, Changing Perspective & Communication Discussing and Questioning Planning Observing Interpreting Ideas and Evidence Recording -Correct use of vocabulary or gesture to name objects and phenomena observed in sky -Grouping objects/ phenomena to indicate developing understanding of astronomy concepts -Making conjectures available to be contrasted -Developing some experiences related to the hypothesis -Linking new information with existing conceptions of the same or different areas -Removing previous points of view according to new inputs -Sharing with others their new knowledge Domains of active learning Scientific skills
- 19. Domains of active learning Awareness of the Universe Objectives Evidence Observing, exploring and discovering: 1. The Sun, Sun relative position, Sun light (shadows), Day/night cycle, time zones, the seasons, the Moon, the Earth as a planet, awareness of the existence of water and of the Earth atmosphere and Sun light for the development of life on Earth, Solar and Moon eclipses,... 2. The Solar system: planets characteristics and movements, wharf planets, asteroids, comets,... 3. The Stars in the night sky, the constellations, orientation, the Life-cycle of stars, the formation of stars and planets,... 4. Our place in the Milky Way, Family of galaxies,... 5. Current developments in astronomy 6. Magnetic fields (compass, northern lights,...) 7. Several complementary questions Direct observation and/or recording of naming, first explanations, discussing, drawing, construction, creative responses, movements and dances, etc. to demonstrate knowledge of one of the features listed. left
- 20. Objectives Evidence Valuing different cultural perspective. Recognising different physical perspectives. Positive attitude towards astronomy. Valuing inclusive education Working Individually & in Teams -Demonstrating awareness of different cultures -Ability to observe and explain differences in phenomena in different countries -Statements of future activity with regards to astronomy -Act on an appropriate way in a frame of diversity Domains of active learning Intercultural awareness
- 21. Objectives Evidence Disseminating knowledge to other teachers Recommendations for improvements Embedding new materials in curriculum CPD sharing Written or spoken statements New short, medium or long term planning Domains of active learning Legacy
- 22. Examples of evidence Objectives Evidence Curiosity Tenacity Enjoyment Inspiration -Children are doing the tasks with pleasure -Children seem enchanted -Children react with diligence in front of the proposed activities -Children demonstrate attention -Children apply perseverance / tenacity -Children manifest inquisitiveness -Children introduce some complex questions Motivation
- 24. Examples of evidence MotivationCase study: Germany- Teacher training responses Workshop 13a and 13b , 2012 n=78 comments
- 25. Objectives Evidence Develop Scientific Thinking & Problem Solving Techniques; Planning & Conducting Investigations Observation, Identification, Classification, Making interconnections, Changing Perspective & Communication Discussing and Questioning Planning Observing Interpreting Ideas and Evidence Recording Evaluation -Correct use of vocabulary or gesture to name objects and phenomena observed in sky -Grouping objects/ phenomena to indicate developing understanding of astronomy concepts -Making conjectures available to be contrasted -Developing some experiences related to the hypothesis -Linking new information with existing conceptions of the same or different areas -Removing previous points of view according to new inputs -Sharing with others their new knowledge Scientific skills Examples of evidence
- 26. Objectives Evidence Develop Scientific Thinking & Problem Solving Techniques; Planning & Conducting Investigations Observation, Identification, Classification, Making interconnections, Changing Perspective & Communication Discussing and Questioning Planning Observing Interpreting Ideas and Evidence Recording Evaluation -Correct use of vocabulary or gesture to name objects and phenomena observed in sky -Grouping objects/ phenomena to indicate developing understanding of astronomy concepts -Making conjectures available to be contrasted -Developing some experiences related to the hypothesis -Linking new information with existing conceptions of the same or different areas -Removing previous points of view according to new inputs -Sharing with others their new knowledge Scientific skills: groups Examples of evidence
- 27. Examples of evidence Scientific skills Case study: The Netherlands- Teacher training responses March 2013 n=65 comments Did you develop any new skills or practice existing skills? Teacher quotes; many focussed on pedagogical approach as a skill they had acquired: “new skills! inquiry learning and how I can use it in my classroom” “how to explain clearly to children using visuals” “the usefulness of discovery learning”
- 28. Examples of evidence Communication skills: teachers Case study: The Netherlands- Teacher training responses March 2013 n=65 comments Did you develop any new skills or practice existing skills? Teacher quotes; many focussed on pedagogical approach as a skill they had acquired: “new skills! inquiry learning and how I can use it in my classroom” “how to explain clearly to children using visuals” “the usefulness of discovery learning”
- 29. Awareness of the Universe Objectives Evidence Observing, exploring and discovering: 1. The Sun, Sun relative position, Sun light (shadows), Day/night cycle, time zones, the seasons, the Moon, the Earth as a planet, awareness of the existence of water and of the Earth atmosphere and Sun light for the development of life on Earth, Solar and Moon eclipses,... 2. The Solar system: planets characteristics and movements, wharf planets, asteroids, comets,... 3. The Stars in the night sky, the constellations, orientation, the Life-cycle of stars, the formation of stars and planets,... 4. Our place in the Milky Way, Family of galaxies,... 5. Current developments in astronomy 6. Magnetic fields (compass, northern lights,...) 7. Several complementary questions Direct observation and/or recording of naming, first explanations, discussing, drawing, construction, creative responses, movements and dances, etc. to demonstrate knowledge of one of the features listed. left Examples of evidence
- 30. Awareness of the Universe Case study: Spain- Teacher training responses Improvement over time Examples of evidence
- 31. Awareness of the Universe Examples of evidence
- 32. Objectives Evidence Valuing different cultural perspective. Recognising different physical perspectives. Positive attitude towards astronomy. Valuing inclusive education Working Individually & in Teams -Demonstrating awareness of different cultures -Ability to observe and explain differences in phenomena in different countries -Statements of future activity with regards to astronomy -Act on an appropriate way in a frame of diversity Intercultural awareness Examples of evidence
- 33. Intercultural awareness Case study: Italian and South African exchange partnership July- August 2012 n = 5 schools Examples of evidence
- 34. Objectives Evidence Disseminating knowledge to other teachers Recommendations for improvements Embedding new materials in curriculum CPD sharing Written or spoken statements New short, medium or long term planning Examples of evidence Legacy
- 35. Examples of evidence Case study: United Kingdom Teacher training responses Nov 2011 n = 48 participants Initial Action Plan - as a result of this training I will: “Endeavour to deliver the programme to my own P6 class within our World Around Us planning /teaching. Disseminate today’s programme to my other 3 year group colleagues in P6 and possibly to the P7 year group. Explore resources indicated to us today and try to secure funding for those requiring purchases”. Follow up: Have you ever had a chance to talk to your colleagues about EU-UNAWE to disseminate what you have learned? “I disseminated some of the materials at a staff meeting. I have also incorporated the materials into a unit called Razzle Dazzle – all based on light, planets, constellations etc and have shared it with two colleagues from other schools who have also used it”.
- 36. Objectives Evidence Disseminating knowledge to other teachers Recommendations for improvements Embedding new materials in curriculum CPD sharing Written or spoken statements New short, medium or long term planning Domains of active learning Legacy
- 37. Domains of active learning Legacy
- 38. UNAWE evaluation Review aims To explain the UNAWE Evaluation approach To show the UNAWE Evaluation handbook materials To show examples of UNAWE evaluation evidence Grace Kimble gkimble@ioe.ac.uk
- 39. UNAWE evaluation