Unawe evaluation session thursday 10th october 2013

270 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
270
On SlideShare
0
From Embeds
0
Number of Embeds
60
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Unawe evaluation session thursday 10th october 2013

  1. 1. UNAWE evaluation Session aims To explain the UNAWE Evaluation approach To show the UNAWE Evaluation handbook materials To show examples of UNAWE evaluation evidence Grace Kimble gkimble@ioe.ac.uk
  2. 2. UNAWE evaluation
  3. 3. UNAWE evaluation
  4. 4. 1.3 To learn about evaluation research and examples -Research about evaluation and examples (GK) Programmes have the same issues “Furthermore, due to budget and time constraints, the evaluation of initiatives is often limited. The interconnections between initiatives are very rare which effectively eliminates the possibilities for scaling-up and for the dissemination of the new ideas: the dynamics of “economy of scale” and the huge potential for real impact are simply not being exploited”. http://ec.europa.eu/research/science- society/document_library/pdf_06/report-rocard-on- science-education_en.pdf
  5. 5. 1.3 To learn about evaluation research and examples -Research about evaluation and examples (GK) local human agency perspective Integration with structural perspectiveCategorisation for communication
  6. 6. Perspectives Criteria Ontological perspective: Structure Human Agency Function Control, supervision, accountability Learning, understanding Goal Standardisation, universality Variance, difference, diversity and peculiarity Frame Structural/ macro perspective Diagnostic i.e. pupil level Focus Products, conceptual definitions Processes, local meanings Benefit Sorting, accountability Strengthening, autonomy Outcomes Knowledge/professionalism Strengthening/ autonomy Methodology Scientific, quantitative, RCT Responsive, diversified Inquiry Analytic Holistic Locus External Internal Levin-Rosalis et al., 2009:191
  7. 7. Context Child Group Class Parent Teacher Group of parents Group of teachers Intervention Resource E Learning programme Enrichment Programme Curriculum Informal learning organisation Cluster of schools Network of (in)formal learning organisations Regional policy National Policy International Policy Structural perspective Human agency perspective
  8. 8. Evaluation strategy: triangulation Teacher surveys for many; mixture of quantitative and qualitative information Level of insight Number of people Pupil drawings/ surveys Qualitative information analysed quantitatively Observations/ interviews Qualitative information analysed quantitatively and reported both qualitatively and quantitatively
  9. 9. Journey: UNAWE evaluation materials Project initiation: Project goals March 2012: Collaborative goals Aug 2012: Summative evaluation materials produced Nov 2012: NPMs amend framework March 2013: UNAWE Evaluation materials published
  10. 10. Journey: UNAWE evaluation materials
  11. 11. Journey: UNAWE evaluation materials
  12. 12. National Science Foundation Basis: UNAWE evaluation materials
  13. 13. Generic Learning Outcomes Basis: UNAWE evaluation materials
  14. 14. Basis: UNAWE evaluation materials
  15. 15. Domains of active learning Objectives Evidence Curiosity Tenacity Enjoyment Inspiration -Children are doing the tasks with pleasure -Children seem enchanted -Children react with diligence in front of the proposed activities -Children demonstrate attention -Children apply perseverance / tenacity -Children manifest inquisitiveness -Children introduce some complex questions Motivation
  16. 16. Objectives Evidence Develop Scientific Thinking & Problem Solving Techniques; Planning & Conducting Investigations Observation, Identification, Classification, Making interconnections, Changing Perspective & Communication  Discussing and Questioning Planning Observing Interpreting Ideas and Evidence Recording -Correct use of vocabulary or gesture to name objects and phenomena observed in sky -Grouping objects/ phenomena to indicate developing understanding of astronomy concepts -Making conjectures available to be contrasted -Developing some experiences related to the hypothesis -Linking new information with existing conceptions of the same or different areas -Removing previous points of view according to new inputs -Sharing with others their new knowledge Domains of active learning Scientific skills
  17. 17. Domains of active learning Awareness of the Universe Objectives Evidence Observing, exploring and discovering: 1. The Sun, Sun relative position, Sun light (shadows), Day/night cycle, time zones, the seasons, the Moon, the Earth as a planet, awareness of the existence of water and of the Earth atmosphere and Sun light for the development of life on Earth, Solar and Moon eclipses,... 2. The Solar system: planets characteristics and movements, wharf planets, asteroids, comets,... 3. The Stars in the night sky, the constellations, orientation, the Life-cycle of stars, the formation of stars and planets,... 4. Our place in the Milky Way, Family of galaxies,... 5. Current developments in astronomy 6. Magnetic fields (compass, northern lights,...) 7. Several complementary questions Direct observation and/or recording of naming, first explanations, discussing, drawing, construction, creative responses, movements and dances, etc. to demonstrate knowledge of one of the features listed. left
  18. 18. Objectives Evidence  Valuing different cultural perspective. Recognising different physical perspectives. Positive attitude towards astronomy. Valuing inclusive education  Working Individually & in Teams -Demonstrating awareness of different cultures -Ability to observe and explain differences in phenomena in different countries -Statements of future activity with regards to astronomy -Act on an appropriate way in a frame of diversity Domains of active learning Intercultural awareness
  19. 19. Objectives Evidence Disseminating knowledge to other teachers Recommendations for improvements Embedding new materials in curriculum CPD sharing Written or spoken statements New short, medium or long term planning Domains of active learning Legacy
  20. 20. Examples of evidence Objectives Evidence Curiosity Tenacity Enjoyment Inspiration -Children are doing the tasks with pleasure -Children seem enchanted -Children react with diligence in front of the proposed activities -Children demonstrate attention -Children apply perseverance / tenacity -Children manifest inquisitiveness -Children introduce some complex questions Motivation
  21. 21. Examples of evidence
  22. 22. Examples of evidence MotivationCase study: Germany- Teacher training responses Workshop 13a and 13b , 2012 n=78 comments
  23. 23. Objectives Evidence Develop Scientific Thinking & Problem Solving Techniques; Planning & Conducting Investigations Observation, Identification, Classification, Making interconnections, Changing Perspective & Communication  Discussing and Questioning Planning Observing Interpreting Ideas and Evidence Recording Evaluation -Correct use of vocabulary or gesture to name objects and phenomena observed in sky -Grouping objects/ phenomena to indicate developing understanding of astronomy concepts -Making conjectures available to be contrasted -Developing some experiences related to the hypothesis -Linking new information with existing conceptions of the same or different areas -Removing previous points of view according to new inputs -Sharing with others their new knowledge Scientific skills Examples of evidence
  24. 24. Objectives Evidence Develop Scientific Thinking & Problem Solving Techniques; Planning & Conducting Investigations Observation, Identification, Classification, Making interconnections, Changing Perspective & Communication  Discussing and Questioning Planning Observing Interpreting Ideas and Evidence Recording Evaluation -Correct use of vocabulary or gesture to name objects and phenomena observed in sky -Grouping objects/ phenomena to indicate developing understanding of astronomy concepts -Making conjectures available to be contrasted -Developing some experiences related to the hypothesis -Linking new information with existing conceptions of the same or different areas -Removing previous points of view according to new inputs -Sharing with others their new knowledge Scientific skills: groups Examples of evidence
  25. 25. Examples of evidence Scientific skills Case study: The Netherlands- Teacher training responses March 2013 n=65 comments Did you develop any new skills or practice existing skills? Teacher quotes; many focussed on pedagogical approach as a skill they had acquired: “new skills! inquiry learning and how I can use it in my classroom” “how to explain clearly to children using visuals” “the usefulness of discovery learning”
  26. 26. Examples of evidence Communication skills: teachers Case study: The Netherlands- Teacher training responses March 2013 n=65 comments Did you develop any new skills or practice existing skills? Teacher quotes; many focussed on pedagogical approach as a skill they had acquired: “new skills! inquiry learning and how I can use it in my classroom” “how to explain clearly to children using visuals” “the usefulness of discovery learning”
  27. 27. Awareness of the Universe Objectives Evidence Observing, exploring and discovering: 1. The Sun, Sun relative position, Sun light (shadows), Day/night cycle, time zones, the seasons, the Moon, the Earth as a planet, awareness of the existence of water and of the Earth atmosphere and Sun light for the development of life on Earth, Solar and Moon eclipses,... 2. The Solar system: planets characteristics and movements, wharf planets, asteroids, comets,... 3. The Stars in the night sky, the constellations, orientation, the Life-cycle of stars, the formation of stars and planets,... 4. Our place in the Milky Way, Family of galaxies,... 5. Current developments in astronomy 6. Magnetic fields (compass, northern lights,...) 7. Several complementary questions   Direct observation and/or recording of naming, first explanations, discussing, drawing, construction, creative responses, movements and dances, etc. to demonstrate knowledge of one of the features listed. left Examples of evidence
  28. 28. Awareness of the Universe Case study: Spain- Teacher training responses Improvement over time Examples of evidence
  29. 29. Awareness of the Universe Examples of evidence
  30. 30. Objectives Evidence  Valuing different cultural perspective. Recognising different physical perspectives. Positive attitude towards astronomy. Valuing inclusive education  Working Individually & in Teams -Demonstrating awareness of different cultures -Ability to observe and explain differences in phenomena in different countries -Statements of future activity with regards to astronomy -Act on an appropriate way in a frame of diversity Intercultural awareness Examples of evidence
  31. 31. Intercultural awareness Case study: Italian and South African exchange partnership July- August 2012 n = 5 schools Examples of evidence
  32. 32. Objectives Evidence Disseminating knowledge to other teachers Recommendations for improvements Embedding new materials in curriculum CPD sharing Written or spoken statements New short, medium or long term planning Examples of evidence Legacy
  33. 33. Examples of evidence Case study: United Kingdom Teacher training responses Nov 2011 n = 48 participants Initial Action Plan - as a result of this training I will: “Endeavour to deliver the programme to my own P6 class within our World Around Us planning /teaching. Disseminate today’s programme to my other 3 year group colleagues in P6 and possibly to the P7 year group. Explore resources indicated to us today and try to secure funding for those requiring purchases”. Follow up: Have you ever had a chance to talk to your colleagues about EU-UNAWE to disseminate what you have learned? “I disseminated some of the materials at a staff meeting. I have also incorporated the materials into a unit called Razzle Dazzle – all based on light, planets, constellations etc and have shared it with two colleagues from other schools who have also used it”.
  34. 34. Objectives Evidence Disseminating knowledge to other teachers Recommendations for improvements Embedding new materials in curriculum CPD sharing Written or spoken statements New short, medium or long term planning Domains of active learning Legacy
  35. 35. Domains of active learning Legacy
  36. 36. UNAWE evaluation Review aims To explain the UNAWE Evaluation approach To show the UNAWE Evaluation handbook materials To show examples of UNAWE evaluation evidence Grace Kimble gkimble@ioe.ac.uk
  37. 37. UNAWE evaluation

×