0
Image: dan / FreeDigitalPhotos.net Deborah Nusche Policy Analyst Education and Training Policy Division OECD Directorate f...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes
<ul><ul><li>Purpose:  To explore how systems of evaluation and assessment can be used to improve the quality, equity and e...
OECD Review on Evaluation and Assessment Frameworks  for Improving School Outcomes:  SCOPE <ul><li>The Review looks at dif...
<ul><li>Overarching policy question:  “How can assessment and evaluation policies work together more effectively to improv...
<ul><ul><ul><li>24 countries:  Australia, Austria, Belgium (Flemish Community), Belgium (Fr.), Canada, Czech Rep.,  </li><...
<ul><ul><li>Outputs: </li></ul></ul><ul><ul><ul><li>24 Country Background Reports:  9 are completed, more to come soon. </...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes
The Country Review visit to Sweden (May 2010) <ul><li>Sweden: first Country Review of the OECD project  </li></ul><ul><li>...
OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes
Evaluation and assessment framework Structure of the OECD Review report for Sweden <ul><ul><li>The Evaluation and Assessme...
The Evaluation and assessment framework
<ul><ul><li>Sweden’s approach to evaluation and assessment is built on high trust system  fostering ownership, participati...
School  evaluation System evaluation Student assessment Evaluation and assessment framework:  Key elements are well establ...
Student assessment
<ul><ul><li>Sweden has a balanced approach to student assessment… </li></ul></ul><ul><ul><li>Broad approach to assessment ...
Teacher appraisal
<ul><ul><li>Swedish teachers are trusted professionals… </li></ul></ul><ul><ul><li>Teachers have a high degree of autonomy...
School evaluation
<ul><ul><li>There has been strong investment in school evaluation… </li></ul></ul><ul><ul><li>School evaluation builds on ...
System evaluation
<ul><ul><li>Education system evaluation is well established… </li></ul></ul><ul><ul><li>Education system performance is mo...
Summary of key issues <ul><ul><li>Developing a coherent framework for evaluation and assessment </li></ul></ul><ul><ul><li...
Where to go from here? 5 suggestions
School  evaluation System evaluation Student assessment Suggested next steps (1):  Establish a strategic plan or framework...
School evaluation System evaluation School principal appraisal Student assessment Develop a framework of teaching standard...
Teacher appraisal Country Examples? Chile: The Good Teaching  Framework provides  clear guidance to  all aspects of the  t...
School  evaluation System evaluation Student assessment Suggested next steps (3): Increase the reliability of national ass...
Increase reliability of national assessments Country Examples? New Zealand:  The National Education  Monitoring Project De...
School  evaluation Self evaluation Municipal evaluation Inspections System evaluation Student assessment Suggested next st...
School evaluation Country Examples? Hong Kong Learning from innovating schools New Zealand: collaborative  school evaluati...
School  evaluation System evaluation  Municipal Central Student assessment Suggested next steps (5): Strengthen education ...
<ul><ul><li>Pointers for policy development </li></ul></ul><ul><ul><li>Map out overall framework  </li></ul></ul><ul><ul><...
Image: dan / FreeDigitalPhotos.net Thank you!  [email_address] www.oecd.org/edu/evaluationpolicy
Upcoming SlideShare
Loading in...5
×

OECD Reviews of Evaluation and Assessment in Education: SWEDEN - Stockholm – 7 December 2011

1,418

Published on

Deborah Nusche

Policy Analyst
Education and Training Policy Division
OECD Directorate for Education

The OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes, launched in late 2009, is designed to respond to the strong interest in evaluation and assessment issues evident at national and international levels. It will provide a description of design, implementation and use of assessment and evaluation procedures in countries; analyse strengths and weaknesses of different approaches; and provide recommendations for improvement.


The Review looks at the various components of assessment and evaluation frameworks that countries use with the objective of improving student outcomes. These include student assessment, teacher appraisal, school evaluation and system evaluation. The analysis focuses on primary and secondary levels of education.

Published in: Education, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,418
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
22
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "OECD Reviews of Evaluation and Assessment in Education: SWEDEN - Stockholm – 7 December 2011"

  1. 1. Image: dan / FreeDigitalPhotos.net Deborah Nusche Policy Analyst Education and Training Policy Division OECD Directorate for Education Stockholm – 7 December 2011 OECD Reviews of Evaluation and Assessment in Education: SWEDEN
  2. 2. OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes
  3. 3. <ul><ul><li>Purpose: To explore how systems of evaluation and assessment can be used to improve the quality, equity and efficiency of school education. </li></ul></ul><ul><ul><li>The Review will: </li></ul></ul><ul><ul><li>Synthesise research-based evidence on the impact of evaluation and assessment strategies and disseminate this knowledge among countries. </li></ul></ul><ul><ul><li>Identify innovative and successful policy initiatives and practices. </li></ul></ul><ul><ul><li>Facilitate exchanges of lessons and dialogue. </li></ul></ul><ul><ul><li>Identify policy options for governments to consider. </li></ul></ul>OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes (2009-2012)
  4. 4. OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes: SCOPE <ul><li>The Review looks at different elements of evaluation and assessment. </li></ul><ul><ul><li>Student assessment; </li></ul></ul><ul><ul><li>Teacher appraisal; </li></ul></ul><ul><ul><li>School evaluation; </li></ul></ul><ul><ul><li>System evaluation; </li></ul></ul><ul><li>Comprehensive approach: Investigation of each component individually, as well as the coherence of the framework as a whole (including the links between the different components). </li></ul>
  5. 5. <ul><li>Overarching policy question: “How can assessment and evaluation policies work together more effectively to improve student outcomes in primary and secondary schools?” </li></ul>OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes: SCOPE
  6. 6. <ul><ul><ul><li>24 countries: Australia, Austria, Belgium (Flemish Community), Belgium (Fr.), Canada, Czech Rep., </li></ul></ul></ul><ul><ul><ul><li>Denmark, Finland, France, Hungary, Iceland, Ireland, Israel, Korea, Luxembourg, Mexico, Netherlands, </li></ul></ul></ul><ul><ul><ul><li>New Zealand, Norway, Poland, Portugal, Slovak Republic, Slovenia and Sweden., </li></ul></ul></ul><ul><ul><ul><li>12 countries: Australia, Belgium (Flemish Community), Chile, Czech Republic, </li></ul></ul></ul><ul><ul><ul><li>Denmark, Luxembourg, Mexico, New Zealand, Norway, Portugal, Slovak Republic </li></ul></ul></ul><ul><ul><ul><li>and Sweden. </li></ul></ul></ul>
  7. 7. <ul><ul><li>Outputs: </li></ul></ul><ul><ul><ul><li>24 Country Background Reports: 9 are completed, more to come soon. </li></ul></ul></ul><ul><ul><ul><li>12 Country Reviews : AUS, DNK, NOR, SWE completed, more to come soon. </li></ul></ul></ul><ul><ul><ul><li>12 Literature Reviews /conceptual papers on issues including: formative and summative assessment; teacher evaluation; school evaluation; education standards; use of results. </li></ul></ul></ul><ul><ul><ul><li>Final Comparative Report: to be completed in 2012 </li></ul></ul></ul>OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes: OUTPUTS <ul><ul><li>All outputs are available at www.oecd.org/edu/evaluationpolicy </li></ul></ul>
  8. 8. OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes
  9. 9. The Country Review visit to Sweden (May 2010) <ul><li>Sweden: first Country Review of the OECD project </li></ul><ul><li>Preparatory work: data analysis, bringing existing OECD work on Sweden together </li></ul><ul><li>Country background report prepared by Sweden </li></ul><ul><li>Formation of an expert team </li></ul><ul><li>6 day visit to Sweden </li></ul><ul><ul><li>Meetings with the national authorities and all key stakeholder groups </li></ul></ul><ul><ul><li>Visits to 4 municipalities and 6 schools </li></ul></ul><ul><ul><li>In each school: group meetings with the leadership team, teachers and students </li></ul></ul>
  10. 10. OECD Review on Evaluation and Assessment Frameworks for Improving School Outcomes
  11. 11. Evaluation and assessment framework Structure of the OECD Review report for Sweden <ul><ul><li>The Evaluation and Assessment Framework </li></ul></ul><ul><ul><li>Student assessment </li></ul></ul><ul><ul><li>Teacher appraisal </li></ul></ul><ul><ul><li>School evaluation </li></ul></ul><ul><ul><li>System evaluation </li></ul></ul>System School Classroom Student assessment Teacher appraisal School evaluation System evaluation
  12. 12. The Evaluation and assessment framework
  13. 13. <ul><ul><li>Sweden’s approach to evaluation and assessment is built on high trust system fostering ownership, participation and commitment : </li></ul></ul><ul><ul><ul><li>Students at the centre: students are part of their own assessment; student feedback is valued and contributes to teacher appraisal and school evaluation </li></ul></ul></ul><ul><ul><ul><li>Teacher professionalism: teachers are trusted professionals; strong focus on teacher-based assessment in the classroom; teachers score national tests ; </li></ul></ul></ul><ul><ul><ul><li>A strong focus on school self evaluation: conceived as a collaborative process; availability of self-evaluation tools </li></ul></ul></ul><ul><ul><li>… complemented with national goals and feedback mechanisms </li></ul></ul><ul><ul><ul><li>A focus on providing clear expectations from the centre </li></ul></ul></ul><ul><ul><ul><li>Working towards a data-rich environment: rich feedback for schools </li></ul></ul></ul><ul><ul><ul><li>Transparency in monitoring and reporting </li></ul></ul></ul>Evaluation and assessment framework: Strengths & Challenges
  14. 14. School evaluation System evaluation Student assessment Evaluation and assessment framework: Key elements are well established… <ul><li>Responsibility </li></ul>Instruments Student assessment Teachers With support from NAE School evaluation School Municipality National Inspectorate Student assessment Curriculum, syllabi, criteria National tests in Years 3,5,9 and upper secondary National test bank School evaluation School self-evaluation tools Municipal quality reports Inspection visits & report s System evaluation International student assessments National assessments Thematic reviews System evaluation Ministry NAE Inspectorate … BUT more work is necessary to integrate them in a coherent framework Teacher appraisal Teacher appraisal School leader Evaluation and assessment framework
  15. 15. Student assessment
  16. 16. <ul><ul><li>Sweden has a balanced approach to student assessment… </li></ul></ul><ul><ul><li>Broad approach to assessment with a mix of classroom-based assessments and performance-based national assessments </li></ul></ul><ul><ul><li>… .but lacks an externally validated measure of student performance </li></ul></ul><ul><ul><li>But all types of assessment are corrected and graded by students’ own teachers </li></ul></ul><ul><ul><li>Variability in teachers’ assessment skills </li></ul></ul><ul><ul><li>Issues of fairness in student assessment and grading </li></ul></ul><ul><ul><li>Limits to the use of aggregate test scores as measures of school, municipality and system performance </li></ul></ul>Individual components: Strengths & Challenges System School Classroom Student assessment Teacher appraisal School evaluation System evaluation
  17. 17. Teacher appraisal
  18. 18. <ul><ul><li>Swedish teachers are trusted professionals… </li></ul></ul><ul><ul><li>Teachers have a high degree of autonomy </li></ul></ul><ul><ul><li>Appraisal and salary progression is up to individual school leaders </li></ul></ul><ul><ul><li>… but do not have sufficient opportunities for professional feedback </li></ul></ul><ul><ul><li>Teacher appraisal is not regulated by law </li></ul></ul><ul><ul><li>There are no professional standards for teachers </li></ul></ul><ul><ul><li>Little guidance and support to enhance teacher appraisal </li></ul></ul><ul><ul><li>Limited career progression opportunities </li></ul></ul>Individual components: Strengths & Challenges System School Classroom Student assessment Teacher appraisal School evaluation System evaluation
  19. 19. School evaluation
  20. 20. <ul><ul><li>There has been strong investment in school evaluation… </li></ul></ul><ul><ul><li>School evaluation builds on a mix of school self-evaluation, municipal school evaluation and national inspections </li></ul></ul><ul><ul><li>A variety of quantitative and qualitative feedback </li></ul></ul><ul><ul><li>… but there are large variations in local capacity </li></ul></ul><ul><ul><li>Great variability in municipal evaluation and school self-evaluation approaches </li></ul></ul><ul><ul><li>Traditions of professional autonomy </li></ul></ul><ul><ul><li>Shift towards greater accountability might jeopardise the improvement function </li></ul></ul>Individual components: Strengths & Challenges System School Classroom Student assessment Teacher appraisal School evaluation System evaluation
  21. 21. System evaluation
  22. 22. <ul><ul><li>Education system evaluation is well established… </li></ul></ul><ul><ul><li>Education system performance is monitored through a broad range of tools </li></ul></ul><ul><ul><li>… but data collection and presentation could be further improved </li></ul></ul><ul><ul><li>National data on learning outcomes relies on teacher grading </li></ul></ul><ul><ul><li>Since teacher grading is uneven, the use of grades as measures of municipality and system performance is not appropriate </li></ul></ul><ul><ul><li>Data presentation could be optimised for use by stakeholders </li></ul></ul>Individual components: Strengths & Challenges System School Classroom Student assessment Teacher appraisal School evaluation System evaluation
  23. 23. Summary of key issues <ul><ul><li>Developing a coherent framework for evaluation and assessment </li></ul></ul><ul><ul><li>Building teachers’ assessment capacity and increasing the reliability of national assessments </li></ul></ul><ul><ul><li>Establishing teacher appraisal as an integral part of the evaluation and assessment framework </li></ul></ul><ul><ul><li>Articulating school self-evaluation and external school evaluation </li></ul></ul><ul><ul><li>Strengthening education system monitoring </li></ul></ul>
  24. 24. Where to go from here? 5 suggestions
  25. 25. School evaluation System evaluation Student assessment Suggested next steps (1): Establish a strategic plan or framework for E&A Take stock and map all the existing elements of E&A and clarify purposes Clarify responsibilities and encourage cooperation Follow up with competency descriptions and training Identify underdeveloped elements and missing links (e.g. how teacher appraisal and school evaluation can reinforce each other) Map existing tools and support to optimise practices Teacher appraisal The improvement of teaching and learning should be at the centre
  26. 26. School evaluation System evaluation School principal appraisal Student assessment Develop a framework of teaching standards Can help to align key elements of the teaching profession such as initial training, registration, professional development, regular appraisal and career advancement Articulate teacher appraisal and school evaluation <ul><li>Strengthen developmental appraisal </li></ul><ul><li>-Internal school process </li></ul><ul><li>Linked with PD and school development </li></ul>Suggested next steps (2) : Develop teacher appraisal as part of the E&A framework <ul><li>Introduce a system of teacher registration to determine career-progression </li></ul><ul><li>Registration at key stages in the career </li></ul><ul><li>More summative </li></ul><ul><li>Stronger external component </li></ul>Teacher appraisal Hold school principals accountable for teacher appraisal
  27. 27. Teacher appraisal Country Examples? Chile: The Good Teaching Framework provides clear guidance to all aspects of the teaching profession Australia: Appraisal gives access to Advanced Skills Teaching Positions New Zealand: professional body of teachers holds the lead role in defining teacher standards
  28. 28. School evaluation System evaluation Student assessment Suggested next steps (3): Increase the reliability of national assessments <ul><li>Make the existing tests more reliable </li></ul><ul><li>Initial teacher training </li></ul><ul><li>Professional development </li></ul><ul><li>Systematic moderation </li></ul>Consider adaptations in test design “ complex assessments” Consider developing a national monitoring sample survey Teacher appraisal
  29. 29. Increase reliability of national assessments Country Examples? New Zealand: The National Education Monitoring Project Denmark: Computer-based assessments provide rapid feedback Queensland, Australia: Moderated internal assessments
  30. 30. School evaluation Self evaluation Municipal evaluation Inspections System evaluation Student assessment Suggested next steps (4): Further develop internal and external school evaluation Maintain and reinforce the improvement focus Learn from successful schools across Sweden To identify these, need to develop reliable national assessment system Continue to refine quality indicators for school evaluation Teacher appraisal Further strengthen schools’ self evaluation capacities Provide additional training resources Continue to focus inspections on this aspect
  31. 31. School evaluation Country Examples? Hong Kong Learning from innovating schools New Zealand: collaborative school evaluation model Scotland: Web-based resources for school self-evaluation, based on the Inspectorate’s Evaluation framework
  32. 32. School evaluation System evaluation Municipal Central Student assessment Suggested next steps (5): Strengthen education system monitoring and mobilise existing data Further build evaluation capacity at central and municipal levels - Knowledge management nationally - Capacity building at the municipal level Improve mobilisation of existing information Explore ways to more reliably monitor education outcomes at the system level Teacher appraisal
  33. 33. <ul><ul><li>Pointers for policy development </li></ul></ul><ul><ul><li>Map out overall framework </li></ul></ul><ul><ul><li>Include missing components (esp. teacher appraisal) </li></ul></ul><ul><ul><li>Ensure articulation between components (e.g. teacher appraisal and school evaluation; school self-evaluation and external evaluation) </li></ul></ul><ul><ul><li>Increase reliability of national assessment system </li></ul></ul><ul><ul><li>Further develop internal and external school evaluation </li></ul></ul><ul><ul><li>Strengthen national system monitoring </li></ul></ul>To conclude: completing the evaluation and assessment framework
  34. 34. Image: dan / FreeDigitalPhotos.net Thank you! [email_address] www.oecd.org/edu/evaluationpolicy
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×