SlideShare a Scribd company logo
1 of 15
Rien Rouw Ministry of Education Holland 
CERI conference November 3rd 2014
“That may be true, but it is not what 
people believe” 
[Canadian minister] 
“It is hard to improve what you do not 
deeply understand” 
[prof. Bryk]
4 
* Multidimensional 
* Simultaneous 
* Immediate 
* Unpredictable 
* Public 
* Historical 
* Kind of thinking: quick, implicit (‘tacit’), automatic, “holistic recognition of 
situations” and “intuitive judgment about actions needed”
5 
Policy
1. Evidence based medicine is the conscientious, explicit, and judicious use 
of current best evidence in making decisions about the care of individual 
patients. The practice of evidence based medicine means integrating 
individual clinical expertise with the best available external clinical 
evidence from systematic research (Sackett et al) 
2. Integration of experience, judgement and expertise with the best 
available external evidence from systematic research (Davies, Cabinet 
Office) 
3. Decisional capital as a third pillar besides 7 
human capital and social capital 
(Fullan en Hargreaves)
*Experimentalism 
*Trial and error as the source for improvement 
*Building coalitions 
*Various perspectives as the source for deep 
understanding
*Effectiveness insight, Cooperation in 
experimental designs 
* between policymakers and researchers at the 
Ministry of Education 
* policymakers need to translate randomized 
research methodology into the design of an 
intervention 
* to create mutually comparable intervention and 
control groups 
* for instance by distributing a grant at random
*‘Evidence for Education’: special fund 
* 23 million euro spread through competition 
* Only consortia of research institutes and schools 
could apply 
* Methodological demand: exclusively RCT’s 
* 37 experiments
*Brokerage needed: either a third party, 
capable / specialized reseachers or 
practitioners 
* Good experiments need input from the field, 
scientists with expertise in the field, scientists 
with statistical expertise 
* Insight in explanatory mechanisms is crucial 
* Systemic approach needed 
* Political tension is not a good condition for 
experimental research
*Netherlands Initiative for Education Research (NRO) 
* To program coherently fundamental, policy-oriented and 
practice-oriented research 
* To bridge the gap between research and practice 
*Match Making Meetings 
*Only consortia can apply for practice-oriented research 
* To make research easy accessable for practitioners
*Regional partnerships between universities, 
universities of applied science, teacher training 
institutes and schools 
*Close cooperation between researchers and 
teachers 
*Combined with teacher training 
*Development of reflective practitioners 
*Teachers as researchers
*m.a.rouw@minocw.nl
* Continuous interaction: involve 
policymakers in generating a report 
* Direct connections: no intermediary 
organisations 
* Dialogue with various research ‘schools’ / 
traditions: 
evidence from various perspectives, both 
quantitative and qualitative, 
both causality and explanatory 
mechanisms 
* Multiple channels: 
scientific reports, short 
summaries, video, blogs, 
workshops, seminars etc. 
* Multilevel: the level of facts, of discourses 
and of beliefs 
* Brokerage as specific function: 
- organized as a specific function or 
profession, not necessarily in a 
separate institution 
- exercised by people of a certain kind: 
researcher nor policymaker, a go-between 
by heart 
* Capacity: of policymakers to interpret 
research, to judge results and to process 
them into policy 
* Systemic: involves practitioners, 
researchers, policymakers and mediators 
15

More Related Content

What's hot

Klara Brunnhuber: Research Waste when Justifying New Research
Klara Brunnhuber: Research Waste when Justifying New ResearchKlara Brunnhuber: Research Waste when Justifying New Research
Klara Brunnhuber: Research Waste when Justifying New ResearchCaroline Blaine
 
Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017
Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017
Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017Crossref
 
Professional Developmental Tools: Research Types
Professional Developmental Tools: Research TypesProfessional Developmental Tools: Research Types
Professional Developmental Tools: Research TypesEarly Artis
 
063-RAND- A Framework to monito Open Science trends in the EU
063-RAND- A Framework to monito Open Science trends in the EU063-RAND- A Framework to monito Open Science trends in the EU
063-RAND- A Framework to monito Open Science trends in the EUinnovationoecd
 
Paper who gets_added...
Paper who gets_added...Paper who gets_added...
Paper who gets_added...EIFLINQ2014
 
Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...
Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...
Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...NHShcs
 
Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011
Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011
Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011PROVIA
 

What's hot (12)

Klara Brunnhuber: Research Waste when Justifying New Research
Klara Brunnhuber: Research Waste when Justifying New ResearchKlara Brunnhuber: Research Waste when Justifying New Research
Klara Brunnhuber: Research Waste when Justifying New Research
 
Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017
Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017
Louise Bezuidenhout - OpenCon Oxford, 1st Dec 2017
 
Professional Developmental Tools: Research Types
Professional Developmental Tools: Research TypesProfessional Developmental Tools: Research Types
Professional Developmental Tools: Research Types
 
063-RAND- A Framework to monito Open Science trends in the EU
063-RAND- A Framework to monito Open Science trends in the EU063-RAND- A Framework to monito Open Science trends in the EU
063-RAND- A Framework to monito Open Science trends in the EU
 
Paper who gets_added...
Paper who gets_added...Paper who gets_added...
Paper who gets_added...
 
Ruttenberg "Implementing Open Science Principles through Research Partnerships"
Ruttenberg "Implementing Open Science Principles through Research Partnerships"Ruttenberg "Implementing Open Science Principles through Research Partnerships"
Ruttenberg "Implementing Open Science Principles through Research Partnerships"
 
Case studies
Case studiesCase studies
Case studies
 
RRITools_ECSA-29102015-DGarcía_LCF
RRITools_ECSA-29102015-DGarcía_LCFRRITools_ECSA-29102015-DGarcía_LCF
RRITools_ECSA-29102015-DGarcía_LCF
 
Happy World Pharmacist Day
Happy World Pharmacist DayHappy World Pharmacist Day
Happy World Pharmacist Day
 
Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...
Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...
Mark Walport (Govt Office for Science) - Innovation, managing risk not avoidi...
 
Project
ProjectProject
Project
 
Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011
Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011
Prof. Richard J.T. Klein’s presentation on PROVIA, June 2011
 

Similar to Rien Rouw Ministry of Education Conference

Getting the buggers to listen – some personal observations of the trials, tri...
Getting the buggers to listen – some personal observations of the trials, tri...Getting the buggers to listen – some personal observations of the trials, tri...
Getting the buggers to listen – some personal observations of the trials, tri...Environmental Protection Agency, Ireland
 
Research Lecture by Dr. Dereje within WU.pdf
Research Lecture by Dr. Dereje within WU.pdfResearch Lecture by Dr. Dereje within WU.pdf
Research Lecture by Dr. Dereje within WU.pdfRebiraWorkineh
 
TCI 2016 A policy learning and multi-knowledge perspective
TCI 2016 A policy learning and  multi-knowledge perspectiveTCI 2016 A policy learning and  multi-knowledge perspective
TCI 2016 A policy learning and multi-knowledge perspectiveTCI Network
 
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...Kicking off the INCENTIVE project with an intro to the CS Principles and Char...
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...Margaret Gold
 
Multidisciplinary Research
Multidisciplinary ResearchMultidisciplinary Research
Multidisciplinary ResearchJan Champagne
 
Seeing it from the other side reflections on a knowledge transfer placement
Seeing it from the other side   reflections on a knowledge transfer placementSeeing it from the other side   reflections on a knowledge transfer placement
Seeing it from the other side reflections on a knowledge transfer placementMerlien Institute
 
Strategies For Impact And Policy Relevance V2
Strategies For Impact And Policy Relevance V2Strategies For Impact And Policy Relevance V2
Strategies For Impact And Policy Relevance V2RECOUP
 
Understanding policy processes
Understanding policy processesUnderstanding policy processes
Understanding policy processesCommsConsult Ltd.
 
Making effective policy use of academic expertise
Making effective policy use of academic expertiseMaking effective policy use of academic expertise
Making effective policy use of academic expertiseblogzilla
 
Open Access and Open Data: what do I need to know (and do)?
Open Access and Open Data: what do I need to know (and do)?Open Access and Open Data: what do I need to know (and do)?
Open Access and Open Data: what do I need to know (and do)?Martin Donnelly
 
Putting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy HeyPutting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy HeyStatsCommunications
 
Presentation_UU_LERU_researchdata_20140606
Presentation_UU_LERU_researchdata_20140606Presentation_UU_LERU_researchdata_20140606
Presentation_UU_LERU_researchdata_20140606Saskia Franken
 
Ethical Publication Issues in the Collection and Analysis of Research Data.pdf
Ethical Publication Issues in the Collection and Analysis of Research Data.pdfEthical Publication Issues in the Collection and Analysis of Research Data.pdf
Ethical Publication Issues in the Collection and Analysis of Research Data.pdfssuser6f4a6d
 
Open Knowledge in Higher Education (OKHE) - session 3
Open Knowledge in Higher Education (OKHE) - session 3Open Knowledge in Higher Education (OKHE) - session 3
Open Knowledge in Higher Education (OKHE) - session 3Chris Millson
 
dokumen.tips_qualitative-approaches-to-research-april-2007-objectives.ppt
dokumen.tips_qualitative-approaches-to-research-april-2007-objectives.pptdokumen.tips_qualitative-approaches-to-research-april-2007-objectives.ppt
dokumen.tips_qualitative-approaches-to-research-april-2007-objectives.pptBayissaBekele
 
Developing core common outcomes for tropical peatland research and management
Developing core common outcomes for tropical peatland research and managementDeveloping core common outcomes for tropical peatland research and management
Developing core common outcomes for tropical peatland research and managementMark Reed
 

Similar to Rien Rouw Ministry of Education Conference (20)

LEARN Webinar
LEARN WebinarLEARN Webinar
LEARN Webinar
 
Getting the buggers to listen – some personal observations of the trials, tri...
Getting the buggers to listen – some personal observations of the trials, tri...Getting the buggers to listen – some personal observations of the trials, tri...
Getting the buggers to listen – some personal observations of the trials, tri...
 
Research Lecture by Dr. Dereje within WU.pdf
Research Lecture by Dr. Dereje within WU.pdfResearch Lecture by Dr. Dereje within WU.pdf
Research Lecture by Dr. Dereje within WU.pdf
 
TCI 2016 A policy learning and multi-knowledge perspective
TCI 2016 A policy learning and  multi-knowledge perspectiveTCI 2016 A policy learning and  multi-knowledge perspective
TCI 2016 A policy learning and multi-knowledge perspective
 
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...Kicking off the INCENTIVE project with an intro to the CS Principles and Char...
Kicking off the INCENTIVE project with an intro to the CS Principles and Char...
 
Multidisciplinary Research
Multidisciplinary ResearchMultidisciplinary Research
Multidisciplinary Research
 
Seeing it from the other side reflections on a knowledge transfer placement
Seeing it from the other side   reflections on a knowledge transfer placementSeeing it from the other side   reflections on a knowledge transfer placement
Seeing it from the other side reflections on a knowledge transfer placement
 
Strategies For Impact And Policy Relevance V2
Strategies For Impact And Policy Relevance V2Strategies For Impact And Policy Relevance V2
Strategies For Impact And Policy Relevance V2
 
Chapter one resaerch
Chapter one resaerchChapter one resaerch
Chapter one resaerch
 
Understanding policy processes
Understanding policy processesUnderstanding policy processes
Understanding policy processes
 
Making effective policy use of academic expertise
Making effective policy use of academic expertiseMaking effective policy use of academic expertise
Making effective policy use of academic expertise
 
Open Access and Open Data: what do I need to know (and do)?
Open Access and Open Data: what do I need to know (and do)?Open Access and Open Data: what do I need to know (and do)?
Open Access and Open Data: what do I need to know (and do)?
 
Putting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy HeyPutting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy Hey
 
Presentation_UU_LERU_researchdata_20140606
Presentation_UU_LERU_researchdata_20140606Presentation_UU_LERU_researchdata_20140606
Presentation_UU_LERU_researchdata_20140606
 
Top Tips_Research Communications: Effective Communication for Southern Resear...
Top Tips_Research Communications: Effective Communication for Southern Resear...Top Tips_Research Communications: Effective Communication for Southern Resear...
Top Tips_Research Communications: Effective Communication for Southern Resear...
 
Ethical Publication Issues in the Collection and Analysis of Research Data.pdf
Ethical Publication Issues in the Collection and Analysis of Research Data.pdfEthical Publication Issues in the Collection and Analysis of Research Data.pdf
Ethical Publication Issues in the Collection and Analysis of Research Data.pdf
 
art-RintoP
art-RintoPart-RintoP
art-RintoP
 
Open Knowledge in Higher Education (OKHE) - session 3
Open Knowledge in Higher Education (OKHE) - session 3Open Knowledge in Higher Education (OKHE) - session 3
Open Knowledge in Higher Education (OKHE) - session 3
 
dokumen.tips_qualitative-approaches-to-research-april-2007-objectives.ppt
dokumen.tips_qualitative-approaches-to-research-april-2007-objectives.pptdokumen.tips_qualitative-approaches-to-research-april-2007-objectives.ppt
dokumen.tips_qualitative-approaches-to-research-april-2007-objectives.ppt
 
Developing core common outcomes for tropical peatland research and management
Developing core common outcomes for tropical peatland research and managementDeveloping core common outcomes for tropical peatland research and management
Developing core common outcomes for tropical peatland research and management
 

More from EduSkills OECD

Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...
AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...
AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...EduSkills OECD
 
Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...
Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...
Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...EduSkills OECD
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxEduSkills OECD
 
Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...
Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...
Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...EduSkills OECD
 
Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...
Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...
Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...EduSkills OECD
 
Andreas Schleicher_ Strengthening Upper Secondary Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary  Education in LithuaniaAndreas Schleicher_ Strengthening Upper Secondary  Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary Education in LithuaniaEduSkills OECD
 
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...EduSkills OECD
 
Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...
Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...
Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...EduSkills OECD
 
Andreas Schleicher - Teach for All 8 February 2024.pptx
Andreas Schleicher - Teach for All 8 February 2024.pptxAndreas Schleicher - Teach for All 8 February 2024.pptx
Andreas Schleicher - Teach for All 8 February 2024.pptxEduSkills OECD
 
Jordan Hill - Presentation of Engaging with education research- With a little...
Jordan Hill - Presentation of Engaging with education research- With a little...Jordan Hill - Presentation of Engaging with education research- With a little...
Jordan Hill - Presentation of Engaging with education research- With a little...EduSkills OECD
 
RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...
RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...
RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...EduSkills OECD
 
Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023
Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023
Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023EduSkills OECD
 
Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...
Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...
Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...EduSkills OECD
 
Mathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptx
Mathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptxMathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptx
Mathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptxEduSkills OECD
 
PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...
PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...
PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...EduSkills OECD
 
Ana Carrero -European year of skills – EU update
Ana Carrero -European year of skills – EU updateAna Carrero -European year of skills – EU update
Ana Carrero -European year of skills – EU updateEduSkills OECD
 
Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...
Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...
Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...EduSkills OECD
 
Key indicators on vocational education - Insights from Education at a Glance ...
Key indicators on vocational education - Insights from Education at a Glance ...Key indicators on vocational education - Insights from Education at a Glance ...
Key indicators on vocational education - Insights from Education at a Glance ...EduSkills OECD
 
Disrupted Futures 2023 | gender stereotype free career guidance
Disrupted Futures 2023 | gender stereotype free career guidanceDisrupted Futures 2023 | gender stereotype free career guidance
Disrupted Futures 2023 | gender stereotype free career guidanceEduSkills OECD
 

More from EduSkills OECD (20)

Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...
AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...
AI & cheating on high-stakes exams in upper secondary - Introduction by Shivi...
 
Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...
Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...
Advancing Gender Equality The Crucial Role of Science and Technology 4 April ...
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
 
Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...
Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...
Andreas Schleicher_OECD-ISSA webinar_Diversity plus Quality, does it equal Eq...
 
Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...
Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...
Managing Choice, Coherence and Specialisation in Upper Secondary Education - ...
 
Andreas Schleicher_ Strengthening Upper Secondary Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary  Education in LithuaniaAndreas Schleicher_ Strengthening Upper Secondary  Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary Education in Lithuania
 
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
 
Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...
Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...
Andreas Schleicher - Making learning resilient in a changing climate - 8 Febr...
 
Andreas Schleicher - Teach for All 8 February 2024.pptx
Andreas Schleicher - Teach for All 8 February 2024.pptxAndreas Schleicher - Teach for All 8 February 2024.pptx
Andreas Schleicher - Teach for All 8 February 2024.pptx
 
Jordan Hill - Presentation of Engaging with education research- With a little...
Jordan Hill - Presentation of Engaging with education research- With a little...Jordan Hill - Presentation of Engaging with education research- With a little...
Jordan Hill - Presentation of Engaging with education research- With a little...
 
RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...
RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...
RETHINKING ASSESSMENT OF SOCIAL AND EMOTIONAL SKILLS by Adriano Linzarini OEC...
 
Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023
Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023
Andreas Schleicher Global Launch of PISA - Presentation - 5 December 2023
 
Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...
Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...
Moving up into upper secondary by Hannah Kitchen - OECD Education Webinar 23N...
 
Mathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptx
Mathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptxMathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptx
Mathematics in PISA by Andreas Schleicher - 31 October 2023 OECD Webinar.pptx
 
PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...
PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...
PISA in Practice - The Power of Data to Improve Education - Andreas Schleiche...
 
Ana Carrero -European year of skills – EU update
Ana Carrero -European year of skills – EU updateAna Carrero -European year of skills – EU update
Ana Carrero -European year of skills – EU update
 
Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...
Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...
Building Future Ready VET systems - EU OECD webinar, 26 October 2023 - Malgor...
 
Key indicators on vocational education - Insights from Education at a Glance ...
Key indicators on vocational education - Insights from Education at a Glance ...Key indicators on vocational education - Insights from Education at a Glance ...
Key indicators on vocational education - Insights from Education at a Glance ...
 
Disrupted Futures 2023 | gender stereotype free career guidance
Disrupted Futures 2023 | gender stereotype free career guidanceDisrupted Futures 2023 | gender stereotype free career guidance
Disrupted Futures 2023 | gender stereotype free career guidance
 

Rien Rouw Ministry of Education Conference

  • 1. Rien Rouw Ministry of Education Holland CERI conference November 3rd 2014
  • 2. “That may be true, but it is not what people believe” [Canadian minister] “It is hard to improve what you do not deeply understand” [prof. Bryk]
  • 3.
  • 4. 4 * Multidimensional * Simultaneous * Immediate * Unpredictable * Public * Historical * Kind of thinking: quick, implicit (‘tacit’), automatic, “holistic recognition of situations” and “intuitive judgment about actions needed”
  • 6.
  • 7. 1. Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. The practice of evidence based medicine means integrating individual clinical expertise with the best available external clinical evidence from systematic research (Sackett et al) 2. Integration of experience, judgement and expertise with the best available external evidence from systematic research (Davies, Cabinet Office) 3. Decisional capital as a third pillar besides 7 human capital and social capital (Fullan en Hargreaves)
  • 8. *Experimentalism *Trial and error as the source for improvement *Building coalitions *Various perspectives as the source for deep understanding
  • 9. *Effectiveness insight, Cooperation in experimental designs * between policymakers and researchers at the Ministry of Education * policymakers need to translate randomized research methodology into the design of an intervention * to create mutually comparable intervention and control groups * for instance by distributing a grant at random
  • 10. *‘Evidence for Education’: special fund * 23 million euro spread through competition * Only consortia of research institutes and schools could apply * Methodological demand: exclusively RCT’s * 37 experiments
  • 11. *Brokerage needed: either a third party, capable / specialized reseachers or practitioners * Good experiments need input from the field, scientists with expertise in the field, scientists with statistical expertise * Insight in explanatory mechanisms is crucial * Systemic approach needed * Political tension is not a good condition for experimental research
  • 12. *Netherlands Initiative for Education Research (NRO) * To program coherently fundamental, policy-oriented and practice-oriented research * To bridge the gap between research and practice *Match Making Meetings *Only consortia can apply for practice-oriented research * To make research easy accessable for practitioners
  • 13. *Regional partnerships between universities, universities of applied science, teacher training institutes and schools *Close cooperation between researchers and teachers *Combined with teacher training *Development of reflective practitioners *Teachers as researchers
  • 15. * Continuous interaction: involve policymakers in generating a report * Direct connections: no intermediary organisations * Dialogue with various research ‘schools’ / traditions: evidence from various perspectives, both quantitative and qualitative, both causality and explanatory mechanisms * Multiple channels: scientific reports, short summaries, video, blogs, workshops, seminars etc. * Multilevel: the level of facts, of discourses and of beliefs * Brokerage as specific function: - organized as a specific function or profession, not necessarily in a separate institution - exercised by people of a certain kind: researcher nor policymaker, a go-between by heart * Capacity: of policymakers to interpret research, to judge results and to process them into policy * Systemic: involves practitioners, researchers, policymakers and mediators 15

Editor's Notes

  1. What does complexity mean for the process of decision making in education practice and policy?
  2. Where does knowledge come from when you are in a pressure cooker: it’s in their heads. Just as a doctor.
  3. We want to stimulate the use of experimental research designs in policymaking. For policymakers this implies more than commissioning a certain research methodology. It means that the design of an intervention must be adapted to the requirements of randomized research. This is possible for instance by distributing a grant at random, in order to create mutually comparable intervention and control groups. We have set up several experiments where policymakers and researchers are working closely together in the first steps of the implementation of policy: the neighbourhood school (an institute for multiproblem dropouts), a fund for individual training grants for teachers and the extension of learning time for children at risk in primary education.
  4. 1) The first designing principle is that researchers and policymakers should maintain continuous interaction, or “sustained interactivity”, as it is also called (Sutcliffe and Court, 2005) or “interactive brokerage” (by one of your colleagues, Tom Leney). If researchers want their research to be used, they must involve policymakers in generating their report. It is not enough to present a plan at the beginning and the results at the end of the research. Furthermore, you have to invest in long-term relationships, because most policies are changing gradually (Levin 2005). 2) Policymakers and researchers should not only continually interact, they should also connect directly with each other. No intermediary organizations such as development institutions must come in between. 3) Policymakers must organize a dialogue with various research ‘schools’ or traditions. ‘Polygamy’ as some researchers call it (Nutley et al. 2003). You need evidence from various perspectives to understand deeply the complex world of education, both quantitative and qualitative research, both research into causal relations and research into mechanisms explaining causality. 4) To spread the good news of results, researchers must use multiple channels to reach diverse audiences: scientific reports, short summaries, video, blogs, workshops, seminars etc. 5) Results need to be communicated on more than one level: the level of facts, of discourses and of beliefs. If research leads to profound changes in policy it is not enough to present the data. Researchers must also formulate a message on the level of beliefs. 6) The previous points clarify the fact that brokerage between science and policy needs to be organized as a specific function or profession (f.i. Canadian Health Services Research Foundation, 2003). It appears preferable not to organize brokerage in a separate institution, but as a function either within the ministry or within research institutes. Furthermore, brokers need to be people of a certain kind. A broker is not producing knowledge, he is not using knowledge, he is not disseminating knowledge. He could be processing knowledge, but his main objective is to make connections between research and policy. Brokers are liaisons or connectors, sometimes they are called ‘boundary workers’. He must be an expert in both science and policy processes, curious, flexible, modest, sharp on details and at the same time understanding the bigger picture, a mediator and communicator. A broker succeeds if no one notices that he is connecting people and worlds. You could compare him with the old-fashioned telephone-operator whom we all know from the movies. The broker must be invisible. 7) However, all these designing principles will not be effective without one precondition being fulfilled, to wit the capacity of policymakers. Policymakers must be capable of understanding and interpreting the methods and results of research. They must develop evidence awareness, just as researchers need to develop policy awareness, by the way. 8) My last designing principle holds especially when profound changes are proposed. In that case an intervention is needed on the level of the whole system of education practice, research and policy. For the promotion of evidence based policy and practice in the Netherlands we call it an eco-system, which consists of three angles: practice, research and policy. A systemic approach means that all subsystems are involved and that diverse streams of interaction improve.