SlideShare a Scribd company logo
OPENING THE ‘BLACK BOX’:
ASSESSING TEACHING AND LEARNING
EXCELLENCE AS A GAME-CHANGE
Dirk Van Damme
OECD/EDU/IMEP
Inputs
Black
box
Outputs
2
Inputs
Black
box
Outputs
3
Financial inputs in higher
education increasing
• Total (public & private) financial investment grew
– Between 2005 and 2011 on average across
OECD increase of 10% in per student
expenditure and 27% in total expenditure
– With huge differences between countries,
increases higher in countries with below-average
expenditure, catching up
– Yearly per student expenditure is now 14 KUS$
– Total expenditure increased from 1.3% GDP in
2000 to 1.6% GDP in 2011
Inputs
4
United States
Switzerland
Denmark
Sweden
Norway
Finland
Netherlands Germany
Japan
Ireland
Belgium
FranceAustria
Spain
Israel
United Kingdom
Brazil
Italy
KoreaPolandPortugal
Czech Republic
HungaryChile
Slovak RepublicMexico Estonia
Iceland
Russian Federation
New Zealand
Slovenia
R² = 0.079
6 000
10 000
14 000
18 000
22 000
26 000
-30 -20 -10 0 10 20 30 40 50 60 70
Annual expenditure
per student (2011,
USD)
Change in expenditure per student between 2005 and 2011 (%)
OECD
average
OECD
average
Financial inputs in higher
education increasing
Inputs
5
• Private expenditure has increased a lot
– 31% of total expenditure (0.5% GDP) comes from
private sources, mainly tuition fees
– Increase from 25% in 2000
– Total private expenditure increased with 32%
since 2005
– >50% in Israel, US, Australia, Japan, UK, Korea
and Chile
Financial inputs in higher
education increasing
Inputs
6
• Increase in total per student expenditure slows
down since crisis
– Negative growth in almost half of countries
between 2008 and 2011
– Expenditure cannot catch up with increasing
student numbers
• Increasing concerns about levels of private
expenditure, student debt
– 5 million international students investing even
much higher amounts of money
But strong signs of stagnating
funding
Inputs
7
80
90
100
110
120
130
140
150
Estonia
SlovakRepublic
Chile
Hungary
Korea
CzechRepublic
Finland
Slovenia
Denmark
RussianFederation
Israel
Japan
UnitedKingdom
Italy
Poland
OECDaverage
EU21average
Netherlands
Switzerland
France
Sweden
Germany
Australia
Brazil
Spain
Norway
Mexico
Belgium
Portugal
Austria
UnitedStates
Ireland
Iceland
Index of change
(2008=100)
Change in expenditure Change in the number of students (in full-time equivalents) Change in expenditure per student
But strong signs of stagnating
funding
Inputs
8
But strong signs of stagnating
funding
Inputs
• Efficiency and value-for-money become very
important policy considerations
– Both for governments and students/families
– Cost of higher education becoming political issue
in many countries
• What are students actually ‘buying’?
– Very weak relationship between cost and actual
‘product’, benefits and outcomes
– Value-for-money depends enormously on
institution and field of study
9
Inputs
Black
box
Outputs
10
Inputs
Black
box
Outputs
11
• Share of tertiary educated in the population
increased, but still huge disparities across
countries
– 34% of adult population in OECD now has a
tertiary qualification, up from 22% in 2000
Outputs Increases in graduate output
12
Outputs Increases in graduate output
0
10
20
30
40
50
60
China
SouthAfrica
Indonesia
Brazil
Turkey
Italy
Chile
Mexico
Portugal
SlovakRepublic
CzechRepublic
Colombia
Austria
Hungary
Poland
Slovenia
Greece
Germany
Latvia
EU21average
France
Spain
OECDaverage
Netherlands
Denmark
Iceland
Belgium
Sweden
Switzerland
Estonia
Norway
Luxembourg
Finland
Ireland
NewZealand
UnitedKingdom
Australia
Korea
UnitedStates
Israel
Japan
Canada
Russian…
2000 2012%
13
• Employment benefits remain high
• On average across OECD academic degree
gives a wage premium of 75% compared to
upper secondary educated workers
• Total net present value over lifetime is around
160 000 US$ for man, 100 000 US$ for woman
– But with huge differences across fields of study
• Or internal rate of return of 16%
• High social benefits in health, interpersonal trust,
volunteering, political participation
Outputs Employment, earnings and
social benefits remain high
14
Outputs Employment, earnings and
social benefits remain high
15
0
50 000
100 000
150 000
200 000
250 000
300 000
350 000
400 000
450 000
500 000
Turkey
Denmark
Spain
Estonia
Sweden
NewZealand
Greece
Korea
Japan
Canada
SlovakRepublic
Poland
Norway
Israel
CzechRepublic
France
Australia
Finland
OECDaverage
Portugal
EU21average
Austria
UnitedKingdom
Netherlands
Italy
Belgium
Slovenia
Germany
UnitedStates
Hungary
Ireland
EquivalentUSD
Private net returns Public net returns
• Is graduate output higher than the economy’s
need for high-skilled labour?
– Graduate unemployment
– Filtering-down effect?
– Over-qualification and over-skilling
– Huge field-of-study mismatches
• Is polarization in labour markets, with high
employment/high earnings because of skill-
biased technological change going to last?
Outputs But increasing concerns about
quality of output
16
Outputs But increasing concerns about
quality of output
17
Outputs But increasing concerns about
quality of output
• Enormous differences in the skills equivalent of
tertiary qualifications
– Foundation skills such as literacy and numeracy
– Can societies accept that higher education
graduates have low literacy and numeracy skills?
18
19
Outputs But increasing concerns about
quality of output
20
0
5
10
15
20
25
30
35
40
Japan
Finland
Netherlands
Sweden
Australia
Norway
Flanders(Belgium)
England(UK)
England/N.Ireland
(UK)
UnitedStates
CzechRepublic
OECDaverage
Poland
Canada
NorthernIreland(UK)
Austria
Germany
Ireland
France
Denmark
Estonia
SlovakRepublic
Korea
RussianFederation
Spain
Italy
Below upper secondary education Upper secondary or post-secondary non-tertiary education Tertiary education
Proportion of 25-64 year-olds scoring at PIAAC numeracy level 4 and 5, by
educational attainment of the population (2012)
Outputs But increasing concerns about
quality of output
21
Outputs But increasing concerns about
quality of output
• Concerns about the quality and added-value of a
university experience
– Academically Adrift: limited improvement in
academic skills
– What is the relative contribution of selection
versus teaching and learning in the production of
high-quality graduates; what is the actual
‘learning gain’
– Doubts on the quality of the teaching and learning
experience at elite universities
22
Outputs But increasing concerns about
quality of output
Inputs
Black
box
Outputs
23
Inputs
Increasing
investments
by taxpayers
and families,
but concerns
about value-
for-money
Black
box
Outputs
High
numbers of
graduates,
still high
returns, but
concerns
about quality
24
Inputs
Increasing
investments
by taxpayers
and families,
but concerns
about value-
for-money
Black
box
Outputs
High
numbers of
graduates,
still high
returns, but
concerns
about quality
?
25
• What do we know about how quality of teaching
and learning results in high-quality output, and
socially interesting outcomes?
• Information asymmetry: both public and private
financers of higher education have very little
understanding of what they actually are
spending money for
• Increase of investment has not been
accompanied by an empowerment of the input
side to make smart choices through better
information
Black
box
Black box problem is problem
of transparency
26
• How to improve transparency?
– Performance management systems: essentially
bureaucratic control systems, very rarely
comparative and tuned to better decision-making
– Quality assurance arrangements: increasingly
relativistic (‘fitness-for-purpose’), bureaucratic
and inward oriented (internal QA), unfit for
external transparency, nor empowering students
– Student satisfaction surveys: empowering, but
perception-based, largely unrelated to teaching
and learning quality
Black
box
Black box problem is problem
of transparency
27
• How to improve transparency?
– Input measures as proxies for teaching and
learning quality: above a threshold level input has
a weak relationship to quality (cfr PISA)
– Research measurement and bibliometric
indicators as proxies for teaching and learning
quality: most inaccurate, unfair to wide range of
institutions and institutional diversity
– Reputations: act as (too?) powerful tools, also in
rankings, but inaccurate, often outdated, inimical
to newcomers and innovators
Black
box
Black box problem is problem
of transparency
28
• Sound metrics of teaching and learning are very
much needed
– To reassure governments and families about the
value-for-money of investments
– To reward institutions who invest in improving
teaching and learning and are not compensated
through other measures
– To value institutional diversification
– To reward and foster quality improvement through
mutual learning
– To compensate for the over-reliance of rankings on
research and reputation metrics
Black
box
Black box problem is problem
of transparency
29
• What are the risks of not improving transparency?
– Erosion of the symbolic power of degrees, the only
monopoly of the higher education sector
• Employers turning to alternative modes of selection
• Emergence of alternative modes of qualification (employer
credentials, badges, recognition of prior learning, etc.)
Black
box
Black box problem is problem
of transparency
30
Black
box
Black box problem is problem
of transparency
31
• What are the risks of not improving transparency?
– Blaming the student becomes the main excuse
– Decreasing trust of governments, employers, families
and wider society in the value of higher education
• Degree inflation
• Concerns about declining standards in some countries
– Gradual erosion of the financial health of higher
education institutions if value-for-money concerns are
left unanswered
• Financial bubbles of student debt
– Markets no longer accept non-transparency
• Cfr Volkswagen
Black
box
Black box problem is problem
of transparency
32
Inputs
Increasing
investments
by taxpayers
and families,
but concerns
about value-
for-money
Black
box
Outputs
High
numbers of
graduates,
still high
returns, but
concerns
about quality
?
33
Inputs
Increasing
investments
by taxpayers
and families,
but concerns
about value-
for-money
Black
box
Outputs
High
numbers of
graduates,
still high
returns, but
concerns
about quality
Opening the black box
34
• We need to better understand what happens in
the teaching and learning environments in
universities
– With the investment inputs provided
– Explaining the benefits and returns and
understanding why they sometimes fail
– In order to incentivize improvements in teaching
and learning
– Empower students and families
– Restore trust
35
Black
box
Opening the black box
• Comparative assessment of learning outcomes
of graduates is the most promising approach to
measure teaching and learning excellence
– OECD’s AHELO project
– National research projects in Germany, UK, Italy
– CLA and various other initiatives in US
– OECD-CEA partnership to implement CLA+ in
countries
– European Commission supported CALOHEE
project in Tuning framework
36
Black
box
Opening the black box
• Strong resistance by parts of the academic
community, but do they have a strong case?
– No consensus on academic skills that matter
– Risk of standardization
– Institutional diversity too large to use limited number of
metrics
– Methodological concerns
– Cost and burden
• …exactly the same arguments used 20 years ago
when the PISA programme was born
• …and very similar to arguments used 10 years ago
against measuring research excellence
37
Black
box
Opening the black box
• Developing reliable metrics of teaching and
learning excellence in universities is the next big
systemic challenge in the development of higher
education worldwide
• In the short term universities might think it’s not
in their interest and that non-transparency is the
better option
• But in the longer term that might be a very risky
approach, in which the costs largely exceed the
short-term profits
38
Black
box
Opening the black box
• The future progress of universities will not come from
– Continued massification and ever higher numbers of
students
– Continued increases in public and private funding
• But will be the outcome of better and more visible quality
improvements in teaching and learning
• The impact of teaching and learning excellence will be
similar to the way research excellence has changed the
system
39
Finally
Inputs
Excellent
teaching
and
learning
Outputs
Opening the black box
40
Thank you !
dirk.vandamme@oecd.org
www.oecd.org/edu/ceri
twitter @VanDammeEDU
41

More Related Content

What's hot

Achieving Equity and Inclusion in Education: An OECD Perspective
Achieving Equity and Inclusion in Education: An OECD PerspectiveAchieving Equity and Inclusion in Education: An OECD Perspective
Achieving Equity and Inclusion in Education: An OECD Perspective
EduSkills OECD
 
Assuring quality at an international level level chea 28 january 2016
Assuring quality at an international level level  chea 28 january 2016Assuring quality at an international level level  chea 28 january 2016
Assuring quality at an international level level chea 28 january 2016
dvndamme
 
Dream jobs? - Teenagers' career aspirations and the future of work
Dream jobs? -  Teenagers' career aspirations and the future of workDream jobs? -  Teenagers' career aspirations and the future of work
Dream jobs? - Teenagers' career aspirations and the future of work
EduSkills OECD
 
Education at a Glance 2020 - United Kingdom launch
Education at a Glance 2020 - United Kingdom launchEducation at a Glance 2020 - United Kingdom launch
Education at a Glance 2020 - United Kingdom launch
EduSkills OECD
 
International approaches to access to and success in higher education dirk ...
International approaches to access to and success in higher education   dirk ...International approaches to access to and success in higher education   dirk ...
International approaches to access to and success in higher education dirk ...
dvndamme
 
Immigrant Students at School: Easing the Journey towards Integration
Immigrant Students at School:  Easing the Journey towards IntegrationImmigrant Students at School:  Easing the Journey towards Integration
Immigrant Students at School: Easing the Journey towards Integration
EduSkills OECD
 
Education Policy Outlook - Making Reforms Happen
Education Policy Outlook - Making Reforms HappenEducation Policy Outlook - Making Reforms Happen
Education Policy Outlook - Making Reforms Happen
EduSkills OECD
 
The state of education around the world: Findings from Education at a Glance ...
The state of education around the world: Findings from Education at a Glance ...The state of education around the world: Findings from Education at a Glance ...
The state of education around the world: Findings from Education at a Glance ...
EduSkills OECD
 
Education at a Glance 2020 - Global insights
Education at a Glance 2020 - Global insightsEducation at a Glance 2020 - Global insights
Education at a Glance 2020 - Global insights
EduSkills OECD
 
OECD PISA 2018 Results - U.K Media Briefing
OECD PISA 2018 Results - U.K Media BriefingOECD PISA 2018 Results - U.K Media Briefing
OECD PISA 2018 Results - U.K Media Briefing
EduSkills OECD
 
Education at a Glance OECD Indicators 2019
Education at a Glance   OECD Indicators 2019Education at a Glance   OECD Indicators 2019
Education at a Glance OECD Indicators 2019
EduSkills OECD
 
Reviews of National Policies for Education - Netherlands 2016
Reviews of National Policies for Education -  Netherlands 2016Reviews of National Policies for Education -  Netherlands 2016
Reviews of National Policies for Education - Netherlands 2016
EduSkills OECD
 
Education in Latvia - Progress, Challenges and Recommendations
Education in Latvia - Progress, Challenges  and RecommendationsEducation in Latvia - Progress, Challenges  and Recommendations
Education in Latvia - Progress, Challenges and Recommendations
EduSkills OECD
 
First results from PISA 2018
First results from PISA 2018First results from PISA 2018
First results from PISA 2018
EduSkills OECD
 
Raising Performance in Lithuanian Education - An International Perspective
Raising Performance in Lithuanian Education -  An International PerspectiveRaising Performance in Lithuanian Education -  An International Perspective
Raising Performance in Lithuanian Education - An International Perspective
EduSkills OECD
 
Education Reforms Across OECD - Trends and Challenges
Education Reforms Across OECD -  Trends and ChallengesEducation Reforms Across OECD -  Trends and Challenges
Education Reforms Across OECD - Trends and Challenges
EduSkills OECD
 
Mending the Education Divide: Getting strong teachers to the schools that nee...
Mending the Education Divide: Getting strong teachers to the schools that nee...Mending the Education Divide: Getting strong teachers to the schools that nee...
Mending the Education Divide: Getting strong teachers to the schools that nee...
EduSkills OECD
 
The resilience of students with an immigrant background - factors that shape ...
The resilience of students with an immigrant background - factors that shape ...The resilience of students with an immigrant background - factors that shape ...
The resilience of students with an immigrant background - factors that shape ...
EduSkills OECD
 
Strong performers and successful reformers in PISA 2012 - Policy lessons for ...
Strong performers and successful reformers in PISA 2012 - Policy lessons for ...Strong performers and successful reformers in PISA 2012 - Policy lessons for ...
Strong performers and successful reformers in PISA 2012 - Policy lessons for ...
EduSkills OECD
 
Education and skills policies to alleviate inequality
Education and skills policies to alleviate inequalityEducation and skills policies to alleviate inequality
Education and skills policies to alleviate inequality
dvndamme
 

What's hot (20)

Achieving Equity and Inclusion in Education: An OECD Perspective
Achieving Equity and Inclusion in Education: An OECD PerspectiveAchieving Equity and Inclusion in Education: An OECD Perspective
Achieving Equity and Inclusion in Education: An OECD Perspective
 
Assuring quality at an international level level chea 28 january 2016
Assuring quality at an international level level  chea 28 january 2016Assuring quality at an international level level  chea 28 january 2016
Assuring quality at an international level level chea 28 january 2016
 
Dream jobs? - Teenagers' career aspirations and the future of work
Dream jobs? -  Teenagers' career aspirations and the future of workDream jobs? -  Teenagers' career aspirations and the future of work
Dream jobs? - Teenagers' career aspirations and the future of work
 
Education at a Glance 2020 - United Kingdom launch
Education at a Glance 2020 - United Kingdom launchEducation at a Glance 2020 - United Kingdom launch
Education at a Glance 2020 - United Kingdom launch
 
International approaches to access to and success in higher education dirk ...
International approaches to access to and success in higher education   dirk ...International approaches to access to and success in higher education   dirk ...
International approaches to access to and success in higher education dirk ...
 
Immigrant Students at School: Easing the Journey towards Integration
Immigrant Students at School:  Easing the Journey towards IntegrationImmigrant Students at School:  Easing the Journey towards Integration
Immigrant Students at School: Easing the Journey towards Integration
 
Education Policy Outlook - Making Reforms Happen
Education Policy Outlook - Making Reforms HappenEducation Policy Outlook - Making Reforms Happen
Education Policy Outlook - Making Reforms Happen
 
The state of education around the world: Findings from Education at a Glance ...
The state of education around the world: Findings from Education at a Glance ...The state of education around the world: Findings from Education at a Glance ...
The state of education around the world: Findings from Education at a Glance ...
 
Education at a Glance 2020 - Global insights
Education at a Glance 2020 - Global insightsEducation at a Glance 2020 - Global insights
Education at a Glance 2020 - Global insights
 
OECD PISA 2018 Results - U.K Media Briefing
OECD PISA 2018 Results - U.K Media BriefingOECD PISA 2018 Results - U.K Media Briefing
OECD PISA 2018 Results - U.K Media Briefing
 
Education at a Glance OECD Indicators 2019
Education at a Glance   OECD Indicators 2019Education at a Glance   OECD Indicators 2019
Education at a Glance OECD Indicators 2019
 
Reviews of National Policies for Education - Netherlands 2016
Reviews of National Policies for Education -  Netherlands 2016Reviews of National Policies for Education -  Netherlands 2016
Reviews of National Policies for Education - Netherlands 2016
 
Education in Latvia - Progress, Challenges and Recommendations
Education in Latvia - Progress, Challenges  and RecommendationsEducation in Latvia - Progress, Challenges  and Recommendations
Education in Latvia - Progress, Challenges and Recommendations
 
First results from PISA 2018
First results from PISA 2018First results from PISA 2018
First results from PISA 2018
 
Raising Performance in Lithuanian Education - An International Perspective
Raising Performance in Lithuanian Education -  An International PerspectiveRaising Performance in Lithuanian Education -  An International Perspective
Raising Performance in Lithuanian Education - An International Perspective
 
Education Reforms Across OECD - Trends and Challenges
Education Reforms Across OECD -  Trends and ChallengesEducation Reforms Across OECD -  Trends and Challenges
Education Reforms Across OECD - Trends and Challenges
 
Mending the Education Divide: Getting strong teachers to the schools that nee...
Mending the Education Divide: Getting strong teachers to the schools that nee...Mending the Education Divide: Getting strong teachers to the schools that nee...
Mending the Education Divide: Getting strong teachers to the schools that nee...
 
The resilience of students with an immigrant background - factors that shape ...
The resilience of students with an immigrant background - factors that shape ...The resilience of students with an immigrant background - factors that shape ...
The resilience of students with an immigrant background - factors that shape ...
 
Strong performers and successful reformers in PISA 2012 - Policy lessons for ...
Strong performers and successful reformers in PISA 2012 - Policy lessons for ...Strong performers and successful reformers in PISA 2012 - Policy lessons for ...
Strong performers and successful reformers in PISA 2012 - Policy lessons for ...
 
Education and skills policies to alleviate inequality
Education and skills policies to alleviate inequalityEducation and skills policies to alleviate inequality
Education and skills policies to alleviate inequality
 

Viewers also liked

(Transformar 16) Impacto social 2
(Transformar 16) Impacto social 2(Transformar 16) Impacto social 2
(Transformar 16) Impacto social 2
Ink_conteudos
 
GENN001 Humanities Lec.2
GENN001 Humanities Lec.2GENN001 Humanities Lec.2
GENN001 Humanities Lec.2Esmail Bialy
 
How can technology change the way we learn and learn stoa, 6 may 2015
How can technology change the way we learn and learn   stoa, 6 may 2015How can technology change the way we learn and learn   stoa, 6 may 2015
How can technology change the way we learn and learn stoa, 6 may 2015
dvndamme
 
Jornada de Humanidades
Jornada de Humanidades Jornada de Humanidades
Jornada de Humanidades
feyrazonvilavella
 
Hoger onderwijs: toekomst, kansen, bedreigingen
Hoger onderwijs: toekomst, kansen, bedreigingenHoger onderwijs: toekomst, kansen, bedreigingen
Hoger onderwijs: toekomst, kansen, bedreigingen
dvndamme
 
Presentation to DC Higher Education Group on the State of the Humanities
Presentation to DC Higher Education Group on the State of the HumanitiesPresentation to DC Higher Education Group on the State of the Humanities
Presentation to DC Higher Education Group on the State of the Humanities
Robert Townsend
 
Humanidades Ciencia Y Tecnologia
Humanidades Ciencia Y TecnologiaHumanidades Ciencia Y Tecnologia
Humanidades Ciencia Y Tecnologiamariogeopolitico
 
What’s the purpose of assessing higher education’s learning outcomes
What’s the purpose of assessing higher education’s learning outcomesWhat’s the purpose of assessing higher education’s learning outcomes
What’s the purpose of assessing higher education’s learning outcomes
dvndamme
 
Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...
Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...
Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...
Realsmartmedia
 
OER and the innovation of learning
OER and the innovation of learningOER and the innovation of learning
OER and the innovation of learning
dvndamme
 
Innovation and creativity in the humanities and the knowledge triangle
Innovation and creativity in the humanities and the knowledge triangleInnovation and creativity in the humanities and the knowledge triangle
Innovation and creativity in the humanities and the knowledge triangledvndamme
 
Humanidades digitales. Humanismo, crisis, tecnología
Humanidades digitales. Humanismo, crisis, tecnologíaHumanidades digitales. Humanismo, crisis, tecnología
Humanidades digitales. Humanismo, crisis, tecnología
Esteban Romero Frías
 
How can technology change the way we teach and learn stoa, 6 may 2015
How can technology change the way we teach and learn   stoa, 6 may 2015How can technology change the way we teach and learn   stoa, 6 may 2015
How can technology change the way we teach and learn stoa, 6 may 2015
dvndamme
 
El humanismo
El humanismoEl humanismo
El humanismo
Asdrubal Alexander
 
Open educational resources a catalyst for innovation in education, berlin, ...
Open educational resources   a catalyst for innovation in education, berlin, ...Open educational resources   a catalyst for innovation in education, berlin, ...
Open educational resources a catalyst for innovation in education, berlin, ...
dvndamme
 
Humanismo
HumanismoHumanismo
Humanismo
nehuatl_nohuian
 

Viewers also liked (18)

(Transformar 16) Impacto social 2
(Transformar 16) Impacto social 2(Transformar 16) Impacto social 2
(Transformar 16) Impacto social 2
 
GENN001 Humanities Lec.2
GENN001 Humanities Lec.2GENN001 Humanities Lec.2
GENN001 Humanities Lec.2
 
How can technology change the way we learn and learn stoa, 6 may 2015
How can technology change the way we learn and learn   stoa, 6 may 2015How can technology change the way we learn and learn   stoa, 6 may 2015
How can technology change the way we learn and learn stoa, 6 may 2015
 
Jornada de Humanidades
Jornada de Humanidades Jornada de Humanidades
Jornada de Humanidades
 
Hoger onderwijs: toekomst, kansen, bedreigingen
Hoger onderwijs: toekomst, kansen, bedreigingenHoger onderwijs: toekomst, kansen, bedreigingen
Hoger onderwijs: toekomst, kansen, bedreigingen
 
Presentation to DC Higher Education Group on the State of the Humanities
Presentation to DC Higher Education Group on the State of the HumanitiesPresentation to DC Higher Education Group on the State of the Humanities
Presentation to DC Higher Education Group on the State of the Humanities
 
Humanidades Ciencia Y Tecnologia
Humanidades Ciencia Y TecnologiaHumanidades Ciencia Y Tecnologia
Humanidades Ciencia Y Tecnologia
 
What’s the purpose of assessing higher education’s learning outcomes
What’s the purpose of assessing higher education’s learning outcomesWhat’s the purpose of assessing higher education’s learning outcomes
What’s the purpose of assessing higher education’s learning outcomes
 
Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...
Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...
Teresa Mangum - The Future of the Academic and Public Humanities: The Changin...
 
OER and the innovation of learning
OER and the innovation of learningOER and the innovation of learning
OER and the innovation of learning
 
Innovation and creativity in the humanities and the knowledge triangle
Innovation and creativity in the humanities and the knowledge triangleInnovation and creativity in the humanities and the knowledge triangle
Innovation and creativity in the humanities and the knowledge triangle
 
Humanidades digitales. Humanismo, crisis, tecnología
Humanidades digitales. Humanismo, crisis, tecnologíaHumanidades digitales. Humanismo, crisis, tecnología
Humanidades digitales. Humanismo, crisis, tecnología
 
Stresemann
StresemannStresemann
Stresemann
 
How can technology change the way we teach and learn stoa, 6 may 2015
How can technology change the way we teach and learn   stoa, 6 may 2015How can technology change the way we teach and learn   stoa, 6 may 2015
How can technology change the way we teach and learn stoa, 6 may 2015
 
El humanismo
El humanismoEl humanismo
El humanismo
 
El humanismo
El humanismoEl humanismo
El humanismo
 
Open educational resources a catalyst for innovation in education, berlin, ...
Open educational resources   a catalyst for innovation in education, berlin, ...Open educational resources   a catalyst for innovation in education, berlin, ...
Open educational resources a catalyst for innovation in education, berlin, ...
 
Humanismo
HumanismoHumanismo
Humanismo
 

Similar to Opening the ‘black box’ was melbourne 2 oct 2015

Strengths and weaknesses of national systems of human capital development in ...
Strengths and weaknesses of national systems of human capital development in ...Strengths and weaknesses of national systems of human capital development in ...
Strengths and weaknesses of national systems of human capital development in ...
dvndamme
 
The role of education and skills in promoting inclusive growth
The role of education and skills in promoting inclusive growthThe role of education and skills in promoting inclusive growth
The role of education and skills in promoting inclusive growth
OECD - Organisation for Economic Co-operation and Development
 
Implementing structural reforms with the OECD: the role of education and skil...
Implementing structural reforms with the OECD: the role of education and skil...Implementing structural reforms with the OECD: the role of education and skil...
Implementing structural reforms with the OECD: the role of education and skil...
dvndamme
 
Innovating learning, social progress and humanity’s future gelp ile, durban...
Innovating learning, social progress and humanity’s future   gelp ile, durban...Innovating learning, social progress and humanity’s future   gelp ile, durban...
Innovating learning, social progress and humanity’s future gelp ile, durban...
dvndamme
 
Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...
Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...
Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...
VATT Institute for Economic Research
 
Edu policy outlook bp jan 2015
Edu policy outlook bp jan 2015Edu policy outlook bp jan 2015
Edu policy outlook bp jan 2015
Beatriz Pont
 
B pont effe edinburg 4 may 2015
B pont effe edinburg 4 may 2015B pont effe edinburg 4 may 2015
B pont effe edinburg 4 may 2015
Beatriz Pont
 
Lithuania report's launch presentation - November 2023
Lithuania report's launch presentation - November 2023Lithuania report's launch presentation - November 2023
Lithuania report's launch presentation - November 2023
daianatorreslima1
 
Andreas Schleicher_ Strengthening Upper Secondary Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary  Education in LithuaniaAndreas Schleicher_ Strengthening Upper Secondary  Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary Education in Lithuania
EduSkills OECD
 
World literacy summit keynote: why low-literacy matters and what policy can do
World literacy summit keynote: why low-literacy matters and what policy can doWorld literacy summit keynote: why low-literacy matters and what policy can do
World literacy summit keynote: why low-literacy matters and what policy can dodvndamme
 
HLEG thematic workshop on "Inequality of Opportunity", Dirk van Damme
HLEG thematic workshop on "Inequality of Opportunity", Dirk van DammeHLEG thematic workshop on "Inequality of Opportunity", Dirk van Damme
HLEG thematic workshop on "Inequality of Opportunity", Dirk van Damme
StatsCommunications
 
Breakout session- Schleicher.pptx
Breakout session- Schleicher.pptxBreakout session- Schleicher.pptx
Breakout session- Schleicher.pptx
EduSkills OECD
 
Perfromance Information in the Education Sector by Paulo Santiago
Perfromance Information in the Education Sector by Paulo SantiagoPerfromance Information in the Education Sector by Paulo Santiago
Perfromance Information in the Education Sector by Paulo Santiago
OECD Governance
 
Education at a Glance 2016
Education at a Glance 2016Education at a Glance 2016
Education at a Glance 2016
EduSkills OECD
 
Education World Forum – Launch of the Education Policy Outlook and Education ...
Education World Forum – Launch of the Education Policy Outlook and Education ...Education World Forum – Launch of the Education Policy Outlook and Education ...
Education World Forum – Launch of the Education Policy Outlook and Education ...
EduSkills OECD
 
Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...
Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...
Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...
AIRPIAAC
 
SKILLED FOR LIFE - I DATI DELL'ITALIA
SKILLED FOR LIFE - I DATI DELL'ITALIA SKILLED FOR LIFE - I DATI DELL'ITALIA
SKILLED FOR LIFE - I DATI DELL'ITALIA
Vittoria Nervi career strategist
 
Education at a Glance 2014 - United Kingdom
Education at a Glance 2014  - United KingdomEducation at a Glance 2014  - United Kingdom
Education at a Glance 2014 - United Kingdom
EduSkills OECD
 
A coordinated approach to skills issues: the OECD Centre for Skills
A coordinated approach to skills issues: the OECD Centre for Skills A coordinated approach to skills issues: the OECD Centre for Skills
A coordinated approach to skills issues: the OECD Centre for Skills
EduSkills OECD
 
Education Fast Forward: Turning School Performance to Economic Success
Education Fast Forward: Turning School Performance to Economic SuccessEducation Fast Forward: Turning School Performance to Economic Success
Education Fast Forward: Turning School Performance to Economic Success
EduSkills OECD
 

Similar to Opening the ‘black box’ was melbourne 2 oct 2015 (20)

Strengths and weaknesses of national systems of human capital development in ...
Strengths and weaknesses of national systems of human capital development in ...Strengths and weaknesses of national systems of human capital development in ...
Strengths and weaknesses of national systems of human capital development in ...
 
The role of education and skills in promoting inclusive growth
The role of education and skills in promoting inclusive growthThe role of education and skills in promoting inclusive growth
The role of education and skills in promoting inclusive growth
 
Implementing structural reforms with the OECD: the role of education and skil...
Implementing structural reforms with the OECD: the role of education and skil...Implementing structural reforms with the OECD: the role of education and skil...
Implementing structural reforms with the OECD: the role of education and skil...
 
Innovating learning, social progress and humanity’s future gelp ile, durban...
Innovating learning, social progress and humanity’s future   gelp ile, durban...Innovating learning, social progress and humanity’s future   gelp ile, durban...
Innovating learning, social progress and humanity’s future gelp ile, durban...
 
Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...
Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...
Economic Policy Council report 2017: Remarks on Education Policy, by Roope Uu...
 
Edu policy outlook bp jan 2015
Edu policy outlook bp jan 2015Edu policy outlook bp jan 2015
Edu policy outlook bp jan 2015
 
B pont effe edinburg 4 may 2015
B pont effe edinburg 4 may 2015B pont effe edinburg 4 may 2015
B pont effe edinburg 4 may 2015
 
Lithuania report's launch presentation - November 2023
Lithuania report's launch presentation - November 2023Lithuania report's launch presentation - November 2023
Lithuania report's launch presentation - November 2023
 
Andreas Schleicher_ Strengthening Upper Secondary Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary  Education in LithuaniaAndreas Schleicher_ Strengthening Upper Secondary  Education in Lithuania
Andreas Schleicher_ Strengthening Upper Secondary Education in Lithuania
 
World literacy summit keynote: why low-literacy matters and what policy can do
World literacy summit keynote: why low-literacy matters and what policy can doWorld literacy summit keynote: why low-literacy matters and what policy can do
World literacy summit keynote: why low-literacy matters and what policy can do
 
HLEG thematic workshop on "Inequality of Opportunity", Dirk van Damme
HLEG thematic workshop on "Inequality of Opportunity", Dirk van DammeHLEG thematic workshop on "Inequality of Opportunity", Dirk van Damme
HLEG thematic workshop on "Inequality of Opportunity", Dirk van Damme
 
Breakout session- Schleicher.pptx
Breakout session- Schleicher.pptxBreakout session- Schleicher.pptx
Breakout session- Schleicher.pptx
 
Perfromance Information in the Education Sector by Paulo Santiago
Perfromance Information in the Education Sector by Paulo SantiagoPerfromance Information in the Education Sector by Paulo Santiago
Perfromance Information in the Education Sector by Paulo Santiago
 
Education at a Glance 2016
Education at a Glance 2016Education at a Glance 2016
Education at a Glance 2016
 
Education World Forum – Launch of the Education Policy Outlook and Education ...
Education World Forum – Launch of the Education Policy Outlook and Education ...Education World Forum – Launch of the Education Policy Outlook and Education ...
Education World Forum – Launch of the Education Policy Outlook and Education ...
 
Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...
Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...
Numeracy Achievement Gaps of Low- and High-Performing Adults: An Analysis Wit...
 
SKILLED FOR LIFE - I DATI DELL'ITALIA
SKILLED FOR LIFE - I DATI DELL'ITALIA SKILLED FOR LIFE - I DATI DELL'ITALIA
SKILLED FOR LIFE - I DATI DELL'ITALIA
 
Education at a Glance 2014 - United Kingdom
Education at a Glance 2014  - United KingdomEducation at a Glance 2014  - United Kingdom
Education at a Glance 2014 - United Kingdom
 
A coordinated approach to skills issues: the OECD Centre for Skills
A coordinated approach to skills issues: the OECD Centre for Skills A coordinated approach to skills issues: the OECD Centre for Skills
A coordinated approach to skills issues: the OECD Centre for Skills
 
Education Fast Forward: Turning School Performance to Economic Success
Education Fast Forward: Turning School Performance to Economic SuccessEducation Fast Forward: Turning School Performance to Economic Success
Education Fast Forward: Turning School Performance to Economic Success
 

More from dvndamme

Onderwijs tijdens en na covid19
Onderwijs tijdens en na covid19 Onderwijs tijdens en na covid19
Onderwijs tijdens en na covid19
dvndamme
 
Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...
Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...
Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...
dvndamme
 
How COVID-19 forces us to re-think education
How COVID-19 forces us to re-think educationHow COVID-19 forces us to re-think education
How COVID-19 forces us to re-think education
dvndamme
 
Covid19 and the impact on global higher education 16 april 2020
Covid19 and the impact on global higher education   16 april 2020Covid19 and the impact on global higher education   16 april 2020
Covid19 and the impact on global higher education 16 april 2020
dvndamme
 
PISA 2018 European countries
PISA 2018 European countriesPISA 2018 European countries
PISA 2018 European countries
dvndamme
 
Vooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunen
Vooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunenVooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunen
Vooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunen
dvndamme
 
Making education systems socially inclusive
Making education systems socially inclusiveMaking education systems socially inclusive
Making education systems socially inclusive
dvndamme
 
Educational opportunity for all keynote goal conference 17 january 2018
Educational opportunity for all   keynote goal conference 17 january 2018Educational opportunity for all   keynote goal conference 17 january 2018
Educational opportunity for all keynote goal conference 17 january 2018
dvndamme
 
Mega trends impacting on higher education - riga, 6 november 2017
Mega trends impacting on higher education - riga, 6 november 2017Mega trends impacting on higher education - riga, 6 november 2017
Mega trends impacting on higher education - riga, 6 november 2017
dvndamme
 
The digital transformation of education
The digital transformation of educationThe digital transformation of education
The digital transformation of education
dvndamme
 
Policy challenges on school-to-work transitions and implications for - 15 sep...
Policy challenges on school-to-work transitions and implications for - 15 sep...Policy challenges on school-to-work transitions and implications for - 15 sep...
Policy challenges on school-to-work transitions and implications for - 15 sep...
dvndamme
 
Kennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectief
Kennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectiefKennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectief
Kennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectief
dvndamme
 
Panel educational science and policy making - earli, tampere, 29 august 2017
Panel educational science and policy making - earli, tampere, 29 august 2017Panel educational science and policy making - earli, tampere, 29 august 2017
Panel educational science and policy making - earli, tampere, 29 august 2017
dvndamme
 
Mega trends shaping societies and impacting on higher education - dublin, 31 ...
Mega trends shaping societies and impacting on higher education - dublin, 31 ...Mega trends shaping societies and impacting on higher education - dublin, 31 ...
Mega trends shaping societies and impacting on higher education - dublin, 31 ...
dvndamme
 
Teaching: a maturing profession
Teaching: a maturing professionTeaching: a maturing profession
Teaching: a maturing profession
dvndamme
 

More from dvndamme (15)

Onderwijs tijdens en na covid19
Onderwijs tijdens en na covid19 Onderwijs tijdens en na covid19
Onderwijs tijdens en na covid19
 
Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...
Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...
Covid-19 en onderwijs - Presentatie ad hoc coronacommissie Vlaams parlement 1...
 
How COVID-19 forces us to re-think education
How COVID-19 forces us to re-think educationHow COVID-19 forces us to re-think education
How COVID-19 forces us to re-think education
 
Covid19 and the impact on global higher education 16 april 2020
Covid19 and the impact on global higher education   16 april 2020Covid19 and the impact on global higher education   16 april 2020
Covid19 and the impact on global higher education 16 april 2020
 
PISA 2018 European countries
PISA 2018 European countriesPISA 2018 European countries
PISA 2018 European countries
 
Vooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunen
Vooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunenVooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunen
Vooruitziend toezicht: de veranderende opdracht van hogescholen ondersteunen
 
Making education systems socially inclusive
Making education systems socially inclusiveMaking education systems socially inclusive
Making education systems socially inclusive
 
Educational opportunity for all keynote goal conference 17 january 2018
Educational opportunity for all   keynote goal conference 17 january 2018Educational opportunity for all   keynote goal conference 17 january 2018
Educational opportunity for all keynote goal conference 17 january 2018
 
Mega trends impacting on higher education - riga, 6 november 2017
Mega trends impacting on higher education - riga, 6 november 2017Mega trends impacting on higher education - riga, 6 november 2017
Mega trends impacting on higher education - riga, 6 november 2017
 
The digital transformation of education
The digital transformation of educationThe digital transformation of education
The digital transformation of education
 
Policy challenges on school-to-work transitions and implications for - 15 sep...
Policy challenges on school-to-work transitions and implications for - 15 sep...Policy challenges on school-to-work transitions and implications for - 15 sep...
Policy challenges on school-to-work transitions and implications for - 15 sep...
 
Kennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectief
Kennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectiefKennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectief
Kennisregio Vlaanderen: sterktes en uitdagingen in internationaal perspectief
 
Panel educational science and policy making - earli, tampere, 29 august 2017
Panel educational science and policy making - earli, tampere, 29 august 2017Panel educational science and policy making - earli, tampere, 29 august 2017
Panel educational science and policy making - earli, tampere, 29 august 2017
 
Mega trends shaping societies and impacting on higher education - dublin, 31 ...
Mega trends shaping societies and impacting on higher education - dublin, 31 ...Mega trends shaping societies and impacting on higher education - dublin, 31 ...
Mega trends shaping societies and impacting on higher education - dublin, 31 ...
 
Teaching: a maturing profession
Teaching: a maturing professionTeaching: a maturing profession
Teaching: a maturing profession
 

Recently uploaded

Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
EduSkills OECD
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
SACHIN R KONDAGURI
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Po-Chuan Chen
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
DhatriParmar
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
Anna Sz.
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 

Recently uploaded (20)

Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
The Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptxThe Accursed House by Émile Gaboriau.pptx
The Accursed House by Émile Gaboriau.pptx
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 

Opening the ‘black box’ was melbourne 2 oct 2015

  • 1. OPENING THE ‘BLACK BOX’: ASSESSING TEACHING AND LEARNING EXCELLENCE AS A GAME-CHANGE Dirk Van Damme OECD/EDU/IMEP
  • 4. Financial inputs in higher education increasing • Total (public & private) financial investment grew – Between 2005 and 2011 on average across OECD increase of 10% in per student expenditure and 27% in total expenditure – With huge differences between countries, increases higher in countries with below-average expenditure, catching up – Yearly per student expenditure is now 14 KUS$ – Total expenditure increased from 1.3% GDP in 2000 to 1.6% GDP in 2011 Inputs 4
  • 5. United States Switzerland Denmark Sweden Norway Finland Netherlands Germany Japan Ireland Belgium FranceAustria Spain Israel United Kingdom Brazil Italy KoreaPolandPortugal Czech Republic HungaryChile Slovak RepublicMexico Estonia Iceland Russian Federation New Zealand Slovenia R² = 0.079 6 000 10 000 14 000 18 000 22 000 26 000 -30 -20 -10 0 10 20 30 40 50 60 70 Annual expenditure per student (2011, USD) Change in expenditure per student between 2005 and 2011 (%) OECD average OECD average Financial inputs in higher education increasing Inputs 5
  • 6. • Private expenditure has increased a lot – 31% of total expenditure (0.5% GDP) comes from private sources, mainly tuition fees – Increase from 25% in 2000 – Total private expenditure increased with 32% since 2005 – >50% in Israel, US, Australia, Japan, UK, Korea and Chile Financial inputs in higher education increasing Inputs 6
  • 7. • Increase in total per student expenditure slows down since crisis – Negative growth in almost half of countries between 2008 and 2011 – Expenditure cannot catch up with increasing student numbers • Increasing concerns about levels of private expenditure, student debt – 5 million international students investing even much higher amounts of money But strong signs of stagnating funding Inputs 7
  • 9. But strong signs of stagnating funding Inputs • Efficiency and value-for-money become very important policy considerations – Both for governments and students/families – Cost of higher education becoming political issue in many countries • What are students actually ‘buying’? – Very weak relationship between cost and actual ‘product’, benefits and outcomes – Value-for-money depends enormously on institution and field of study 9
  • 12. • Share of tertiary educated in the population increased, but still huge disparities across countries – 34% of adult population in OECD now has a tertiary qualification, up from 22% in 2000 Outputs Increases in graduate output 12
  • 13. Outputs Increases in graduate output 0 10 20 30 40 50 60 China SouthAfrica Indonesia Brazil Turkey Italy Chile Mexico Portugal SlovakRepublic CzechRepublic Colombia Austria Hungary Poland Slovenia Greece Germany Latvia EU21average France Spain OECDaverage Netherlands Denmark Iceland Belgium Sweden Switzerland Estonia Norway Luxembourg Finland Ireland NewZealand UnitedKingdom Australia Korea UnitedStates Israel Japan Canada Russian… 2000 2012% 13
  • 14. • Employment benefits remain high • On average across OECD academic degree gives a wage premium of 75% compared to upper secondary educated workers • Total net present value over lifetime is around 160 000 US$ for man, 100 000 US$ for woman – But with huge differences across fields of study • Or internal rate of return of 16% • High social benefits in health, interpersonal trust, volunteering, political participation Outputs Employment, earnings and social benefits remain high 14
  • 15. Outputs Employment, earnings and social benefits remain high 15 0 50 000 100 000 150 000 200 000 250 000 300 000 350 000 400 000 450 000 500 000 Turkey Denmark Spain Estonia Sweden NewZealand Greece Korea Japan Canada SlovakRepublic Poland Norway Israel CzechRepublic France Australia Finland OECDaverage Portugal EU21average Austria UnitedKingdom Netherlands Italy Belgium Slovenia Germany UnitedStates Hungary Ireland EquivalentUSD Private net returns Public net returns
  • 16. • Is graduate output higher than the economy’s need for high-skilled labour? – Graduate unemployment – Filtering-down effect? – Over-qualification and over-skilling – Huge field-of-study mismatches • Is polarization in labour markets, with high employment/high earnings because of skill- biased technological change going to last? Outputs But increasing concerns about quality of output 16
  • 17. Outputs But increasing concerns about quality of output 17
  • 18. Outputs But increasing concerns about quality of output • Enormous differences in the skills equivalent of tertiary qualifications – Foundation skills such as literacy and numeracy – Can societies accept that higher education graduates have low literacy and numeracy skills? 18
  • 19. 19 Outputs But increasing concerns about quality of output
  • 20. 20 0 5 10 15 20 25 30 35 40 Japan Finland Netherlands Sweden Australia Norway Flanders(Belgium) England(UK) England/N.Ireland (UK) UnitedStates CzechRepublic OECDaverage Poland Canada NorthernIreland(UK) Austria Germany Ireland France Denmark Estonia SlovakRepublic Korea RussianFederation Spain Italy Below upper secondary education Upper secondary or post-secondary non-tertiary education Tertiary education Proportion of 25-64 year-olds scoring at PIAAC numeracy level 4 and 5, by educational attainment of the population (2012) Outputs But increasing concerns about quality of output
  • 21. 21 Outputs But increasing concerns about quality of output • Concerns about the quality and added-value of a university experience – Academically Adrift: limited improvement in academic skills – What is the relative contribution of selection versus teaching and learning in the production of high-quality graduates; what is the actual ‘learning gain’ – Doubts on the quality of the teaching and learning experience at elite universities
  • 22. 22 Outputs But increasing concerns about quality of output
  • 24. Inputs Increasing investments by taxpayers and families, but concerns about value- for-money Black box Outputs High numbers of graduates, still high returns, but concerns about quality 24
  • 25. Inputs Increasing investments by taxpayers and families, but concerns about value- for-money Black box Outputs High numbers of graduates, still high returns, but concerns about quality ? 25
  • 26. • What do we know about how quality of teaching and learning results in high-quality output, and socially interesting outcomes? • Information asymmetry: both public and private financers of higher education have very little understanding of what they actually are spending money for • Increase of investment has not been accompanied by an empowerment of the input side to make smart choices through better information Black box Black box problem is problem of transparency 26
  • 27. • How to improve transparency? – Performance management systems: essentially bureaucratic control systems, very rarely comparative and tuned to better decision-making – Quality assurance arrangements: increasingly relativistic (‘fitness-for-purpose’), bureaucratic and inward oriented (internal QA), unfit for external transparency, nor empowering students – Student satisfaction surveys: empowering, but perception-based, largely unrelated to teaching and learning quality Black box Black box problem is problem of transparency 27
  • 28. • How to improve transparency? – Input measures as proxies for teaching and learning quality: above a threshold level input has a weak relationship to quality (cfr PISA) – Research measurement and bibliometric indicators as proxies for teaching and learning quality: most inaccurate, unfair to wide range of institutions and institutional diversity – Reputations: act as (too?) powerful tools, also in rankings, but inaccurate, often outdated, inimical to newcomers and innovators Black box Black box problem is problem of transparency 28
  • 29. • Sound metrics of teaching and learning are very much needed – To reassure governments and families about the value-for-money of investments – To reward institutions who invest in improving teaching and learning and are not compensated through other measures – To value institutional diversification – To reward and foster quality improvement through mutual learning – To compensate for the over-reliance of rankings on research and reputation metrics Black box Black box problem is problem of transparency 29
  • 30. • What are the risks of not improving transparency? – Erosion of the symbolic power of degrees, the only monopoly of the higher education sector • Employers turning to alternative modes of selection • Emergence of alternative modes of qualification (employer credentials, badges, recognition of prior learning, etc.) Black box Black box problem is problem of transparency 30
  • 31. Black box Black box problem is problem of transparency 31
  • 32. • What are the risks of not improving transparency? – Blaming the student becomes the main excuse – Decreasing trust of governments, employers, families and wider society in the value of higher education • Degree inflation • Concerns about declining standards in some countries – Gradual erosion of the financial health of higher education institutions if value-for-money concerns are left unanswered • Financial bubbles of student debt – Markets no longer accept non-transparency • Cfr Volkswagen Black box Black box problem is problem of transparency 32
  • 33. Inputs Increasing investments by taxpayers and families, but concerns about value- for-money Black box Outputs High numbers of graduates, still high returns, but concerns about quality ? 33
  • 34. Inputs Increasing investments by taxpayers and families, but concerns about value- for-money Black box Outputs High numbers of graduates, still high returns, but concerns about quality Opening the black box 34
  • 35. • We need to better understand what happens in the teaching and learning environments in universities – With the investment inputs provided – Explaining the benefits and returns and understanding why they sometimes fail – In order to incentivize improvements in teaching and learning – Empower students and families – Restore trust 35 Black box Opening the black box
  • 36. • Comparative assessment of learning outcomes of graduates is the most promising approach to measure teaching and learning excellence – OECD’s AHELO project – National research projects in Germany, UK, Italy – CLA and various other initiatives in US – OECD-CEA partnership to implement CLA+ in countries – European Commission supported CALOHEE project in Tuning framework 36 Black box Opening the black box
  • 37. • Strong resistance by parts of the academic community, but do they have a strong case? – No consensus on academic skills that matter – Risk of standardization – Institutional diversity too large to use limited number of metrics – Methodological concerns – Cost and burden • …exactly the same arguments used 20 years ago when the PISA programme was born • …and very similar to arguments used 10 years ago against measuring research excellence 37 Black box Opening the black box
  • 38. • Developing reliable metrics of teaching and learning excellence in universities is the next big systemic challenge in the development of higher education worldwide • In the short term universities might think it’s not in their interest and that non-transparency is the better option • But in the longer term that might be a very risky approach, in which the costs largely exceed the short-term profits 38 Black box Opening the black box
  • 39. • The future progress of universities will not come from – Continued massification and ever higher numbers of students – Continued increases in public and private funding • But will be the outcome of better and more visible quality improvements in teaching and learning • The impact of teaching and learning excellence will be similar to the way research excellence has changed the system 39 Finally