SlideShare a Scribd company logo
Analysis of the Research Excellence
Framework 2014 impact case studies
Ian Thornton
In partnership with
King’s analysis
Four strands to extract insights
Topic modelling: Identify hidden thematic structures or
topics in corpus of documents
Keyword in context: Identify keywords displayed
within surrounding context
Information extraction: Automate extraction of
specific words (nouns) such as
countries
Qualitative analysis: Read and hand-code samples of
case studies
287 relevant case studies, found through two
methods
Surprisingly little overlap between case studies
identified by the two methods
These 287 case studies were mostly submitted to
the life sciences and social sciences panels
The research has impact in 175 countries
With many usual suspects, but also c.40 mentions
for Australia and the Netherlands
This research was supported by a very wide range
of UK organisations
But the number of
mentions did not
correlate at all with
investment in
development-
relevant research
2013-14
£383m of public
R&D funding is
spent on
international
development.
Equal to 8.3%
of the £4.6bn
science budget
% of UK public R&D funding spent on international development
Breakdown by UKCDS members
2013-14 Each £ symbol = £8m
DFID
£ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £
£ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £
MRC
£ £ £ £ £
Other RCs
£
Wellcome Trust
£ £ £ £
4.6% of Wellcome Trust committed awards are
on science for international development
2011-12 2012-13 2013-14
0%
5%
10%
Given that they spend dramatically different
amounts (which itself is changing)
Most research claimed to have impact across
multiple sectors
With lots claiming to have an impact on health outcomes
The majority of case
studies claiming to
impact on health were
not submitted to life
sciences UoAs
84 case studies cited observed outcomes
stemming from the research
Caveats galore, but still (I think) useful insights
• Caveats with the sample
• Caveats with the methods
• Hints of interdisciplinarity – but the UKCDS Board
decided not to pursue
What people really want are stories, not analysis
UKCDS’
top 20
Ian thornton REF "Routes to Impact" presentation 26/05/2016

More Related Content

What's hot

Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...
Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...
Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...
Wiley
 
Stephan Fraser - Evidence informed policy making - 27 June 2017
Stephan Fraser - Evidence informed policy making - 27 June 2017Stephan Fraser - Evidence informed policy making - 27 June 2017
Stephan Fraser - Evidence informed policy making - 27 June 2017
OECD Governance
 
Mariam Chammat - Evidence informed policy making - 27 June 2017
Mariam Chammat - Evidence informed policy making - 27 June 2017Mariam Chammat - Evidence informed policy making - 27 June 2017
Mariam Chammat - Evidence informed policy making - 27 June 2017
OECD Governance
 
Warwick Anderson | Research funding perspectives for CIPHER forum
Warwick Anderson | Research funding perspectives for CIPHER forumWarwick Anderson | Research funding perspectives for CIPHER forum
Warwick Anderson | Research funding perspectives for CIPHER forum
Sax Institute
 
John Lavis | Making research work for decision makers: international perspect...
John Lavis | Making research work for decision makers: international perspect...John Lavis | Making research work for decision makers: international perspect...
John Lavis | Making research work for decision makers: international perspect...
Sax Institute
 
The Clinical and Translational Science Awards (CTSA) Program: What can it do ...
The Clinical and Translational Science Awards (CTSA) Program: What can it do ...The Clinical and Translational Science Awards (CTSA) Program: What can it do ...
The Clinical and Translational Science Awards (CTSA) Program: What can it do ...
CTSciNet .org
 
Majella McCloskey - Evidence-informed policy making - 26 June 2017
Majella McCloskey - Evidence-informed policy making - 26 June 2017Majella McCloskey - Evidence-informed policy making - 26 June 2017
Majella McCloskey - Evidence-informed policy making - 26 June 2017
OECD Governance
 
OECD Piret Tonurist - Evidence informed policy making - 27 June 2017
OECD Piret Tonurist - Evidence informed policy making - 27 June 2017OECD Piret Tonurist - Evidence informed policy making - 27 June 2017
OECD Piret Tonurist - Evidence informed policy making - 27 June 2017
OECD Governance
 
What are metrics good for? Reflections on REF and TEF
What are metrics good for? Reflections on REF and TEFWhat are metrics good for? Reflections on REF and TEF
What are metrics good for? Reflections on REF and TEF
Dorothy Bishop
 
Access to global health research: Prevalence and cost of open access
Access to global health research: Prevalence and cost of open accessAccess to global health research: Prevalence and cost of open access
Access to global health research: Prevalence and cost of open access
valéry ridde
 
Prof Trevor Duffy, Chief Academic Officer, RCSI Hospitals Group
Prof Trevor Duffy,  Chief Academic Officer, RCSI Hospitals GroupProf Trevor Duffy,  Chief Academic Officer, RCSI Hospitals Group
Prof Trevor Duffy, Chief Academic Officer, RCSI Hospitals Group
Investnet
 
LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...
LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...
LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...
BSBEtalk
 
Uk co rr_sep2015final
Uk co rr_sep2015finalUk co rr_sep2015final
Uk co rr_sep2015final
University of Glasgow
 
New ways to better Healthcare Research
New ways to better Healthcare ResearchNew ways to better Healthcare Research
New ways to better Healthcare Research
DayOne
 
The culture of research metrics in research organisations
The culture of research metrics in research organisationsThe culture of research metrics in research organisations
The culture of research metrics in research organisations
Higher Education Funding Council for England
 
Putting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy HeyPutting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy Hey
StatsCommunications
 
Next Generation Digital Trials - Introduction to a changing landscape
Next Generation Digital Trials - Introduction to a changing landscape Next Generation Digital Trials - Introduction to a changing landscape
Next Generation Digital Trials - Introduction to a changing landscape
DayOne
 
Lessons from the INDEPTH network: Moving from project to institutional approach
Lessons from the INDEPTH network: Moving from project to institutional approachLessons from the INDEPTH network: Moving from project to institutional approach
Lessons from the INDEPTH network: Moving from project to institutional approach
UNICEF Office of Research - Innocenti
 
UK millennium cohort study: Strategies to foster sustainability and ownership
UK millennium cohort study: Strategies to foster sustainability and ownershipUK millennium cohort study: Strategies to foster sustainability and ownership
UK millennium cohort study: Strategies to foster sustainability and ownership
UNICEF Office of Research - Innocenti
 
Engaging with the Impact Agenda
Engaging with the Impact AgendaEngaging with the Impact Agenda
Engaging with the Impact Agenda
University of Glasgow
 

What's hot (20)

Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...
Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...
Samantha Robertson - NHMRC Perspectives on Increasing Access to Data from Pub...
 
Stephan Fraser - Evidence informed policy making - 27 June 2017
Stephan Fraser - Evidence informed policy making - 27 June 2017Stephan Fraser - Evidence informed policy making - 27 June 2017
Stephan Fraser - Evidence informed policy making - 27 June 2017
 
Mariam Chammat - Evidence informed policy making - 27 June 2017
Mariam Chammat - Evidence informed policy making - 27 June 2017Mariam Chammat - Evidence informed policy making - 27 June 2017
Mariam Chammat - Evidence informed policy making - 27 June 2017
 
Warwick Anderson | Research funding perspectives for CIPHER forum
Warwick Anderson | Research funding perspectives for CIPHER forumWarwick Anderson | Research funding perspectives for CIPHER forum
Warwick Anderson | Research funding perspectives for CIPHER forum
 
John Lavis | Making research work for decision makers: international perspect...
John Lavis | Making research work for decision makers: international perspect...John Lavis | Making research work for decision makers: international perspect...
John Lavis | Making research work for decision makers: international perspect...
 
The Clinical and Translational Science Awards (CTSA) Program: What can it do ...
The Clinical and Translational Science Awards (CTSA) Program: What can it do ...The Clinical and Translational Science Awards (CTSA) Program: What can it do ...
The Clinical and Translational Science Awards (CTSA) Program: What can it do ...
 
Majella McCloskey - Evidence-informed policy making - 26 June 2017
Majella McCloskey - Evidence-informed policy making - 26 June 2017Majella McCloskey - Evidence-informed policy making - 26 June 2017
Majella McCloskey - Evidence-informed policy making - 26 June 2017
 
OECD Piret Tonurist - Evidence informed policy making - 27 June 2017
OECD Piret Tonurist - Evidence informed policy making - 27 June 2017OECD Piret Tonurist - Evidence informed policy making - 27 June 2017
OECD Piret Tonurist - Evidence informed policy making - 27 June 2017
 
What are metrics good for? Reflections on REF and TEF
What are metrics good for? Reflections on REF and TEFWhat are metrics good for? Reflections on REF and TEF
What are metrics good for? Reflections on REF and TEF
 
Access to global health research: Prevalence and cost of open access
Access to global health research: Prevalence and cost of open accessAccess to global health research: Prevalence and cost of open access
Access to global health research: Prevalence and cost of open access
 
Prof Trevor Duffy, Chief Academic Officer, RCSI Hospitals Group
Prof Trevor Duffy,  Chief Academic Officer, RCSI Hospitals GroupProf Trevor Duffy,  Chief Academic Officer, RCSI Hospitals Group
Prof Trevor Duffy, Chief Academic Officer, RCSI Hospitals Group
 
LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...
LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...
LWEC presentation on the Ecosystem Approach and the National Ecosystem Assess...
 
Uk co rr_sep2015final
Uk co rr_sep2015finalUk co rr_sep2015final
Uk co rr_sep2015final
 
New ways to better Healthcare Research
New ways to better Healthcare ResearchNew ways to better Healthcare Research
New ways to better Healthcare Research
 
The culture of research metrics in research organisations
The culture of research metrics in research organisationsThe culture of research metrics in research organisations
The culture of research metrics in research organisations
 
Putting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy HeyPutting well being metrics into policy action, Nancy Hey
Putting well being metrics into policy action, Nancy Hey
 
Next Generation Digital Trials - Introduction to a changing landscape
Next Generation Digital Trials - Introduction to a changing landscape Next Generation Digital Trials - Introduction to a changing landscape
Next Generation Digital Trials - Introduction to a changing landscape
 
Lessons from the INDEPTH network: Moving from project to institutional approach
Lessons from the INDEPTH network: Moving from project to institutional approachLessons from the INDEPTH network: Moving from project to institutional approach
Lessons from the INDEPTH network: Moving from project to institutional approach
 
UK millennium cohort study: Strategies to foster sustainability and ownership
UK millennium cohort study: Strategies to foster sustainability and ownershipUK millennium cohort study: Strategies to foster sustainability and ownership
UK millennium cohort study: Strategies to foster sustainability and ownership
 
Engaging with the Impact Agenda
Engaging with the Impact AgendaEngaging with the Impact Agenda
Engaging with the Impact Agenda
 

Similar to Ian thornton REF "Routes to Impact" presentation 26/05/2016

Cross cultural survey_workshop_dublin_2012
Cross cultural survey_workshop_dublin_2012Cross cultural survey_workshop_dublin_2012
Cross cultural survey_workshop_dublin_2012
Edwin van Teijlingen
 
Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...
Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...
Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...
Scott Edmunds
 
Attracting EC Funding - Diana Salmen
Attracting EC Funding - Diana SalmenAttracting EC Funding - Diana Salmen
Attracting EC Funding - Diana Salmen
Human Variome Project
 
IRDiRC: progress and expectations
IRDiRC: progress and expectationsIRDiRC: progress and expectations
IRDiRC: progress and expectations
Canadian Organization for Rare Disorders
 
Roc ipposi dec2015 challenges and opportunities for clinical research
Roc ipposi dec2015 challenges and opportunities for clinical researchRoc ipposi dec2015 challenges and opportunities for clinical research
Roc ipposi dec2015 challenges and opportunities for clinical research
ipposi
 
Dr. Graham Love, Chief Executive, Health Research Board
Dr. Graham Love, Chief Executive, Health Research BoardDr. Graham Love, Chief Executive, Health Research Board
Dr. Graham Love, Chief Executive, Health Research Board
Investnet
 
High-level analysis of NIHR research impact derived from REF2014 case studies
High-level analysis of NIHR research impact derived from REF2014 case studiesHigh-level analysis of NIHR research impact derived from REF2014 case studies
High-level analysis of NIHR research impact derived from REF2014 case studies
Adam Kamenetzky
 
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
Retired
 
ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015
ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015
ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015
ScHARR HEDS
 
UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013
UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013
UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013David Bembo
 
In metrics we trust?
In metrics we trust?In metrics we trust?
In metrics we trust?
ORCID, Inc
 
Research methodology
Research methodologyResearch methodology
Research methodologyTosif Ahmad
 
John Savill - MRC Open Council Meeting 2011
 John Savill  - MRC Open Council Meeting 2011  John Savill  - MRC Open Council Meeting 2011
John Savill - MRC Open Council Meeting 2011
Medical Research Council
 
Visualization Tools for the Refinery Platform - Supporting reproducible resea...
Visualization Tools for the Refinery Platform - Supporting reproducible resea...Visualization Tools for the Refinery Platform - Supporting reproducible resea...
Visualization Tools for the Refinery Platform - Supporting reproducible resea...
Nils Gehlenborg
 
Anne-Marie Coriat strategic approach to capacity & skills gaps in scientifi...
Anne-Marie Coriat   strategic approach to capacity & skills gaps in scientifi...Anne-Marie Coriat   strategic approach to capacity & skills gaps in scientifi...
Anne-Marie Coriat strategic approach to capacity & skills gaps in scientifi...
NHShcs
 
The role of clinical research in securing the future of the industry in Ireland
The role of clinical research in securing the future of the industry in IrelandThe role of clinical research in securing the future of the industry in Ireland
The role of clinical research in securing the future of the industry in Ireland
Irish Pharmaceutical Healthcare Association (IPHA)
 
Robyn Davies funding & assessment - CNRS Masterclass 2013
Robyn Davies funding & assessment - CNRS Masterclass 2013Robyn Davies funding & assessment - CNRS Masterclass 2013
Robyn Davies funding & assessment - CNRS Masterclass 2013
angewatkins
 
Clare Woods - Excel in Health
Clare Woods - Excel in HealthClare Woods - Excel in Health
Clare Woods - Excel in Health
Innovation Agency
 
Databases and Coding Validation Working Group Meeting
Databases and Coding Validation Working Group MeetingDatabases and Coding Validation Working Group Meeting
Databases and Coding Validation Working Group Meeting
Zoe Mitchell
 
OER_s1220738.pptx
OER_s1220738.pptxOER_s1220738.pptx
OER_s1220738.pptx
CheeSiongWong1
 

Similar to Ian thornton REF "Routes to Impact" presentation 26/05/2016 (20)

Cross cultural survey_workshop_dublin_2012
Cross cultural survey_workshop_dublin_2012Cross cultural survey_workshop_dublin_2012
Cross cultural survey_workshop_dublin_2012
 
Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...
Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...
Scott Edmunds talk at ODHK.meet.26: Open Science Data = Open Data (a rant in ...
 
Attracting EC Funding - Diana Salmen
Attracting EC Funding - Diana SalmenAttracting EC Funding - Diana Salmen
Attracting EC Funding - Diana Salmen
 
IRDiRC: progress and expectations
IRDiRC: progress and expectationsIRDiRC: progress and expectations
IRDiRC: progress and expectations
 
Roc ipposi dec2015 challenges and opportunities for clinical research
Roc ipposi dec2015 challenges and opportunities for clinical researchRoc ipposi dec2015 challenges and opportunities for clinical research
Roc ipposi dec2015 challenges and opportunities for clinical research
 
Dr. Graham Love, Chief Executive, Health Research Board
Dr. Graham Love, Chief Executive, Health Research BoardDr. Graham Love, Chief Executive, Health Research Board
Dr. Graham Love, Chief Executive, Health Research Board
 
High-level analysis of NIHR research impact derived from REF2014 case studies
High-level analysis of NIHR research impact derived from REF2014 case studiesHigh-level analysis of NIHR research impact derived from REF2014 case studies
High-level analysis of NIHR research impact derived from REF2014 case studies
 
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
Convergence of Occupational and Environmental Exposure Science: the Whole Pic...
 
ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015
ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015
ScHARR Health Economics and Decision Sciencs (HEDS) Newsletter- Summer 2015
 
UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013
UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013
UK Knowledge Exchange, TechnologieAllianz, Berlin 16.04.2013
 
In metrics we trust?
In metrics we trust?In metrics we trust?
In metrics we trust?
 
Research methodology
Research methodologyResearch methodology
Research methodology
 
John Savill - MRC Open Council Meeting 2011
 John Savill  - MRC Open Council Meeting 2011  John Savill  - MRC Open Council Meeting 2011
John Savill - MRC Open Council Meeting 2011
 
Visualization Tools for the Refinery Platform - Supporting reproducible resea...
Visualization Tools for the Refinery Platform - Supporting reproducible resea...Visualization Tools for the Refinery Platform - Supporting reproducible resea...
Visualization Tools for the Refinery Platform - Supporting reproducible resea...
 
Anne-Marie Coriat strategic approach to capacity & skills gaps in scientifi...
Anne-Marie Coriat   strategic approach to capacity & skills gaps in scientifi...Anne-Marie Coriat   strategic approach to capacity & skills gaps in scientifi...
Anne-Marie Coriat strategic approach to capacity & skills gaps in scientifi...
 
The role of clinical research in securing the future of the industry in Ireland
The role of clinical research in securing the future of the industry in IrelandThe role of clinical research in securing the future of the industry in Ireland
The role of clinical research in securing the future of the industry in Ireland
 
Robyn Davies funding & assessment - CNRS Masterclass 2013
Robyn Davies funding & assessment - CNRS Masterclass 2013Robyn Davies funding & assessment - CNRS Masterclass 2013
Robyn Davies funding & assessment - CNRS Masterclass 2013
 
Clare Woods - Excel in Health
Clare Woods - Excel in HealthClare Woods - Excel in Health
Clare Woods - Excel in Health
 
Databases and Coding Validation Working Group Meeting
Databases and Coding Validation Working Group MeetingDatabases and Coding Validation Working Group Meeting
Databases and Coding Validation Working Group Meeting
 
OER_s1220738.pptx
OER_s1220738.pptxOER_s1220738.pptx
OER_s1220738.pptx
 

More from LIDC

Lens on Development
Lens on DevelopmentLens on Development
Lens on Development
LIDC
 
Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...
Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...
Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...
LIDC
 
An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...
An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...
An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...
LIDC
 
Distance Learning for Health Workshop: Open and distance learning for health ...
Distance Learning for Health Workshop: Open and distance learning for health ...Distance Learning for Health Workshop: Open and distance learning for health ...
Distance Learning for Health Workshop: Open and distance learning for health ...LIDC
 
Distance Learning for Health Workshop: Capability, Development and Open and D...
Distance Learning for Health Workshop: Capability, Development and Open and D...Distance Learning for Health Workshop: Capability, Development and Open and D...
Distance Learning for Health Workshop: Capability, Development and Open and D...LIDC
 
Distance Learning for Health Workshop: Evidence of Impact - Saville Kushner
Distance Learning for Health Workshop: Evidence of Impact - Saville KushnerDistance Learning for Health Workshop: Evidence of Impact - Saville Kushner
Distance Learning for Health Workshop: Evidence of Impact - Saville KushnerLIDC
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...LIDC
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...LIDC
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...LIDC
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...LIDC
 
Pauline horton
Pauline hortonPauline horton
Pauline hortonLIDC
 
Distance Learning for Health Workshop: Public Health Online Courses - Jessica...
Distance Learning for Health Workshop: Public Health Online Courses - Jessica...Distance Learning for Health Workshop: Public Health Online Courses - Jessica...
Distance Learning for Health Workshop: Public Health Online Courses - Jessica...LIDC
 
Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...
Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...
Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...LIDC
 
Distance Learning for Health: Tana Wuliji
Distance Learning for Health: Tana WulijiDistance Learning for Health: Tana Wuliji
Distance Learning for Health: Tana WulijiLIDC
 
Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...
Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...
Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...LIDC
 
The Use of Evidence in Developing Countries: (South African) Experiences and ...
The Use of Evidence in Developing Countries: (South African) Experiences and ...The Use of Evidence in Developing Countries: (South African) Experiences and ...
The Use of Evidence in Developing Countries: (South African) Experiences and ...LIDC
 
The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - LIDC
 
Using Evidence to Drive Health Interventions: The Case of Household Water Tre...
Using Evidence to Drive Health Interventions: The Case of Household Water Tre...Using Evidence to Drive Health Interventions: The Case of Household Water Tre...
Using Evidence to Drive Health Interventions: The Case of Household Water Tre...LIDC
 
Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...
Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...
Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...LIDC
 
Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...
Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...
Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...LIDC
 

More from LIDC (20)

Lens on Development
Lens on DevelopmentLens on Development
Lens on Development
 
Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...
Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...
Malcolm Potts Crisis in the Sahel: Where Population and Climate Change Are Co...
 
An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...
An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...
An Interdisciplinary Perspective on Global Health and the SDGs - Prof. Sir An...
 
Distance Learning for Health Workshop: Open and distance learning for health ...
Distance Learning for Health Workshop: Open and distance learning for health ...Distance Learning for Health Workshop: Open and distance learning for health ...
Distance Learning for Health Workshop: Open and distance learning for health ...
 
Distance Learning for Health Workshop: Capability, Development and Open and D...
Distance Learning for Health Workshop: Capability, Development and Open and D...Distance Learning for Health Workshop: Capability, Development and Open and D...
Distance Learning for Health Workshop: Capability, Development and Open and D...
 
Distance Learning for Health Workshop: Evidence of Impact - Saville Kushner
Distance Learning for Health Workshop: Evidence of Impact - Saville KushnerDistance Learning for Health Workshop: Evidence of Impact - Saville Kushner
Distance Learning for Health Workshop: Evidence of Impact - Saville Kushner
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
 
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...Distance Learning for Health Workshop: Programmes of Training for Health Mana...
Distance Learning for Health Workshop: Programmes of Training for Health Mana...
 
Pauline horton
Pauline hortonPauline horton
Pauline horton
 
Distance Learning for Health Workshop: Public Health Online Courses - Jessica...
Distance Learning for Health Workshop: Public Health Online Courses - Jessica...Distance Learning for Health Workshop: Public Health Online Courses - Jessica...
Distance Learning for Health Workshop: Public Health Online Courses - Jessica...
 
Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...
Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...
Distance Learning for Health Workshop: AMREF Kenya's e-Learning Nursing Progr...
 
Distance Learning for Health: Tana Wuliji
Distance Learning for Health: Tana WulijiDistance Learning for Health: Tana Wuliji
Distance Learning for Health: Tana Wuliji
 
Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...
Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...
Using Randomized Control Trials to Inform Development Policy - Dr Rachel Glen...
 
The Use of Evidence in Developing Countries: (South African) Experiences and ...
The Use of Evidence in Developing Countries: (South African) Experiences and ...The Use of Evidence in Developing Countries: (South African) Experiences and ...
The Use of Evidence in Developing Countries: (South African) Experiences and ...
 
The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges - The Use of Evidence in Developing Countries: Experiences and Challenges -
The Use of Evidence in Developing Countries: Experiences and Challenges -
 
Using Evidence to Drive Health Interventions: The Case of Household Water Tre...
Using Evidence to Drive Health Interventions: The Case of Household Water Tre...Using Evidence to Drive Health Interventions: The Case of Household Water Tre...
Using Evidence to Drive Health Interventions: The Case of Household Water Tre...
 
Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...
Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...
Systematic Reviews as a Source of Useful Evidence: The Experience of the EPPI...
 
Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...
Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...
Surviving the Big One: Recovery After the 2008 Sichuan Earthquake - Dr Patric...
 

Recently uploaded

Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
Tamralipta Mahavidyalaya
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
DeeptiGupta154
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
Delapenabediema
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 

Recently uploaded (20)

Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.Biological Screening of Herbal Drugs in detailed.
Biological Screening of Herbal Drugs in detailed.
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
The Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official PublicationThe Challenger.pdf DNHS Official Publication
The Challenger.pdf DNHS Official Publication
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 

Ian thornton REF "Routes to Impact" presentation 26/05/2016

  • 1. Analysis of the Research Excellence Framework 2014 impact case studies Ian Thornton
  • 4. Four strands to extract insights Topic modelling: Identify hidden thematic structures or topics in corpus of documents Keyword in context: Identify keywords displayed within surrounding context Information extraction: Automate extraction of specific words (nouns) such as countries Qualitative analysis: Read and hand-code samples of case studies
  • 5. 287 relevant case studies, found through two methods Surprisingly little overlap between case studies identified by the two methods
  • 6. These 287 case studies were mostly submitted to the life sciences and social sciences panels
  • 7. The research has impact in 175 countries With many usual suspects, but also c.40 mentions for Australia and the Netherlands
  • 8. This research was supported by a very wide range of UK organisations But the number of mentions did not correlate at all with investment in development- relevant research
  • 9. 2013-14 £383m of public R&D funding is spent on international development. Equal to 8.3% of the £4.6bn science budget % of UK public R&D funding spent on international development Breakdown by UKCDS members 2013-14 Each £ symbol = £8m DFID £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ £ MRC £ £ £ £ £ Other RCs £ Wellcome Trust £ £ £ £ 4.6% of Wellcome Trust committed awards are on science for international development 2011-12 2012-13 2013-14 0% 5% 10% Given that they spend dramatically different amounts (which itself is changing)
  • 10. Most research claimed to have impact across multiple sectors With lots claiming to have an impact on health outcomes The majority of case studies claiming to impact on health were not submitted to life sciences UoAs
  • 11. 84 case studies cited observed outcomes stemming from the research
  • 12. Caveats galore, but still (I think) useful insights • Caveats with the sample • Caveats with the methods • Hints of interdisciplinarity – but the UKCDS Board decided not to pursue
  • 13. What people really want are stories, not analysis

Editor's Notes

  1. <number>
  2. Column chart ‘live’ in ppt Select the chart by clicking on it, and then right-click to ‘Edit data…’ Data entry: NB divide % figs by 100 Position dotted line by hand at top of most recent data, and position the central text box accordingly too The ‘£’ signs are typed in Using the most recent data set the value of the smallest amount to equal one ‘£’ and change the key in grey to show this Calculate and update how many ‘£’s needed for the others <number>