Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Research Excellence Framework 2014 [Michael Rayner & Shirley Leckie]

1,997 views

Published on

Published in: Education
  • Be the first to comment

  • Be the first to like this

Research Excellence Framework 2014 [Michael Rayner & Shirley Leckie]

  1. 1. Creating the University of the Highlands and Islands
  2. 2. Research Excellence Framework (REF) 2014 Michael Rayner – Dean of Research Shirley Leckie – Research Data and Information Manager Creating the University of the Highlands and Islands
  3. 3. Introduction Creating the University of the Highlands and Islands Background Information: RAE 2008 UHI Performance Sector Performance REF 2014 New Rules and Approaches UHI Approach to REF 2014 Research Impact – Practical Session REF 2014 Hints and Tips
  4. 4. What is research assessment? Creating the University of the Highlands and Islands • Research assessment began in the UK in the 1980’s • Originally this exercise was NOT related to funding – focussed on volume of outputs • Developed into RAE in 1986 and was based on quality • Run approximately every 5 years – 1986, 1989, 1992, 1996, 2001 and 2008 • RAE undertaken by the four UK higher education funding councils • Each UoA given a rank/score with this used to inform allocation of quality weighted research funding
  5. 5. RAE 2008 Creating the University of the Highlands and Islands Four star Quality that is world-leading in terms of originality, significance and rigour. Three star Quality that is internationally excellent in terms of originality, significance and rigour but which nonetheless falls short of the highest standards of excellence. Two star Quality that is recognised internationally in terms of originality, significance and rigour. One star Quality that is recognised nationally in terms of originality, significance and rigour. Unclassified Quality that falls below the standard of nationally recognised work. Or work which does not meet the published definition of research for the purposes of this assessment.
  6. 6. Building a Quality Profile Creating the University of the Highlands and Islands
  7. 7. UHI Performance in RAE 2008 Creating the University of the Highlands and Islands Unit of Assessment Cat A Staff World Leading Internat’ly Excellent Internat’ly Recognised Nationally Recognised u/c 4* 3* 2* 1* 0 15 Pre-clinical and Human Biological Sciences 2 0 10 55 35 0 16 Agriculture, Veterinary and Food Science 3 0 5 35 60 0 17 Earth Systems and Environmental Sciences 42 5 35 45 15 0 31 Town and Country Planning 7.5 0 10 35 40 15 33 Archaeology 3.3 5 15 40 40 0 50 European Studies 4 0 5 15 60 20 56 Celtic Studies 4 5 10 35 30 20 61 Theology, Divinity and Religious Studies 3.6 0 10 30 50 10 per cent 2 13 36 41 8
  8. 8. UHI Performance in RAE 2008 Creating the University of the Highlands and Islands RAE 2008 THE BASIC DATA Interpretation 41 % Nationally recognised 36% Internationally recognised 13% Internationally excellent 2% World leading •UHI is 96/132 in the UK, above 4 other Scottish institutions •RAE fundable disciplines increased from 1 in 2001 to 8 in 2008 •RAE funded staff increased from 13 in 2001 to 75 in 2008 •Three disciplines contained world leading research •Largest UoA, 13th UK, 2nd largest in Scotland behind Edinburgh •ARC contributed half of the growth. Other half from UHI internal growth •Boost to culture and confidence
  9. 9. RAE 2008 Results Creating the University of the Highlands and Islands 2008 Research Assessment Exercise Results : Scotland Overall quality profile Note: In this table, joint submissions are shown split by their constituent institutions. (% of research activity at each quality level) Institution name UoA No. Unit of assessment name FTE Category A staff submitted 4* 3* 2* 1* u/c University of Aberdeen 15 Pre-clinical and Human Biological Sciences 35.00 5 35 35 15 10 UHI Millennium Institute 15 Pre-clinical and Human Biological Sciences 2.00 0 10 55 35 0 University of Aberdeen 16 Agriculture, Veterinary and Food Science 20.00 20 35 40 5 0 University of Edinburgh 16 Agriculture, Veterinary and Food Science 107.24 20 35 25 10 10 University of Glasgow 16 Agriculture, Veterinary and Food Science 74.90 5 50 35 10 0 Heriot-Watt University 16 Agriculture, Veterinary and Food Science 12.70 5 35 35 25 0 University of Stirling 16 Agriculture, Veterinary and Food Science 32.90 5 45 40 10 0 UHI Millennium Institute 16 Agriculture, Veterinary and Food Science 3.00 0 5 35 60 0
  10. 10. RAE 2008 Results Creating the University of the Highlands and Islands 2008 Research Assessment Exercise Results : Scotland Overall quality profile Note: In this table, joint submissions are shown split by their constituent institutions. (% of research activity at each quality level) Institution name UoA No. Unit of assessment name FTE Category A staff submitted 4* 3* 2* 1* u/c University of Aberdeen 17 Earth Systems and Environmental Sciences 14.53 10 50 35 5 0 University of Abertay Dundee 17 Earth Systems and Environmental Sciences 12.00 10 35 40 15 0 University of Edinburgh 17 Earth Systems and Environmental Sciences 77.14 15 55 25 5 0 University of Glasgow 17 Earth Systems and Environmental Sciences 36.00 5 50 35 10 0 Heriot-Watt University 17 Earth Systems and Environmental Sciences 10.90 0 25 55 20 0 Napier University 17 Earth Systems and Environmental Sciences 13.00 0 20 45 30 5 University of Stirling 17 Earth Systems and Environmental Sciences 19.80 5 35 50 10 0 UHI Millennium Institute 17 Earth Systems and Environmental Sciences 42.00 5 35 45 15 0 University of the West of Scotland 17 Earth Systems and Environmental Sciences 7.00 0 15 50 35 0 University of Aberdeen 31 Town and Country Planning 7.90 20 40 30 10 0 University of Glasgow 31 Town and Country Planning 17.39 15 45 35 5 0 Heriot-Watt University 31 Town and Country Planning 13.80 20 30 35 10 5 UHI Millennium Institute 31 Town and Country Planning 7.50 0 10 35 40 15
  11. 11. RAE 2008 Results Creating the University of the Highlands and Islands 2008 Research Assessment Exercise Results : Scotland Overall quality profile Note: In this table, joint submissions are shown split by their constituent institutions. (% of research activity at each quality level) Institution name UoA No. Unit of assessment name FTE Category A staff submitted 4* 3* 2* 1* u/c University of Glasgow 33 Archaeology 20.86 10 40 35 15 0 UHI Millennium Institute 33 Archaeology 3.30 5 15 40 40 0 University of Glasgow 50 European Studies 9.00 5 35 45 10 5 Heriot-Watt University 50 European Studies 13.20 10 20 40 30 0 University of Stirling 50 European Studies 12.03 5 25 45 20 5 University of Strathclyde 50 European Studies 4.40 10 10 40 40 0 UHI Millennium Institute 50 European Studies 4.00 0 5 15 60 20 University of the West of Scotland 50 European Studies 4.00 0 5 45 45 5
  12. 12. RAE 2008 Results Creating the University of the Highlands and Islands 2008 Research Assessment Exercise Results : Scotland Overall quality profile Note: In this table, joint submissions are shown split by their constituent institutions. (% of research activity at each quality level) Institution name UoA No. Unit of assessment name FTE Category A staff submitted 4* 3* 2* 1* u/c University of Aberdeen 56 Celtic Studies 5.00 0 15 45 35 5 University of Edinburgh 56 Celtic Studies 12.00 20 30 35 10 5 University of Glasgow 56 Celtic Studies 6.00 10 50 30 5 5 UHI Millennium Institute 56 Celtic Studies 4.00 5 10 35 30 20 University of Aberdeen 61 Theology, Divinity and Religious Studies 18.00 15 65 20 0 0 University of Edinburgh 61 Theology, Divinity and Religious Studies 30.00 30 30 25 15 0 University of Glasgow 61 Theology, Divinity and Religious Studies 16.50 10 35 35 15 5 University of St Andrews 61 Theology, Divinity and Religious Studies 16.00 20 30 45 5 0 UHI Millennium Institute 61 Theology, Divinity and Religious Studies 3.60 0 10 30 50 10
  13. 13. UHI Compared to Scottish Average Creating the University of the Highlands and Islands UHI RAE 2008 results compared to Scottish average 0 5 10 15 20 25 30 35 40 45 World Leading (4*) Internationally Excellent (3*) Internationally Recognised (2*) Nationally Recognised (1*) Percent(%) UHI Scottish Average
  14. 14. REF 2014 Creating the University of the Highlands and Islands Official (Funding Councils) Timetable for REF 2014 • 8th October 2010 : Deadline for nominating panel members • October 2010 : Sub-panel chairs appointed • November 2010 : Reports from the impact pilot exercise • December 2010 : Panel members appointed • Early 2011 : Panels begin meeting • Mid 2011 : Panels consult on criteria • Mid 2011 : Guidance on submissions published • Late 2011 : Panel criteria and methods published • Early 2013 : Submission system operational • Late 2013 : Submissions deadline • 2014 : Panels assess submissions • December 2014 : Outcomes published
  15. 15. REF 2014 - Differences from RAE 2008 Creating the University of the Highlands and Islands Evolution, not Revolution Panels and UoA’s For further details please refer to HEFCE website http://www.hefce.ac.uk/research/ref/ No of panels No of sub panels/UoA’s RAE 2008 15 67 REF 2014 4 36
  16. 16. REF 2014 - Differences from RAE 2008 RAE 2008 • Research outputs – 70% (min 50%) • Research Environment – 20% (min 5%) • Esteem Indicators – 10% (min 5%) REF 2014 • Research Outputs – 60% • Research Environment – 15% • Impact – 25% ? • Tweaked definitions of Quality Descriptions: • 4* = Exceptional • 3* = Excellent • 2* = Very Good • 1* = Good Creating the University of the Highlands and Islands
  17. 17. REF 2014 Creating the University of the Highlands and Islands Particular stress on the economic and societal benefits of research • Outputs - Greater use of citations to inform peer review • Environment – Development of structured template to cover key issues, appropriate ‘level definitions’ and a consistent approach for panels to produce environment profiles. Also greater use of metrics (drawing from HESA statistics). • Impact – This has been introduced for the first time , in line with the government’s ‘economic impact’ agenda
  18. 18. REF 2014 Creating the University of the Highlands and Islands Initial Questions
  19. 19. UHI Preparation for REF 2014 Creating the University of the Highlands and Islands What are the main issues for UHI? • Approach • Focus • Staff Engagement • UHI Strategic Plan • Timescale
  20. 20. REF 2014 – UHI Draft Timeline Creating the University of the Highlands and Islands Key events July Aug Sept Oct Nov Dec 2010                           Main Panel Chairs Designate appointed             Announce panel structure and start recruitment of expert panels             Prepare outline guidance/discussion paper for Res Cttee on managing REF preparations             Discuss outline plans with RPG members and Res Cttee             Secure names and details of potential nominees for sub-panel membership             Engage with Deans and Academic partners re. approach to REF preparation and support             Establish REF Internet/intranet site for UHI             Start to identify - with partners - main REF contacts in Academic Partner locations             Deadline for applications for sub-panel chairs             Arrange for REF stock-take/audit             Begin to secure names for potential 'critical friends' for UoA submission development             Deadline for nominating panel members             Sub-panel chairs appointed             UHI research conf. - EO to provide advice and info. on the REF and Dean of Res. to lead a workshop             Reports from the impact pilot exercise             Undertake REF stock-take/audit             Analyse information and advice following impact pilot exercise             Panel members appointed                          
  21. 21. Research Impact Creating the University of the Highlands and Islands • HEFCE currently developing an approach to recognising the wider contribution of high quality research to society • Embracing a wide definition of impact – economy, society, public policy, culture or quality of life • The impact must be evident during the REF assessment period, but the research may have been undertaken earlier • Impact arising from the unit’s portfolio of research as a whole – not the impact of each researcher • Assessment by expert panels, against criteria that are deemed appropriate for each discipline group • Assessment not measurement – impact statement, case studies
  22. 22. Impact Pilot Creating the University of the Highlands and Islands • 29 UK HEIs, each submitting to 2 panels • Submissions based on case studies • Pilot panels include a mix of practicing researchers and beneficiaries and users of research • Criteria reflecting the ‘breadth and depth’ of impacts
  23. 23. Impact Pilot Creating the University of the Highlands and Islands • Definitions and types of impact • Criteria for assessment • How to frame evidence of impact: • Refining the case study approach • What are appropriate indicators? • How to establish the link with high quality research, and over what timeframe? • ‘Overlap’ with environment • Role of ‘users and beneficiaries’ in the assessment • Burden implications • Reports from the pilot due to be released during seminars from November 18th
  24. 24. Practical Segment Creating the University of the Highlands and Islands • In small groups think about how you would go about creating a case study for a particular piece of research and showcasing the impact the research has had. • Make notes and each group can briefly recap their thoughts
  25. 25. Research Impact Creating the University of the Highlands and Islands
  26. 26. Help and Advice Creating the University of the Highlands and Islands • Early Preparation is Key – good data management • Be Smart and Strategic • Regional focus but international applicability • Researcher Portal • Research Networks • Mentoring • Partnerships and Collaboration • Research Office • Make use (as permitted) of UoA Panel Members

×