Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

What happens next? Strategies for building and assessing the long-term impact of research projects

1,792 views

Published on

Presentation delivered to the 8th International Conference on Qualitative and Quantitative Methods in Libraries on impact in the context of library and information science research

Published in: Education
  • Be the first to comment

  • Be the first to like this

What happens next? Strategies for building and assessing the long-term impact of research projects

  1. 1. What happens next? Strategies for building and assessing the long-term impact of research projects Closing keynote presentation 8th International Conference on Qualitative and Quantitative Methods in Libraries 27th May 2016 Dr Hazel Hall Professor of Social Informatics @hazelh
  2. 2. www.napier.ac.uk/iidi http://hazelhall.org/about
  3. 3. www.napier.ac.uk/iidi Page 3 @hazelh #QQML2016
  4. 4. www.napier.ac.uk/iidi Page 4
  5. 5. www.napier.ac.uk/iidi Page 5
  6. 6. www.napier.ac.uk/iidi Page 6
  7. 7. www.napier.ac.uk/iidi Page 7 http://jis.sagepub.com/content/42/3/369.abstract
  8. 8. www.napier.ac.uk/iidi Page 8
  9. 9. www.napier.ac.uk/iidi Page 9
  10. 10. www.napier.ac.uk/iidi Page 10
  11. 11. www.napier.ac.uk/iidi Public engagement and impact Page 11
  12. 12. www.napier.ac.uk/iidi Page 12
  13. 13. www.napier.ac.uk/iidi Public engagement is not impact Page 13
  14. 14. www.napier.ac.uk/iidi Page 14
  15. 15. www.napier.ac.uk/iidi Page 15 To what extent do our services meet these particular (information) needs? How does the use of our services have a wider impact on our users? What is the value of our services (in general)? In LIS: impact understood in terms of service value
  16. 16. www.napier.ac.uk/iidi Page 16 How should we evaluate academic impact in general (bibliometrics)? To what extent does LIS research influence LIS practice? How should we evaluate library and information services? In LIS impact as a theme of study
  17. 17. www.napier.ac.uk/iidi Page 17 What can we do to ensure that our research has an impact on practice? Today’s agenda: impact as integral part of research activity How can you design a study to measure impact? Show us the evidence!
  18. 18. www.napier.ac.uk/iidi Page 18 To facilitate a co-ordinated and strategic approach to LIS research across the UK (2009-2012)
  19. 19. www.napier.ac.uk/iidi Page 19 To facilitate a co-ordinated and strategic approach to LIS research across the UK (2009-2012) To explore the extent to which LIS research projects influence practice (2011) To create outputs to support the use and execution of research by librarians and information scientists (2012) To develop a UK-wide network of LIS researchers (2011-2012)
  20. 20. www.napier.ac.uk/iidi Page 20 What can we do to ensure that our research has an impact on practice? Today’s agenda: impact as integral part of research activity How can you design a study to measure impact? Show us the evidence!
  21. 21. www.napier.ac.uk/iidi Page 21 To explore the extent to which LIS research projects influence practice (2011) To create outputs to support the use and execution of research by librarians and information scientists (2012)
  22. 22. www.napier.ac.uk/iidi Page 22 Recommendations derived from: Literature review Practitioner poll (200) ‘Impactful’ project case studies (5) Sector-specific focus groups (3)  Public  Academic  Healthcare Validation survey (213)
  23. 23. www.napier.ac.uk/iidi Page 23 Recommendations for researchers: Seek high-profile sponsorship and on-going support of projects Conduct sector-specific studies of direct relevance to particular groups Engage practitioners in project design and implementation Deploy dissemination strategies that align with how and where practitioners consume new information  Create teaching and community support materials  Publish in non-academic titles using clear language
  24. 24. www.napier.ac.uk/iidi Page 24
  25. 25. www.napier.ac.uk/iidi Page 25 http://lisresearch.org/rilies-project
  26. 26. www.napier.ac.uk/iidi Page 26 What can we do to ensure that our research has an impact on practice? Today’s agenda: impact as integral part of research activity How can you design a study to measure impact? Show us the evidence!
  27. 27. www.napier.ac.uk/iidi Page 27 To develop a UK-wide network of LIS researchers (2011-2012)
  28. 28. www.napier.ac.uk/iidi DREaM events and reach Page 28 Five events 2 conferences 3 linked workshops – for the ‘cadre’ of DREaMers 213 participants, 33 presenters Remote audience ~80 blog posts ~800 tweets Multiple web pages, SlideShares, SoundClouds, Vimeos etc.
  29. 29. www.napier.ac.uk/iidi Page 29 Expert-led research methods training: • 3 workshops • 12 sessions
  30. 30. www.napier.ac.uk/iidi Page 30 Dissemination of research: • Unconference half hours at workshops • One minute madness at conferences
  31. 31. www.napier.ac.uk/iidi DREaM impact in 2012 Page 31 Growth in knowledge and expertise in research skills Substantial growth in theoretical knowledge Modest increase in application of new skills Greater confidence as researchers Widened networks Brettle, A., Hall, H., & Oppenheim, C. (2012). We have a DREaM: the Developing Research Excellence and Methods network. Paper presented at the 4th International Conference on Qualitative and Quantitative Methods in Libraries, Limerick, Ireland, 22-25 May 2012.
  32. 32. www.napier.ac.uk/iidi DREaM impact to 2015: anecdotal evidence Page 32 Development of new resources Research, evaluation and audit, Facet, 2013 First editor was a DREaMer A third of the book’s authors had some involvement with the LIS Research Coalition Events Organised by DREaMers Participation from others who were associated with the project But what else? Particular interest in less visible impact
  33. 33. www.napier.ac.uk/iidi Page 33 Have the DREaM workshop participants innovated in the workplace since 2012? Has their post-DREaM research determined services provision, or influenced the LIS research agenda? To what extent can they point to any impact of their post- DREaM research on end- user communities? Has DREaM network participation opened up new opportunities for their research? Do they continue to operate as a network?
  34. 34. www.napier.ac.uk/iidi Page 34 Survey distributed to workshop participants: • Population of 35 • Completion by 32 Work undertaken in 2015: survey
  35. 35. www.napier.ac.uk/iidi Work undertaken in 2015: focus groups Page 35 10 participants 4 in Edinburgh 6 in London
  36. 36. www.napier.ac.uk/iidi Page 36 https://hazelhall.org/2015/06/22/dream-again-project-launch/
  37. 37. www.napier.ac.uk/iidi Page 37 Have the DREaM workshop participants innovated in the workplace since 2012? Has their post-DREaM research determined services provision, or influenced the LIS research agenda? To what extent can they point to any impact of their post- DREaM research on end- user communities? Has DREaM network participation opened up new opportunities for their research? Do they continue to operate as a network?
  38. 38. www.napier.ac.uk/iidi Page 38 YES! ‘[I have used this session] to inform consultancy work with clients. It highlighted a number of issues and prompted me to research further.’ ‘Although I have not used this in my own research...this has been really helpful in allowing me to understand and participate in discussions about research methods.’
  39. 39. www.napier.ac.uk/iidi Page 39 Have the DREaM workshop participants innovated in the workplace since 2012? Has their post-DREaM research determined services provision, or influenced the LIS research agenda? To what extent can they point to any impact of their post- DREaM research on end- user communities? Has DREaM network participation opened up new opportunities for their research? Do they continue to operate as a network?
  40. 40. www.napier.ac.uk/iidi Page 40 YES! 50% actively involved in research Themes: information literacy, policy, health, cultural heritage, data mining, data protection, economics, education, employability, knowledge management, law, politics, psychiatry, social justice Claims of 12 participants that 40 of 87 outputs have informed policy (20), determined services provision (23), developed LIS research agenda (15), all 3 (5)
  41. 41. www.napier.ac.uk/iidi Page 41 Majority: • Internal presentations • Blogs and social media • Journal publications • Peer review service
  42. 42. www.napier.ac.uk/iidi Page 42 Have the DREaM workshop participants innovated in the workplace since 2012? Has their post-DREaM research determined services provision, or influenced the LIS research agenda? To what extent can they point to any impact of their post- DREaM research on end- user communities? Has DREaM network participation opened up new opportunities for their research? Do they continue to operate as a network?
  43. 43. www.napier.ac.uk/iidi Page 43 We have examples Understanding of student use of learning spaces  changes to physical environment within academic library Articulation of information literacy priorities public library participation in the discourse
  44. 44. www.napier.ac.uk/iidi Page 44 Have the DREaM workshop participants innovated in the workplace since 2012? Has their post-DREaM research determined services provision, or influenced the LIS research agenda? To what extent can they point to any impact of their post- DREaM research on end- user communities? Has DREaM network participation opened up new opportunities for their research? Do they continue to operate as a network?
  45. 45. www.napier.ac.uk/iidi Page 45 DREaM contributed to the development of my research capability and profile and has influenced my decision to seek a stronger academic role. Involvement in the project helped me develop confidence as an LIS researcher to go on to write successful bids and be an active part of the LIS research community. YES!
  46. 46. www.napier.ac.uk/iidi Page 46 17 job changes - and participation in the DREaM project was a factor in 11 (NB correlation between number of research outputs and likelihood of changing role) I have been promoted… This required a considerable research portfolio and DREaM has contributed to this. Furthermore [two cadre members] provided references. DREaM gave me the confidence to go for more senior roles, and gave me a thorough background knowledge in research.
  47. 47. www.napier.ac.uk/iidi Page 47 Have the DREaM workshop participants innovated in the workplace since 2012? Has their post-DREaM research determined services provision, or influenced the LIS research agenda? To what extent can they point to any impact of their post- DREaM research on end- user communities? Has DREaM network participation opened up new opportunities for their research? Do they continue to operate as a network?
  48. 48. www.napier.ac.uk/iidi Page 48 YES! Majority (22) maintain social and work ties All but one of the rest maintain either social or work ties 12 active collaborators on 37 initiatives Collaborators most productive: 70% research outputs The higher the number of work-related ties, the greater the quantity of research outputs
  49. 49. www.napier.ac.uk/iidi Page 49 Other forms of impact from DREaM Delivery of events Format, e.g. lecture-workshop switch Delegate participation, e.g. One Minute Madness Speaker participation, e.g. widened pool Reporting of events Deployment of social media
  50. 50. www.napier.ac.uk/iidi Page 50 What can we do to ensure that our research has an impact on practice? Mission accomplished? How can you design a study to measure impact? Find advice in 11 recommendations of the RiLIES project DREaM Again as a worked case study
  51. 51. www.napier.ac.uk/iidi Page 51 Over to you!
  52. 52. www.napier.ac.uk/iidi Contact Hazel Hall Page 52 @hazelh http://hazelhall.org http://about.me/hazelh h.hall@napier.ac.uk +44 (0)131 455 2760 Slides on SlideShare at: http://slideshare.net/hazelhall
  53. 53. What happens next? Strategies for building and assessing the long-term impact of research projects Closing keynote presentation 8th International Conference on Qualitative and Quantitative Methods in Libraries 27th May 2016 Dr Hazel Hall Professor of Social Informatics @hazelh

×