Research Assessment to Support Research Impact

  • 3,015 views
Uploaded on

A talk given at the SCAP Symposium on August 12 2012. The talk focuses on the question of how new tools for tracking the use and re-use of research provide new mechanisms by which we can demonstrate …

A talk given at the SCAP Symposium on August 12 2012. The talk focuses on the question of how new tools for tracking the use and re-use of research provide new mechanisms by which we can demonstrate and investigate research impact with a particular focus on those papers published from the University of Cape Town with PLOS.

More in: Technology , Travel , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
3,015
On Slideshare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
24
Comments
0
Likes
11

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n

Transcript

  • 1. Research Assessment toSupport Research Impact Cameron Neylon University of Cape Town - 10 August 2012
  • 2. You are free to: Copy, share, adapt, or re-mix; Photograph, film, or broadcast; Blog, live-blog, or post video of;This presentation. Provided that: You attribute the work to its author and respect the rights and licenses associated with its components.
  • 3. There is a gaping (ethical, moral) hole in our assessment systemshttp://www.flickr.com/photos/amanderson/2421035280 CC-BY
  • 4. But if we throw it all out...?Something missing...http://www.flickr.com/photos/limaoscarjuliet/3305886294 CC-BY
  • 5. key pointshttp://www.flickr.com/photos/y_i/2360600227 CC-BY
  • 6. http://www.flickr.com/photos/andrec/2893549851 CC-BY
  • 7. I don’t have answers... ...only questionshttp://www.flickr.com/photos/drachmann/327122302 CC-BY-SA
  • 8. What do you value?
  • 9. What is your mission?
  • 10. Values Mission
  • 11. Mission Assessment
  • 12. Mission Assessment
  • 13. Mission Assessment
  • 14. http://www.flickr.com/photos/28481088@N00/2050334184 CC-BY
  • 15. Can we measure better?http://www.flickr.com/photos/sterlic/4299631538 CC-BY
  • 16. An assertion.
  • 17. We want to seescholarship used.
  • 18. In the right places...http://www.flickr.com/photos/velkr0/3472576304 CC-BY
  • 19. In the right places...http://www.flickr.com/photos/argonne/3465398655 CC-BY
  • 20. In the right places...http://www.flickr.com/photos/ol1/6048544977 CC-BY-SA
  • 21. ...at the right time.http://www.flickr.com/photos/robbie73/3387189144 CC-BY-SA
  • 22. We want scholarship tobe re-used and re-usable
  • 23. Impact = Re-use
  • 24. Application = Re-use
  • 25. Commercialised = Re-use
  • 26. Education = Re-use
  • 27. Engagement = Re-use
  • 28. ...but also...
  • 29. Citation = Re-use
  • 30. http://www.flickr.com/photos/flavinsky/3410980137 CC-BY
  • 31. I can’t tell you which ones matter to you...http://www.flickr.com/photos/andrec/2893549851 CC-BY
  • 32. ...but we do have new ways to measure these...
  • 33. Articles with impact...http://www.flickr.com/photos/babasteve/3140688308 CC-BY
  • 34. ...but (relatively)few citations (yet)
  • 35. PLOS papers authored by University of Cape Town staff Usage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRef citation counts. Total Views 14000 12000 10000 8000 6000 4000 2000 0 0 20 40 60 80 MonthsALM data visualisations courtesy of Martin Fenner
  • 36. PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.Total Views 14000 Guidance for Evidence-Informed Policies about Health Systems: Rationale for and Challenges of Guidance Development 12000 Building the Field of Health Policy and Systems Research: 10000 Framing the Questions, PLOS Medicine 8000 6000 4000 2000 0 0 20 40 60 80 Months
  • 37. PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.Total Views 14000 12000 10000 8000 6000 4000 2000 0 0 20 40 60 80 Months
  • 38. PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts. Red circles represent papers with "HIV" in title.Total Views 15000 “HIV” in title 10000 5000 0 0 20 40 60 80 Months
  • 39. 5000 0 0 20
  • 40. PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.Total Views 14000 12000 10000 8000 6000 4000 2000 0 0 20 40 60 80 Months
  • 41. PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts.Total Views 50000 40000 30000 20000 10000 0 0 20 40 60 80 Months
  • 42. PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts. Red circles represent papers with "Health" in title.Total Views Toward a Global View of Alcohol, Tobacco, Cannabis, and Cocaine 50000 Use: Findings from the WHO World Mental Health Surveys 40000 Patient Adherence to Tuberculosis Treatment: 30000 A Systematic Review of Qualitative Research 20000 10000 0 0 20 40 60 80 Months
  • 43. Lots of data...http://total-impact.org/collection/yhb7tr
  • 44. ...but here’s a story
  • 45. altmetric.com
  • 46. What’s the missing audience for theseSouth African papers?
  • 47. ...here’s one...
  • 48. Not very high views
  • 49. PLOS papers authored by University of Cape Town staffUsage data from the PLoS journal website (combined HTML views and PDF downloads). Circle size correlates with CrossRefcitation counts. Red circles represent papers with "HIV" in title.Total Views 15000 10000 Not an obvious outlier... 5000 0 0 20 40 60 80 Months
  • 50. ...but highly relevant interactions
  • 51. ...driven by this person...
  • 52. ...who I can talk to.
  • 53. See http://bit.ly/NJOyUn for the whole conversation
  • 54. This. Is Impact.
  • 55. It’s not about where you publish...
  • 56. ...but who you reach
  • 57. p://www.flickr.com/photos/cappellmeister/39508741 CC-BY
  • 58. Think at network scale...
  • 59. You’re used to thinkingabout reaching scholars...
  • 60. ...but at the scale of the network...
  • 61. ...there are many ways to make connections...
  • 62. ...and not all of them with your traditional audience..
  • 63. You don’t even knowwho most of them are..
  • 64. ...so how do youmaximise reach?
  • 65. http://flickr.com/photos/virtualsugar/316200555/ CC-BY
  • 66. key pointshttp://www.flickr.com/photos/y_i/2360600227 CC-BY
  • 67. http://www.flickr.com/photos/andrec/2893549851 CC-BY
  • 68. Values Mission
  • 69. http://www.flickr.com/photos/28481088@N00/2050334184 CC-BY
  • 70. http://www.flickr.com/photos/sterlic/4299631538 CC-BY
  • 71. Mission Assessment
  • 72. Assessment Impact
  • 73. p://www.flickr.com/photos/cappellmeister/39508741 CC-BY
  • 74. Think like the network.
  • 75. We can’t build a system on yesterday’s truths.
  • 76. We could maintain asystem on today’s....
  • 77. ...for a whilehttp://www.flickr.com/photos/22746515@N02/4375854224 CC-BY
  • 78. You build for the future on tomorrow’s realities...http://www.flickr.com/photos/yakobusan/2436481628 CC-BY
  • 79. Innovators don’t follow markets...http://www.flickr.com/photos/petrick/2291498814 CC-BY
  • 80. ...they build them.http://www.flickr.com/photos/98528214@N00/312210315/ CC-BY-SA
  • 81. Networks are the future.http://www.flickr.com/photos/pagedooley/3143417443 CC-BY
  • 82. Not rankings...http://www.flickr.com/photos/73112697@N03/6597508893 CC-BY
  • 83. http://www.flickr.com/photos/mgifford/3558463424 CC-BY-SA
  • 84. @cameronneylonhttp://cameronneylon.net