Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Altmetrics: the movement, the tools, and the implications

1,161 views

Published on

The October 2015 iteration of the class created and taught by Andrea Denton and Kimberley R. Barker, both of the UVA Claude Moore Health Sciences Library.

Published in: Social Media
  • Be the first to comment

Altmetrics: the movement, the tools, and the implications

  1. 1. Altmetrics: the movement, the tools, and the implications Kimberley R. Barker, MLIS Andrea H. Denton, MILS October 8, 2015
  2. 2. Defining altmetrics • J. Priem (@jasonpriem), I like the term #articlelevelmetrics, but it fails to imply *diversity* of measures. Lately, I'm liking #altmetrics., 4:28 AM - 29 Sep 10, Tweet • “…the creation and study of new metrics based on the Social Web for analyzing, and informing scholarship.” – http://altmetrics.org/about/
  3. 3. Defining altmetrics • Metrics that supplement or complement traditional metrics
  4. 4. Awareness, not promotion!
  5. 5. From metrics to altmetrics Measures Traditional Research Products Traditional - Article - Chapter - Book Times Cited Impact Factor + Rank H-index
  6. 6. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Book Times Cited Impact Factor + Rank H-index Page Views Downloads
  7. 7. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Books Times Cited Impact Factor + Rank H-index Page Views New - Dataset - Blog post - More None
  8. 8. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Books Times Cited Impact Factor + Rank H-index Page Views New - Datasets - Blog post - More None News stories Blog mentions Tweets
  9. 9. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Books Times Cited Impact Factor + Rank H-index Page Views News stories Blog mentions Tweets New - Datasets - Blog post - More None News stories Blog mentions Tweets
  10. 10. Additional scholarly contributions • Blogs • Invited Interviews • Twitter • Facebook postings • Reddit • Datasets • Patents • Software • Copyrights
  11. 11. Examples of “altmeasuring” • Downloads and page views • Track-backs • Tweets and retweets • Links from review services (e.g. Facultyof1000) • Sharing, social bookmarking • News media
  12. 12. New metrics for traditional products
  13. 13. Newer metrics for traditional products Br J Sports Med doi:10.1136/bjsports-2013-092417
  14. 14. New metrics for new products
  15. 15. Other influences NSF “Publications” broadened to “Products of Research” (Jan 2013) • “citable and accessible including but not limited to publications, data sets, software, patents, and copyrights.“
  16. 16. Other influences NIH Biosketch new format (Jan 2015) • other non-publication research products, including audio or video products; patents; data and research materials; databases; educational aids or curricula; instruments or equipment; models; protocols; and software or netware…
  17. 17. Tools
  18. 18. Early altmetric tools • Measure web views and downloads –Google Analytics –Bit.ly • Measure views and reads of articles • Google Profiles • ResearchGate
  19. 19. Journal-level tools • Each publisher does it a slightly different way • Examples…
  20. 20. BMC Medicine
  21. 21. Wiley
  22. 22. Emerging Tools • ImpactStory • Altmetric.com • PlumX
  23. 23. Impactstory • Create an online profile – Discover and share how your research is read, cited, tweeted, bookmarked, and more – Help colleagues find and read your preprints, articles, slides and other work by uploading research products straight your profile • Jason Priem and Heather Piwowar • Free for 30 days, then $60 a year.
  24. 24. Sample Impactstory Profile
  25. 25. Altmetric.com • London-based start-up • Funding from Digital Science (LabGuru, FigShare)
  26. 26. Altmetric’s widget (“donut”) • Used by publishers/journals –Nature Publishing –Cell Press –Wiley –BioMed Central –BMJ Specialty journals
  27. 27. What sources does Altmetric track? News outlets • Over 1,300 sites • Manually curated list • Text mining • Global coverage Social media and blogs • Twitter, Facebook, Google+, Sina Weibo • Public posts only • Manually curated list Reference managers • Mendeley, CiteULike • Reader counts • Don’t count towards the Altmetric score Other sources • Wikipedia • YouTube • Reddit • F1000 • Pinterest • Q&A Post-publication peer review • Publons • PubPeer Policy documents • NICE Evidence • Intergovernmental Panel on Climate Change • Many more…
  28. 28. Altmetric Score Volume Sources Authors The score for an article rises as more people mention it. Each source category contributes a different base amount to the final score. How often the author of each mention talks about scholarly articles influences the contribution of the mention. The Altmetric score provides an indicator of the attention surrounding a research output. It represents a weighted approximation of all the attention picked up for a research output and is calculated according to three facets:
  29. 29. Cochrane Library paper investigated use of probiotics to treat eczema: There is not enough evidence to recommend using probiotics for the treatment of eczema. The paper has a relatively low score of attention but received mentions across policy documents and Wikipedia: • Royal College of Paediatrics and Child Health - Allergy Care Pathways for Children: core competency for health professionals treating children with eczema Discovering policy references
  30. 30. Nature Neuroscience
  31. 31. Altmetric Explorer • Subscription product – monitor, search and measure conversations about your publications and those of your competitors • “Pricing options”
  32. 32. Altmetric Bookmarklet • Free • Reading a paper and want to find out its Altmetric details? Install the bookmarklet in your browser • When viewing the paper, “Altmetric it”
  33. 33. Altmetric Bookmarklet
  34. 34. Altmetric Bookmarklet
  35. 35. Plum Analytics • PlumX is an institutional “impact dashboard” that provides information on how research output is being utilized, interacted with, and talked about around the world • Gathers metrics (altmetrics) about research from more than thirty sources including PLOS, PubMed and YouTube, and categorizes them
  36. 36. However…
  37. 37. • Standards aren’t fully defined – Definitions, calculations, etc. – NISO effort • Are altmetrics important for discovery? For evaluation? Both? Issues
  38. 38. Issues • Impact vs. attention –David C.’s Improbable Science… “Why you should ignore altmetrics and other bibliometric nightmares” http://www.dcscience.net/?p=6369 • Popularity –Popular topics get higher counts, quickly, but then fade. How does this reflect quality?
  39. 39. Issues • Too much concern on metrics (“culture of measurement”) • Does social media help promote good science? Or not? (e.g. anti-vaccine)
  40. 40. Altmetrics: where to start? Altmetrics for Researchers (Duke University Medical Library)
  41. 41. What are your products? • (Papers, Chapters, Books) • A clinical protocol? • Software code? • Conference poster? • Teaching materials? • White paper?
  42. 42. Where are your products? • A repository? • Website? • Profile? Are they well-described (findable)? Are they accessible by others? Are they citable? Are they downloadable? Are there metrics to tell you?
  43. 43. What metrics match those products? Product Metric Clinical protocol Adoption Software code Downloads or forks Conference poster Views Teaching materials Adoption/adaptation White paper Views, Tweets
  44. 44. What systems or tools can provide those metrics? • Journal’s website –Views, downloads, comparisons • Repository –Views, downloads • Altmetric.com; Impactstory
  45. 45. How will you explain these metrics? • Contextualize – “This paper was in the top 10% of all papers downloaded in 2015.” • Describe “broader impact” – “This work was picked up by over 100 news sources.”
  46. 46. Pulling it all together • Online identity • Personal branding • Reputation management
  47. 47. Additional Readings • Altmetrics for Researchers (Duke University Medical Center Library & Archives) • How to Track the Impact of Research Data with Metrics (Digital Curation Centre)
  48. 48. Thank You! Andrea Denton andrea@virginia.edu Kimberley Barker kimberley@virginia.edu

×