Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Altmetrics: the movement, the
tools, and the implications
Kimberley R. Barker, MLIS
Andrea H. Denton, MILS
October 8, 2015
Defining altmetrics
• J. Priem (@jasonpriem), I like the term
#articlelevelmetrics, but it fails to imply
*diversity* of m...
Defining altmetrics
• Metrics that supplement or complement
traditional metrics
Awareness,
not
promotion!
From metrics to altmetrics
Measures
Traditional
Research
Products
Traditional
- Article
- Chapter
- Book
Times Cited
Impac...
From metrics to altmetrics
Measures
Traditional New
Research
Products
Traditional
- Article
- Chapter
- Book
Times Cited
I...
From metrics to altmetrics
Measures
Traditional New
Research
Products
Traditional
- Article
- Chapter
- Books
Times Cited
...
From metrics to altmetrics
Measures
Traditional New
Research
Products
Traditional
- Article
- Chapter
- Books
Times Cited
...
From metrics to altmetrics
Measures
Traditional New
Research
Products
Traditional
- Article
- Chapter
- Books
Times Cited
...
Additional scholarly contributions
• Blogs
• Invited Interviews
• Twitter
• Facebook postings
• Reddit
• Datasets
• Patent...
Examples of “altmeasuring”
• Downloads and page views
• Track-backs
• Tweets and retweets
• Links from review services (e....
New metrics for traditional products
Newer metrics for traditional products
Br J Sports Med doi:10.1136/bjsports-2013-092417
New metrics for new products
Other influences
NSF “Publications” broadened to “Products
of Research” (Jan 2013)
• “citable and accessible including but...
Other influences
NIH Biosketch new format (Jan 2015)
• other non-publication research products,
including audio or video p...
Tools
Early altmetric tools
• Measure web views and downloads
–Google Analytics
–Bit.ly
• Measure views and reads of articles
• ...
Journal-level tools
• Each publisher does it a slightly different
way
• Examples…
BMC Medicine
Wiley
Emerging Tools
• ImpactStory
• Altmetric.com
• PlumX
Impactstory
• Create an online profile
– Discover and share how your research is read,
cited, tweeted, bookmarked, and mor...
Sample Impactstory Profile
Altmetric.com
• London-based start-up
• Funding from Digital Science (LabGuru, FigShare)
Altmetric’s widget (“donut”)
• Used by publishers/journals
–Nature Publishing
–Cell Press
–Wiley
–BioMed Central
–BMJ Spec...
What sources does Altmetric track?
News outlets
• Over 1,300 sites
• Manually curated list
• Text mining
• Global coverage...
Altmetric Score
Volume Sources Authors
The score for an article
rises as more people
mention it.
Each source category
cont...
Cochrane Library paper investigated use of probiotics to
treat eczema: There is not enough evidence to recommend
using pro...
Nature Neuroscience
Altmetric Explorer
• Subscription product – monitor, search and
measure conversations about your
publications and those of...
Altmetric Bookmarklet
• Free
• Reading a paper and want to find out its
Altmetric details? Install the bookmarklet
in your...
Altmetric Bookmarklet
Altmetric Bookmarklet
Plum Analytics
• PlumX is an institutional “impact dashboard”
that provides information on how research
output is being ut...
However…
• Standards aren’t fully defined
– Definitions, calculations, etc.
– NISO effort
• Are altmetrics important for discovery?...
Issues
• Impact vs. attention
–David C.’s Improbable Science… “Why you
should ignore altmetrics and other
bibliometric nig...
Issues
• Too much concern on metrics (“culture of
measurement”)
• Does social media help promote good
science? Or not? (e....
Altmetrics: where to start?
Altmetrics for Researchers (Duke University Medical Library)
What are your products?
• (Papers, Chapters, Books)
• A clinical protocol?
• Software code?
• Conference poster?
• Teachin...
Where are your products?
• A repository?
• Website?
• Profile?
Are they well-described (findable)?
Are they accessible by ...
What metrics match those products?
Product Metric
Clinical protocol Adoption
Software code Downloads or forks
Conference p...
What systems or tools can provide
those metrics?
• Journal’s website
–Views, downloads, comparisons
• Repository
–Views, d...
How will you explain these metrics?
• Contextualize
– “This paper was in the top 10% of all papers
downloaded in 2015.”
• ...
Pulling it all together
• Online identity
• Personal branding
• Reputation management
Additional Readings
• Altmetrics for Researchers (Duke University
Medical Center Library & Archives)
• How to Track the Im...
Thank You!
Andrea Denton andrea@virginia.edu
Kimberley Barker kimberley@virginia.edu
Upcoming SlideShare
Loading in …5
×

Altmetrics: the movement, the tools, and the implications

The October 2015 iteration of the class created and taught by Andrea Denton and Kimberley R. Barker, both of the UVA Claude Moore Health Sciences Library.

  • Be the first to comment

Altmetrics: the movement, the tools, and the implications

  1. 1. Altmetrics: the movement, the tools, and the implications Kimberley R. Barker, MLIS Andrea H. Denton, MILS October 8, 2015
  2. 2. Defining altmetrics • J. Priem (@jasonpriem), I like the term #articlelevelmetrics, but it fails to imply *diversity* of measures. Lately, I'm liking #altmetrics., 4:28 AM - 29 Sep 10, Tweet • “…the creation and study of new metrics based on the Social Web for analyzing, and informing scholarship.” – http://altmetrics.org/about/
  3. 3. Defining altmetrics • Metrics that supplement or complement traditional metrics
  4. 4. Awareness, not promotion!
  5. 5. From metrics to altmetrics Measures Traditional Research Products Traditional - Article - Chapter - Book Times Cited Impact Factor + Rank H-index
  6. 6. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Book Times Cited Impact Factor + Rank H-index Page Views Downloads
  7. 7. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Books Times Cited Impact Factor + Rank H-index Page Views New - Dataset - Blog post - More None
  8. 8. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Books Times Cited Impact Factor + Rank H-index Page Views New - Datasets - Blog post - More None News stories Blog mentions Tweets
  9. 9. From metrics to altmetrics Measures Traditional New Research Products Traditional - Article - Chapter - Books Times Cited Impact Factor + Rank H-index Page Views News stories Blog mentions Tweets New - Datasets - Blog post - More None News stories Blog mentions Tweets
  10. 10. Additional scholarly contributions • Blogs • Invited Interviews • Twitter • Facebook postings • Reddit • Datasets • Patents • Software • Copyrights
  11. 11. Examples of “altmeasuring” • Downloads and page views • Track-backs • Tweets and retweets • Links from review services (e.g. Facultyof1000) • Sharing, social bookmarking • News media
  12. 12. New metrics for traditional products
  13. 13. Newer metrics for traditional products Br J Sports Med doi:10.1136/bjsports-2013-092417
  14. 14. New metrics for new products
  15. 15. Other influences NSF “Publications” broadened to “Products of Research” (Jan 2013) • “citable and accessible including but not limited to publications, data sets, software, patents, and copyrights.“
  16. 16. Other influences NIH Biosketch new format (Jan 2015) • other non-publication research products, including audio or video products; patents; data and research materials; databases; educational aids or curricula; instruments or equipment; models; protocols; and software or netware…
  17. 17. Tools
  18. 18. Early altmetric tools • Measure web views and downloads –Google Analytics –Bit.ly • Measure views and reads of articles • Google Profiles • ResearchGate
  19. 19. Journal-level tools • Each publisher does it a slightly different way • Examples…
  20. 20. BMC Medicine
  21. 21. Wiley
  22. 22. Emerging Tools • ImpactStory • Altmetric.com • PlumX
  23. 23. Impactstory • Create an online profile – Discover and share how your research is read, cited, tweeted, bookmarked, and more – Help colleagues find and read your preprints, articles, slides and other work by uploading research products straight your profile • Jason Priem and Heather Piwowar • Free for 30 days, then $60 a year.
  24. 24. Sample Impactstory Profile
  25. 25. Altmetric.com • London-based start-up • Funding from Digital Science (LabGuru, FigShare)
  26. 26. Altmetric’s widget (“donut”) • Used by publishers/journals –Nature Publishing –Cell Press –Wiley –BioMed Central –BMJ Specialty journals
  27. 27. What sources does Altmetric track? News outlets • Over 1,300 sites • Manually curated list • Text mining • Global coverage Social media and blogs • Twitter, Facebook, Google+, Sina Weibo • Public posts only • Manually curated list Reference managers • Mendeley, CiteULike • Reader counts • Don’t count towards the Altmetric score Other sources • Wikipedia • YouTube • Reddit • F1000 • Pinterest • Q&A Post-publication peer review • Publons • PubPeer Policy documents • NICE Evidence • Intergovernmental Panel on Climate Change • Many more…
  28. 28. Altmetric Score Volume Sources Authors The score for an article rises as more people mention it. Each source category contributes a different base amount to the final score. How often the author of each mention talks about scholarly articles influences the contribution of the mention. The Altmetric score provides an indicator of the attention surrounding a research output. It represents a weighted approximation of all the attention picked up for a research output and is calculated according to three facets:
  29. 29. Cochrane Library paper investigated use of probiotics to treat eczema: There is not enough evidence to recommend using probiotics for the treatment of eczema. The paper has a relatively low score of attention but received mentions across policy documents and Wikipedia: • Royal College of Paediatrics and Child Health - Allergy Care Pathways for Children: core competency for health professionals treating children with eczema Discovering policy references
  30. 30. Nature Neuroscience
  31. 31. Altmetric Explorer • Subscription product – monitor, search and measure conversations about your publications and those of your competitors • “Pricing options”
  32. 32. Altmetric Bookmarklet • Free • Reading a paper and want to find out its Altmetric details? Install the bookmarklet in your browser • When viewing the paper, “Altmetric it”
  33. 33. Altmetric Bookmarklet
  34. 34. Altmetric Bookmarklet
  35. 35. Plum Analytics • PlumX is an institutional “impact dashboard” that provides information on how research output is being utilized, interacted with, and talked about around the world • Gathers metrics (altmetrics) about research from more than thirty sources including PLOS, PubMed and YouTube, and categorizes them
  36. 36. However…
  37. 37. • Standards aren’t fully defined – Definitions, calculations, etc. – NISO effort • Are altmetrics important for discovery? For evaluation? Both? Issues
  38. 38. Issues • Impact vs. attention –David C.’s Improbable Science… “Why you should ignore altmetrics and other bibliometric nightmares” http://www.dcscience.net/?p=6369 • Popularity –Popular topics get higher counts, quickly, but then fade. How does this reflect quality?
  39. 39. Issues • Too much concern on metrics (“culture of measurement”) • Does social media help promote good science? Or not? (e.g. anti-vaccine)
  40. 40. Altmetrics: where to start? Altmetrics for Researchers (Duke University Medical Library)
  41. 41. What are your products? • (Papers, Chapters, Books) • A clinical protocol? • Software code? • Conference poster? • Teaching materials? • White paper?
  42. 42. Where are your products? • A repository? • Website? • Profile? Are they well-described (findable)? Are they accessible by others? Are they citable? Are they downloadable? Are there metrics to tell you?
  43. 43. What metrics match those products? Product Metric Clinical protocol Adoption Software code Downloads or forks Conference poster Views Teaching materials Adoption/adaptation White paper Views, Tweets
  44. 44. What systems or tools can provide those metrics? • Journal’s website –Views, downloads, comparisons • Repository –Views, downloads • Altmetric.com; Impactstory
  45. 45. How will you explain these metrics? • Contextualize – “This paper was in the top 10% of all papers downloaded in 2015.” • Describe “broader impact” – “This work was picked up by over 100 news sources.”
  46. 46. Pulling it all together • Online identity • Personal branding • Reputation management
  47. 47. Additional Readings • Altmetrics for Researchers (Duke University Medical Center Library & Archives) • How to Track the Impact of Research Data with Metrics (Digital Curation Centre)
  48. 48. Thank You! Andrea Denton andrea@virginia.edu Kimberley Barker kimberley@virginia.edu

×