Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Altmetrics for research: impact measurement &#hcsm

2,995 views

Published on

Presentation given to the Alberta Research Center for Health Evidence (ARCHE) on July 22, 2014.

  • Be the first to comment

Altmetrics for research: impact measurement &#hcsm

  1. 1. Robin Featherstone, MLIS Research Librarian, Alberta Research Centre for Health Evidence @rmfeatherstone http://www.slideshare.net/featherr Altmetrics for research : impact measurement & #hcsm http://www.ualberta.ca/ARCHE/ @arche4evidence Summer 2014
  2. 2. Conflict of interest disclosure • I have had free access to the Altmetric.com Explorer since September 2013
  3. 3. Altmetrics… […] capture ways in which articles are disseminated throughout the expanding scholarly ecosystem, and reach beyond the scope of traditional trackers and filters. […] measure research impact by including references outside of traditional scholarly publishing. 1. Public Library of Science (PLOS). Altmetrics. [29 April 2014]. Available from http://article-level-metrics.plos.org/alt-metrics/ 2. Baynes G. Scientometrics, bibliometrics, altmetrics: Some introductory advice for the lost and bemused. Insights. 2012;25(3):311-5. doi: 10.1629/2048-7754.25.3.311.
  4. 4. Altmetric tools measure data collected from: • Tweets • Blog mentions • Facebook posts • Presentations • News articles • Shared citations (e.g., Mendeley, CiteULike) • Data uploads • Etc.
  5. 5. BIG DATA
  6. 6. What’s your impact3? 3. Emerald Group Publishing. Impact of Research [11 April 2014]. Available from: http://www.emeraldgrouppublishing.com/authors/impact/index.htm http://blogs.lse.ac.uk/impactofsocialsciences/2011/07/14/publishers-measuring-impact/
  7. 7. Agenda • Researcher & article case studies • Altmetric products • Measurable mentions & unique IDs • Gaming the system • Altmetric research • Altmetrics for biomedical and health sciences • Future directions
  8. 8. Researcher case study – Heather Piwowar • h-index: 9 – 23 articles cited 280 times http://www.scopus.com/authid/detail.url?authorId=25122628200
  9. 9. Researcher Case Study – Heather Piwowar • 40 Slideshares 88 followers http://www.slideshare.net/hpiwowar • 107 ImpactStory research products http://impactstory.org/HeatherPiwowar • 1469 Figshare views http://figshare.com/authors/Heather_Piwowar/96399 • 1812 GitHub contributions https://github.com/hpiwowar • 52 Google Scholar publications cited 762 times http://scholar.google.ca/citations?user=1YLq0XMAAAAJ&hl=en • ResearchGate score: 15.31 • Research Gate Impact Points: 50.29 https://www.researchgate.net/profile/Heather_Piwowar2
  10. 10. Article Case Study – Carlisle 2014 • Web of Science times cited: 1 • Google Scholar times cited: 1 • Scopus times cited: 1
  11. 11. Article Case Study – Carlisle 2014 • Altmetric score: 134.15
  12. 12. Altmetrics Players
  13. 13. Q: Which twitter post will be counted by altmetrics measurement instruments? A. Great review on pet ownership for children with autism by Gretchen Carlisle B. Great review by @gretchgretch15 on pet ownership - #autism C. Great review - http://dx.doi.org/10.1016/j.pedn.2013.09.005
  14. 14. What is gaming? • Alice has a new paper out. She asks those grad students of hers who blog to write about it. • Alice has a new paper out. She believes that it contains important information for diabetes patients and so signs up to a ’100 retweets for $$$’ service. 5. Case examples from: Adie, E. Gaming Altmetrics. [29 April 2014]. Available from http://www.altmetric.com/blog/gaming-altmetrics/
  15. 15. Auto-spamming
  16. 16. Spectrum of social media self- promotion 6. Adie, E. Gaming Altmetrics. [29 April 2014]. Available from http://www.altmetric.com/blog/gaming-altmetrics/
  17. 17. Altmetrics research • PLOS Altmetrics Collection: http://www.ploscollections.org/altmetrics • Many studies compared altmetrics with citation counts and Impact Factors • Positive but weak correlations found
  18. 18. Altmetrics in the health sciences • ‘Biomedical and health sciences’ showed highest share of publications with Altmetric.com scores7 • Increasing numbers of PubMed citations were being tweeted8 2010 2.4% 2011 10.9% 2012 20.4% 7. Costas R, Zahedi Z, Wouters P. Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. arXiv preprint arXiv:14014321. 2014. 8. Haustein S, Peters I, Sugimoto CR, Thelwall M, Larivière V. Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology. 2013.
  19. 19. Social Media and health • Used for: – Health promotion9, 10 – Education11 – Communication and knowledge sharing12 9. Williams G, Hamm MP, Shulhan J, Vandermeer B, Hartling L. Social media interventions for diet and exercise behaviours: a systematic review and meta-analysis of randomised controlled trials. BMJ Open. 2014;4(2). doi: 10.1136/bmjopen-2013-003926. 10. Hamm MP, Chisholm A, Shulhan J, Milne A, Scott SD, Given LM, et al. Social media use among patients and caregivers: a scoping review. BMJ Open. 2013;3(5). doi: 10.1136/bmjopen-2013-002819. 11. Hamm MP, Klassen TP, Scott SD, Moher D, Hartling L. Education in Health Research Methodology: Use of a Wiki for Knowledge Translation. PLoS ONE. 2013;8(5):e64922. doi: 10.1371/journal.pone.0064922. 12. Hamm MP, Chisholm A, Shulhan J, Milne A, Scott SD, Klassen TP, et al. Social media use by health care professionals and trainees: a scoping review. Academic medicine : journal of the Association of American Medical Colleges. 2013;88(9):1376-83. doi: 10.1097/ACM.0b013e31829eb91c.
  20. 20. Rank Score Article Title Year Journal 1 1350 Early Television Exposure and Subsequent Attentional Problems in Children 2004 Pediatrics 2 558 Do Television and Electronic Games Predict Children’s Psychosocial Adjustment? Longitudinal Research Using the UK Millennium Cohort Study 2013 Archives of Disease in Childhood 3 521 Microbial Contamination of Human Milk Purchased via the Internet 2013 Pediatrics 4 457 Effective Messages in Vaccine Promotion: A Randomized Trial 2014 Pediatrics 5 383 Gun Violence Trends in Movies 2013 Pediatrics Using Altmetrics.com rankings – Pediatric Journals
  21. 21. Using Altmetrics.com rankings - ARCHE publications
  22. 22. Future Directions – Publisher-driven altmetrics
  23. 23. Future Directions – Product development • Increase transparency of self-promotion activites • Implement anti-spamming/anti-gaming software solutions
  24. 24. Future Directions – Standards development
  25. 25. Future Directions – Research • Is there a correlation between altmetrics rankings and… – full-text downloads? – qualitative measures of interest? – …
  26. 26. Future Directions - Assessment • Will be used by: – funding agencies – research centres – Knowledge Translation (KT) researchers
  27. 27. Future Directions
  28. 28. The Alberta Research Centre for Health Evidence Edmonton, Alberta, Canada Robin Featherstone, MLIS @rmfeatherstone feathers@ualberta.ca Slides available: http://www.slideshare.net/featherr

×