Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

118 views

Published on

Date: Feb 7, 2018

Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries

Overview: Scholarship is increasingly being created, disseminated, and measured on digital and social platforms. If Twitter exchanges, Facebook “saves,” and YouTube hits are the new metrics for tracking scholarship, how are we measuring societal and educational impact and outreach? How can researchers display their research impact using social media on promotion and tenure dossiers? This webinar will discuss altmetrics, alternative scholarly metrics that measure the impact and use of scholarship. We will focus on PlumX, the tool used at USC, which combines traditional and new metrics to paint a comprehensive portrait of your scholarly output and its reach in various communities and with different stakeholders.

Published in: Health & Medicine
  • Be the first to comment

  • Be the first to like this

Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

  1. 1. Digital Scholar Webinar February 7, 2018 Hosted by the Southern California Clinical and Translational Science Institute (SC CTSI) University of Southern California (USC) and Children’s Hospital Los Angeles (CHLA)
  2. 2. Katja Reuter, PhD, Director of the Digital Scholar Program About Today’s Session
  3. 3. Alternative Scholarly Metrics
  4. 4. Today’s Learning Objectives  Describe the potential and strengths of using alternative scholarly metrics that measure the impact and use of scholarship  Describe basic features of the measurement tool PlumX and how they are used  Describe potential weaknesses of using alternative scholarly metrics and how to address them
  5. 5. Caroline Muglia Today’s Speaker Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries
  6. 6. Questions: Please use the Q&A Feature 1. Click on the tab here to access Q&A 2. Ask and post question here 1 2
  7. 7. Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers Caroline Muglia Co-Associate Dean for Collections & Technical Services; Head, Resource Sharing & Collection Assessment muglia@usc.edu
  8. 8. Scenario 1
  9. 9. Dr. Fernando T. Maestre Professor, Biology and Geology Department at Universidad Rey Juan Carlos (Madrid, Spain)
  10. 10. What is altmetrics? Altmetrics is a broad term that encapsulates the collection of multiple digital indicators related to scholarly work. These indicators are derived from activity and engagement among diverse stakeholders and scholarly outputs in the research ecosystem, including the public sphere. Source:http://www.niso.org/apps/group_public/download.php/17091/NISO%20RP-25-2016%20Outputs%20of%20the%20NISO%20Alternative%20Assessment%20Project.pdf
  11. 11. How does Altmetrics work? ● Researchers leave “data exhaust” when they research and engage with social media ● PlumX mines the exhaust and gathers metrics ● Compares LIKE with LIKE
  12. 12. What is “data exhaust?”
  13. 13. Trends in promotion and tenure dossiers ● Societal impact ○ Citations to research in public policy documents, references in patents, and citations to research in various sources ● Educational impact ○ Articles and books in syllabi, data and other learning objects ● Public engagement and outreach ○ Press coverage, social media buzz, and downloads and views of scholarship and public dissemination of science
  14. 14. Scenario 2
  15. 15. Dr. Jennifer B Unger, PhD Professor of Preventive Medicine, Keck School of Medicine of USC
  16. 16. List of Dr. Unger’s publications with Plum Analytics “plum print”
  17. 17. More detailed view of one article
  18. 18. Learn about her related Twitter Activity per article
  19. 19. The universe is expanding
  20. 20. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  21. 21. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  22. 22. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  23. 23. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  24. 24. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
  25. 25. In 2012, NIH promised to put aside 10% of their funds for AIDS research. In 2015, $3B was reduced to $65M put towards AIDS research.
  26. 26. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
  27. 27. “Over the next year, I will lead a dedicated, combined effort by governments, private industry, researchers, physicians, patients, and philanthropies to target investment, coordinate across silos, and increase access to information for everyone in the cancer community.” -President Barack Obama in “A Moonshot to Cure Cancer,” January 12, 2016
  28. 28. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
  29. 29. In 2015, NIH funded 1 of 5 people.
  30. 30. In 2015, 4 of 5 people did not get funded by NIH.
  31. 31. Clinical Citations
  32. 32. Basic medicine is cited 3 to 5 times more than clinical medicine and this is reflected in journal impact numbers.
  33. 33. Scenario 3
  34. 34. Clinical Citations with Plum Analytics print
  35. 35. More detailed view of one article
  36. 36. Detailed view of DynaMed Plus Topics tab
  37. 37. 4 major outputs for clinical citations Clinical alerting service
  38. 38. 4 major outputs for clinical citations Clinical guidelinesClinical alerting service
  39. 39. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service
  40. 40. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service Clinical Trials
  41. 41. Feedback changes behavior
  42. 42. Established researchers Early career researchers Archetypes within disciplines
  43. 43. Common FAQs (with some answers)
  44. 44. Gaming metrics Question: Traditional metrics can be gamed. How can this be avoided in altmetrics? Answer: ▪ Transparency of metrics ▪ PlumX doesn’t provide a score, but instead provides a data visualization ▪ No calculations on top of things and then hiding what went into it Example: Twitter!
  45. 45. Retractions Question: How does PlumX account for retracted articles? Answer: ▪ Plum captures that the article was retracted ▪ Also captures the activity around them ▪ Since Plum doesn’t offer a score, it’s not impacted
  46. 46. Health policy Question: Where are the altmetrics around health policy (the other side of clinical translational science)? Answer: ▪ They are working on it! They are in the stage of figuring out how to group the altmetrics data (comparing LIKE with LIKE) Stay tuned!
  47. 47. Thank you! muglia@usc.edu
  48. 48. Supplemental slides
  49. 49. NIH Biosketch “contributions to science” ● Historical background that frames the scientific problem ● Influence of the finding/s on the progress of science or the application to health or technology ● Your specific role in the described work ● List of up to four peer-reviewed publications or other non- publication research outputs for each contribution
  50. 50. Makes visible what was invisible. Makes measureable what was immeasurable.
  51. 51. Plum Analytics is part of CINAHL & EBSCOHost
  52. 52. Q u e s t i o n s Program director: Katja Reuter, PhD Email: katja.reuter@usc.edu Twitter: @dmsci Next Digital Scholar Webinar I n f o r m a t i o n a b o u t t h e p r o g r a m http://sc-ctsi.org/digital-scholar/ March 7, 2018/12-1PM PST Topic: Disseminating scientific research via Twitter: Practical insights and research evidence Speaker: Katja Reuter, PhD, Assistant Professor of Clinical Preventive Medicine, Department of Preventive Medicine, Keck School of Medicine of USC; Director of Digital Innovation and Communication, SC CTSI Register at: http://bit.ly/2FhOZ6d

×