Successfully reported this slideshow.

Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

1

Share

1 of 57
1 of 57

Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

1

Share

Download to read offline

Date: Feb 7, 2018

Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries

Overview: Scholarship is increasingly being created, disseminated, and measured on digital and social platforms. If Twitter exchanges, Facebook “saves,” and YouTube hits are the new metrics for tracking scholarship, how are we measuring societal and educational impact and outreach? How can researchers display their research impact using social media on promotion and tenure dossiers? This webinar will discuss altmetrics, alternative scholarly metrics that measure the impact and use of scholarship. We will focus on PlumX, the tool used at USC, which combines traditional and new metrics to paint a comprehensive portrait of your scholarly output and its reach in various communities and with different stakeholders.

Date: Feb 7, 2018

Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries

Overview: Scholarship is increasingly being created, disseminated, and measured on digital and social platforms. If Twitter exchanges, Facebook “saves,” and YouTube hits are the new metrics for tracking scholarship, how are we measuring societal and educational impact and outreach? How can researchers display their research impact using social media on promotion and tenure dossiers? This webinar will discuss altmetrics, alternative scholarly metrics that measure the impact and use of scholarship. We will focus on PlumX, the tool used at USC, which combines traditional and new metrics to paint a comprehensive portrait of your scholarly output and its reach in various communities and with different stakeholders.

More Related Content

Slideshows for you

Similar to Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

More from SC CTSI at USC and CHLA

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

  1. 1. Digital Scholar Webinar February 7, 2018 Hosted by the Southern California Clinical and Translational Science Institute (SC CTSI) University of Southern California (USC) and Children’s Hospital Los Angeles (CHLA)
  2. 2. Katja Reuter, PhD, Director of the Digital Scholar Program About Today’s Session
  3. 3. Alternative Scholarly Metrics
  4. 4. Today’s Learning Objectives  Describe the potential and strengths of using alternative scholarly metrics that measure the impact and use of scholarship  Describe basic features of the measurement tool PlumX and how they are used  Describe potential weaknesses of using alternative scholarly metrics and how to address them
  5. 5. Caroline Muglia Today’s Speaker Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries
  6. 6. Questions: Please use the Q&A Feature 1. Click on the tab here to access Q&A 2. Ask and post question here 1 2
  7. 7. Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers Caroline Muglia Co-Associate Dean for Collections & Technical Services; Head, Resource Sharing & Collection Assessment muglia@usc.edu
  8. 8. Scenario 1
  9. 9. Dr. Fernando T. Maestre Professor, Biology and Geology Department at Universidad Rey Juan Carlos (Madrid, Spain)
  10. 10. What is altmetrics? Altmetrics is a broad term that encapsulates the collection of multiple digital indicators related to scholarly work. These indicators are derived from activity and engagement among diverse stakeholders and scholarly outputs in the research ecosystem, including the public sphere. Source:http://www.niso.org/apps/group_public/download.php/17091/NISO%20RP-25-2016%20Outputs%20of%20the%20NISO%20Alternative%20Assessment%20Project.pdf
  11. 11. How does Altmetrics work? ● Researchers leave “data exhaust” when they research and engage with social media ● PlumX mines the exhaust and gathers metrics ● Compares LIKE with LIKE
  12. 12. What is “data exhaust?”
  13. 13. Trends in promotion and tenure dossiers ● Societal impact ○ Citations to research in public policy documents, references in patents, and citations to research in various sources ● Educational impact ○ Articles and books in syllabi, data and other learning objects ● Public engagement and outreach ○ Press coverage, social media buzz, and downloads and views of scholarship and public dissemination of science
  14. 14. Scenario 2
  15. 15. Dr. Jennifer B Unger, PhD Professor of Preventive Medicine, Keck School of Medicine of USC
  16. 16. List of Dr. Unger’s publications with Plum Analytics “plum print”
  17. 17. More detailed view of one article
  18. 18. Learn about her related Twitter Activity per article
  19. 19. The universe is expanding
  20. 20. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  21. 21. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  22. 22. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  23. 23. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
  24. 24. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
  25. 25. In 2012, NIH promised to put aside 10% of their funds for AIDS research. In 2015, $3B was reduced to $65M put towards AIDS research.
  26. 26. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
  27. 27. “Over the next year, I will lead a dedicated, combined effort by governments, private industry, researchers, physicians, patients, and philanthropies to target investment, coordinate across silos, and increase access to information for everyone in the cancer community.” -President Barack Obama in “A Moonshot to Cure Cancer,” January 12, 2016
  28. 28. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
  29. 29. In 2015, NIH funded 1 of 5 people.
  30. 30. In 2015, 4 of 5 people did not get funded by NIH.
  31. 31. Clinical Citations
  32. 32. Basic medicine is cited 3 to 5 times more than clinical medicine and this is reflected in journal impact numbers.
  33. 33. Scenario 3
  34. 34. Clinical Citations with Plum Analytics print
  35. 35. More detailed view of one article
  36. 36. Detailed view of DynaMed Plus Topics tab
  37. 37. 4 major outputs for clinical citations Clinical alerting service
  38. 38. 4 major outputs for clinical citations Clinical guidelinesClinical alerting service
  39. 39. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service
  40. 40. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service Clinical Trials
  41. 41. Feedback changes behavior
  42. 42. Established researchers Early career researchers Archetypes within disciplines
  43. 43. Common FAQs (with some answers)
  44. 44. Gaming metrics Question: Traditional metrics can be gamed. How can this be avoided in altmetrics? Answer: ▪ Transparency of metrics ▪ PlumX doesn’t provide a score, but instead provides a data visualization ▪ No calculations on top of things and then hiding what went into it Example: Twitter!
  45. 45. Retractions Question: How does PlumX account for retracted articles? Answer: ▪ Plum captures that the article was retracted ▪ Also captures the activity around them ▪ Since Plum doesn’t offer a score, it’s not impacted
  46. 46. Health policy Question: Where are the altmetrics around health policy (the other side of clinical translational science)? Answer: ▪ They are working on it! They are in the stage of figuring out how to group the altmetrics data (comparing LIKE with LIKE) Stay tuned!
  47. 47. Thank you! muglia@usc.edu
  48. 48. Supplemental slides
  49. 49. NIH Biosketch “contributions to science” ● Historical background that frames the scientific problem ● Influence of the finding/s on the progress of science or the application to health or technology ● Your specific role in the described work ● List of up to four peer-reviewed publications or other non- publication research outputs for each contribution
  50. 50. Makes visible what was invisible. Makes measureable what was immeasurable.
  51. 51. Plum Analytics is part of CINAHL & EBSCOHost
  52. 52. Q u e s t i o n s Program director: Katja Reuter, PhD Email: katja.reuter@usc.edu Twitter: @dmsci Next Digital Scholar Webinar I n f o r m a t i o n a b o u t t h e p r o g r a m http://sc-ctsi.org/digital-scholar/ March 7, 2018/12-1PM PST Topic: Disseminating scientific research via Twitter: Practical insights and research evidence Speaker: Katja Reuter, PhD, Assistant Professor of Clinical Preventive Medicine, Department of Preventive Medicine, Keck School of Medicine of USC; Director of Digital Innovation and Communication, SC CTSI Register at: http://bit.ly/2FhOZ6d

Editor's Notes

  • Dr. Maestre is an Ecologist. In this tweet from 2014, he announced that he used altmetrics information in two successful grant applications. In his first application, to the Humboldt Foundation in Germany, he had to list 5 relevant publications.
  • Here is the “relevance” portion of his annotated bibliography detailing the relevant publications.
  • In his second application to the Consolidator Grants program of the European Research Council who funded his BIODESERT project, Dr. Maestre had to present an Early Achievement Track Record. Within that section he included key publications with the number of ISI Web of Science® [Google Scholar] citations (excluding self-citations) they have accrued, as well as with their altmetrics.
  • Altmetrics are immediacy indicators.
    Comparing LIKE with LIKE is core premise of Altmetrics
  • You can share DOI, software code, and images. It’s all traceable and it’s all part of your altmetric profile.
  • Usage: who is using, is it in library collection—I built it, did someone come?
    Mentions: where the stories are hidden
    Captures: saved for later. this is a trend where you see future citations. if you save something to Facebook and read it later, that is tracked as capture. Then they compared captures to citations and found a strong connection.
    Citations: we know these
    Social Media: especially early career trying to break into what’s important.
  • Source: http://profiles.sc-ctsi.org/jennifer.unger
    ORCID: https://orcid.org/
  • Hover over Plum print to see altmetrics numbers. When you click on “See Details” you see a more robust portrait of the impact of his specific work.
  • Source: http://www.visualcapitalist.com/happens-internet-minute-2017/
  • This is what PlumX captures.
  • Source: https://obamawhitehouse.archives.gov/the-press-office/2016/01/12/inspiring-new-generation-defy-bounds-innovation-moonshot-cure-cancer
  • Source: https://plu.mx/usc/a/?pmid=22267844&display-tab=artifact-clinical-citations#CITED_BY_COUNT,CLINICAL_CITED_BY_COUNT

  • You can buy tweets, so some retweets are from fake accounts. Plum looks at multiple metrics and in this case, tweets would be lop-sided from other metrics. The pattern is skewed.
    Plum also has human investigate the patterns.

    But there are some gray areas including self promotion vs. gaming especially in social media.
  • The NIH invests nearly $32.3 billion annually in medical research for the American people.
    More than 80% of the NIH's funding is awarded through almost 50,000 competitive grants to more than 300,000 researchers at more than 2,500 universities, medical schools, and other research institutions in every state and around the world.
    NIH Biosketch provides space for up to 5 contributions which should each include the following listed on the slide.
    There is an opportunity for altmetrics data to tell the story of your research and contribution.
  • ×