Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)
•Download as PPTX, PDF•
1 like•687 views
Date: Feb 7, 2018 Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries Overview: Scholarship is increasingly being created, disseminated, and measured on digital and social platforms. If Twitter exchanges, Facebook “saves,” and YouTube hits are the new metrics for tracking scholarship, how are we measuring societal and educational impact and outreach? How can researchers display their research impact using social media on promotion and tenure dossiers? This webinar will discuss altmetrics, alternative scholarly metrics that measure the impact and use of scholarship. We will focus on PlumX, the tool used at USC, which combines traditional and new metrics to paint a comprehensive portrait of your scholarly output and its reach in various communities and with different stakeholders.
Recommended
More Related Content
What's hot
What's hot (19)
Similar to Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)
Similar to Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018) (20)
More from SC CTSI at USC and CHLA
More from SC CTSI at USC and CHLA (20)
Recently uploaded
Recently uploaded (20)
Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)
- 1. Digital Scholar Webinar February 7, 2018 Hosted by the Southern California Clinical and Translational Science Institute (SC CTSI) University of Southern California (USC) and Children’s Hospital Los Angeles (CHLA)
- 2. Katja Reuter, PhD, Director of the Digital Scholar Program About Today’s Session
- 4. Today’s Learning Objectives Describe the potential and strengths of using alternative scholarly metrics that measure the impact and use of scholarship Describe basic features of the measurement tool PlumX and how they are used Describe potential weaknesses of using alternative scholarly metrics and how to address them
- 5. Caroline Muglia Today’s Speaker Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries
- 6. Questions: Please use the Q&A Feature 1. Click on the tab here to access Q&A 2. Ask and post question here 1 2
- 7. Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers Caroline Muglia Co-Associate Dean for Collections & Technical Services; Head, Resource Sharing & Collection Assessment muglia@usc.edu
- 8. Scenario 1
- 9. Dr. Fernando T. Maestre Professor, Biology and Geology Department at Universidad Rey Juan Carlos (Madrid, Spain)
- 12. What is altmetrics? Altmetrics is a broad term that encapsulates the collection of multiple digital indicators related to scholarly work. These indicators are derived from activity and engagement among diverse stakeholders and scholarly outputs in the research ecosystem, including the public sphere. Source:http://www.niso.org/apps/group_public/download.php/17091/NISO%20RP-25-2016%20Outputs%20of%20the%20NISO%20Alternative%20Assessment%20Project.pdf
- 13. How does Altmetrics work? ● Researchers leave “data exhaust” when they research and engage with social media ● PlumX mines the exhaust and gathers metrics ● Compares LIKE with LIKE
- 14. What is “data exhaust?”
- 15. Trends in promotion and tenure dossiers ● Societal impact ○ Citations to research in public policy documents, references in patents, and citations to research in various sources ● Educational impact ○ Articles and books in syllabi, data and other learning objects ● Public engagement and outreach ○ Press coverage, social media buzz, and downloads and views of scholarship and public dissemination of science
- 16. Scenario 2
- 17. Dr. Jennifer B Unger, PhD Professor of Preventive Medicine, Keck School of Medicine of USC
- 18. List of Dr. Unger’s publications with Plum Analytics “plum print”
- 19. More detailed view of one article
- 20. Learn about her related Twitter Activity per article
- 23. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
- 24. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
- 25. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
- 26. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research
- 27. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
- 28. In 2012, NIH promised to put aside 10% of their funds for AIDS research. In 2015, $3B was reduced to $65M put towards AIDS research.
- 29. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
- 30. “Over the next year, I will lead a dedicated, combined effort by governments, private industry, researchers, physicians, patients, and philanthropies to target investment, coordinate across silos, and increase access to information for everyone in the cancer community.” -President Barack Obama in “A Moonshot to Cure Cancer,” January 12, 2016
- 31. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact
- 32. In 2015, NIH funded 1 of 5 people.
- 33. In 2015, 4 of 5 people did not get funded by NIH.
- 35. Basic medicine is cited 3 to 5 times more than clinical medicine and this is reflected in journal impact numbers.
- 36. Scenario 3
- 37. Clinical Citations with Plum Analytics print
- 38. More detailed view of one article
- 39. Detailed view of DynaMed Plus Topics tab
- 41. 4 major outputs for clinical citations Clinical alerting service
- 42. 4 major outputs for clinical citations Clinical guidelinesClinical alerting service
- 43. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service
- 44. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service Clinical Trials
- 47. Established researchers Early career researchers Archetypes within disciplines
- 48. Common FAQs (with some answers)
- 49. Gaming metrics Question: Traditional metrics can be gamed. How can this be avoided in altmetrics? Answer: ▪ Transparency of metrics ▪ PlumX doesn’t provide a score, but instead provides a data visualization ▪ No calculations on top of things and then hiding what went into it Example: Twitter!
- 50. Retractions Question: How does PlumX account for retracted articles? Answer: ▪ Plum captures that the article was retracted ▪ Also captures the activity around them ▪ Since Plum doesn’t offer a score, it’s not impacted
- 51. Health policy Question: Where are the altmetrics around health policy (the other side of clinical translational science)? Answer: ▪ They are working on it! They are in the stage of figuring out how to group the altmetrics data (comparing LIKE with LIKE) Stay tuned!
- 54. NIH Biosketch “contributions to science” ● Historical background that frames the scientific problem ● Influence of the finding/s on the progress of science or the application to health or technology ● Your specific role in the described work ● List of up to four peer-reviewed publications or other non- publication research outputs for each contribution
- 55. Makes visible what was invisible. Makes measureable what was immeasurable.
- 56. Plum Analytics is part of CINAHL & EBSCOHost
- 57. Q u e s t i o n s Program director: Katja Reuter, PhD Email: katja.reuter@usc.edu Twitter: @dmsci Next Digital Scholar Webinar I n f o r m a t i o n a b o u t t h e p r o g r a m http://sc-ctsi.org/digital-scholar/ March 7, 2018/12-1PM PST Topic: Disseminating scientific research via Twitter: Practical insights and research evidence Speaker: Katja Reuter, PhD, Assistant Professor of Clinical Preventive Medicine, Department of Preventive Medicine, Keck School of Medicine of USC; Director of Digital Innovation and Communication, SC CTSI Register at: http://bit.ly/2FhOZ6d
Editor's Notes
- Dr. Maestre is an Ecologist. In this tweet from 2014, he announced that he used altmetrics information in two successful grant applications. In his first application, to the Humboldt Foundation in Germany, he had to list 5 relevant publications.
- Here is the “relevance” portion of his annotated bibliography detailing the relevant publications.
- In his second application to the Consolidator Grants program of the European Research Council who funded his BIODESERT project, Dr. Maestre had to present an Early Achievement Track Record. Within that section he included key publications with the number of ISI Web of Science® [Google Scholar] citations (excluding self-citations) they have accrued, as well as with their altmetrics.
- Altmetrics are immediacy indicators. Comparing LIKE with LIKE is core premise of Altmetrics
- You can share DOI, software code, and images. It’s all traceable and it’s all part of your altmetric profile.
- Usage: who is using, is it in library collection—I built it, did someone come? Mentions: where the stories are hidden Captures: saved for later. this is a trend where you see future citations. if you save something to Facebook and read it later, that is tracked as capture. Then they compared captures to citations and found a strong connection. Citations: we know these Social Media: especially early career trying to break into what’s important.
- Source: http://profiles.sc-ctsi.org/jennifer.unger ORCID: https://orcid.org/
- Hover over Plum print to see altmetrics numbers. When you click on “See Details” you see a more robust portrait of the impact of his specific work.
- Source: http://www.visualcapitalist.com/happens-internet-minute-2017/
- This is what PlumX captures.
- Source: https://obamawhitehouse.archives.gov/the-press-office/2016/01/12/inspiring-new-generation-defy-bounds-innovation-moonshot-cure-cancer
- Source: https://plu.mx/usc/a/?pmid=22267844&display-tab=artifact-clinical-citations#CITED_BY_COUNT,CLINICAL_CITED_BY_COUNT
- You can buy tweets, so some retweets are from fake accounts. Plum looks at multiple metrics and in this case, tweets would be lop-sided from other metrics. The pattern is skewed. Plum also has human investigate the patterns. But there are some gray areas including self promotion vs. gaming especially in social media.
- The NIH invests nearly $32.3 billion annually in medical research for the American people. More than 80% of the NIH's funding is awarded through almost 50,000 competitive grants to more than 300,000 researchers at more than 2,500 universities, medical schools, and other research institutions in every state and around the world. NIH Biosketch provides space for up to 5 contributions which should each include the following listed on the slide. There is an opportunity for altmetrics data to tell the story of your research and contribution.