Brace for Impact: New Means for Measuring Research MetricsMary Ellen Sloane
As open access journals and repositories gain a foothold in scholarly communication, researchers are finding that the traditional impact factor and citation count metrics only reflect a portion of the dissemination of scholarly works.
New technology, research, and citation tools aid our ability to measure the influence of research. A matrix of tools and initiatives, like PLoS Article-Level Metrics, BePress’ Author Dashboard, Mendeley, Altmetrics, and ImpactStory are providing a more robust picture of scholarly communication today.
This presentation provides an overview of the impact factor system and new tools for gathering metrics and their relevance for librarians and researchers.
Presentation given at the Library Information Technology Association (LITA) Forum in Louisville, KY, in November 2013.
Joining the ‘buzz’ : the role of social media in raising research visibilityEileen Shepherd
Traditional bibliometric methods of evaluating academic research, such as journal impact factors and article citations, have been supplemented in the past 5-10 years by the development of altmetrics (alternative metrics or article level metrics). Altmetrics measures impact of research, data and publications, such as references in data and knowledge bases, article views, downloads and mentions in social media and news media. This presentation gives a brief background to altmetrics and demonstrates how Rhodes University librarians are using social media to raise the visibility of the research output of their institution. (Rhodes University is in Grahamstown, South Africa)
Presentation for the Narma Workshop: An introduction to metrics and their use - turning data into intelligence. http://narma.no/narma-kurs/workshop-an-introduction-to-metrics-and-their-use-turning-data-into-intelligence/
Sinds de publicatie van het “Altmetrics manifesto” door Jason Priem en de zijnen heeft dit onderwerp een grote vlucht genomen. In het huidige bibliometrics landschap krijgt het onderzoek naar andere mogelijkheden om impact van publicaties en onderzoek te meten een prominente plaats. Tegenwoordig willen onderzoekers niet alleen maar beoordeeld worden op basis van Impact Factoren en versterken zij de roep om alternatieve methoden om impact te beoordelen. In het kader van onderzoeksondersteuning kunnen bibliotheken in dit domein een nieuwe en belangrijke rol spelen. In deze sessie worden de ontwikkelingen tegen het licht gehouden en sterke en zwakke punten blootgelegd. Tijdens de workshop wordt ingegaan op de verschillende indicatoren voor het bepalen van de impact van tijdschriften, artikelen, onderzoeksgroepen en onderzoekers. Tools, methoden en het laatste onderzoek komen aan bod.
Updated 30/01/2015
This session included discussions around the value of bibliometrics for individual performance management/promotion and the REF.
What are bibliometrics?
Journal metrics
Personal metrics
Article level metrics and altmetrics
Open Lunch 1: Preprints & open peer review in different disciplinesUoLResearchSupport
On Feb 25th 2021 Dr Chris Wareing from the School of Physics and Astronomy was one of two speakers discussing his experiences of publishing preprints in his discipline and how that has included sharing data, code and open peer review.
Dr Chris Wareing is a computational fluid dynamicist, with expertise in hydrodynamic and magneto-hydrodynamic numerical modelling through finite difference and spectral method.
Brace for Impact: New Means for Measuring Research MetricsMary Ellen Sloane
As open access journals and repositories gain a foothold in scholarly communication, researchers are finding that the traditional impact factor and citation count metrics only reflect a portion of the dissemination of scholarly works.
New technology, research, and citation tools aid our ability to measure the influence of research. A matrix of tools and initiatives, like PLoS Article-Level Metrics, BePress’ Author Dashboard, Mendeley, Altmetrics, and ImpactStory are providing a more robust picture of scholarly communication today.
This presentation provides an overview of the impact factor system and new tools for gathering metrics and their relevance for librarians and researchers.
Presentation given at the Library Information Technology Association (LITA) Forum in Louisville, KY, in November 2013.
Joining the ‘buzz’ : the role of social media in raising research visibilityEileen Shepherd
Traditional bibliometric methods of evaluating academic research, such as journal impact factors and article citations, have been supplemented in the past 5-10 years by the development of altmetrics (alternative metrics or article level metrics). Altmetrics measures impact of research, data and publications, such as references in data and knowledge bases, article views, downloads and mentions in social media and news media. This presentation gives a brief background to altmetrics and demonstrates how Rhodes University librarians are using social media to raise the visibility of the research output of their institution. (Rhodes University is in Grahamstown, South Africa)
Presentation for the Narma Workshop: An introduction to metrics and their use - turning data into intelligence. http://narma.no/narma-kurs/workshop-an-introduction-to-metrics-and-their-use-turning-data-into-intelligence/
Sinds de publicatie van het “Altmetrics manifesto” door Jason Priem en de zijnen heeft dit onderwerp een grote vlucht genomen. In het huidige bibliometrics landschap krijgt het onderzoek naar andere mogelijkheden om impact van publicaties en onderzoek te meten een prominente plaats. Tegenwoordig willen onderzoekers niet alleen maar beoordeeld worden op basis van Impact Factoren en versterken zij de roep om alternatieve methoden om impact te beoordelen. In het kader van onderzoeksondersteuning kunnen bibliotheken in dit domein een nieuwe en belangrijke rol spelen. In deze sessie worden de ontwikkelingen tegen het licht gehouden en sterke en zwakke punten blootgelegd. Tijdens de workshop wordt ingegaan op de verschillende indicatoren voor het bepalen van de impact van tijdschriften, artikelen, onderzoeksgroepen en onderzoekers. Tools, methoden en het laatste onderzoek komen aan bod.
Updated 30/01/2015
This session included discussions around the value of bibliometrics for individual performance management/promotion and the REF.
What are bibliometrics?
Journal metrics
Personal metrics
Article level metrics and altmetrics
Open Lunch 1: Preprints & open peer review in different disciplinesUoLResearchSupport
On Feb 25th 2021 Dr Chris Wareing from the School of Physics and Astronomy was one of two speakers discussing his experiences of publishing preprints in his discipline and how that has included sharing data, code and open peer review.
Dr Chris Wareing is a computational fluid dynamicist, with expertise in hydrodynamic and magneto-hydrodynamic numerical modelling through finite difference and spectral method.
The Impact Factor, Eigenfactor, and Altmetrics: From Theory to AnalysisMolly Keener
Altmetrics is an emerging area encompassing broader assessment of scholarly impact through downloads, links, and online conversations to fill gaps in assessing research. Bibliometrics is the traditional form of measuring the impact of scholarly research through citation rates. The Research & Instruction Librarian for Sciences and the Scholarly Communication Librarian at Wake Forest University will compare bibliometrics and altmetrics, and discuss their applications in science information literacy and research assessment in higher education.
Assessing Research Impact: Bibliometrics, Citations and the H-IndexFintan Bracken
Talk presented by Dr. Fintan Bracken at the Mary Immaculate College Research Day on 1st September 2015. The talk looked at assessing and maximising the impact of the arts and humanities research conducted at Mary Immaculate College in Limerick, Ireland.
Research impact metrics for librarians: calculation & contextLibrary_Connect
Slides from the May 19, 2016, Library Connect webinar "Research impact metrics for librarians: calculation & context" with Jenny Delasalle and Andrew Plume.
Watch the webinar at: https://libraryconnect.elsevier.com/library-connect-webinars?commid=199783
Overview of Bibliometrics - IAP Course version 1.1Micah Altman
Whose articles cite a body of work? Is this a high-impact journal? How might others assess my scholarly impact? Citation analysis is one of the primary methods used to answer these questions.
DSG Webinar Session: Setting up our Search Alerts & Identifying suitable Conf...Nurhazman Abdul Aziz
This webinar is conducted by Hazman Aziz, IEEE Client Services Manager. Hazman is an academic librarian and also a PhD Candidate who reads and researches in the areas of societal impact analysis at the University of Malaya. He promotes the advocacy in digital publishing and access to IEEE Xplore®. This webinar is organized in conjunction with the support from Doctorate Support Group, established in Malaysia to share the research journal in postgraduate studies.
The IEEE Xplore® digital library provides access to IEEE journals, transactions, letters, magazines and conference proceedings, IET journals and conference proceedings, IEEE Standards and IEEE educational courses.
In this webinar, we share and learn to:
- Set up Search Alerts
- Understand the scholarly publishing route
- Identify a suitable conference proceeding and journals
This is an open webinar and all postgraduates, PhD Candidates and researchers who have the interest to understand, utilized and harness your research output on IEEE Xplore® are welcome to join in.
Increasingly, many aspects of scholarly communication—particularly publication, research data, and peer review—undergo scrutiny by researchers and scholars. Many of these practitioners are engaging in a variety of ways with Alternative Metrics (#altmetrics in the Twitterverse). Alternative Metrics take many forms but often focus on efforts to move beyond proprietary bibliometrics and traditional forms of peer referencing in assessing the quality and scholarly impact of published work. Join NISO for a webinar that will present several emerging aspects of Alternative Metrics.
Beyond the Journal Impact Factor: Altmetrics; New Ways of Measuring Impactsbeas1
A powerpoint presentation given at Portland State University Library as part of the Library's workshop series for faculty. Download the file to see the notes for each slide.
Talk at the University of Tokyo on history of Retraction Watch, our database, and current trends. Includes titles in Japanese, courtesy of Iekuni Ichikawa.
Research Impact in Specialized Settings: 3 Case StudiesElaine Lasda
Presentation of 3 case studies where research impact metrics are used to further the mission of institutions and organizations out of the traditional academic millieu.
The Impact Factor, Eigenfactor, and Altmetrics: From Theory to AnalysisMolly Keener
Altmetrics is an emerging area encompassing broader assessment of scholarly impact through downloads, links, and online conversations to fill gaps in assessing research. Bibliometrics is the traditional form of measuring the impact of scholarly research through citation rates. The Research & Instruction Librarian for Sciences and the Scholarly Communication Librarian at Wake Forest University will compare bibliometrics and altmetrics, and discuss their applications in science information literacy and research assessment in higher education.
Assessing Research Impact: Bibliometrics, Citations and the H-IndexFintan Bracken
Talk presented by Dr. Fintan Bracken at the Mary Immaculate College Research Day on 1st September 2015. The talk looked at assessing and maximising the impact of the arts and humanities research conducted at Mary Immaculate College in Limerick, Ireland.
Research impact metrics for librarians: calculation & contextLibrary_Connect
Slides from the May 19, 2016, Library Connect webinar "Research impact metrics for librarians: calculation & context" with Jenny Delasalle and Andrew Plume.
Watch the webinar at: https://libraryconnect.elsevier.com/library-connect-webinars?commid=199783
Overview of Bibliometrics - IAP Course version 1.1Micah Altman
Whose articles cite a body of work? Is this a high-impact journal? How might others assess my scholarly impact? Citation analysis is one of the primary methods used to answer these questions.
DSG Webinar Session: Setting up our Search Alerts & Identifying suitable Conf...Nurhazman Abdul Aziz
This webinar is conducted by Hazman Aziz, IEEE Client Services Manager. Hazman is an academic librarian and also a PhD Candidate who reads and researches in the areas of societal impact analysis at the University of Malaya. He promotes the advocacy in digital publishing and access to IEEE Xplore®. This webinar is organized in conjunction with the support from Doctorate Support Group, established in Malaysia to share the research journal in postgraduate studies.
The IEEE Xplore® digital library provides access to IEEE journals, transactions, letters, magazines and conference proceedings, IET journals and conference proceedings, IEEE Standards and IEEE educational courses.
In this webinar, we share and learn to:
- Set up Search Alerts
- Understand the scholarly publishing route
- Identify a suitable conference proceeding and journals
This is an open webinar and all postgraduates, PhD Candidates and researchers who have the interest to understand, utilized and harness your research output on IEEE Xplore® are welcome to join in.
Increasingly, many aspects of scholarly communication—particularly publication, research data, and peer review—undergo scrutiny by researchers and scholars. Many of these practitioners are engaging in a variety of ways with Alternative Metrics (#altmetrics in the Twitterverse). Alternative Metrics take many forms but often focus on efforts to move beyond proprietary bibliometrics and traditional forms of peer referencing in assessing the quality and scholarly impact of published work. Join NISO for a webinar that will present several emerging aspects of Alternative Metrics.
Beyond the Journal Impact Factor: Altmetrics; New Ways of Measuring Impactsbeas1
A powerpoint presentation given at Portland State University Library as part of the Library's workshop series for faculty. Download the file to see the notes for each slide.
Talk at the University of Tokyo on history of Retraction Watch, our database, and current trends. Includes titles in Japanese, courtesy of Iekuni Ichikawa.
Research Impact in Specialized Settings: 3 Case StudiesElaine Lasda
Presentation of 3 case studies where research impact metrics are used to further the mission of institutions and organizations out of the traditional academic millieu.
Practical applications for altmetrics in a changing metrics landscapeDigital Science
"Practical applications for altmetrics in a changing metrics landscape" - Sara Rouhi, Altmetric product specialist, and Anirvan Chatterjee, Director Data Strategy for CTSI at UCSF
Altmetrics: the movement, the tools, and the implicationsKR_Barker
Measuring scholarly impact has traditionally been tied to the calculation of a scholarly article’s number of citations and the Impact Factor of its journal. Today, however, scholarly contributions take many forms: computer code, data sets, blog postings, tweets, practice guidelines and beyond. As the products of research evolve, so will the way in which credit is measured. This class will provide an overview of “altmetrics”, the movement to assess influence of both traditional and non-traditional scholarly contributions. We will define altmetrics, discuss why it is important in today’s digital scholarly environment, and demonstrate tools available to measure influence. After completing this course, the learner will be able to define altmetrics and compare it to traditional forms of measuring scholarly impact; name examples of scholarly contributions that are alternatives to traditional methods (e.g. datasets, blog postings, tweets, etc.); name examples of alternative means of measuring scholarly contributions (e.g. download counts, tweets about, etc.); discuss why today’s online, social environment necessitates a change in the way scholarly contributions are measured; name resources to learn more about altmetrics such as altmetrics.org; and name tools to measure alternative scholarly contributions such as Altmetric.com, Impact Story, Plum Analytics, etc.
Introduction to Altmetrics for Medical and Special LibrariansLinda Galloway
Altmetrics (or alternative citation metrics) provide new ways to track scholarly influence across a wide range of media and platforms. This presentation covers altmetric fundamentals, tips on connecting your users with altmetrics, and an overview of newly published research. Presented as part of the NN/LM MAR Boost Box Series; http://nnlm.gov/mar/training/boost_mar2014.pdf
ALTMETRICS : A HASTY PEEP INTO NEW SCHOLARLY MEASUREMENTSaptarshi Ghosh
The term ‘Altmetrics’ was proposed by Jason Priem, a PhD student at the School of Information and Library Science at University of North Carolina, Chapel Hill through a tweet. [https://twitter.com/asnpriem/status/25844968813].
Altmetrics is the combination of two words such as: ‘Alternative’ and ‘Metrics’ in which the ‘alt-‘part refers to alternative types of metrics (that is alternative to traditional metrics such as citation analysis, impact factor, downloads & usage data etc.).
Altmetrics is the creation and study of new metrics based on the Social Web for analyzing, and informing scholarship (http://altmetrics.org/about/). It is the study of new indicators for the analysis of academic activity based on Web 2.0.
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...plumanalytics
This webinar features two PlumX customers:
Tim Deliyannides, Director, Office of Scholarly Communication and Publishing and Head, Information Technology, University of Pittsburgh - Tim will talk about how the library is a publisher at Pitt and how they use altmetrics to assist their publishing analytics. Additionally, Tim will talk about how Pitt instrumented altmetrics in their institutional repository and the positive results they’ve had from doing that.
Robin Champieux, Scholarly Communication Librarian, Oregon Health & Science University - Robin will talk about how they use altmetrics at OHSU to integrate the library into the research process and to support and interact with the researchers and research institutes.
Andrea Michalek, Co-Founder and President of Plum Analytics, will kick off the session with a brief introduction.
Lecture on "Altmetrics: An Alternative View-Point to Assess Research Impact" in Five days Advanced Training Programme on Bibliometrics and Research Output Analysis during 15th - 20th June, 2015 at INFLIBNET Centre, Gandhinagar.
Modern research metrics and new models of evaluation have risen high on the academic agenda in the last few years. In this session two UK institutions who have adopted such metrics across their faculty will share their motivations and experiences of doing so, and explain further how they are integrating these data into existing models of review and analysis.
With the flourishing environment of platforms for sharing data, establishing an online profile and engaging in scientific discourse through alternative modes of publishing and participation, there are numerous potential benefits. However, while many scientists invest significant amounts of time in sharing their activities and opinions with friends and family the majority do not make use of the new opportunities to participate in the developing social web of science, despite the potential impact and influence on future careers. We now have many new ways to contribute to science outside of the classical publishing model. These include the ability to annotate and curate data, to “publish” in new ways on blogs and micropublishing sites, and many of these activities can be as part of a growing crowdsourcing network. Our efforts in this area are already being indexed and exposed on the internet via our publications, presentations and data and increasingly we are being quantified. This presentation will provide an overview of the various types of networking and collaborative sites available to scientists and ways to expose their scientific activities online. Many of these can ultimately contribute to the developing metrics of a scientist as identified in the new world of alternative metrics. Participation offers a great opportunity to develop a scientific profile within the community and may ultimately be very beneficial, especially to scientists early in their career.
FeedNavigator – a Medical Current Awareness ServiceTerkon Päivittäjä
FeedNavigator – a Medical Current Awareness Service
Pasi Keski-Nisula, The National Library of Health Sciences, Helsinki, Finland
LInks:
FeedNavigator
http://www.terkko.helsinki.fi/feednavigator/
EAHIL 2008 Scientific Programme
http://wiki.helsinki.fi/display/EAHILScientificProgramme/Home
Title: Promoting scholarly publishing through libraries
Author: Jukka Englund
Affiliation: Terkko - National Library of Health Sciences, Helsinki, Finland
Links:
National Library of Health Sciences - Terkko (Finland)
http://www.terkko.helsinki.fi/english/
EAHIL 2008 Scientific programme
https://wiki.helsinki.fi/display/EAHILScientificProgramme/Home
This presentation by Morris Kleiner (University of Minnesota), was made during the discussion “Competition and Regulation in Professions and Occupations” held at the Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found out at oe.cd/crps.
This presentation was uploaded with the author’s consent.
0x01 - Newton's Third Law: Static vs. Dynamic AbusersOWASP Beja
f you offer a service on the web, odds are that someone will abuse it. Be it an API, a SaaS, a PaaS, or even a static website, someone somewhere will try to figure out a way to use it to their own needs. In this talk we'll compare measures that are effective against static attackers and how to battle a dynamic attacker who adapts to your counter-measures.
About the Speaker
===============
Diogo Sousa, Engineering Manager @ Canonical
An opinionated individual with an interest in cryptography and its intersection with secure software development.
Have you ever wondered how search works while visiting an e-commerce site, internal website, or searching through other types of online resources? Look no further than this informative session on the ways that taxonomies help end-users navigate the internet! Hear from taxonomists and other information professionals who have first-hand experience creating and working with taxonomies that aid in navigation, search, and discovery across a range of disciplines.
Acorn Recovery: Restore IT infra within minutesIP ServerOne
Introducing Acorn Recovery as a Service, a simple, fast, and secure managed disaster recovery (DRaaS) by IP ServerOne. A DR solution that helps restore your IT infra within minutes.
Sharpen existing tools or get a new toolbox? Contemporary cluster initiatives...Orkestra
UIIN Conference, Madrid, 27-29 May 2024
James Wilson, Orkestra and Deusto Business School
Emily Wise, Lund University
Madeline Smith, The Glasgow School of Art
9. Data sources: Altmetric.com
[http://bit.ly/1ESfaf4]
• Policy documents
– WHO, NIH
• Mainstream media
– Manually curated list of RSS feeds from news websites
• Social media data
– Twitter, Facebook, Google+, Pinterest, Sina Weibo,
blogs, Reviews on F1000, YouTube…
• Online reference manager and publisher
download count data
– Mendeley, CiteULike
10. Top 10 most popular Altmetrics articles
(”medical matters”2013)
WoS + Scopus: 361/432 citations
11. #2 most popular Altmetrics open access article
(”medical matters”2013)
WoS + Scopus: 10 citations
12. Researcher vs. social media expert
• Librarian as a go-between agent
– Metrics and publications are our business
– From passive repository of collections to proactive
visibility services
– What the library could do…
13. Terkko visibility services
• Terkko Kudos
– A service designed to increase the impact and maximum global visibility of the
published articles from the Academic Medical Center Helsinki (#amchelsinki)
– http://terkko.helsinki.fi/terkko-kudos/links/
• Scholar Chart
• Mashup: Combines data from more than one source: FeedNavigator RSS
feeds, Impact Factors, SCImago Journal Ranks, Jufo
• Lists ca. 800 Finnish medical scholars’ articles in real time
• http://terkko.helsinki.fi/scholarchart/
• Top Cited
– The most cited articles from the Univ of Helsinki (Scopus API)
– http://terkko.helsinki.fi/topcited/
14. Terkko Altmetrics Process
• PubMed author search
– RSS feed to FeedNavigator
• Compiled to Scholar Chart
• Added to CiteULike -> back to FeedNavigator
• Added to Mendeley
– -> Twitter (through Twitterfeed) (#amchelsinki)
• Added to Facebook
• Added to ImpactStory
• Article of the Week (in Finnish, Medical Faculty)
21. The metrics ’keep a-comin’…
• K-index (Kardashian Index)
• “If Kim Kardashian commented on the value of the ENCODE project,
her tweet would get more retweets and favorites than the rest of the
scientific community combined.”
• “On Twitter, … the ‘top tweet’ on any given subject will not necessarily
come from an expert, it will come from the most followed person.”
• “If your K-index gets above 5, then it’s time to get off Twitter and
write those papers.”
• I propose the ‘Kardashian Index’, a measure of discrepancy
between a scientist’s social media profile and publication
record based on the direct comparison of numbers of
citations and Twitter followers. (Neil Hall, doi:10.1186/s13059-014-0424-0)
• It was with tongue in cheek, but…
23. The metrics ’keep a-comin’…
• …and then Science
opened the stars of
Twitter data…!
• E-index (Engagement
Index)
– By Andrew Maynard
(University of Michigan
Risk Science Center)
– ”a measure I admittedly
just made up!”
– H-index/number of tweets
24. What altmetrics actually measure?
• The point of altmetrics isn’t to measure quality.
It’s to better understand impact: both the
quantity of impact and the diverse types of
impact.
• And when we supplement traditional measures
of impact like citations with newer, altmetrics-based
measures like post-publication peer review
counts, scholarly bookmarks, etc we have a
better picture of the full extent of impact. Not
the only picture. But a better picture.
• [Stacy Konkiel et al: http://blog.impactstory.org/beall-altmetrics/]