Department of Information Science
Bar-Ilan University, Israel
Scientific revolution in scientometrics?
• Taxonomic change: not only impact on
science, but also on society (Bornmann, 2013)
• “altmetrics will play a significant role in
measuring societal impact”(Bornmann, 2013
in the SIGMETRICS list)
• Scientific revolution or not, bibliometricians
start to take altmetrics into account
– Altmetric indicators can measure (at least
partially) societal impact
Altmetrics – recent achievements
• Altmetric tools
– ImpactStory, Altmetric, Plum Analytics
• Publishers add altmetrics to their site
– PLoS ALM, BMJ
• Post-publication peer-review
– F1000, PubMed, ResearchBlogging
• Studies showing the value of Mendeley
– Significant, medium strength correlations with citation
– Seems to be one of the most promising altmetric
Achievements + Interest ->
What to measure?
What is the meaning of the measurements?
How to measure?
What is the quality of the underlying data?
What & how to measure?
– Multiple copies
– Tweets are ephemeral
– Different venues
• Not only scholarly peer-reviewed publications
– Books, reports, datasets, applications, software,
presentations, videos, ….
What is the meaning of these
• Why do users download an article? How are
“views” related to “downloads”?
• Why do they share a link?
• Why do they make use of a dataset?
• Who are the users?
– Quite easy to “game” the measures
– No gatekeepers
– The “wisdom of crowds”
– “Big data”
– Feeds are not comprehensive
– Difficult to monitor
– Even more problematic to reach “historical data”
– Tweets archived at the Library of Congress
• Are they here to stay?
– Connotea, 2collab
– Most popular today:
• Mendeley, CiteULike
• Zotero – data are not aggregated
• Is altmetric analysis high on their list of priorites?
• Data quality
– Entered by users
• Accuracy, multiple records
– Author names