Published articles in prominent journals cite other articles in prominent journals = prestige and tenure.This mechanism of using citations in published journals to determine impact of research was built in the 1960’s.
As everyone knows, information has moved online.Where printed books and journals were once the only scholarly record, this too has become digital.The current impact measurements for research were defined in the 1960's, when the world was a different place.They are only based at looking at what papers cite other papers in the reference section of a document.
Categories of metrics
Compare the metrics showcasing the capturing of immediate impact versus a search on Google Scholar for something like “brain cancer.”
“Same” article on PLOS, PubMed, and Pitt’s institutional repository.Metrics need to be algorithmicallycombined from ALL places to capture all of its use.
http://demo.plu.mx/a/eKXLDK8_gEB-iSPG_HLlHVGtDVYDreSTzdY7VST1rmY/Plum’s Identity resolution system, can match different artifacts together by known identifiers (like DOI), aliases of URLs, and proprietary clustering analysis algorithms.This system scales across millions of artifacts, and gives a complete view to the metrics.
NicholasPyenson blogs about his research.In a recent (2012) Nature paper that was chosen to be one of Discover Magazine’s top science stories of the year.His work has gotten pickup in the popular press and he has blogged about key areas relating to his research.Traditionally, he will not get “credit” for this work.http://nmnh.typepad.com/pyenson_lab/nature-rorquals-organ.html
Other types of artifacts we track for this research include: BBC article about his work that was liked on Facebook over 700 times and tweeted nearly 500 times A popular blog post about his research An article in the New York TimesThese 2nd level metrics can also be used to help quantify not just the paper he authored, but the reach and engagement of others writing about his work.
At the time this snapshot of metrics was taken, his work was newly published. It hadn’t been picked up in Web of Science yet at all.However, the metrics surrounding his work give us a leading indicator that it may be impactful research.
This visualization of a researcher’s output, when weighted by impact, shows which artifacts have been getting the most engagement across their entire life’s work.This is very useful when trying to get an overall sense of what a particular researcher (or lab, or group) is most known for.
PlumX offers embeddable widgets for Publishers, Institutions and Researchers.We offer both Author level and Artifact level widgets.
Plum analytics - acs -- 2013-09-09
Andrea Michalek, Co-founder
Plum Analytics: An altmetrics tool for
determining impact in the chemical
Andrea Michalek – Co-Founder and CEO
• Helped launch dozens of early stage
• Director of Technology for Summon® --
$15M scholarly search used in 450 libraries
Mike Buschman – Co-Founder and Chief
• Program Manager for Microsoft Academic
Search and Book Search—both launched in
• Director of Product Management for
Well-known Problems with
• Citations added because of pressure by editors
• Negative citations
• Only about 30% of influences are cited*
• “Informal” influence isn’t measured through citations
• Secondary sources
• Review articles “take” citations away from reviewed
• Matthew effect – the rich get richer
* MacRoberts and MacRoberts, 2010
Citations are only a small fraction of how a
paper is reused
collected October 10, 2012
for 62,536 PLOS Papers
PlumX Platform: Built for Big
• Built for Scale – goal tracking all the world’s researchers,
all of their outputs, and metrics for each.
• Technology that solves inherent problems around:
• Author disambiguation
• Identity Resolution
• Calculating combined metrics
• Harvesting metrics at scale
• Experience architecting scalable platforms
• E.g., Summon – provides sub-second response time to
searching over 1B documents (including full text of
both articles and books)
Different categories of impact
• Downloads, views, book holdings, ILL, document
• Favorites, bookmarks, saves, readers, groups, watchers
• Blog post, news story, Wikipedia
article, comments, review
• Social Media
• Tweets, Google +1s, likes, shares, ratings
• Web of Science, Scopus, Google Scholar, Microsoft
Academic Search, patents
Build User Profiles from
• Set of tools that can utilize existing systems.
• Google Scholar: BibTeX
• Institutional repositories: bePress, dSpace, ePrints
• Our goal: We integrate with what our customers have
implemented limit re-entry of data