Metrics:The New Black?  Kristen Fisher Ratan      NFAIS 2012
The web is getting personal
Can Web Metrics Indicate   Research Impact?
Metrics:The New Black?  Kristen Fisher Ratan      NFAIS 2012
Research Dissemination          IS   Research Impact
Dissemination creates indicatorsof impact Publication       DisseminationArticle Level    • Citations                 • We...
ALMs: Two Traditional Use Cases Author                                Researcher/Writer/Journalist  Self-Metrics          ...
Beyond the Article
Usage isn’t always indicative                                1595 Tweets
Inside the Article
Powerpoint download feature inadvertently        tracked sub-article usage
New feature may be able to track cut/paste activities
90%
To Measure is to Know
Let’s get tracking•   Cut/paste•   Figures opened, downloaded•   Links clicked•   Time spent on article page•   Supplement...
What Might Data Drive?•   Tenure and promotion•   Grants•   Reputation•   Discovery•   Prioritization             $ Attent...
Caveats and concerns•   Missed citation data•   Data sources aren’t reliable•   Digital addresses change•   Usage doesn’t ...
Next: Context-Mining
Thank You!Kristen Fisher Ratan    kratan@plos.org
Metrics: The New Black?
Metrics: The New Black?
Metrics: The New Black?
Metrics: The New Black?
Metrics: The New Black?
Metrics: The New Black?
Metrics: The New Black?
Metrics: The New Black?
Upcoming SlideShare
Loading in...5
×

Metrics: The New Black?

2,945

Published on

How will the proliferation of altmetrics (ALMs) change our understanding of user behavior in scholarly publishing?

Published in: Technology

Metrics: The New Black?

  1. 1. Metrics:The New Black? Kristen Fisher Ratan NFAIS 2012
  2. 2. The web is getting personal
  3. 3. Can Web Metrics Indicate Research Impact?
  4. 4. Metrics:The New Black? Kristen Fisher Ratan NFAIS 2012
  5. 5. Research Dissemination IS Research Impact
  6. 6. Dissemination creates indicatorsof impact Publication DisseminationArticle Level • Citations • Web usageMetrics (ALMs) • Star Ratings • Social bookmarking • Community rating • Media/blog coverage • Commenting activity • and more…
  7. 7. ALMs: Two Traditional Use Cases Author Researcher/Writer/Journalist Self-Metrics Research & Discovery Measure the impact and reach of Gauge value of any article with their work post-publication peer review Benchmark article performance Conduct custom searches that against others account for research impact Collect relevant articles and Evaluate publication decisions to organize based upon array of maximize the impact of their work criteria Gain insight into article’s impact Understand readership within context of related research Communicate impact of research to Analyze trends/behaviors across a employers, funders, potential database of academic literature collaborators The Third? Meta-analysis using large datasets of ALMs
  8. 8. Beyond the Article
  9. 9. Usage isn’t always indicative 1595 Tweets
  10. 10. Inside the Article
  11. 11. Powerpoint download feature inadvertently tracked sub-article usage
  12. 12. New feature may be able to track cut/paste activities
  13. 13. 90%
  14. 14. To Measure is to Know
  15. 15. Let’s get tracking• Cut/paste• Figures opened, downloaded• Links clicked• Time spent on article page• Supplemental info viewed• Authors’ info viewed• Pathways that info travels• ALMs viewed and used To understand true use of context
  16. 16. What Might Data Drive?• Tenure and promotion• Grants• Reputation• Discovery• Prioritization $ Attention: the new currency
  17. 17. Caveats and concerns• Missed citation data• Data sources aren’t reliable• Digital addresses change• Usage doesn’t mean useful• Deliberate gaming• Context
  18. 18. Next: Context-Mining
  19. 19. Thank You!Kristen Fisher Ratan kratan@plos.org
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×