Telling your research story with (alt)metrics

2,763 views

Published on

Presentation on the use of altmetrics to inform stories about altmetrics. Presented for Open Access week 2013 in Amsterdam. See http://uba.uva.nl/home/componenten/agenda-2/agenda-2/content/folder/lezingen/13/10/altmetrics.html

Published in: Education, Technology
0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,763
On SlideShare
0
From Embeds
0
Number of Embeds
1,074
Actions
Shares
0
Downloads
17
Comments
0
Likes
6
Embeds 0
No embeds

No notes for slide
  • NL Top Sectors
  • This is a pain to calculate!
  • We believe metrics are it but policy makers don’t necessarily. What they want is evidence.
  • There’s more and more “stuff” – where are we
  • From Assistant Provost for Faculty Appointments and Information at Harvard University, where she manages the review of faculty appointments University-wide - See more at: http://elife.elifesciences.org/content/2/e00452#sthash.9shtp91n.dpuf
  • From Assistant Provost for Faculty Appointments and Information at Harvard University, where she manages the review of faculty appointments University-wide - See more at: http://elife.elifesciences.org/content/2/e00452#sthash.9shtp91n.dpuf
  • Rankings, and comparison per sea
  • Users, Narcissim& Control 2012
  • Side note
  • This will happen closer than 20 years
  • Clear correlation between F1000 recommendations and citations
  • Expert in graphics
  • Posted last week (submitted for review)
  • Shukumisa campaign is a national coalition of 30 organisations working to combat sexual violence in one form or another
  • Telling your research story with (alt)metrics

    1. 1. Telling your research story with (alt)metrics Paul Groth (@pgroth) Web & Media Group VU University Amsterdam http://www.few.vu.nl/~pgroth
    2. 2. Research Project Grants Applications, awards, and success rates NIH Data Book – (http://report.nih.gov/ndb/index.aspx) Data provided by the Division of Information Services, Reporting Branch
    3. 3. "Outside letters basically trump everything," says Robert Simoni, chairman of the biology department at Stanford University in California. Metrics: Do metrics matter? Nature 2010 http://doi.org/10.1038/465860a
    4. 4. http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest
    5. 5. ―Imagine how the academic appointment process might change if search and review committees had access—within an appropriately tagged or linked online CV, for example, or via the ORCID system—to information about the specific contributions made by a candidate to each of his/her works, including contributions that might not otherwise have qualified for ‗authorship‘ status?‖ Point of view: Faculty appointments and the record of scholarship Amy Brand http://dx.doi.org/10.7554/eLife.00452
    6. 6. Point of view: Faculty appointments and the record of scholarship Amy Brand http://dx.doi.org/10.7554/eLife.00452 Opportunities • Individuals and institutions need better tools for curating and networking their own record of scholarship • Institutions need more information about scholarly contribution • ALMs that reliably differentiate sources of input (general; academic; expert; etc.) would be more useful‖ Slide 3: http://article-level-metrics.plos.org/files/2013/10/Brand.pptx
    7. 7. ENTER ALTMETRICS
    8. 8. Altmetrics is the study and use of scholarly impact measures based on activity in online tools and environments. http://doi.org/10.1371/journal.pone.0048753
    9. 9. ―It took approximately a generation (20 years) for bibliographic citation analysis to achieve acceptability as a measure of academic impact." (Vaughan and Shaw, 2003)
    10. 10. What altmetrics are not good at
    11. 11. (Wouters & Costas, 2012)
    12. 12. ―The main problem is that none of the new tools we reviewed meet crucial requirements for data quality and indicator construction. This prevents them from currently being usable in the context of research evaluation and assessment.‖ (Wouters & Costas, 2012)
    13. 13. http://www.slideshare.net/paulwouters1/issi2013-wg-pw
    14. 14. (Birkholtz et al. 2013) (Fausto et al 2012) http://jasonpriem.org/self-archived/5uni-poster.png The Research is Happening http://ploscollections.org/altmetrics http://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.html
    15. 15. http://www.cwts.nl/pdf/CWTS-WP-2013-003.pdf
    16. 16. Why now?
    17. 17. Figure 1. Terms and definitions. Allen HG, Stanton TR, Di Pietro F, Moseley GL (2013) Social Media Release Increases Dissemination of Original Articles in the Clinical Pain Sciences. PLoS ONE 8(7): e68914. doi:10.1371/journal.pone.0068914 http://www.plosone.org/article/info:doi/10.1371/journal.pone.0068914
    18. 18. SOURCES
    19. 19. http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest
    20. 20. Largest List of Metrics Sources • • • • • • • • • • Amazon Bit.ly CrossRef Delicious Dryad dSpace ePrints Facebook Figshare Github • • • • • • • • • Google+ Medwave Mendeley Microsoft Academic Search PLOS PubMed Reddit Research Blogging Scopus • • • • • • • • • SlideShare SourceForge Stack Overflow Twitter USPTO Vimeo Wikipedia Worldcat YouTube 27 From Andrea Michalek
    21. 21. STORIES
    22. 22. Steve
    23. 23. Published AND discussed AND cited 34
    24. 24. THE FUTURE – RICHER VIEWS OF IMPACT
    25. 25. • Cameron Neylon - ALM Workshop 2013 Summary • http://article-levelmetrics.plos.org/files/2013/10/Neylon.pptx
    26. 26. Not very high views
    27. 27. Not an obvious outlier...
    28. 28. ...but interesting interact
    29. 29. ...driven by this person...
    30. 30. ...who I can talk to.
    31. 31. See http://bit.ly/NJOyUn for the whole conversation
    32. 32. This. Is Impact.
    33. 33. SUPPORT FOR YOUR STORY
    34. 34. Three Points 1) The story you want to convey 2) Metrics as evidence 3) Transparency is central
    35. 35. Conclusion • Altmetrics is still developing – But useful today • Your content is embedded in a network of content – Show the impact of your content through associated content • Tell a story using your network
    36. 36. Thanks Collaborators: Peter van den Besselaar, Julie Birkholz, Frank van Harmelen, Shenghui Wang, Rinke Hoekstra, Thomas Gurney, Mike Taylor, Anita de Waard, Jason Priem, Dario Taraborelli, Cameron Neylon

    ×