Carpenter NISO Altmetrics Meeting #2 opening presentation Dec 2013

647 views
491 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
647
On SlideShare
0
From Embeds
0
Number of Embeds
31
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Carpenter NISO Altmetrics Meeting #2 opening presentation Dec 2013

  1. 1. Do We Need Standards for Alternative Metrics? What are we hoping to accomplish? Todd Carpenter, Executive Director, NISO NISO Alternative Assessment Initiative Discussion Forum #2 Washington, DC | December 11, 2013
  2. 2. About • Non-profit industry trade association accredited by ANSI with 150+ members • Mission of developing and maintaining technical standards related to information, documentation, discovery and distribution of published materials and media • Volunteer driven organization: 400+ spread out across the world • Responsible in various wasy for standards like ISSN, DOI, Dublin Core metadata, DAISY digital talking books, OpenURL, MARC records, and ISBN
  3. 3. We stand on the shoulders of giants...
  4. 4. The Mighty Citation
  5. 5. Impact factor
  6. 6. Thomson-Reuters 
 IMPACT FACTOR
  7. 7. Two Stanford Students
  8. 8. They wrote a paper
  9. 9. They started a company in someone’s garage Photo: AP
  10. 10. A simple conclusion can be drawn Citations are awesome, aren’t they? A perfect solution to all the world’s problems, no?
  11. 11. Back to Sir Isaac Newton “What Des-Cartes did was a good step.You have added much several ways, & especially in taking ye colours of thin plates into philosophical consideration. If I have seen further it is by standing on ye shoulders of Giants."
  12. 12. Caveat emptor Citations aren’t always what we think they are
  13. 13. Another problem with citations
  14. 14. So where to from here?
  15. 15. Define altmetrics, please
  16. 16. Usage Based Metrics
  17. 17. Clickstream Analysis
  18. 18. Social Media Metrics Image: Danny Brown, The State of Social Media Marketing 2012
  19. 19. Clickstream network analysis Clickstream data yields highresolution maps of science Johan Bollen, Herbert Van de Sompel, et al. PLoS One, February 2009
  20. 20. Behavioral Metrics
  21. 21. Multivariate analysis
  22. 22. Sentiment Analysis
  23. 23. Citation of non-traditional content Citations to new forms of communication aren’t as simple as one might think. ! Define a use of this? Image: Domenico, Caron, Davis, et al.
  24. 24. We’ve got what, now how?
  25. 25. What can be measured? Image: Flickr user karindalziel
  26. 26. How do we measure things?
  27. 27. At what granularity do we measure things?
  28. 28. Which measurements are valuable?
  29. 29. How do we ensure the validity of those measurements?
  30. 30. How to (or even if we should) deal with other issues such as gaming?
  31. 31. Issues we face with alternative metrics
  32. 32. Basic Definitions ! (So we are all talking about the same thing)
  33. 33. Comparison across providers Source:  Scott  Chamberlain,  Consuming  Article-­‐Level  Metrics: Observations  And  Lessons  From  Comparing  Aggregator  Provider  Data,   Information  Standards  Quarterly,  Summer  2013,  Vol  25,  Issue  2.
  34. 34. Consistency in what is counted Source:  Scott  Chamberlain,  Consuming  Article-­‐Level  Metrics: Observations  And  Lessons  From  Comparing  Aggregator  Provider  Data,   Information  Standards  Quarterly,  Summer  2013,  Vol  25,  Issue  2.
  35. 35. Authorship ----Disambiguation & Contributor Roles
  36. 36. Open exchange of component data
  37. 37. TRUST
  38. 38. What is NISO trying to do?
  39. 39. Alterna(ve  Assessment   Ini(a(ve   ! Phase  1  Mee(ngs October  9,  2013    -­‐  San  Francisco,  CA December  11,  2013  -­‐  Washington,  DC January  23-­‐24  -­‐  Philadelphia,  PA ! Phase  1  report  expected  in  May  2014
  40. 40. Alterna(ve  Assessment  Ini(a(ve   ! Phase  2 Presenta(ons  of  report  (June  2014) Priori(za(on  Effort  (June  -­‐  Aug,  2014) Project  approval  (Sept  2014) Working  group  forma(on  (Oct  2014) Consensus  Development  (Nov  2014  -­‐  Dec  2015) Trial  Use  Period  (Dec  15  -­‐  Mar  16) Publica(on  of  final  recommenda(ons  (Jun  16)
  41. 41. Criticism
  42. 42. Why now? Isn’t it too soon? Can NISO to do this?
  43. 43. How soon is now?
  44. 44. These things take time
  45. 45. It will be hard to change
  46. 46. “All I see now is blonde, brunette, redhead”
  47. 47. One Very Last Thing… Image from Will Lion: http://www.flickr.com/photos/will-lion/2646213692/
  48. 48. Thank you! Todd Carpenter, Executive Director tcarpenter@niso.org National Information Standards Organization (NISO) 3600 Clipper Mill Road, Suite 302 Baltimore, MD 21211 USA +1 (301) 654-2512 www.niso.org

×