BG3 - AltmetricsCERN Workshop on Innovations in Scholarly Communication (OAI8)Daniel Beucke | beucke@sub.uni-goettingen.de...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Objectives: from the Breakout Group’s AnnouncementPossible o...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Determinants: Methodology“Methodologyis the systematic, theo...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Methodology: Relevance for AltMetrics• What is the theory be...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Determinants: Data Quality“Data Quality• The state of comple...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Data Quality: Relevance for AltMetrics• How to detect fraud ...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Determinants: StabilityStabilityStable “means unchanging, pe...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Data Quality: Stability• What infrastructure is needed to of...
CERN Workshop on Innovations in Scholarly Communication (OAI8)DeterminantsReliability“The quality of a measurement indicat...
CERN Workshop on Innovations in Scholarly Communication (OAI8)Reliability: Relevance for AltMetrics• How to keep the data ...
CERN Workshop on Innovations in Scholarly Communication (OAI8)DiscussionWhat other determinants should be discussed?http:/...
Upcoming SlideShare
Loading in …5
×

How to improve the acceptance of AltMetrics

1,756 views

Published on

Slides from the Breakout Group on AltMetrics at the OAI8 Confernce in Geneva

Published in: Education, Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,756
On SlideShare
0
From Embeds
0
Number of Embeds
530
Actions
Shares
0
Downloads
12
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

How to improve the acceptance of AltMetrics

  1. 1. BG3 - AltmetricsCERN Workshop on Innovations in Scholarly Communication (OAI8)Daniel Beucke | beucke@sub.uni-goettingen.deUlrich Herb | u.herb@sulb.uni-saarland.de
  2. 2. CERN Workshop on Innovations in Scholarly Communication (OAI8)Objectives: from the Breakout Group’s AnnouncementPossible outcomes:Recommendations how to improve the acceptance of AltMetrics.The session will focus on issues as methodology, data quality, stabilityand reliability, tbc. …Of course other determinants may be discussed too…2
  3. 3. CERN Workshop on Innovations in Scholarly Communication (OAI8)Determinants: Methodology“Methodologyis the systematic, theoretical analysis of the methods applied to a field ofstudy, or the theoretical analysis of the body of methods and principlesassociated with a branch of knowledge.”http://en.wikipedia.org/wiki/Methodology3
  4. 4. CERN Workshop on Innovations in Scholarly Communication (OAI8)Methodology: Relevance for AltMetrics• What is the theory behind AltMetrics?• What is the meaning of the scores?• How do the scores relate to dimensions as quality, relevance,popularity, prominence ….?Or is it sufficient:• to collect numbers? … just as Citation Metrics do• to analyze the data automatically? … in a data driven scienceapproach4
  5. 5. CERN Workshop on Innovations in Scholarly Communication (OAI8)Determinants: Data Quality“Data Quality• The state of completeness, validity, consistency, timeliness andaccuracy that makes data appropriate for a specific use.”http://en.wikipedia.org/wiki/Data_quality5
  6. 6. CERN Workshop on Innovations in Scholarly Communication (OAI8)Data Quality: Relevance for AltMetrics• How to detect fraud or gaming?• How to identify and handle human and automated Social MediaMentions / Events (e.g. via twitterfeed)?• How to identify documents properly (via DOI, URL)?• How to handle documents that are available under more than onelocator (DOI + URL, static HTML-URL + dynamic PHP-generated URL)on a publication platform?• How to handle documents that are available on more than onepublication platform (journal + repositories)?6
  7. 7. CERN Workshop on Innovations in Scholarly Communication (OAI8)Determinants: StabilityStabilityStable “means unchanging, permanent, firmly fixed or established.”http://en.wikipedia.org/wiki/Stable_(disambiguation)7
  8. 8. CERN Workshop on Innovations in Scholarly Communication (OAI8)Data Quality: Stability• What infrastructure is needed to offer a stable AltMetrics service?• Who (or what sort of institution/ agent) might/ should offer suchservices? Publishers, Database Producers (e.g. Thomson Scientific),Academics, Libraries, Infrastructure Organisations ..?• How to finance such a service?8
  9. 9. CERN Workshop on Innovations in Scholarly Communication (OAI8)DeterminantsReliability“The quality of a measurement indicating the degree to which themeasure is consistent, that is, repeated measurements would give thesame result.”http://en.wiktionary.org/wiki/reliability9
  10. 10. CERN Workshop on Innovations in Scholarly Communication (OAI8)Reliability: Relevance for AltMetrics• How to keep the data consistent?• How to assure the data curation?• Should AltMetrics Services offer the raw data they use in order toallow re-analysis and verification (or falsification) of the scores?• Should AltMetrics Services store the Social Media / Usage Events(Tweets, Downloads, CiteULike Bookmarks, …) or should theycalculate the scores on the fly?10
  11. 11. CERN Workshop on Innovations in Scholarly Communication (OAI8)DiscussionWhat other determinants should be discussed?http://bit.ly/11p1KVt11

×