Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Article and Object Level Metrics: New Ways of Assessing Research
Similar to Article and Object Level Metrics: New Ways of Assessing Research (20)
Recently uploaded
Recently uploaded (20)
Article and Object Level Metrics: New Ways of Assessing Research
- 1. Re-imagining discovery and access to research: Grants, publications, citations, clinical trials, datasets and patents in one place Article and Object Level Metrics New Ways of Assessing Research Ben McLeish Director of Outreach & Advocacy
- 2. Digital Science – a portfolio of innovative companies
- 3. Agenda ● Articles and Objects ○ Traditional Items ○ New Items & Objects ○ Networks & Relationships ● Old & New Metrics ○ Numbers ○ Categories ○ Uses/Re-Uses
- 5. 1-5 years from grant to publication immediate 2-3 years years years decades Pre-publication Post publication Publications Patents Policy docs Traditional Items Articles (& Maybe Book Chapters) Citations
- 6. Articles were considered for: ● Citations they accrued ● References they made Why? a) Other than publication volume, these were the available elements which could be counted b) Articles or published documents were the main/only unit of research activity c) Technical Limitations: Databases and Data Science has only just begun expanding both the base of what can be analysed, and opened up new methods of measurement and analysis Analysis was therefore always retrospective/downstream focused, and only focused on further publication activity.
- 7. 1-5 years from grant to publication immediate 2-3 years years years decades Pre-publication Post publication Grants Research Preprints Data sets Publications Tweets Blogs Citations Clinical Trials Patents Policy docs New Items & Objects
- 8. Research Grants are now themselves Research Objects Grants Data from funders are now themselves trackable “items” - Funding amounts - year awarded - year started - year ended - Discipline or research area - Affiliations - Country Data Grants show early indicators of research trends - sometimes years prior to research and publication
- 9. Preprints, datasets, clinical trials and patents are also items Preprints Data sets Clinical Trials Patents Datasets can live within a publication. They may also exist separately, and be homed in multiple platforms (Pangea, Dryad, Zenodo, Mendeley Data, figshare) Also an early indicator of research - preprint archives have separate download, citation and social attention than their ultimate versions of record. Sometimes also different audiences. Produced either by researchers, or using/citing researcher’s work. An example of an output that can measure productivity and inventiveness or influence of a researcher’s work. Can also be an output, an activity or an example of re-use of a researcher’s publications, if the trial record cites a researcher’s work.
- 10. An article now can contain other items, eg: datasets, code etc Biodiversity on the Rocks: Macrofauna Inhabiting Authigenic Carbonate at Costa Rica Methane Seeps PLoS ONE, 10(7), e0131080 - July 2015 https://doi.org/10.1371/journal.pone.0131080 ● Independently citable ● Downloads ● Might be shared on social media, cited in policy ● Code and data are increasingly offered as reusable assets in research ● Can be independently evaluated to establish Open Data Policy uptake per researcher or in aggregate at an institutional/publisher level
- 11. Networks and Relationships Items are becoming interrelated. Here’s what Digital Science has found. 1.2bn links 1.2m links 367k links 41m Patents 220m links 178k links 239k to funders 1 4 m l i n k s 2 0 m t o f u n d e r s 1.6m links Status: June 2020 1 . 1 m l i n k s 409k links 674k to funders 5.4m Grants $1.6 trillion in funding 502k Policy documents 566k Clinical trials 2 4 k l i n k s 2 4 1 k t o f u n d e r s 137m Altmetric data points 110m Publications improved metadata of 77m 1.5m Datasets 12m links 10m links
- 12. Agenda ● Articles and Objects ○ Traditional Items ○ New Items & Objects ○ Networks & Relationships ● Old & New Metrics ○ Numbers & Values ○ Categories ○ Uses/Re-Uses
- 13. Numbers & Values Altmetrics Reading, Sharing, Discussion and Commentary Partly measure engagement Partly measure re-use Do not measure quality (but neither do downloads, citations, Journal Impact Factor etc)
- 15. Research Interaction has exploded - become more social
- 16. Categories - Breaking down Patent use by Field of Research
- 17. Use and Re-Use How research fosters global innovation
- 18. Use and Re-Use How research fosters global innovation
- 19. Conclusion New Technology and New Research Activity has allowed for new metrics Categorization Concept extraction Reference extraction Institution identification Researcher disambiguation New Outputs New Technologies New Metrics and Insights Concepts Researchers Organizations Classifications References Metrics Publications Policy docs Patents Altmetric Datasets Grants Clinical trials