Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

OSFair2017 Workshop | Impact Data Services on the Cloud

90 views

Published on

Mappet Walker talks about research impact data services and presents opportunities to improve and the OpenUP impact data services on the cloud | OSFair2017 Workshop

Workshop title: Open metrics on the cloud

Workshop overview:
Impact metrics have a strong influence on the scientific community, affecting the assessment of institutions of higher education and research as well as decisions concerning who gets promoted or hired, who receives grants, and who publishes where. In this situation, it is essential that the methods used to calculate metrics should be transparent, and reproducible and that their integrity should be auditable, and beyond question. This workshop will discuss the limitations of current systems and platforms, presenting a use case from Usage Statistics platform, and the recommendations of creating an open platform for Impact Data.

Presentation Abstract:
Impact metrics have a strong influence on the scientific community, affecting the assessment of institutions of higher education and
research. In this situation, it is essential that the methods used to calculate metrics should be transparent, and reproducible and that their integrity should be auditable, and beyond question.

This workshop aims to provide an overview of the potential impact on the market. Open Access repositories, research data repositories, and publisher platforms are not standardized. But they are an important complement to other (traditional and alternative) bibliometric indicators to provide a comprehensive and recent view of the impact of scholarly resources. In particular, use data from non-traditional output types are available on the Internet. A key challenge is to achieve a similar, consistent, standards-based usage across different platforms Web resources or files and the use of resources among different repositories.

This workshop combines three thematic blocks:

- Motivations and outcomes from the European Commission Expert Group on Altmetrics report on "Next-generation metrics" report
- Current usage statistics initiatives (OpenAIRE, IRUS-UK): services standardization efforts
- Opportunity for an Impact Data Services Cloud (OpenUp)

The presentation builds on the results of the OpenUP landscape scan, and an analysis of how research results are measured today, the limitations of current approaches, and a proposed solution: a new platform for Open Metrics that gives users the information they need to understand and reproduce current metrics, to create and share their own metrics of research output and to take account of research outputs (e.g. data, code, laboratory equipment, animals, cell-lines, research protocols).

When: DAY 2 - PARALLEL SESSION 4 & 5

Published in: Science
  • There is a useful site for you that will help you to write a perfect and valuable essay and so on. Check out, please ⇒ www.WritePaper.info ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

OSFair2017 Workshop | Impact Data Services on the Cloud

  1. 1. 1 Impact Data Services on the Cloud Athens, 07 September 2017
  2. 2. 22017-09-07
  3. 3. 3 Discussion today • Define impact, uses and requirements • Measuring research results today • The opportunities to improve • OpenUP Impact Data Services on the cloud 2017-09-07
  4. 4. 4 • Attention • Presence in media • Immediate scientific citations • Short term, measured in day, weeks, months • Scientific impact • Substantial changes in scientific theories, methods, etc. • Citations long after original publication • Medium to long term, usually takes years • Social and economic impact • Substantial changes in products, production processes, employment, environment, transport, health • Long term, usually take several decade What is impact? 2017-09-07
  5. 5. 5 • Choosing where to publish/ methods of dissemination • Short term Journal impact factor • Academic selection and recruitment • Short term citations • Aggregate citation metrics e.g. H-index • Other attention metrics (Altmetrics) • Patents and other research outputs, not widely used but useful • References in patents not widely used but useful • Allocation of funding • Formal study of long term metrics • Long term policy and historical studies • Long term citations and metrics Impact metrics: uses & requirements 2017-09-07
  6. 6. OpenUP Research Impact Goals 6 • Presents an analysis of how research results, are measured today • The limitations of current approaches • A proposed solution: • a platform for Open Metrics • to understand and reproduce current metrics, • to create and share their own metrics • to take account of research outputs 2017-09-07
  7. 7. 7 Measuring Research Impact today 2017-09-07
  8. 8. 8 Impact Data Services providers today 2017-09-07
  9. 9. Opportunities for improvement 9 • Open it up. • The market is dominated by a small number of metrics providers. • Own it. • Scientific communities do not own the production process. • One metric does not fit all. • The available impact factors present a limited view to the science communities. • Metrics create distorted market incentives. • Current metrics do not give proper credit for scientific outputs other than publications. • Transparency. Reproducibility. • Metrics are easily gamed. 2017-09-07
  10. 10. Impact Data Services on the Cloud 102017-09-07
  11. 11. Features 11 • Collect Impact Data • E.g. citations, mentions, views, downloads, references in patents • Give researchers access to the impact data they require • to reproduce current metrics • E.g. simulate impact metrics of journal • to produce their own metrics • E.g. compare citations produced by research in two different research programs • Broader coverage of research outputs 2017-09-07
  12. 12. 12 This is where the footer goes Sample: Research Impact on Leica Microscope • Research Impact today measures publication related results. • Research results can also reference other forms of input and output • Using the Leica microscope, as a prototype, this use case shows how a Text & Data mining platform enables the measurement of research results that are input to research
  13. 13. 13 Research impact on Leica Microscope AnnotateAnnotate Annotated Articles Annotated Articles OMTD Data Repository OMTD Data Repository Article name, domain, institution, year, Licensing, Article link Article name, domain, institution, year, Licensing, Article link Leica Microscope Text & Data Mining Leica Microscope Text & Data Mining 2 3 4 5 6 Dictionary of Keywords, Synonyms & rules Dictionary of Keywords, Synonyms & rules 1 Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Article Using Leica Microscope Review and approveReview and approve Research Impact Leica Microscope Research Impact Leica Microscope 7 8
  14. 14. 2017-09-19 14 OpenUP: Impact Data Architecture
  15. 15. 15 • An open science system should be grounded in a mix of expert judgement, quantitative and qualitative measures • provides collaboration across stakeholders • Transparency and accuracy are crucial • the ability to create, share, reuse metrics and data • Make better use of existing metrics for open science • an innovation that allows creation of new metrics where there is a gap • Next generation metrics should be underpinned by an open, transparent, and linked data infrastructure • use EOSC and existing e-infrastructures • Measure what matters • generate fit for purpose qualitative measures OpenUP Response to the HLEG Next Generation Metrics 2017-09-07
  16. 16. What next? 16 • Continue the engagements, conversations and use-case development activities • Finalize the OpenUP research impact recommendation • Seek partnerships and collaboration 2017-09-07
  17. 17. 17The OpenUP project received funding through the H2020 Framework Programme, GA No: 710722 Thank you for your attention! Mappet Walker

×