Cathy Holland
Digital Science
September 28,
2018
SciELO
Conference
Through the lens of
Dimensions -
Interoperability,
visibility, credibility
Agenda
● Definitions
○ Are we on the same page?
● The power of interoperability
● Visibility and the indexing of all titles
● Credibility of metrics
● The end
Definitions
● Interoperability
○ The ability of computer systems or software to exchange and
make use of information
○ A capacidade de sistemas de computador ou software para
trocar e fazer uso de informações
○ La capacidad de los sistemas informáticos o software para
intercambiar y hacer uso de la información
Definitions
● Visibility
○ The state of being able to see or be seen or the degree to which
something has attracted general attention; prominence
○ O estado de ser capaz de ver ou ser visto ou o grau em que algo
atraiu a atenção geral; proeminência
○ El estado de poder ver o ser visto o el grado en que algo ha
atraído la atención general; prominencia
Definitions
● Credibility
○ The quality of being trusted and believed in
○ A qualidade de ser confiável e acreditado em
○ La calidad de ser confiable y creer en
The Lens of Dimensions
What is Dimensions? A Networked Research Knowledge System
• Connects data across the different elements of research (for discovery and analysis)
• Built in collaboration with 100+ research organization development partners worldwide
• Basic publications discovery version free for individual researchers
• Full data versions licensed to institutions, publishers, funders and corporate customers
• Features a variety of article-level metrics such as:
○ Altmetrics, total number of of citations, recent citations, FCR, RCR
Interoperability
Interoperability
Interoperability
4.1m
grants
$1.3 trillion in
funding
37m
patents
368k
Policy
papers
9m
Altmetric
data
points
139K links
480k
Clinical
trials
350K links
320M links
873M links
97m
Publications
improved
metadata
of 50m
Interoperability
Text heretext
Visibility
Visibility
Visibility
ALL SciELO content
has been indexed in
Dimensions.
Visibility
Filter by source title
Content automatically linked to related grants, patents
clinical trials, policy docs, citations and metrics
Credibility
We do not want
to impose
metrics ...
… metrics
should be
developed by
the community
… at the
discipline,
national or
institutional
level.
Example of a
partner metric:
Relative
Citation Ration
(RCR) … please join
the efforts for
more and / or
better metrics!
Dimensions and metrics
Credibility
https://sfdora.org/read/
Credibility
https://www.digital-
science.com/resources/portfolio-
reports/a-guide-to-the-dimensions-data-
approach
Credibility
Credibility
Credibility
What does this
interoperable tool show
us about SciELO?
Publications vs. Citation Rate - SciELO Journals
Patent References Linked to SciELO Journal Articles
Policy References Linked to SciELO Journal Articles
dimensions.ai
Thank you!

Cathy Holland - Through the lens of Dimensions: Interoperability, visibility, credibility

Editor's Notes

  • #2 Make sure to introduce yourself
  • #3 Quick snapshot of the agenda
  • #4 First I want to touch quickly on definitions - Often in the space we are not all speaking the same language. One of these definition might mean something slightly different to a researcher or publisher or they may mean different things depending on your research area. Math or Religious Studies can have very different view on what it i I highlight these to note that if we are to achieve the goals the ecosystem is interest in, we need to be sure we are all talking about the same definitions. I say this as I have frequently seen two people think they are talking about the same thing when in reality they are not. Happens all the time in my marriage ;)
  • #5 Visibility Definitions
  • #6 Credibility
  • #7 As we are looking at these 3 attributes from the lens of Dimensions, First we need to know more about Dimensions as it was just launched in January this year.
  • #8 Dimensions is a Networked Knowledge Research System. Not only do we collect citation data, we also we also link the citation data to other data points so that we get the “full research story”. What makes it differnet? The indexing of grants, content, patents etc is based on full text so we can really get a full understanding of the piece of work and thus categorize the objects and get better information to link them to build a full picture.. Additionally Dimensions indexes all articles.
  • #9 Let’s talk a little bit about interoperability
  • #10 Our data by definition is interoperable - we have pulled in a huge amount of data from other places in order to connect it and make it more useful We can also connect this data with other data sets Powerful API so you can extract data sets and further analyze Work with other institutional identifiers Pull in new taxonomies so organizations can analyze their own space
  • #11 Just a quick snapshot of the linkages here and some numbers on the data.
  • #12 Quick snapshot of the interface itself.
  • #13 Landing page for an article
  • #14 We have started with other Digital Science tools that many organizations already use to start our journey on interoperability.
  • #15 If you drill down further, you have links to the actual citations, policy, or patent reference.
  • #16 As example of interoperability beyond our own tools, we are integrated with ORCID.
  • #18 Built for researchers to discover content - with full text index you can find even more content related to your subject area.
  • #19 All SciELO content indexed Dimensions - everyone can find SciELO articles in the platform. Due to the full text index, natural language processing etc, we can get more accurate with a subject area. This will mean that SciELO content has a higher chance of being Also, all content in Dimensions is picking up citation data.
  • #20 In the interface you can filter further by source title to see what is going on with your exact content. You can also see the linkages if you drill down.
  • #21 Moving onto Credibility
  • #22 First I want to say something on Metrics and how we view them. I considered this as we have talked a lot about metrics at this conference. I think this slide says it all We don’t want to impose metrics Metrics should be developed by the community At the discipline, national, or institutional level. We even have partnered with organizations like the NIH to develop metrics
  • #23 Credibility can be very subjective - however we have a few things that make us credible. First I want to touch on the fact that we just signed onto DORA. In case you have not heard of DORA it is an initiative within the community to promote and develop best practice in the assessment of research. If you have not read the declaration I encourage you to do so. Explain what this means and why it is important.
  • #24 Additionally we are very transparent about how we are accomplishing this and have put out a guide called the Dimensions Data Approach. It is located on Figshare so please do feel free to look it up.
  • #25 Dimensions comes out a group of companies that already have good reputations in community. However what really means you have arrive is when those in the community start to use and evaluate your tools to give their perspective. One of the early adopter of Dimensions was the the University of Zurich. They show citation from several providers as a comparison point. You can see the numbers are similar.
  • #26 We also have some third party evaluations. Some of these were a complete but positive surprise to us and others were more like interviews and discussions.
  • #27 We also have some third party evaluations. Some of these were a complete but positive surprise to us and others were more like interviews and discussions.
  • #28 Earlier - Working Group 4 on the performance of SciELO Journals
  • #29 Citations - Chat from Dimensions - Relative to what is going on with publications - Citations keep going up while publications are steady
  • #32 This database is partially free so please do take a look at Dimensions.ai. Right now you do not even have to register.