In 2018, the SciELO Program will celebrate 20 years of operation, in full alignment with the advances of open science. The SciELO 20 Years Conference will address and debate – during its three-day program – the main political, methodological and technological issues that define today’s state of the art in scholarly communication and the trends and innovations that is shaping the future of the universal openness of scholarly publishing and its relationship with today’s Open Access journals, in particular those of the SciELO Network. The program of the conference is organized around the alignment of SciELO journals and operations with the best practices on communication of open science, such as publishing research data, expediting editorial processes and communication through the continuous publication of articles and the adoption of preprints, maximizing the transparency of research evaluation and the flow of scholarly communication, and searching for more comprehensive systems for assessing research, articles and journals. A two-day meeting of the coordinators of the national collections of the SciELO Network will take place prior to the Conference with focus on the evaluation of SciELO journals and the SciELO Program and their improvement following the lines of action that will guide their development in the forthcoming five years. The celebration of SciELO’s 20-year anniversary constitutes an important landmark in SciELO’s evolution, and an exceptional moment to promote the advancement of an inclusive, global approach to scholarly communication and to the open access movement while respecting the diversities of thematic and geographic areas, as well as of languages of scientific research.

1. Liz Allen
Director of Strategic Initiatives, F1000
Scielo 20| Sao Paolo| September 2018
@allen_liz
Assuring quality, transparency & ethics in
‘open science’ publishing

2. Liz Allen
Director of Strategic Initiatives, F1000
Scielo 20| Sao Paolo| September 2018
@allen_liz
Assuring quality, transparency & ethics in
‘open science’ publishing

3. “Plan S is the boldest advance
since the first days of Open
Access when BioMed Central,
the first OA publisher and
PubMed Central, the OA
repository were launched. We
at F1000 Group support it fully.”
Vitek Tracz, founder of BioMed
Central & Chairman of F1000 Group

4. “Everything that can be counted does not necessarily count;
everything that counts cannot necessarily be counted.”
attributed to Albert Einstein
theoretical physicist, philosopher
& author
1879-1955

5. Growth in life & biomedical science output
Source: Web of Science (2017)

6. how we share, discover
& talk about science is
evolving fast

7. • Post-publication peer review
• Open peer review
• Open data
• Open access
• Versioning
• Indexing
• Comprehensive meta-data
• Full usage metrics
• Living figures
• more to come ….

8. F1000’s post-publication, open peer review publishing model
Preprint-like stage

9. F1000’s post-publication, open peer review publishing model
Preprint-like stage
Plagiarism checks
Image manipulation checks
Ethical checks
FAIR data compliance
FAIR software compliance
Open materials & methods
Adherence to recognised standards
Open Access compliance

10.  invited peer review
 indexing in bibliographic databases
F1000’s post-publication, open peer review publishing model
Preprint-like stage

11. Providing open research publishing services to funders

12. … and to publishers: Emerald Open Research

13. Research evaluation principals …
Designed with purpose & transparent
Balanced & realistic
Contextualised
Proportionate
Avoid unintended consequences &
perverse incentives …

14. https://en.wikipedia.org/wiki/Goodhart's_law

15. Metadata around outputs is vital

16. Platform descriptors:
Publishing outlet
o ISSN
o name
Publishing model & process
o peer review (Y/N)
o type of peer review model used
o time to peer review
o indexing speed
Content licenses & accessibility
o OA & type
o access & permissions
o indexed - where
o fully machine readable i.e. XML, HTML

17. Content descriptors:
Editorial checks performed:
o plagiarism
o ethical checks
Content license & accessibility
o OA etc
o DOI
Content type
o research article, research protocol,
data note etc
Resources availability
o DOI
Affiliations
o funder registry (Crossref)
o organisation ids – coming soon …
Subject classifiers/keywords

18. Author descriptors:
Names
Institution affiliation
Funding sources
Contributor role (CRediT)
o ORCID
o Contributor role taxonomy (CrediT)
https://casrai.org/credit/

19. Reviewer descriptors:
Names
Institution affiliation
ORCID
Review activity with trackable & persistent
DOIs & linked to ORCID & Crossref metadata

20. Reviewer descriptors:
Names
ORCID ids
Institution affiliation

21. Content descriptors:
Editorial checks performed:
o Plagiarism
Content license & accessibility
o OA etc
o DOI
Content type
o Research article, research protocol,
data note etc
Resources availability
o DOI
Affiliations
o funder registry (Crossref)
o Organisation ids – coming soon …
Use, reuse & ‘quality’ indicators
o reach – circulation?
o attention
o engagement
o influence (citation?)

22. Deciding what information is needed for:
o use & reuse of content
o participation in research – as an ‘author’ as a reviewer, as a consumer
o balanced evaluation of research and researchers
Develop standard definitions where possible
Capture key information into platforms AT START
Enable inter-operability :
o reduce duplication & waste
o avoid silos
o encourage internationalization & sharing
Building a meta-data infrastructure is good science

23. “Science remains the
key driver of human
progress, yet we have
little evidence on how
to best fund science
and incentivize high-
quality work.”
John Ioannides (2018), Professor
of Medicine & Health Policy

24. Obrigada!
Liz Allen
Director of Strategic Initiatives, F1000
Scielo 20| Sao Paolo| September 2018
@allen_liz

25. F1000’s Director of Strategic Initiatives (2015 – present)
Head of Evaluation at Wellcome (2000 - 2015 )
ORCID Board Director (2010 – 2015)
Co-led development of project CRediT (2010 - present)
Crossref Board Director (2017 – present)
Visiting Senior Research Fellows at Policy Institute @ Kings College London
Love all things meta-data, research outputs, metrics & ‘science of science’
About me (declarations)