Leeds ReproducibiliTea session on seven easy steps to open science / open research.

1. )
)
)
)
)
)
)
)
)
Leeds ReproducibiliTea:
Seven Easy Steps to
Open Research
)
)
)
)
)
)
)
)
)

2. What is the ReproducibiliTea
journal club?
• ReproducibiliTea is an early career
researcher led journal (and tea-
drinking) club.
• Its goal is to facilitate and deepen
the conversation about open
research across all fields of study
represented at Leeds, from Data
Science to Humanities.
• ReproducibiliTea is an international
journal club, and is sponsored by
the UK Reproducibility Network
(UKRN).

3. What is Open Research?
‘Open Science’ is an
international movement
that promotes making all
aspects of the research
cycle accessible.
However, we feel ‘Open
Research’ is a much more
inclusive term as the
principles of OS can be used
in many, if not all,
disciplines.

4. What is open
research?
• Open research could include publicly
sharing of results, software and code,
methodology, protocols and
documentation, as well as
publications and data.
• In the arts and humanities, open
research could involve sharing digital
humanities methods and tools,
reflections on your research practice,
notes, audio-visual materials and
annotated bibliographies.
From
https://library.leeds.ac.uk/info/1406/researcher_support/199/open_research

5. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
THE PAPER
Seven Easy Steps to Open Research

6. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
BACKGROUND
Two primary reasons for researchers not to engage
in open research practices:
• Lack of information about the resources
available and;
• Lack of incentives for adopting such practices
(Washburn et al., 2018).

7. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
BACKGROUND
An accessible and consolidated guide is
needed which outlines best openly available
resources related to improved research
practices (i.e., open research).

8. )
)
)
)
)
)
)
)
)
Contents
SEVEN EASY STEPS
01 Understanding open research
)
)
)
)
)
)
)
)
)
02 Open access
03 Open data, materials & code 04 Reproducible analyses
05 Preregistration 06 Replication
07 Teaching open research

9. )
)
)
)
)
)
)
)
)
01
Step 1
UNDERSTANDING
OPEN RESEARCH
)
)
)
)
)
)
)
)
)

10. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Open research does not mean one
set of specific rules.
It’s instead a collection of several
good and open research practices,
that apply variously to different
research contexts.
Step 1

11. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Why transparency and openness
are important
Step 1

12. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Incentives
• Journal badges for open data, open
materials, etc.
• Funders are also adopting new
research transparency requirements
(e.g., Plan S).
• University hiring and promotion
practices.
Step 1

13. )
)
)
)
)
)
)
)
)
02
OPEN ACCESS
)
)
)
)
)
)
)
)
)
Step 2

14. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Basic & essential part of research
transparency is open access
publications, and openness in
dissemination process.
Step 2

15. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
• Gold route = made publicly available at
the point of publication (i.e., by the
publishers themselves).
• Green route = authors self-archiving.
Step 2

16. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
• Preprints fall under the green route,
which are papers that have not yet been
peer-reviewed.
Step 2

17. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Incentives
• OA publications are cited more
by other researchers
• Covered more by news outlets
Step 2

18. )
)
)
)
)
)
)
)
)
03
OPEN DATA, MATERIALS
AND CODE
)
)
)
)
)
)
)
)
)
Step 3

19. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Another basic form of open research is,
where possible, making the study
materials, data, and/or analysis code
publicly available.
Step 3

20. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Data should be shared in a FAIR
manner – findable, accessible,
interoperable, and reusable.
Step 3

21. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Incentives
• Some journals ask researchers to share
data once paper goes into press.
• Some funding agencies mandate that
data should be made available with
closure of project.
Step 3

22. )
)
)
)
)
)
)
)
)
04
REPRODUCIBLE
ANALYSES
)
)
)
)
)
)
)
)
)
Step 4

23. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
To complete this, need resources
(i.e., open data and open code) that
allow others to generate the exact
same results reported in the paper.
Step 4

24. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Requires good data management
For example:
• Saving raw data and cleaned data separately.
• All steps of data processing should be recorded,
either by coding analyses in open-source
programs like R or Python or by “pasting” SPSS
analytical steps into a reproducible syntax file.
Step 4

25. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Incentive
Person who is most likely to reuse
your data is yourself!
Reproducible and clear data will
help you with re-analysing it.
Step 4

26. )
)
)
)
)
)
)
)
)
05
PREREGISTRATION
)
)
)
)
)
)
)
)
)
Step 5

27. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
• Time stamped document detailing
your proposed study’s design,
methods and analysis plan.
• Submitted to public registry before
data collection.
Step 5

28. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Can reduce (or at least make transparent) some of
these questionable research practices:
Step 5

29. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Incentive
You’re just frontloading your work by
making the decisions on methods and
analysis earlier,
and increases transparency and
credibility of your research.
Step 5

30. )
)
)
)
)
)
)
)
)
06
REPLICATION RESEARCH
)
)
)
)
)
)
)
)
)
Step 6

31. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
There is a replication crisis in research
where many psychological, and other
disciplinary (e.g., medical), studies cannot
be replicated.
Replication is fundamental to scientific
endeavor.
Step 6

32. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
• Researchers can contribute by conducting
replication studies themselves, and/or;
• Facilitating replication of their own work
through open and reproducible materials,
data, and code.
Step 6

33. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Incentives
• You are contributing to a
fundamental part of scientific
endeavor, and the building
scientific theories.
Step 6

34. )
)
)
)
)
)
)
)
)
07
TEACHING OPEN
RESEARCH
)
)
)
)
)
)
)
)
)
Step 7

35. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Main barrier to adopting open
practices = lack of education
in this area.
Step 7

36. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Main barrier to adopting open
practices = lack of education
in this area.
Step 7

37. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Step 7

38. )
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
)
Incentives
• Creates better future researchers,
and/or;
• Creates more critical thinking
population, e.g., critically view
research presented in media.
Step 7

39. )
)
)
)
)
)
)
)
)
Contents
SEVEN EASY STEPS
01 Understanding open research
)
)
)
)
)
)
)
)
)
02 Open access
03 Open data, materials & code 04 Reproducible analyses
05 Preregistration 06 Replication
07 Teaching open research

40. Thank you for listening!
Any questions?
• Potential discussion topics:
• Have you used any of these practices
before?
• Which are you most interested in
implementing now?