This presentation was provided by Leslie D. McIntosh, during the eighth and final session of our Spring 2023 NISO Training Series "Quality Assurance of Data Sets." The class focused on Data Quality Management, and was held June 15, 2023.

1. Quality Assurance of
Datasets
NISO Training Series 2023
Leslie D. McIntosh, PhD

2. Leslie McIntosh
A Brief Introduction
Dr. LeslieMcIntosh is the VP of Research Integrity at Digital
Science and dedicates her work to improving research and
investigating and reducing mis- and disinformation in
science.
As an academic turned entrepreneur, she founded Ripeta in
2017 to improve research quality and integrity. Now part of
Digital Science, the Ripeta algorithms lead in detecting trust
markers of research manuscripts. She works around the
globe with governments, publishers, institutions, and
companies to improve research and scientific decision-
making. She has given hundreds of talks including to the US-
NIH, NASA, and World Congress on Research Integrity, and
consulted with the US, Canadian, and European
governments. Dr. McIntosh’s work was the most-read
RetractionWatch post of 2022.
JOB TITLE: VP, Research Integrity
AFFILIATION: Digital Science
EMAIL: leslie@digital-
science.com
ORCID:https://orcid.org/0000-0002-3507-7468

3. 2023-Jun-15

4. Creation and Planning
informs research design and grant
proposal evaluation
Reuse
enables the reuse of scientific work
by elucidating scientific rigor
Evaluation
automates the evaluation of
scientific rigor of manuscripts
Research
Data Life
Cycle
Preservation
aligns and extracts the metadata within
and across repositories
Discovery
augments article
discovery based on the
reporting rigor

5. Researchers
Responsibilities
Ensure research
rigor and
methodological
transparency.
First do no harm.
Incentives
Add to scientific
discovery, improve
personal reputation,
increase citations.
Institutions
Responsibilities
Ensure research aligns
with institutional
mission and vision.
Incentives
Improve, maintain,
and/or promote
institutional or
departmental
reputations.
Publishers
Responsibilities
Publish the full
scientific workflow.
Ensure the
dissemination of good
science
Incentives Facilitate
scientific discovery,
gain citations, increase
value.
Funders
Responsibilities and
Incentives
Support well-conducted
research and ensure
funded research is in
line with the
organizational missions
or improving human
health.
Incentives Facilitate
scientific discovery.
Table 1: Scientific Stakeholder Responsibilities and Incentives
If the aim is to ensure scientific rigor, who are the stakeholders and what are their responsibilities in preventing the
dissemination and consumption of non-rigorous, non-reproducible science.

6. Resources
Data Management
Data Quality

7. The NISO Primer:
Research Data
Management
Author: Carly Strasser

8. Data Management for
Researchers: Organize,
maintain and share your
data for research
success (Research
Skills)
Author: Kristen Briney
ISBN-13: 978-1784270117
(Not in folder as it is a book for purchase.)

9. How To Conduct A Data
Quality Assessment (DQA)
Prepared by Olivier Mumbere and
Laurent Kopi in 2012

10. Data Citation of
Evolving Data
Recommendations of the Working Group on Data
Citation (WGDC), Research Data Alliance
Andreas Rauber, Ari Asmi, Dieter van Uytvanck
and Stefan Pröll
In Practice:
● Precisely and Persistently Identifying and
Citing Arbitrary Subsets of Dynamic Data
● Incorporating Data Citation in a
Biomedical Repository: An
Implementation Use Case

11. Activity
What are the three things you can use
from what you have learned?

12. Follow-up Thoughts
Working with data does not mean working without emotion.
Think about where your goals lie?
- There are very different emotions based on your internal motivating factors
- There are very different emotions from your lived experiences

13. Follow-up Thoughts
To ensure and assure quality data, there must be checks
● on the data
● on the people
● of the algorithms
● of the processes
We all come with biases. We all have different intentions. That is why there are checks.