This presentation was provided by William Mattingly of the Smithsonian Institution, for the third session of NISO's 2023 Training Series on Text and Data Mining. Session three, "Data Pre-processing for Libraries," was held on Thursday, October 26, 2023.

1. Text and Data Mining
Ethics and Cleaning Data

2. 1. Challenges of Machine Learning
2. Ethical and Machine Learning
3. Data Normalization
4. Data Reduction
Goals

3. Ethics and
Machine
Learning

4. Ethics and
Machine
Learning
-
- Environmental
- Human Labor
- Data
- Biases

5. Environmental
-

6. Human Labor

7. Data
-

8. Biases
-

9. -

10. -

11. -

14. Challenges of
ML Data
Computational Resources

15. Finding
Dragons

16. Finding
Dragons
Data Cleaning

18. Finding
Dragons
Data from Two Sources

22. Finding
Dragons
Finding Outliers

23. Plot a Single Feature

25. Plot Two Features

27. How do we Plot beyond 3 Dimensions?

28. Dimensionality Reduction

29. Plotting with Outliers

31. Plotting with Outliers

33. Plotting with More Data

35. Plotting with More Data without Outliers