The document discusses challenges in digital research workflows, including issues with discovery and management of digital data as well as traditional metrics for evaluating researchers. It argues that definitions of "data" need updating and practices are limiting progress. The document calls for rethinking how search and metrics are approached in order to make research more reproducible, transparent, and useful to the scientific process.

1. rethinking digital
research
kaitlin thaney
@kaythaney ; @digitalsci
wolfram data summit

2. text text
text

3. discovery
management
the “social”

4. discovery &
delivery

5. changes at the
workbench

6. annotation &
curation

7. social &
administrative

8. significant
(and somewhat silly)
gaps still exist

10. what we know, is
research.

11. research is changing
(as is the research workflow)
text text
text

12. discovery is still
sub-optimal.

13. still the starting point

14. specific DBs no better
(in this case, likely worse)

15. name disambiguation
103-90-2
254-465-1
4-(Acetylamino)phenol
4-13-00-01091 (Beilstein Handbook Reference)
4-Acetaminophenol
4'-Hydroxyacetanilide
4-Hydroxyanilid kyseliny octove
Acetamide, N-(4-hydroxyphenyl)-
Acetamide, N-(p-hydroxyphenyl)-
Acetanilide, 4'-hydroxy-
APAP
N-(4-Hydroxyphenyl)acetamid
N-(4-Hydroxyphenyl)acetamide
N-(4-Hydroxy-phenyl)-acetamide
N-(4-Hydroxyphényl)acétamide
N-(4-Hydroxyphenyl)acetanilide
N-(p-hydroxyphenyl)acetamide
N-Acetyl-4-aminophenol
N-Acetyl-p-aminophenol ...
and the list goes on ...

16. streamline
search

17. our definition of
“data” is changing.
(or, at least, is long overdue to.)

18. mix of digital and
analog mediums
CC-BY-2.0 - Plaxco Lab - http://www.flickr.com/photos/34857812@N04/

19. the non-digital

20. the non-digital
parameters

21. ordering
+
processing
the non-digital

22. protocols
parameters
misc. lit

23. tracking
expiration
calibration

24. wasted ...
$$$
time
resource

25. our practices are
limiting us.
(and in some cases, harming.)

27. 3 Gb/year

28. 9 Gb/PhD
3 Gb/year

29. 30,000,000 Gb/all*
9 Gb/PhD
3 Gb/year
* roughly

30. how much made available?
30,000,000 Gb/all*
9 Gb/PhD
3 Gb/year
* roughly

31. make stupidly simple
... and part of the process.

32. “ Non-reproducible single
occurrences are of no
significance to science. “
- Karl Popper

35. rethink the way we
rank researchers.
(the big, hairy “social” issue.)

36. “ What Des-Cartes did was a good
step. You have added much several
ways, & especially in taking ye
colours of thin plates into
philosophical consideration.
If I have seen further it is by standing
on ye shoulders of Giants. “
- Isaac Newton, 1676

37. locked in old mechanisms.

38. “Right now we're going through a
Cambrian explosion of metrics.”
- Johan Bollen
Nature 465, 864-866 (2010) | doi:10.1038/465864a

39. there’s been a drastic spike in terms of
sheer volume and type

40. citation / impact factor
h - index
weighted citations (eigenfactor, sjr)
“betweenness centrality”
alt-metrics, etc.

41. difficult to ...
harmonise
track /maintain / map
understand
(even still measure)

43. administrators /
funders
as influencers
drivers of
behavioral change

44. we’re battling
tradition, not just
technology.

45. www.digital-science.com
kaitlin@digital-science.com
@kaythaney