Text-Fabric as a processing tool in an evolving context of research in ancient texts and the organization of the resulting data

1. Text-Fabric in context
Cody Kingham - Dirk Roorda
2020-02-18
Lorentz Center Leiden

2. overview
• the bigger picture
• connections
• evolving context
• knowledge - linked data
• text - fabric - example shebanq
• text-fabric - the system
• shift in sophistication

3. the bigger picture

4. the bigger picture
• lots of unconnected data with potential links

5. the bigger picture
• lots of unconnected data with potential links
- e.g. Hebrew Bible and Greek New Testament

6. the bigger picture
• lots of unconnected data with potential links
- e.g. Hebrew Bible and Greek New Testament
- e.g. Hurrian to Greek Mythology

7. the bigger picture
• lots of unconnected data with potential links
- e.g. Hebrew Bible and Greek New Testament
- e.g. Hurrian to Greek Mythology
• common problems when converting / annotating /
analyzing datasets

8. the bigger picture
• lots of unconnected data with potential links
- e.g. Hebrew Bible and Greek New Testament
- e.g. Hurrian to Greek Mythology
• common problems when converting / annotating /
analyzing datasets
• unique edge cases that can shed light on other edge
cases

12. the bigger picture

13. the bigger picture
• A Decentralized Feedback Loop

14. the bigger picture
• A Decentralized Feedback Loop
- share your work process, not just your data

15. the bigger picture
• A Decentralized Feedback Loop
- share your work process, not just your data
- shared knowledge graphs

16. the bigger picture
• A Decentralized Feedback Loop
- share your work process, not just your data
- shared knowledge graphs
• Distributed Computation

17. the bigger picture
• A Decentralized Feedback Loop
- share your work process, not just your data
- shared knowledge graphs
• Distributed Computation
- recruit and “evangelize” — exponential growth

18. the bigger picture
• A Decentralized Feedback Loop
- share your work process, not just your data
- shared knowledge graphs
• Distributed Computation
- recruit and “evangelize” — exponential growth
• Leverage existing tools (e.g. TF, TAG)

19. connections
Perseus is a practical experiment in which we explore possibilities
and challenges of digital collections in a networked world
Human readable information
Machine actionable knowledge
Machine generated knowledge
http://www.perseus.tufts.edu/hopper/research

20. connections
Perseus is a practical experiment in which we explore possibilities
and challenges of digital collections in a networked world
Human readable information
Machine actionable knowledge
Machine generated knowledge
http://www.perseus.tufts.edu/hopper/research
knowledge

21. connections
Perseus is a practical experiment in which we explore possibilities
and challenges of digital collections in a networked world
Human readable information
Machine actionable knowledge
Machine generated knowledge
http://www.perseus.tufts.edu/hopper/research
knowledge text

22. connections
Perseus is a practical experiment in which we explore possibilities
and challenges of digital collections in a networked world
Human readable information
Machine actionable knowledge
Machine generated knowledge
http://www.perseus.tufts.edu/hopper/research
How to connect all this?
knowledge text

23. evolving context

24. evolving context
philologians
hebrew
babylonian
sanskrit

25. evolving context
philologians
web
developers
jupyter
web

26. evolving context
philologians
linguists
historians
geographers
lexemes
events
places
web
developers

27. evolving context
philologians
linguists
historians
geographers
lexemes
events
places
linked data
specialists
web
developers
semantic web
wordnets
geonames

28. evolving context
philologians
linguists
historians
geographers
linked data
specialists
research software
engineers
web
developers
semantic web
query engines
data models

29. evolving context
philologians
linguists
historians
geographers
linked data
specialists
research software
engineers
web
developers
semantic web
query engines
data models

30. evolving context
philologians
linguists
historians
geographers
linked data
specialists
research software
engineers
web
developers
text-fabric semantic web
query engines
data models

31. evolving context
philologians
linguists
historians
geographers
linked data
specialists
data
scientists
research software
engineers
web
developers
text-fabric semantic weba i
neural networks
machine learning

32. evolving context
philologians
linguists
historians
geographers
linked data
specialists
data
scientists
research software
engineers
web
developers
Ph.D-PostDoc3.1.2rc4
Neo Aramaic
Medieval Arabic
all kinds of Greek
Akkadian
Sumerian
text-fabric semantic weba i

33. evolving context
philologians
linguists
historians
geographers
linked data
specialists
data
scientists
research software
engineers
web
developers
Ph.D-PostDoc3.1.2rc4
text-fabric semantic weba i

34. evolving context
philologians
linguists
historians
geographers
linked data
specialists
data
scientists
research software
engineers
web
developers
Ph.D-PostDoc3.1.2rc4
text-fabric semantic weba i

35. evolving context
philologians
linguists
historians
geographers
linked data
specialists
data
scientists
research software
engineers
web
developers
Ph.D-PostDoc3.1.2rc4
text-fabric semantic weba i

36. knowledge: linked data

37. text -
fabric

38. text -
fabric

39. text -
fabric

40. text -
fabric

41. text -
fabric

42. example: shebanq

43. example: shebanq
shebanq.ancient-data.org

44. what is in a text as graph?
-- text !

45. what is in a text as graph?
-- representations

46. what is in a text as graph?
-- underlying data

47. what is in a text as graph?
-- query results

48. what is in a text as graph?
-- annotations (man-machine)

49. what is in a text as graph?
-- links to other interfaces on the same data

50. what is in a text as graph?
-- links to other interfaces on the same data

51. what is in a text as graph?
-- links to other interfaces on the same data

52. text-fabric: the system

53. text-fabric: the system
github.com/annotation
garden

54. text-fabric: the system
github.com/annotation
nbviewer.jupyter.org/github/annotation/
garden
tutorials

55. text-fabric: the system
github.com/annotation
nbviewer.jupyter.org/github/annotation/
garden
tutorials
hands-on
tutorials/blob/master/lorentz2020/start.ipynb

56. browser - search

57. browser - view in context

58. app framework

59. programming library

60. programming library
built-in: research data exchange

61. shift in sophistication
Hebrew Bible @ WIVU Amsterdam: 1970-2012

62. shift in sophistication
the graph is bigger than you and your database/webapp
Hebrew Bible @ WIVU Amsterdam: 1970-2012

63. shift in sophistication
the graph is bigger than you and your database/webapp
Hebrew Bible @ WIVU Amsterdam: 1970-2012
ETCBC Amsterdam: 2012-2020
BHSA - Dead Sea Scrolls - Peshitta
NINO Cunei: 2017-2020
Uruk - Old Babylonian - Old Assyrian
RU Utrecht: 2019
Q'uran

64. The Future - 2024

65. The Future - 2024
yrs of work30

66. The Future - 2024

67. The Future - 2024

68. The Future - 2024

69. The Future - 2024

70. The Future - 2024

71. The Future - 2024

72. The Future - 2024

73. The Future - 2024

74. The Future - 2024

75. The Future - 2024
02 yrs of work

76. The Future - 2024
02 yrs of work

77. The End
dirk@annotation.nl
dirk.roorda@dans.knaw.nl
cak47@cam.ac.uk