Over the last few years, there has been a stronger emphasis on functional programming languages and constructs in mainstream programming. But we are still far from programming nirvana. The real frontier is not the code we write, but the systems we build. Until we move towards "FP" thinking at a system level, we are just going to keep building similarly broken systems, albeit with a nicer GOTO syntax. The lifeblood of your system is data. The data that models the events, facts, and insights of your domain, and how they apply to your users. We have not yet mastered data modeling, and I would surmise that it is the root-cause of many project failures and costly refactors. This talk is an introduction to modeling business data in web applications. Together, we will explore how existing popular solutions model data, why they fail, and how we could do better with surprisingly little effort. The slides may include parentheses and square brackets, given my predilection for alien technologies, but the conclusions are broad and applicable to many.

1. This slide intentionally left blank.

2. This slide intentionally left blank.

3. ORIENTED
ARCHITECTURE
DATA

4. @pithyless

7. OPINIONS

9. ǡ

10. ǡ
Dž

11. ǽǡ
Dž

12. ȓ
ǽǡ
Dž

13. ȓ
ǽǡ
Dž

14. “PRODUCT”

15. INFORMATION
SYSTEMS

17. INFORMATION
SYSTEMS

18. TECHNICAL
DEBT

19. OBJECT-ORIENTED
PROGRAMMING

20. FUNCTIONAL
PROGRAMMING

21. PREACHEDTO
COLLEAGUES

22. PREACHEDTO
ANDFAILED.
COLLEAGUES

25. SOAMVC
DRYTDD

26. SNAKE
OIL

27. ENCAPSULATION

29. MVC

30. MVC

31. SOA

32. MVC
SOA
MVCMVCMVC

33. MVC
SOA
MVC
MVC
MVC

37. DUPLICATION

38. SOURCE
OFTRUTH

41. RELIABILITY

42. CONFIDENCE

43. TYPES/SCHEMAS
ASSERTIONS
PROPERTYTESTING

46. JUST
TOOLS

47. NOTRELIGION

49. DATA

50. DATA
QUEUES

51. DATA
QUEUES

52. DATA
QUEUES

53. PROJECTS
FAIL

54. 1. Not understanding
the domain.

55. 1. Not understanding
the domain.
2. Not modeling
the domain.

56. 1. Not understanding
the domain.
2. Not modeling
the domain.
3. Breaking #1 or #2,
and failing to adapt.

57. SOUL-SEARCHING

58. 1. model essence
of things

59. 1. model essence
of things
2. don’t violate
physics

60. /.

61. 1.DATA
2.FLOW
3.????
4.PROFIT!!!

62. 1.DATA

63. immutable

64. immutability
changeseverything

65. realworld
isimmutable

66. realworld
isimmutable

67. semantic

68. recursive

69. #scalar
string
boolean
number

70. #identity
symbol
keyword

71. #collection
list map
vector
set

72. #custom
#uuid
“de305d54-…”
#inst
“2016-02-18…”

73. 2.FLOW

74. f(A)=B

75. A
f
B

76. f(A)=B

77. 3.???

78. FACTS ➟LOG
QUESTIONS
ANSWERS
➟

79. FACTS

81. Youmustbeshapeless,formless,likewater.
Watercandripanditcancrash.

82. FLATDATA
WATER

83. [eavt]

84. [eavt]
entity

85. [eavt]
entity attribute

86. [eavt]
entity attribute
value

87. [eavt]
entity attribute
value time

88. [eavt]
entity attribute
value time

89. [eavt?]
add / retract?

90. [1 :name “Bob”]

91. [1 :name “Bob” 100]

92. [1 :name “Bob” 100 true]

93. [1 :name “Bob” 100 true]
[1 :likes “Cats” 100 true]

94. [1 :name “Bob” 100 true]
[1 :likes “Cats” 100 true]
…
[1 :likes “Dogs” 111 true]

95. [1 :name “Bob” 100 true]
[1 :likes “Cats” 100 true]
…
[1 :likes “Dogs” 111 true]
Bob likes?

96. [1 :name “Bob” 100 true]
[1 :likes “Cats” 100 true]
…
[1 :likes “Dogs” 111 true]
105 - Cats

97. [1 :name “Bob” 100 true]
[1 :likes “Cats” 100 true]
…
[1 :likes “Dogs” 111 true]
111 - Cats, Dogs

98. [1 :name “Bob” 100 true]
[1 :likes “Cats” 100 true]
…
[1 :likes “Cats” 111 false]
[1 :likes “Dogs” 111 true]
111 - Dogs

99. [1 :likes 2]

100. [1 :name “Bob” 100 true]
[2 :name “Mary” 100 true]

101. [1 :name “Bob” 100 true]
[2 :name “Mary” 100 true]
…
[1 :likes 2 111 true]

102. [1 :name “Bob” 100 true]
[2 :name “Mary” 100 true]
…
[1 :likes 2 111 true]
…
[2 :likes 1 222 true]

103. [1 :likes 2]
[1 :likes [:name “Mary”]]

104. [eavt]

105. LOG

106. APPEND
ONLY

107. TOTAL
ORDER

108. BUSINESSDATA
SOURCECODE

109. Q&A

110. Log Q

111. Log
QDB
QDB
QDB

112. QUERIES!

113. DOYOU
SQLBRO?

115. AUDITING

116. LOG
#index#index

117. RELATIONAL
(ROW)

118. [eavt]
#index#index

119. [:find ?name ?age
:in $db ?id
:where
[?id :actor/name ?name]
[?id :actor/age ?age]]

120. [:find ?name ?age
:in $db ?id
:where
[?id :actor/name ?name]
[?id :actor/age ?age]]

121. [:find ?name ?age
:in $db ?id
:where
[?id :actor/name ?name]
[?id :actor/age ?age]]

122. [:find ?name ?age
:in $db ?id
:where
[?id :actor/name ?name]
[?id :actor/age ?age]]

123. [:find ?name ?age
:in $db ?id
:where
[?id :actor/name ?name]
[?id :actor/age ?age]]

124. RELATIONAL
(COLUMN)

125. [aevt]
#index#index

126. [:find (avg ?age)
:in $db
:where
[_ :actor/age ?age]]

127. [:find (avg ?age)
:in $db
:where
[_ :actor/age ?age]]

128. [:find (avg ?age)
:in $db
:where
[_ :actor/age ?age]]

129. [:find (avg ?age)
:in $db
:where
[_ :actor/age ?age]]

130. GRAPH

131. [avet]
#index

132. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

133. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

134. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

135. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

136. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

137. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

138. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

139. SEARCH

140. inverted
#index#index

141. [:find ?m ?title ?score
:in $db ?query
:where
[(fulltext $db
:movie/title ?query)
[[?m ?title _ ?score]]]]

142. [:find ?m ?title ?score
:in $db ?query
:where
[(fulltext $db
:movie/title ?query)
[[?m ?title _ ?score]]]]

143. [:find ?m ?title ?score
:in $db ?query
:where
[(fulltext $db
:movie/title ?query)
[[?m ?title _ ?score]]]]

144. [:find ?m ?title ?score
:in $db ?query
:where
[(fulltext $db
:movie/title ?query)
[[?m ?title _ ?score]]]]

145. [:find ?m ?title ?score
:in $db ?query
:where
[(fulltext $db
:movie/title ?query)
[[?m ?title _ ?score]]]]

146. [eavt]

147. 4.PROFIT!

148. REALWORLD

149. STREAM
TREEMESH

150. STREAM

151. TREE

152. MESH

153. MESH

154. MESH

155. MESH

156. MESH

157. MESH

158. MESH

159. MESH

160. MESH

161. STREAM
TREEMESH

162. ROI

164. THEORY
APPLIED

165. QUEUES

166. LearnDatalogToday.org

167. SIMULATION/
PROPERTY
TESTING

168. LAMBDAARCHITECTURE

169. @martinkl

170. DATOMIC

171. OM/NEXT

172. CRDT

173. EOF

174. @pithyless

175. [eavt]

176. [1 :name “Bob” 100 true]
[2 :name “Mary” 100 true]
…
[1 :likes 2 111 true]
…
[2 :likes 1 222 true]

177. [:find ?name ?age
:in $db ?id
:where
[?id :actor/name ?name]
[?id :actor/age ?age]]

178. [:find (avg ?age)
:in $db
:where
[_ :actor/age ?age]]

179. [:find ?title
:in $db ?first ?second
:where
[?a1 :actor/name ?first]
[?a2 :actor/name ?second]
[?a1 :actor/movies ?m]
[?a2 :actor/movies ?m]
[?m :movie/title ?title]]

180. [:find ?m ?title ?score
:in $db ?query
:where
[(fulltext $db
:movie/title ?query)
[[?m ?title _ ?score]]]]