This document discusses the evolution of data from structured databases to modern unstructured big and small data. It notes that while big data gets most attention, comparatively little data falls into that category. Between the size and unstructured nature of data today, it is surprising that any information can be found, and it is difficult to ask the right question to uncover what you need as you often only get one chance.

1. All Data Big and Small
May 2011
10.20.2005

2. http://redmonk.com/public/lucene.pdf
2

3. In the beginning, there was
the database...
3

4. 1979 1983 1989
4

5. When you have a hammer
and so on
5

6. Source: http://www.flickr.com/photos/pagedooley/2234031789/
6

7. December 29, 2004
7

8. The Cambrian Non-relational
Explosion
8

9. Source: http://www.pnas.org/content/97/9/4426/F1.expansion.html
9

10. 10

11. Why?
11

12. Different tools for
different jobs
12

13. Or, rather, different data
13

14. A lot of different data
14

15. 15

16. Most of the attention goes to
Big Data
16

17. In spite of the fact that
comparatively few have it
17

18. Less heralded is unstructured data
18

19. 19

20. Between the size and (un)structure,
it's amazing anything gets found
20

21. 21
Source: http://www.flickr.com/photos/28705377@N04/4142872268/

22. It's hard to ask the right question
22

23. To make matters worse,
you may only get one chance
23

24. The most important answer
is the next question
24

25. Some questions
25

26. 26

27. 27

28. 28

29. 29

30. 30

31. OTHER
QUESTIONS
31