The document discusses search technologies like Lucene, Solr, Elasticsearch and Groonga. It covers basic search tools like grep and describes algorithms like n-gram for fragment-level searching. The text explains how n-gram works by splitting documents into multiple fragments and using those fragments to find matches across different records. It also provides examples of using 1-gram, 2-gram and 3-gram techniques for search.

1. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
2019.01.22 オタクが最新技術を追うライトニングトークイベント２回目

2. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
• 2018 10
• Fantia
Ruby, JavaScript
Java
2

3. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
●
●
●
●
●
●
●
3

4. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
< >
●
●
4

5. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
: Full text search
Wikipedia
5
( )

6. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
6

7. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
7
Apache Lucene Java
Whoosh Python
Apache Solr
Elasticsearch
Groonga C
Google
Fess

8. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
≒
8

9. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
• grep
•
9

10. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
grep
⇒
10

11. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
•
< >
• Linux grep
• Ctrl+F 11

12. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
⇒
12

13. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
13
Ruby , Ruby 2

14. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
< >
• Google
• RDB (B-Tree)
• ( )
14

15. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
15

16. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
( )
2,3
16

17. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
ID
1
2
3
17
ID
2, 3
1, 2
3
1, 2, 3
1, 3
2
2
( )
N-Gram

18. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
→ ID
2, 3
1, 2
3
1, 2, 3
1, 3
2
2
ID
1
2
3
18
( )

19. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
19
⇒

20. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
20
⇒ ...
•
• N-Gram

21. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
21

22. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
↓ ...
6
22

23. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
N-Gram
< >
23

24. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
N-Gram
N
24

25. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
N-Gram
< > 2-Gram
↓ 2 ...
10
25

26. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
N-Gram
< >
< >
N( )
26

27. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
27

28. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
< >
• →
• 2-Gram →
⇨ 28

29. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
N-
Gram
29
N-Gram

30. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
•
•
•
N-Gram
– ⇒ N-Gram
– ⇒
–
⇒ N-Gram + 30

31. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
Fantia
• N-Gram
31

32. Copyright (C) 2019 Toranoana Inc. All Right Reserved.
32