1. ELASTICSEARCH
The “new school” search engine

2. About me - @nignatov
• Founder at NodeSpark
• Using PHP since 2006
• Using Drupal since 2009
• Elasticsearch Connector maintainer
• Love to experiment with new technologies

3. After the session you should
know:
• What is Elasticsearch
• How Elasticsearch is working in general
• What you can do with Drupal and
Elasticsearch.
• Roadmap of the project and some
brain food.

4. The main goal
GET INLOVE!
GET INVOLVED!

5. Shay Banon
• http://thedudeabides.com/
• https://github.com/kimchy
• https://twitter.com/kimchy/
Who made Elasticsearch?

6. Why “new school”?

7. Who else is using it?

8. Who is using it?

9. Visit Elastic{ON} to get more

10. • Distributed out of the box - Incredible easy to make cluster, just
start new node!
• High availability
• Real time index/search
• REST API with JSON
• Build on top of Apache Lucene and Open Source
http://github.com/elasticsearch/elasticsearch
• Schema free
• Document oriented
What is Elasticsearch?

11. Vertical and horizontal scaling
S01
S01
S01
S01 S02 S03 S04
+

12. The feature I really love

13. How to install it?

14. How to install it?

15. How to install it?

16. … or Found.no
https://found.no

17. Some terms before we start
RELATIONAL DB ELASTICSEARCH
Database Index
Tables Types
Rows Documents
Column Field

18. Indices API – Create index
index

19. How distributed works?
Node
2
Node
1
PUT /twitter
index:
number_of_shards:3
number_of_replicas:
1P 2P
3P
2P 1R
3R
2R
Node
3
3P 1R3R
2R3R

20. Node
2
Multiple indices
Node
1
1P 2P2R
Node
3
3P 1R3R
PUT /news?pretty
index:
number_of_shards:3
number_of_replicas:1
1NP 2NR 2NP 3NR 3NP 1NR
Node
2
Node
1
1P 2P2R
Node
3
3P 1R3R
PUT /news?pretty
index:
number_of_shards:3
number_of_replicas:1
1NP 2NR 2NP 3NR 3NP 1NR

21. index type id
Index API - Request

22. Node
2
Node
1
PUT /twitter/tweet/1
{….}
1P 2P2R
Node
3
3P 1R3R
Distributed indexing

23. Index API - Response

24. Get API - Req and Res

25. Node
2
Node
1
GET /twitter/tweet/1
1P 2P2R
Node
3
3P 1R3R
Distributed GET

26. PUT the document again or…
Update document

27. Delete document

28. Search API - Request

29. Node
2
Node
1
GET /twitter/_search?
q=vienna
1P 2P2R
Node
3
3P 1R3R
Distributed Search

30. Delete index

31. How full text search works?
Search for: “Drupal Camp Vienna has been
great!”

32. 1. Separate the string into words
2. Create sorted unique list
3. Specify which documents contains this terms
TERMS DOC 1 DOC 2 DOC 3
drupal X X
camp X X
vienna X X
Has X X
been X X
great X
Inverted index

33. Tokenization + Normalization
or
tokenizer + token filters (>=0)
Analysis

34. DSL Query language
Aggregation API (Facets on steroids)
Aliasing
Percolating
GEO searching
Attachments
many more
More features

35. Elasticsearch and Drupal

36. Drupal 7 EcoSystem
1. Elasticsearch Connector
2. EC Search API
3. EC Views
4. EC Statistics
5. EC Watchdog
6. EC Sequence
7. EC Devel

37. Drupal 7 Watchdog

38. Drupal 7 Search API

39. Drupal 8… still patchable!

40. Roadmap
• Drupal Abstraction Layer
• Vagrant, Travis-CI, and automated
tests
• Search API integration
• Stand alone views module
• Statistics / Personalization
• Automatic the “Easy install” library
packing.

41. Brainstorm – Content hub
Site
X
Site
Y
Site
Z
Content
Hub
Feed
Site

42. Brainstorm – Headless
NodeJS
Data
Warehouse
Drupal
CMS
Frontend

43. Brainstorm – SLA Hub
Site
01
Site
02
Site
03
Site
04
Site
05
Support Department
Monitoring

44. Brainstorm - Performance
Web
01
Web
02
Web
03
Web
04
Web
05

45. Special thanks!

46. Thank you!
Questions
?