Elasticsearch Overview

1. Search & Analyze Data in Real Time
ELASTICSEARCH

2. agenda
1- Full Text Search
2- Elasticsearch Overview
3- Basic Concepts
4- Elasticsearch Users
5- Real World Use Cases
6- Plugins

3. fulltextsearch

4. fulltextsearch
Like
Select * from Article
nolock where
ArticleTitleManset Like
'%kitap%' or ArticleText
Like '%kitap%'
It controls all rows

5. fulltextsearch
Why Full Text Search?
Making Text Searchable

6. fulltextsearch

7. fulltextsearch

8. fulltextsearch
INVERTED INDEX

9. fulltextsearch
Full Text Search Databases

10. fulltextsearch
Full Text Search Engines

11. fulltextsearch
Full Text Databases versus Full Text Search Engines
CAP THEOREM
Distributed systems are
not guarantee to provide
these three terms :

12. fulltextsearch
Full Text Databases versus Full Text Engines

13. whatıselastıcsearch?

14. whatıselastıcsearch?
Real Time Search & Analytics Engine

15. whatıselastıcsearch?
Open Source - Apache Licence
https://github.com/elastic/elasticsearch

16. whatıselastıcsearch?
Written In Java - Support Cross Platform
Elasticsearch Requires Java!!!

17. whatıselastıcsearch?
Built On Top Of Lucene ● Very Popular, Full Text Search Library
● Project Based

18. whatıselastıcsearch?
Document Oriented(JSON) - Restful Api

19. whatıselastıcsearch?
Distributed

20. whatıselastıcsearch?
History
Elasticsearch created by Shay Bannon. Before Elasticsearch,
Shay Bannon ‘s first product is Compass.Compass created
on 2004 to “scalable search solution” and also built on
Lucene.
In February 2010, Compass development was
stopped by Shay Bannon and Elasticsearch
released.

21. basıcconcepts

22. BASICCONCEPTS
ELASTICSEARCH STRUCTURE

23. BASICCONCEPTS
Elasticsearch Flow
At first, Data should index
to Elasticsearch
Then you can search!

24. BASICCONCEPTS
Analyzers

25. BASICCONCEPTS
Analyzers
Character Filter
+
Tokenizer
+ =
Token Filter
+
Token Filter
ANALYZER

26. BASICCONCEPTS
Mapping Data
Unlike Solr and Sphinx, Elasticsearch is scheme-free.
Mapping can change on the fly.

27. BASICCONCEPTS
Types
Others
IPV4
Attachment

28. BASICCONCEPTS
Relevance
By Default, results are returned in descending order
of Relevance.
Term Frequency
Inverse Document Frequency
Field - Length Norm

29. BASICCONCEPTS
Scoring & Boosting
For custom scoring, increase
boost value

30. elastıcsearchusers

31. whouses?

32. realworldusecases

33. usecases
ALL DATA TYPES SEARCHING

34. usecases
https://qbox.io/blog/boston-elasticsearch-
meetup-scoring-images-by-color
IMAGE SEARCHING

35. usecases
GEOLOCATION SEARCHING & DISTANCE CALCULATION
https://github.com/varunpant/AroundMe

36. usecases
CENTRALIZED LOGGING
Loggly built in Elasticsearch
and Kibana

37. usecases
DATA ANALYZING

38. usecases
ALERT SYSTEM

39. plugıns&products

40. PLUGINS
HEAD
Web Front End Browsing to Elasticsearch
Data and Cluster Management

41. PLUGINS
SENSE
Web Querying Plugin

42. PLUGINS
KOPF
Web Administration Tool
for Elasticsearch

43. Products
LOGSTASH
● Logging
● Event sourcing
● Archiving
● Alert Data
● Monitoring Data

44. Products
KIBANA
Browser based search and analytics
dashboard for Elasticsearch.
Open Source data visualization platform,
powerful graphics.

45. Products
LOGSTASH & KIBANA

46. Products
WATCHER
Alerting For Elasticsearch Data &
Cluster
● Command
● Email
● JIRA
● OpsGenie
● SNS
● Hipchat
● Slack
● Debug

47. Products
SHIELD
Protect your data with Shield
Role Based Security, Encyrption,
IP Filtering

48. Mustafa Dağdelen
happysearchıng!