The document discusses search implementation and ElasticSearch. It begins with an overview of how search works by indexing documents into an inverted index of tokens and associated document postings. It then provides a Ruby implementation of a basic search index and demonstrates indexing documents and searching the index. The document concludes by describing features of ElasticSearch like its use of HTTP and JSON, schema-free indexing, distributed search capabilities, and Ruby integration.

1. Your Data,
Your Search
Karel Minařík

2. http://karmi.cz
ElasticSearch

3. Your Data,
Your Search
Karel Minařík and Florian Hanke

5. Search is the primary interface
for getting information today.
ElasticSearch

7. http://www.apple.com/macosx/what-is-macosx/spotlight.html

9. WTF?!

10. ???
???

11. # https://github.com/rubygems/gemcutter/blob/master/app/models/rubygem.rb#L29-33
#
def self.search(query)
where("versions.indexed and (upper(name) like upper(:query) or
upper(versions.description) like upper(:query))", {:query => "%#{query.strip}%"}).
includes(:versions).
order("rubygems.downloads desc")
end

13. ???

14. ???

16. Search (mostly) sucks.
Why?
ElasticSearch

17. WHY SEARCH SUCKS?
How do you implement search?
class MyModel
include Whatever::Search
end
MyModel.search "something"

18. WHY SEARCH SUCKS?
How do you implement search?
class MyModel
include Whatever::Search
MAGIC
end
MyModel.search "whatever"

19. WHY SEARCH SUCKS?
How do you implement search?
Query Results Result
def search
@results = MyModel.search params[:q]
respond_with @results
end

20. WHY SEARCH SUCKS?
How do you implement search?
Query Results Result
MAGIC
def search
@results = MyModel.search params[:q]
respond_with @results
end

21. WHY SEARCH SUCKS?
How do you implement search?
Query Results Result
MAGIC +
def search
@results = MyModel.search params[:q]
respond_with @results
end

22. 23px
670px
A personal story...

23. WHY SEARCH SUCKS?
Compare your search library with your ORM library
MyModel.search "(this OR that) AND NOT whatever"
Arel::Table.new(:articles).
where(articles[:title].eq('On Search')).
where(["published_on => ?", Time.now]).
join(comments).
on(article[:id].eq(comments[:article_id]))
take(5).
skip(4).
to_sql

24. Your data, your search.
ElasticSearch

25. HOW DOES SEARCH WORK?
A collection of documents
file_1.txt
The ruby is a pink to blood-­‐red colored gemstone ...
file_2.txt
Ruby is a dynamic, reflective, general-­‐purpose object-­‐oriented
programming language ...
file_3.txt
"Ruby" is a song by English rock band Kaiser Chiefs ...

26. HOW DOES SEARCH WORK?
How do you search documents?
File.read('file1.txt').include?('ruby')

27. HOW DOES SEARCH WORK?
The inverted index
TOKENS POSTINGS
ruby file_1.txt file_2.txt file_3.txt
pink file_1.txt
gemstone file_1.txt
dynamic file_2.txt
reflective file_2.txt
programming file_2.txt
song file_3.txt
english file_3.txt
rock file_3.txt
http://en.wikipedia.org/wiki/Index_(search_engine)#Inverted_indices

28. HOW DOES SEARCH WORK?
The inverted index
MySearchLib.search "ruby"
ruby file_1.txt file_2.txt file_3.txt
pink file_1.txt
gemstone file_1.txt
dynamic file_2.txt
reflective file_2.txt
programming file_2.txt
song file_3.txt
english file_3.txt
rock file_3.txt
http://en.wikipedia.org/wiki/Index_(search_engine)#Inverted_indices

29. HOW DOES SEARCH WORK?
The inverted index
MySearchLib.search "song"
ruby file_1.txt file_2.txt file_3.txt
pink file_1.txt
gemstone file_1.txt
dynamic file_2.txt
reflective file_2.txt
programming file_2.txt
song file_3.txt
english file_3.txt
rock file_3.txt
http://en.wikipedia.org/wiki/Index_(search_engine)#Inverted_indices

30. module SimpleSearch
def index document, content
tokens = analyze content
store document, tokens
puts "Indexed document #{document} with tokens:", tokens.inspect, "n"
end
def analyze content
# >>> Split content by words into "tokens"
content.split(/W/).
# >>> Downcase every word
map { |word| word.downcase }.
# >>> Reject stop words, digits and whitespace
reject { |word| STOPWORDS.include?(word) || word =~ /^d+/ || word == '' }
end
def store document_id, tokens
tokens.each do |token|
# >>> Save the "posting"
( (INDEX[token] ||= []) << document_id ).uniq!
end
end
def search token
puts "Results for token '#{token}':"
# >>> Print documents stored in index for this token
INDEX[token].each { |document| " * #{document}" }
end
INDEX = {}
STOPWORDS = %w|a an and are as at but by for if in is it no not of on or that the then there t
extend self
end
A naïve Ruby implementation

31. HOW DOES SEARCH WORK?
Indexing documents
SimpleSearch.index "file1", "Ruby is a language. Java is also a language.
SimpleSearch.index "file2", "Ruby is a song."
SimpleSearch.index "file3", "Ruby is a stone."
SimpleSearch.index "file4", "Java is a language."
Indexed document file1 with tokens:
["ruby", "language", "java", "also", "language"]
Indexed document file2 with tokens:
["ruby", "song"] Words downcased,
stopwords removed.
Indexed document file3 with tokens:
["ruby", "stone"]
Indexed document file4 with tokens:
["java", "language"]

32. HOW DOES SEARCH WORK?
The index
puts "What's in our index?"
p SimpleSearch::INDEX
{
"ruby" => ["file1", "file2", "file3"],
"language" => ["file1", "file4"],
"java" => ["file1", "file4"],
"also" => ["file1"],
"stone" => ["file3"],
"song" => ["file2"]
}

33. HOW DOES SEARCH WORK?
Search the index
SimpleSearch.search "ruby"
Results for token 'ruby':
* file1
* file2
* file3

34. HOW DOES SEARCH WORK?
The inverted index
TOKENS POSTINGS
ruby 3 file_1.txt file_2.txt file_3.txt
pink 1 file_1.txt
gemstone file_1.txt
dynamic file_2.txt
reflective file_2.txt
programming file_2.txt
song file_3.txt
english file_3.txt
rock file_3.txt
http://en.wikipedia.org/wiki/Index_(search_engine)#Inverted_indices

35. It is very practical to know how search works.
For instance, now you know that
the analysis step is very important.
Most of the time, it's more important than the search step.
ElasticSearch

36. module SimpleSearch
def index document, content
tokens = analyze content
store document, tokens
puts "Indexed document #{document} with tokens:", tokens.inspect, "n"
end
def analyze content
# >>> Split content by words into "tokens"
content.split(/W/).
# >>> Downcase every word
map { |word| word.downcase }.
# >>> Reject stop words, digits and whitespace
reject { |word| STOPWORDS.include?(word) || word =~ /^d+/ || word == '' }
end
def store document_id, tokens
tokens.each do |token|
# >>> Save the "posting"
( (INDEX[token] ||= []) << document_id ).uniq!
end
end
def search token
puts "Results for token '#{token}':"
# >>> Print documents stored in index for this token
INDEX[token].each { |document| " * #{document}" }
end
INDEX = {}
STOPWORDS = %w|a an and are as at but by for if in is it no not of on or that the then there t
extend self
end
A naïve Ruby implementation

37. HOW DOES SEARCH WORK?
The Search Engine Textbook
Search Engines
Information Retrieval in Practice
Bruce Croft, Donald Metzler and Trevor Strohma
Addison Wesley, 2009
http://search-engines-book.com

38. SEARCH IMPLEMENTATIONS
The Baseline Information Retrieval Implementation
Lucene in Action
Michael McCandless, Erik Hatcher and Otis Gospodnetic
July, 2010
http://manning.com/hatcher3

39. http://elasticsearch.org

40. { }
HTTP
JSON
Schema-free
Index as Resource
Distributed
Queries
Facets
Mapping
Ruby
ElasticSearch

41. ELASTICSEARCH FEATURES
HTTP JSON / Schema-free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
# Add document
curl -­‐X POST "http://localhost:9200/articles/article/1" -­‐d '{ "title" : "One" }'
# Query
curl -­‐X GET "http://localhost:9200/articles/_search?q=One"
curl -­‐X POST "http://localhost:9200/articles/_search" -­‐d '{
INDEX TYPE ID
"query" : { "terms" : { "tags" : ["ruby", "python"], "minimum_match" : 2 } }
}'
# Delete index
curl -­‐X DELETE "http://localhost:9200/articles"
# Create index with settings and mapping
curl -­‐X PUT "http://localhost:9200/articles" -­‐d '
{ "settings" : { "index" : "number_of_shards" : 3, "number_of_replicas" : 2 }},
{ "mappings" : { "document" : {
"properties" : {
"body" : { "type" : "string", "analyzer" : "snowball" }
}
} }
}'

42. ELASTICSEARCH FEATURES
HTTP JSON / Schema-free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
# Add document
curl -­‐X POST "http://localhost:9200/articles/article/1" -­‐d '{ "title" : "One" }'
# Query
curl -­‐X GET "http://localhost:9200/articles/_search?q=One"
curl -­‐X POST "http://localhost:9200/articles/_search" -­‐d '{
"query" : { "terms" : { "tags" : ["ruby", "python"], "minimum_match" : 2 } }
}'
# Delete index
curl -­‐X DELETE "http://localhost:9200/articles"
# Create index with settings and mapping
curl -­‐X PUT "http://localhost:9200/articles" -­‐d '
{ "settings" : { "index" : "number_of_shards" : 3, "number_of_replicas" : 2 }},
{ "mappings" : { "document" : {
"properties" : {
"body" : { "type" : "string", "analyzer" : "snowball" }
}
} }
}'

43. ELASTICSEARCH FEATURES
HTTP JSON / Schema-free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
http { GET http://user:password@localhost:8080/_search?q=* => http://localhost:9200/user/_search?q=*
server {
listen 8080;
server_name search.example.com;
error_log elasticsearch-­‐errors.log;
access_log elasticsearch.log;
location / {
# Deny access to Cluster API
if ($request_filename ~ "_cluster") {
return 403;
break;
}
# Pass requests to ElasticSearch
proxy_pass http://localhost:9200;
proxy_redirect off;
proxy_set_header X-­‐Real-­‐IP $remote_addr;
proxy_set_header X-­‐Forwarded-­‐For $proxy_add_x_forwarded_for;
proxy_set_header Host $http_host;
# Authorize access
auth_basic "ElasticSearch";
auth_basic_user_file passwords;
# Route all requests to authorized user's own index
rewrite ^(.*)$ /$remote_user$1 break;
rewrite_log on;
return 403;
}
https://gist.github.com/986390
}

44. ELASTICSEARCH FEATURES
JSON / Schema-free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
ON
HTTP /
JS
{
"id" : "abc123",
"title" : "ElasticSearch Understands JSON!",
"body" : "ElasticSearch not only “works” with JSON, it understands it! Let’s first .
"published_on" : "2011/05/27 10:00:00",
"tags" : ["search", "json"],
"author" : {
"first_name" : "Clara",
"last_name" : "Rice",
"email" : "clara@rice.org"
}
}

45. ELASTICSEARCH FEATURES
HTTP / JSON / Schema-free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X DELETE "http://localhost:9200/articles"; sleep 1
curl -­‐X POST "http://localhost:9200/articles/article" -­‐d '
{
"id" : "abc123",
"title" : "ElasticSearch Understands JSON!",
"body" : "ElasticSearch not only “works” with JSON, it understands it! Let’s first .
"published_on" : "2011/05/27 10:00:00",
"tags" : ["search", "json"],
"author" : {
"first_name" : "Clara",
"last_name" : "Rice",
"email" : "clara@rice.org"
}
}'
curl -­‐X POST "http://localhost:9200/articles/_refresh"
curl -­‐X GET
"http://localhost:9200/articles/article/_search?q=author.first_name:clara"

46. ELASTICSEARCH FEATURES
HTTP / JSON / Schema-free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X GET "http://localhost:9200/articles/_mapping?pretty=true"
{
"articles" : {
"article" : {
"properties" : {
"title" : {
"type" : "string"
},
// ...
"author" : {
"dynamic" : "true",
"properties" : {
"first_name" : {
"type" : "string"
},
// ...
}
},
"published_on" : {
"format" : "yyyy/MM/dd HH:mm:ss||yyyy/MM/dd",
"type" : "date"
}
}
}
}
}

47. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X POST "http://localhost:9200/articles/comment" -­‐d '
{
"body" : "Wow! Really nice JSON support.",
"published_on" : "2011/05/27 10:05:00",
"author" : {
"first_name" : "John",
"last_name" : "Pear",
"email" : "john@pear.org"
}
}'
curl -­‐X POST "http://localhost:9200/articles/_refresh"
curl -­‐X GET
"http://localhost:9200/articles/comment/_search?q=author.first_name:john"

48. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X GET
"http://localhost:9200/articles/comment/_search?q=body:json"
curl -­‐X GET
"http://localhost:9200/articles/_search?q=body:json"
curl -­‐X GET
"http://localhost:9200/articles,users/_search?q=body:json"
curl -­‐X GET
"http://localhost:9200/_search?q=body:json"

49. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X DELETE "http://localhost:9200/articles"; sleep 1
curl -­‐X POST "http://localhost:9200/articles/article" -­‐d '
{
"id" : "abc123",
"title" : "ElasticSearch Understands JSON!",
"body" : "ElasticSearch not only “works” with JSON, it understands it! Let’s first ...",
"published_on" : "2011/05/27 10:00:00",
"tags" : ["search", "json"],
"author" : {
"first_name" : "Clara",
"last_name" : "Rice",
"email" : "clara@rice.org"
}
}'
curl -­‐X POST "http://localhost:9200/articles/_refresh"
curl -­‐X GET "http://localhost:9200/articles/article/1"

50. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
{"_index":"articles","_type":"article","_id":"1","_version":1, "_source" :
{
"id" : "1",
"title" : "ElasticSearch Understands JSON!",
"body" : "ElasticSearch not only “works” with JSON, it understands it! Let’s
"published_on" : "2011/05/27 10:00:00",
"tags" : ["search", "json"],
"author" : {
"first_name" : "Clara",
"last_name" : "Rice",
"email" : "clara@rice.org"
}
}}
The Index Is Your Database.

51. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
Index Aliases
curl -­‐X POST 'http://localhost:9200/_aliases' -­‐d '
{
"actions" : [
{ "add" : {
index_A "index" : "index_1",
"alias" : "myalias"
my_alias }
},
{ "add" : {
"index" : "index_2",
"alias" : "myalias"
index_B }
}
]
}'
http://www.elasticsearch.org/guide/reference/api/admin-indices-aliases.html

52. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
The “Sliding Window” problem
curl -­‐X DELETE http://localhost:9200 / logs_2010_01
logs_2010_02
logs
logs_2010_03
logs_2010_04
“We can really store only three months worth of data.”

53. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
Index Templates
curl -­‐X PUT localhost:9200/_template/bookmarks_template -­‐d '
{
"template" : "users_*", Apply this configuration
for every matching
"settings" : { index being created
"index" : {
"number_of_shards" : 1,
"number_of_replicas" : 3
}
},
"mappings": {
"url": {
"properties": {
"url": {
"type": "string", "analyzer": "simple", "boost": 10
},
"title": {
"type": "string", "analyzer": "snowball", "boost": 5
}
// ...
}
}
}
}
'
http://www.elasticsearch.org/guide/reference/api/admin-indices-templates.html

54. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
$ cat elasticsearch.yml
cluster:
name: <YOUR APPLICATION>
Automatic Discovery Protocol
MASTER
Node 1 Node 2 Node 3 Node 4
http://www.elasticsearch.org/guide/reference/modules/discovery/

55. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
Index A is split into 3 shards, and duplicated in 2 replicas.
A1 A1' A1'' Replicas
A2 A2' A2''
A3 A3' A3''
curl -­‐XPUT 'http://localhost:9200/A/' -­‐d '{
"settings" : {
"index" : {
Shards "number_of_shards" : 3,
"number_of_replicas" : 2
}
}
}'

56. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Index as Resource / Distributed / Queries / Facets / Mapping / Ruby
Im
pr
ce
ove
an
rm
in
de
rfo
xi
pe
ng
h
pe
a rc
rfo
se
rm
e
ov
an
pr
ce
Im
SH
AR
AS
DS
IC
PL
RE

57. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
$ curl -­‐X GET "http://localhost:9200/_search?q=<YOUR QUERY>"
apple
Terms
apple iphone
Phrases "apple iphone"
Proximity "apple safari"~5
Fuzzy apple~0.8
app*
Wildcards
*pp*
Boosting apple^10 safari
[2011/05/01 TO 2011/05/31]
Range
[java TO json]
apple AND NOT iphone
+apple -­‐iphone
Boolean
(apple OR iphone) AND NOT review
title:iphone^15 OR body:iphone
Fields published_on:[2011/05/01 TO "2011/05/27 10:00:00"]
http://lucene.apache.org/java/3_1_0/queryparsersyntax.html

58. ELASTICSEARCH FEATURES
Queries / Facets / Mapping / Ruby
ON
HTTP / JSON / Schema Free / Distributed /
JS
Query DSL
curl -­‐X POST "http://localhost:9200/articles/_search?pretty=true" -­‐d '
{
"query" : {
"terms" : {
"tags" : [ "ruby", "python" ],
"minimum_match" : 2
}
}
}'
http://www.elasticsearch.org/guide/reference/query-dsl/

59. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
Geo Search
curl -­‐X POST "http://localhost:9200/venues/venue" -­‐d '
{ Accepted formats for Geo:
"name": "Pizzeria",
"pin": { [lon, lat] # Array
"location": {
"lat": 50.071712,
"lat,lon" # String
"lon": 14.386832 drm3btev3e86 # Geohash
}
}
}'
curl -­‐X POST "http://localhost:9200/venues/_search?pretty=true" -­‐d '
{
"query" : {
"filtered" : {
"query" : { "query_string" : { "query" : "pizzeria" } },
"filter" : {
"geo_distance" : {
"distance" : "0.5km",
"pin.location" : { "lat" : 50.071481, "lon" : 14.387284 }
}
}
}
}
}'
http://www.elasticsearch.org/guide/reference/query-dsl/geo-distance-filter.html

60. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
Query
http://blog.linkedin.com/2009/12/14/linkedin-faceted-search/

61. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X POST "http://localhost:9200/articles/_search?pretty=true" -­‐d '
{
"query" : {
"query_string" : { "query" : "title:T*"} User query
},
"filter" : {
"terms" : { "tags" : ["ruby"] } “Checkboxes”
},
"facets" : {
"tags" : {
"terms" : { Facets
"field" : "tags",
"size" : 10
}
}
}
}'
# facets" : {
# "tags" : {
# "terms" : [ {
# "term" : "ruby",
# "count" : 2
# }, {
# "term" : "python",
# "count" : 1
# }, {
# "term" : "java",
# "count" : 1
# } ]
# }
# }
http://www.elasticsearch.org/guide/reference/api/search/facets/index.html

62. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X POST "http://localhost:9200/articles/_search?pretty=true" -­‐d '
{
"facets" : {
"published_on" : {
"date_histogram" : {
"field" : "published",
"interval" : "day"
}
}
}
}'

63. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
Geo Distance Facets
curl -­‐X POST "http://localhost:9200/venues/_search?pretty=true" -­‐d '
{
"query" : { "query_string" : { "query" : "pizzeria" } },
"facets" : {
"distance_count" : {
"geo_distance" : {
"pin.location" : {
"lat" : 50.071712,
"lon" : 14.386832
},
"ranges" : [
{ "to" : 1 },
{ "from" : 1, "to" : 5 },
{ "from" : 5, "to" : 10 }
]
}
}
}
}'
http://www.elasticsearch.org/guide/reference/api/search/facets/geo-distance-facet.html

64. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X DELETE "http://localhost:9200/articles"
curl -­‐X POST "http://localhost:9200/articles/article" -­‐d '
{
"mappings": {
"article": {
"properties": {
"tags": {
"type": "string",
"analyzer": "keyword"
},
"content": {
"type": "string",
"analyzer": "snowball"
},
"title": {
"type": "string",
"analyzer": "snowball",
"boost": 10.0
}
}
}
}
}'
curl -­‐X GET 'http://localhost:9200/articles/_mapping?pretty=true'
Remember?
def analyze content
# >>> Split content by words into "tokens"
content.split(/W/).
# >>> Downcase every word
map { |word| word.downcase }.
# ...
http://www.elasticsearch.org/guide/reference/api/admin-indices-create-index.html end

65. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X DELETE "http://localhost:9200/urls"
curl -­‐X POST "http://localhost:9200/urls/url" -­‐d '
{
"settings" : {
"index" : {
"analysis" : {
"analyzer" : {
"url_analyzer" : {
"type" : "custom",
"tokenizer" : "lowercase",
"filter" : ["stop", "url_stop", "url_ngram"]
}
},
"filter" : {
"url_stop" : {
"type" : "stop",
"stopwords" : ["http", "https", "www"]
},
"url_ngram" : {
"type" : "nGram",
"min_gram" : 3,
"max_gram" : 5
}
}
}
}
}
}'
https://gist.github.com/988923

66. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
curl -­‐X PUT localhost:9200/urls/url/_mapping -­‐d '
{
"url": {
"properties": { "url": { "type": "string", "analyzer": "url_analyzer" } }
}
}'
curl -­‐X POST localhost:9200/urls/url -­‐d '{ "url" : "http://urlaubinkroatien.de" }'
curl -­‐X POST localhost:9200/urls/url -­‐d '{ "url" : "http://besteurlaubinkroatien.de" }'
curl -­‐X POST localhost:9200/urls/url -­‐d '{ "url" : "http://kroatien.de" }'
curl -­‐X POST localhost:9200/urls/_refresh
curl "http://localhost:9200/urls/_search?pretty=true&q=url:kroatien"
curl "http://localhost:9200/urls/_search?pretty=true&q=url:urlaub"
curl "http://localhost:9200/urls/_search?pretty=true&q=url:(urlaub AND kroatien)"
https://gist.github.com/988923

67. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
K R O A T I E N
K R O
}
R O A
O A T
Trigrams
A T I
T I E
I E N

68. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
Tire.index 'articles' do
delete
create
store :title => 'One', :tags => ['ruby'], :published_on => '2011-­‐01-­‐01'
store :title => 'Two', :tags => ['ruby', 'python'], :published_on => '2011-­‐01-­‐02'
store :title => 'Three', :tags => ['java'], :published_on => '2011-­‐01-­‐02'
store :title => 'Four', :tags => ['ruby', 'php'], :published_on => '2011-­‐01-­‐03'
refresh
end
s = Tire.search 'articles' do
query { string 'title:T*' }
filter :terms, :tags => ['ruby']
sort { title 'desc' }
http://github.com/karmi/tire
facet 'global-­‐tags' { terms :tags, :global => true }
facet 'current-­‐tags' { terms :tags }
end

69. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
class Article < ActiveRecord::Base
include Tire::Model::Search
include Tire::Model::Callbacks
end
$ rake environment tire:import CLASS='Article'
Article.search do
query { string 'love' }
facet('timeline') { date :published_on, :interval => 'month' }
sort { published_on 'desc' }
end
http://github.com/karmi/tire

70. ELASTICSEARCH FEATURES
HTTP / JSON / Schema Free / Distributed / Queries / Facets / Mapping / Ruby
class Article
include Whatever::ORM
include Tire::Model::Search
include Tire::Model::Callbacks
end
$ rake environment tire:import CLASS='Article'
Article.search do
query { string 'love' }
facet('timeline') { date :published_on, :interval => 'month' }
sort { published_on 'desc' }
end
http://github.com/karmi/tire

72. Try ElasticSearch and Tire with a one-line command.
$ rails new tired -­‐m "https://gist.github.com/raw/951343/tired.rb"
A “batteries included” installation.
Downloads and launches ElasticSearch.
Sets up a Rails applicationand and launches it.
When you're tired of it, just delete the folder.

73. Thanks!
d