You want to give your site visitors the best user experience. To accomplish this, your visitors can search as well as browse your content. Search is only relevant when results are meaningful to the visitor. In this talk, Jettro will introduce you to the concepts like precision, recall and relevancy. Jettro uses Examples to show concepts in the context of search, autocomplete, suggestions and grouping of results. Used technologies are Angular, Java and elasticsearch. After the presentation you'll have a good idea about the steps you need to take te present your visitors relevant results.

1. Big Data:
Relevant search results (with elasticsearch)
Jettro Coenradie
AMSTERDAM 16-17 MAY 2017

5. RELEVANT SEARCH
RESULTS

6. RELEVANT -
SOMETHING DIRECTLY RELATED,
CONNECTED OR PERTINENT TO A TOPIC
Wikipedia

7. PRECISION
▸Make sure that all results are relevant

8. RECALL
▸Don’t hide relevant results

9. TRADE-OFF BETWEEN PRECISION AND RECALL

10. RELEVANT RESULTS
▸Ranked content based on the needs of
your users.

11. WHAT TO SEARCH FOR?

12. TEACH YOUR SEARCH ENGINE
IMPORTANT FEATURES ABOUT YOUR
CONTENT

13. CONTENT
▸ Album in Rolling Stone Top 500
of all times.
OK COMPUTER
RADIOHEAD
1997
CAPITOL
OK IS WHERE RADIOHEAD BEGAN PULLING AT THEIR
SOUND LIKE TAFFY, NOT WORRYING IF IT WAS STILL
"ROCK." THE RESULT IS A SLOW, HAUNTING ALBUM
WITH UNFORGETTABLE TRACKS SUCH AS "KARMA
POLICE" AND "PARANOID ANDROID." GUITARIST
JONNY GREENWOOD ARRANGED WHITE-NOISE
STRINGS, AND THOM YORKE MADE ALIENATION
FEEL ALLURING.

14. FEATURES
OK COMPUTER
RADIOHEAD
1997
CAPITOL
OK IS WHERE RADIOHEAD BEGAN PULLING AT THEIR
SOUND LIKE TAFFY, NOT WORRYING IF IT WAS STILL
"ROCK." THE RESULT IS A SLOW, HAUNTING ALBUM
WITH UNFORGETTABLE TRACKS SUCH AS "KARMA
POLICE" AND "PARANOID ANDROID." GUITARIST
JONNY GREENWOOD ARRANGED WHITE-NOISE
STRINGS, AND THOM YORKE MADE ALIENATION
FEEL ALLURING.
162
TITLE
ARTIST
CREATION YEAR
LABEL
INFORMATION
LIST RANK

15. HELP YOUR SEARCH ENGINE TO RANK
DOCUMENTS USING SIGNALS IN YOUR
QUERIES.

16. ONLY ALBUMS FROM THE LABEL ‘CAPITOL’ ARE IMPORTANT
SIGNALS
SEARCHED WORD IN TITLE IS MORE IMPORTANT THAN IN INFORMATION
RECENT ALBUMS ARE MORE IMPORTANT THAN OLDER ALBUMS
HIGHER RANKED ALBUMS ARE MORE IMPORTANT

17. CALCULATE A SCORE
TF / IDF

18. HOW DOES SEARCH
WORK?

20. PURE JAVA IMPLEMENTATION
public class AlbumRepository {
private Set<Album> albums;
public List<Album> findAlbumsBy(String search, int from, int to){
return albums.stream()
.filter(a -> (a.getYear() >= from && a.getYear() <= to))
.filter(a -> a.getInformation().contains(search))
.collect(toList());
}
}

21. MATCH YOUR SEARCH STRING TO THE AVAILABLE DOCUMENTS

24. LOWERCASING / TYPOS
PURE JAVA IMPLEMENTATION
SCORING/RANKING
STEMMING / SYNONYMS
public class AlbumRepository {
private Set<Album> albums;
public List<Album> findAlbumsBy(String search, int from, int to){
return albums.stream()
.filter(a -> (a.getYear() >= from && a.getYear() <= to))
.filter(a -> a.getInformation().contains(search))
.collect(toList());
}
}

25. SEARCH ENGINE
APPROACH

26. SEARCH ENGINE
APPROACH

27. QUERY VERSUS FILTER CONTEXT
▸ Query Context
▸ How well does this document match this query clause? (Score)
▸ Filter Context
▸ Does this document match this query clause? (true or false)

30. USING THE INVERTED
INDEX

31. USING AN INVERTED INDEX

32. USING AN INVERTED INDEX

33. FROM TEXT TO TERMS
CREATING THE INVERTED INDEX

34. compelling melodies in songs like
"Masters of War" and "Blowin' in the Wind"

35. compelling melodies in songs like
"Masters of War" and "Blowin' in the Wind"
compelling
melodies
songs
like
masters
war
blowin
wind

36. compelling melodies in songs like "Masters of War" and "Blowin' in the Wind"
compelling melodies in songs like Masters of War and Blowin in the Wind

37. compelling melodies in songs like "Masters of War" and "Blowin' in the Wind"
compelling melodies in songs like Masters of War and Blowin in the Wind
compelling melodies in songs like Masters of War and Blowin in the Wind

38. compelling melodies in songs like "Masters of War" and "Blowin' in the Wind"
compelling melodies in songs like Masters of War and Blowin in the Wind
compelling melodies in songs like Masters of War and Blowin in the Wind
compelling melodies in songs like masters of war and blowin in the wind
Lowercase
compelling melodies in songs like masters of war and blowin in the wind
Stop words
compelling melodies songs like masters war blowin wind
Synonyms
storm

39. CREATING THE MAPPING
SPECIFYING THE FEATURES

40. {
"album": {
"properties": {
"id": { "type": "long" },
"album": {
"type": "keyword",
"fields": { "analyzed": { "type": "text" } }
},
"artist": {
"type": "keyword",
"fields": { "analyzed": { "type": "text"} }
},
"image": { "type": "keyword" },
"information": { "type": "text" },
"label": { "type": "keyword" },
"order": { "type": "long" },
"sequence": { "type": "long" },
"tags": { "type": "keyword" },
"year": { "type": "long" }
}
}
}

41. START SEARCHING

43. MORE SEARCH

44. USE SYNONYMS

45. YOU TWO => U2

46. USE EDGE-NGRAMS

47. c
Coldplay
co
col
cold
coldp
coldpl
coldpla
coldplay

48. CONCLUDING

49. QUESTIONS
@jettroCoenradie
https://www.linkedin.com/in/jettro/
https://github.com/jettro
https://amsterdam.luminis.eu/author/jettro/
https://rolling500.luminis.amsterdam