Elastic search meetup 20/9/2012

930 views
864 views

Published on

Presentation given by me on the first ElasticSearch NL meetup.

Published in: Technology, Lifestyle, Spiritual
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
930
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
1
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • Survey\n- How many people wrote an ES plugin?\n- How many people are familiar with the ES Faceting code?\n- How many people wrote an ES facet?\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • remember the process, input sent to shards where the search is made. Then faceting kicks in.\n
  • hmm - \nvalues are really tokens (potentially show the A example)\nmemory !!\n
  • \n
  • \n
  • remember - this may lose data. Facets like top X terms may get wrong results\n
  • \n
  • \n
  • \n
  • \n
  • - Date histogram is cool, but only gives you numerical stats\n- We needed to be able to know the top influentials in our data on a week by week basis (or month or what have you)\n-> Faceted Date Histogram was born -> What is it?\n
  • \n
  • \n
  • \n
  • Elastic search meetup 20/9/2012

    1. 1. ElasticSearch NL 20/9/2012
    2. 2. Tonight• Pizza & Beer• Deep dive into faceting ( me :) )• ElasticSearch.com introduction ( Uri/Shay )• More drinks..
    3. 3. Deep Dive into Faceting Boaz Leskes CTO Buzzcapture @bleskes
    4. 4. ?
    5. 5. The lazy dog jumps over a quick brown fox
    6. 6. The lazy dog jumps over a quick brown fox
    7. 7. q = foxThe lazy dog jumps over a quick brown fox 5 times a
    8. 8. The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog The quick brown fox The quickdog jumpsq = fox The lazy brown fox jumps over the lazy dog jumps the brown foxdog over over the lazy The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog
    9. 9. The quick brown fox The quick brown foxjumps quick the lazy fox The over brown dog jumps over the lazy dog 5a jumps over the lazy dogThe quick brown fox The quickdog jumps The lazy brown foxjumps over the lazy dog jumps the brown foxdog over over the lazy 3a 10 aThe quick brown fox The quick brown foxjumps quick the lazy fox The over brown dog jumps over the lazy dog 2a jumps over the lazy dog
    10. 10. "facets": { "o_count": {The quick brown fox "lettercount": { The quick brown foxjumps quick the lazy fox The over brown dog jumps over the lazy dog 5a "letter": "o", jumps over the lazy dog "field": "doc" } } }The quick brown fox The quickdog jumps The lazy brown foxjumps over the lazy dog jumps the brown foxdog over over the lazy 3a 10 a "facets": {The quick brown fox "o_count": { The quick brown foxjumps quick the lazy fox The over brown dog jumps over the lazy dog 2a "type ": "lettercount" jumps over the lazy dog "count": 12 } }
    11. 11. IntermezzoA plugin to register your facet
    12. 12. The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog The quick brown fox The quickdog jumpsq = fox The lazy brown fox jumps over the lazy dog jumps the brown foxdog over over the lazy The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog
    13. 13. Facet Processor parse creates per sharddoc ids Facet Collector Facet doc ids doc values Field Cache
    14. 14. brown 2 5 10 12 dog fox 5 6 12 13quick
    15. 15. brown 2 5 10 12 dog fox 5 6 12 13quick 2 5 brown 6 dog 10 fox quick 12 13
    16. 16. The quick brown fox The quick brown foxjumps quick the lazy fox The over brown dog jumps over the lazy dog 5a jumps over the lazy dogThe quick brown fox The quickdog jumps The lazy brown foxjumps over the lazy dog jumps the brown foxdog over over the lazy 3a 10 aThe quick brown fox The quick brown foxjumps quick the lazy fox The over brown dog jumps over the lazy dog 2a jumps over the lazy dog
    17. 17. Facet Facet Processor Facet Facet Facet reduce internal stream
    18. 18. James 3Charlie 2Adam 2 Eve 1Brown 2Remco 2Adam 2 Eve 1David 3James 2 Jan 2 Eve 1
    19. 19. James 3 James 3Charlie 2 Charlie 2Adam 2 Adam 2 Eve 1Brown 2 Brown 2Remco 2 Remco 2Adam 2 Adam 2 Eve 1David 3 David 3James 2 James 2 Jan 2 Jan 2 Eve 1
    20. 20. James 3 James 3Charlie 2 Charlie 2Adam 2 Adam 2 Eve 1Brown 2 Brown 2 James 5Remco 2 Remco 2 Adam 4Adam 2 Adam 2 Remco 2 Eve 1David 3 David 3James 2 James 2 Jan 2 Jan 2 Eve 1
    21. 21. Facet Processor parseFacet Collector Facet internal streamFacet Processor reduce output multi threaded single thread
    22. 22. Faceted Date Histogram
    23. 23. Existing Machinery
    24. 24. Facet Processor parseFacet Collector Facet internal streamFacet Processor reduce output multi threaded single thread
    25. 25. Facet Processor parse Date Facet Collector Value Processor 10 sept. 17 sept.Value Facet Collector Value Facet Collector Value Facet Value FacetValue Facet Reduce Value Facet Reduce
    26. 26. Thanks! Code is available on github:Letter Count Facet: https://github.com/bleskes/es_nl_meetup_2012_9_20Faceted Date Histogram: https://github.com/bleskes/elasticfacets

    ×