Downloaded 22 times
Uploaded byGrid Dynamics
Faceting with Lucene Block Join Query - Lucene/Solr Revolution 2014
The document discusses the necessity of specialized faceting for Lucene block join queries, detailing the challenges with false positives when aggregating facet counts for products instead of SKUs. It introduces the proposed block join facet component and its expected functionality, emphasizing that facet counts should correspond to parent documents. The document concludes with suggestions for performance improvements and references for further reading.
![Vibe Coding vs. Spec-Driven Development [Free Meetup]](https://cdn.slidesharecdn.com/ss_thumbnails/vibecodingvsspecdrivendevelopment-251209105622-43f455e7-thumbnail.jpg?width=640&height=640&fit=bounds)
Faceting with Lucene Block Join Query - Lucene/Solr Revolution 2014
- 2. Faceting with Lucene Block Join Query
- 3. Agenda 1. Whywe need special faceting for Block Join queries? 1. Proposed Block Join facet component.
- 4. Introducing myself PRIVILEGEDAND CONFIDENTIAL Oleg Savrasov, PhD A programmer Working for Grid Dynamics (griddynamics.com) Work and live in Saint-Petersburg, Russia
- 5.
- 6. Jerrica is lookingfor a dress
- 7. Huge amount ofdresses
- 8. Facet filters help Facet filters Reduced amount
- 9. Tasks to besolved ● Performant Search ● Facet calculation/filtering FacetComponent ?
- 10.
- 11. Aggregated facet counts Facets should count products, not SKU. Expected facets: COLOR Blue : 1 Red : 1 SIZE S : 1 M : 1
- 12. Flat documents don’thelp False positive match for +COLOR:Blue +SIZE:M
- 13. Separate SKU documents q = *:* facet.field = COLOR facet.field = SIZE COLOR Blue : 1 Red : 2 SIZE S : 2 M : 1 Wrong numbers! There is only one product
- 14. Search products only q = *:* fq = scope:product facet.field = COLOR facet.field = SIZE COLOR : 0 SIZE : 0 No such fields in product documents
- 15. Aggregated facet counts Facets should count products, not SKU. Expected facets: COLOR Blue : 1 Red : 1 SIZE S : 1 M : 1
- 16. Solr Block JoinSupport (since Lucene 3.4.0) Green Blue Yello w Yello w Blue Green Product Green Yello w Product Green Blue Yello w Yello w Product docId Child docs Parent doc Query: {!parent which="scope:product"}COLOR:Blue 1 1 1 Block 1 1 scope:product COLOR:Blue 1 ToParentQuery 1 1
- 17. SOLR-5743 Faceting withBlock Join support ● Create BlockJoinFacetComponent ● ToParentQuery is expected ● Facet counts should correspond to amount of parent documents ● Only DocValues fields are supported
- 18. Faceting over DocSetslices Green Blue Yello w Yello w Blue Green Product Green Yello w Product Green Blue Yello w Yello w Product docId 0 1 0 0 1 0 1 DocSet Slice DocSet Slice counts COLOR Blue : 2 Aggregated counts COLOR Blue : +1
- 19. Block Join FacetComponent
- 20.
- 21.
- 22. It works! q= {!parent which="scope:product"}COLOR:Blue child.facet.field = SIZE <response> ... <lst name="facet_counts"> <lst name="facet_fields"> <lst name="SIZE"> <int name="S">14</int> <int name="L">22</int> <int name="XL">17</int> </lst> </lst> </lst> </response>
- 23. The dress isfound
- 24. Further improvements ●Thorough profiling ● Performance improvements ● Algorithmic improvements
- 25. References http://www.slideshare.net/MarkHarwood/proposal-for-nested-document-support-in- lucene http://blog.mikemccandless.com/2012/01/searching-relational-content-with.html http://blog.griddynamics.com/2013/09/solr-block-join-support.html
- 26. Big thanks! Pleasevote for SOLR-5743. Do you have any questions?