Faceted navigation using django haystack and solr

Faceted Navigation with django-haystack and solrDjangoTO 2012-02-09Craig Nagy @nagyman

What is Faceted Navigation/Browsing?• Visible options for narrowing a set of items based on metadata; interactive query building• Important for e-commerce sites with a signiﬁcant number of products; shared classiﬁcations/metadata• Browse vs Search, Links vs. Forms

Engines with Faceted Search• Commercial: Endeca, FAST Search Server (Microsoft, SharePoint)• Open Source: solr (backed by Apache Lucene), Whoosh, Sphinx (“multi- queries”)• SQL - COUNT, GROUP BY, JOINs, oh my

Solr• Full text, faceted, distributed, amazing performance (Java)• Lucene syntax - title:”The Right Way” AND text:go, text:swim?ing, test~, craig nagy^4• JSON/XML API - transparent with Haystack• Run in a servlet container (e.g. Tomcat); Haystack provides easy local testing (Jetty) - manage.py solr --start• Data is denormalized; documents based on a schema

Solr Schema • All fields to index in schema.xml. Haystack has tools to help generate this file (manage.py build_solr_schema)• _exact fields for facets, multiValued=”true” for lists of data, data types

Haystack• Provides QuerySet-like API to a number of search backends haystack.query.SearchQuerySet • sqs = SearchQuerySet().ﬁlter(content=foo, pub_date__lte=datetime.date(2012, 1, 1))• Mirror your models, and any value you want to index• Automatic content_type handling• Performance Tip: Don’t access unindexed data

Haystack - Indexing• subclass haystack.indexes.SearchIndex.• prepare_<ﬁeldname> or prepare callbacks• manage.py update_index or real-time

Full text indexingPrepare FieldsRegister

Not Included• Not included in Haystack • Views, templates, utilities, generating URLs, handling special data types• Custom Helpers: Searcher, FacetList, Facet, FacetItem, templatetags• Extras: Facet Landing Pages (e.g. Etsy, Zappos, G Adventures)

Facet Parsing• Haystack returns dictionaries of facet data; we parse into custom objects

Template Tagstemplatetags for arranging the faceted navigation

UI Pattern - Integrated Faceted Breadcrumbs (IFB)• http://boxesandarrows.com/view/faceted-ﬁnding-with (by Greg Nudelman)

Integrated Faceted Breadcrumbs

Refs• http://www.ﬂickr.com/photos/morville/collections/72157603789246885/• http://haystacksearch.org/• https://github.com/toastdriven/django-haystack• http://boxesandarrows.com/view/faceted-ﬁnding-with• http://lucene.apache.org/solr/• http://django-haystack.readthedocs.org/en/latest/tutorial.html• http://www.gadventures.com/trips/

Faceted navigation using django haystack and solr

by Craig Nagy

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 1

Statistics

Faceted navigation using django haystack and solr Presentation Transcript