Search, APIs, capability management and Sensis's journey

Search, APIs,Capability Management and the Sensis Journey Craig Rees

• Project background• Platform selection• Search capability• Relevance• Architecture• Quality management• Hurdles• What’s next Today’s menu

• Sensis helps Australians find, buy and sell • From print directories to a cross-platform lead generator • Sensis publishes over 1.8 Million business listings • Two of the top 10 visited online sites in Australia (WhitePages.com.au and YellowPages.com.au)Sensis

Business objectives• Drive presence in the local search market place• Open up the largest database of business listings in Australia• Reduce the effort required from local search developers Technology objectives• Free to use, we are after the • Develop a total search platform reporting • Relevancy testing as part of the development lifecycle • A framework to identify problem spaces • Manageable platform • Continuous deploymentsProject background

Developer portal

• Support for the search capability team• Structured vs non structured data• Deterministic vs black box• Non propriety code base• Community backing Platform selection

• A/B testing • Machine learningOptimized Lvl 5 • External collaboration • Multiple contexts • Online dashboards • Test environmentsManaged Lvl 4 • Dynamic search refinements • Targets and metrics • Defined team • Regular monitoringMonitored Lvl 3 • Static autosuggest • Basic linguistics • Adhoc processes • Part time teamAdhoc Lvl 2 • Static dictionaries • Individual led innovation • No resources • No reportingUnmanaged Lvl 1 • Out of the box featuresThe Sensis Search capability maturity model*Courtesy of Pete Crawford & Craig Lonsdale

Location Intent Chronology • Name • Type Social Graph • Product • Spatial Device IndividualContext is key

Business Geo Service Data Solr Mashery Business Name Query Data Search MongoDB Handler Service Index API Publisher Reporting Type Query Service Handler Historical search Data Reporting Events OntologiesOur architecture

Business Geo Service Data Solr Mashery Business Name Query Data Search MongoDB Handler Service Index API Publisher Reporting Type Query Service Handler Historical search Data Reporting Events OntologiesData staging

Business Geo Service Data Solr Mashery Business Name Query Data Search MongoDB Handler Service Index API Publisher Reporting Type Query Service Handler Historical search Data Reporting Events OntologiesSearch

Business Geo Service Data Solr Mashery Business Name Query Data Search MongoDB Handler Service Index API Publisher Reporting Type Query Service Handler Historical search Data Reporting Events OntologiesAPI

Business Geo Service Data Solr Mashery Business Name Query Data Search MongoDB Handler Service Index API Publisher Reporting Type Query Service Handler Historical search Data Reporting Events OntologiesAPI proxy

• Moved from a black box Yesterday Today Tomorrow solution to a manageable platform• Deliver search improvements without major code changes• Understand how results were calculated• Identity problems scientifically• Continuously tune and test relevance Evolution of search management

Specific gold sets for each Path Analysis problem space: used to identify  Intent  Spelling & stemming problems  Location spaces  Phrase parsing Features signed off “Gold Sets” only when they make used to define a positive impact to overall quality quality score score (TREC)Problem spaces, quality management & tuning

Search quality analysis and testing

Results examiner

Score analysis

Tuning

Lather, rinse, repeat

• Data redundancy and homogeneity • Solr ranking of rare terms • Intent differentiation • Contextual synonymsHurdles along the way

• Query engine • Facets / autosuggest • Real time tuning • Machine learning • Multi term queries • Scoring thresholds • Content ValueWhere next?

Email: craig.rees@sensis.com.au www: developers.sensis.com.au Twitter: @SensisAPI @ablebagelQuestions?

Search, APIs, capability management and Sensis's journey

by ablebagel on May 26, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

Statistics

Search, APIs, capability management and Sensis’s journey — Presentation Transcript