• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Better search engine testing for solr
 

Better search engine testing for solr

on

  • 3,103 views

A refactoring of my earlier presentation targeted more towards Solr, and less on testing. I'm basing my presentation for Lucene EuroCon on this. Would love some more feedback!

A refactoring of my earlier presentation targeted more towards Solr, and less on testing. I'm basing my presentation for Lucene EuroCon on this. Would love some more feedback!

Statistics

Views

Total Views
3,103
Views on SlideShare
3,098
Embed Views
5

Actions

Likes
0
Downloads
9
Comments
0

3 Embeds 5

http://twitter.com 2
https://www.linkedin.com 2
https://duckduckgo.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Better search engine testing for solr Better search engine testing for solr Presentation Transcript

    • BETTER SEARCH ENGINE TESTING FOR SOLRCVILLE MEETUP | EPUGH@O19S.COM | @DEP4B 1
    • WHY AM I QUALIFIED TO BE UP HERE?• Principal of OpenSource Connections - Solr Search Consultancy• Member of Apache Software Foundation• Presenter at conferences (OSCON, ApacheCON, UberConf, ExpoQA, STPcon 2009/2011!)• Fascinated by the art of software development 2
    • 3. X Co So m on ingAUTHOR 3
    • FATHER 4
    • AGENDA Why Test Search?Two General Approaches Test Tools for Solr Wrap Up 5
    • REDUCE HUMAN ERROR 6
    • photo credit to Jay Grieves @ www.bigswingingdeveloper.com 7
    • TWO APPROACHES TO TEST Humans Automated Tests 8
    • HUMAN TESTING• Better deals with ambiguity 9
    • RELEVANCY IS LIKEPORNOGRAPHY.... 10
    • I KNOW IT WHEN I SEE IT! http://en.wikipedia.org/wiki/Les_Amants 11
    • AUTOMATED TESTING 12
    • SWEET SPOT• Repeat Testing for Relevancy Tuning• Performance Testing: hitting SLA?• Regression Testing (Typical use case for automated testing) 13
    • “ONE TRUE ANSWER”• Absolute Truth / Matrix / Grid / TREC / Relevancy Assertions • The correct answers for each search are known ahead of time • Humans judges often decide these correct answers, stored as Relevancy Assertions • Can be labor intensive to setup• A “Numerical Grade” is produced for comparision 14
    • SO WHAT IS A JUDGEMENT LIST? 15
    • 16
    • COMPARABLE RESULTS Original AjaxSolr WebSolrgata 4 40.0 80.0 80.0HIF 1 alpha 90.0 100.0 30HIF-1 alpha 100.0 100.0 30HIF1 alpha 70.0 100.0 100.0HIF1A 100.0 100.0 100.0iNOS 60.0 60.0 60.0IRE-1 alpha 30 90.0 90.0 17
    • WRAP UP 18
    • Search  Stack User  Interface Search  Engine Informa3on 19
    • 20
    • 21
    • A HYBRID APPROACH? Humans Automated Tests 22
    • A HYBRID APPROACH? Tool Supported Testing Humans Automated Tests Judgements 23
    • TESTING IS A HUMAN ACTIVITY James Bach, satisfice.com 24
    • THANK YOU!• twitter: dep4b• speakerrate: http://www.speakerrate.com/epugh/• email: epugh@opensourceconnections.com 25 25