Recently Sensis Online Directories has developed an approach to answer the question of “Is our search relevant?”, based on facts rather than by judgement. Companies who have a search component to their systems can be in discussions where statements like the following are made: “We have a problem Y with the results in this area, If we make this change X, the problem of search goes away”. How do you quantify that a simple change in one area solves an issue, in isolation, without causing flow on affects. This presentation talks about the approach Sensis Online Directories have undertaken to quantify the quality of its search and measure improvement and changes.