Visualizing Search-Term Relevance, Boolean Operators, and Phrases using the CirSA Chart Ratvinder Grewal, PhD Dept. of Mat...
What and Why <ul><li>Major current search engines reviewed </li></ul><ul><li>Use a visual representation to overcome this ...
CirSA ( Cir cle- S ector- A rc) Chart <ul><li>No. of terms in the query </li></ul><ul><li>Individual term relevance </li><...
Usability Testing <ul><li>Previous tests have shown: </li></ul><ul><ul><li>Users are aware terms in a multi-term query do ...
Test One: Decoding Boolean operators from a CirSA chart <ul><li>Objective:  Test whether users can decode Boolean operator...
Test Two: Specify Boolean operators and phrases onto a CirSA chart <ul><li>Objective:  Test whether users can specify Bool...
Interested in knowing more?  Read the full article in the conference proceedings for InSciT 2006. Visualizing Search-Term ...
Upcoming SlideShare
Loading in...5
×

Visualizing Search Term Relevance, Boolean Operators, and Phrases using the CirSA Chart

1,142
-1

Published on

Ratvinder Singh Grewal
Dept. of Mathematics and Computer Science, Laurentian University, Ramsey Lake Road, Sudbury, ON, Canada.

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,142
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Visualizing Search Term Relevance, Boolean Operators, and Phrases using the CirSA Chart

  1. 1. Visualizing Search-Term Relevance, Boolean Operators, and Phrases using the CirSA Chart Ratvinder Grewal, PhD Dept. of Mathematics & Computer Science Laurentian University Sudbury, ON P3E 2E6 [email_address] http://www.cs.laurentian.ca/rsgrewal/ Funded by LURF
  2. 2. What and Why <ul><li>Major current search engines reviewed </li></ul><ul><li>Use a visual representation to overcome this problem </li></ul><ul><li>Major current search engines reviewed </li></ul><ul><ul><li>Overall relevance score undefined </li></ul></ul><ul><ul><li>Contribution of each term not revealed </li></ul></ul><ul><ul><li>How much relevance does the ambiguous term bulb contribute towards the search query energy saving bulb ? </li></ul></ul><ul><ul><li>Can the average user understand the query ((beetle OR bug) AND convertible) AND NOT “mark 2” ? </li></ul></ul>
  3. 3. CirSA ( Cir cle- S ector- A rc) Chart <ul><li>No. of terms in the query </li></ul><ul><li>Individual term relevance </li></ul><ul><li>Relative relevance </li></ul><ul><li>Overall relevance </li></ul><ul><li>Term irrelevance (i.e., NOT) </li></ul><ul><li>Boolean operators between terms </li></ul><ul><li>2D circle </li></ul><ul><li>Represent relevance of a search result </li></ul><ul><li>Specify relevance of a search query </li></ul>( beetle OR bug ) AND NOT convertible <ul><li>Divided into equal sectors (e.g., 3) </li></ul><ul><li>Each term is allocated a unique colour </li></ul><ul><li>An arc is drawn in each sector </li></ul>80% 60% 10% How it works: What it shows: It can be used to: <ul><li>Each sector represents a term in the query </li></ul><ul><li>The area covered by the arc is the same colour and in proportion to the relevance of the term </li></ul>
  4. 4. Usability Testing <ul><li>Previous tests have shown: </li></ul><ul><ul><li>Users are aware terms in a multi-term query do not have equal importance. </li></ul></ul><ul><ul><li>Using the CirSA chart users can correctly assess the ranking of simulated search-engine results for multi-term queries that have unequal overall relevance. </li></ul></ul><ul><ul><li>User can correctly shade each sector of a CirSA chart in proportion to the relevance of the term represented by that sector. </li></ul></ul><ul><ul><li>Users find the CirSA chart the easiest representation to interpret compared to other visual and non-visual representations tested. </li></ul></ul><ul><ul><li>Users more accurately rank CirSA charts than the other representations tested. </li></ul></ul><ul><ul><li>User can correctly rank CirSA charts representing simulated search-engine results that have the same overall relevance but unequal term relevance. </li></ul></ul><ul><li>New tests will see if users can: </li></ul><ul><ul><li>Decode a CirSA chart representing Boolean operators? </li></ul></ul><ul><ul><li>Specify Boolean operators onto a CirSA chart? </li></ul></ul><ul><ul><li>Intuit how to specify phrases onto a CirSA chart? </li></ul></ul>
  5. 5. Test One: Decoding Boolean operators from a CirSA chart <ul><li>Objective: Test whether users can decode Boolean operators from the CirSA chart. </li></ul><ul><li>Task: Using the information shown on the CirSA chart rewrite the simulated search query inserting Boolean operators between the appropriate terms/phrases. </li></ul>beetle bug convertible ----------------------------------------------- beetle OR bug AND NOT convertible E.G. <ul><li>Results: </li></ul>Find out in the article!
  6. 6. Test Two: Specify Boolean operators and phrases onto a CirSA chart <ul><li>Objective: Test whether users can specify Boolean operators onto a CirSA chart, and intuit how phrases should be specified. </li></ul><ul><li>Results: </li></ul><ul><li>Task: Identify the terms/phrases in the simulated query by circling them in a different colour. Assign each term/phrase an arbitrary percentage to represents its relevance, and then represent this relevance and the Boolean operators onto the CirSA chart. </li></ul>(beetle OR bug) AND NOT convertible 70% 50% 90% E.G. Find out in the article!
  7. 7. Interested in knowing more? Read the full article in the conference proceedings for InSciT 2006. Visualizing Search-Term Relevance, Boolean Operators, and Phrases using the CirSA Chart Further reading: Grewal, R. S., Jackson, M., Wallis, J. and Burden, P. (1999) Using Visualisation to Interpret Search Engine Results. In Clarke, D., Dix, A. and Dix, F. (eds.) Proceedings of The Active Web . Staffordshire University, UK, 20 January. Staffordshire University, UK, pp. 15-25. Grewal, R. S., Jackson, M., Burden, P. and Wallis, J. (1999) A Novel Interface for Interpreting Search Engine Results. Proceedings of Lost in the Web: Navigation on the Internet. Savoy Place, London, 2 November. Savoy Place, London: IEE Press, pp. 7/1-7/10. Grewal, R. S., Jackson, M., Burden, P. and Wallis, J. (2000) A Visual Representation of Search-engine Queries and their Results. In Li, Q., Ozsoyoglu, Z. M., Wagner, R., Kambayashi, Y. and Zhang, Y. (eds.) Proceedings of the 1 st International Conference on Web Information Systems Engineering. Hong Kong, China, 19-21 June. Los Alamitos, California: IEEE Computer Society Press, pp. 352-356. Grewal, R. S., Jackson, M., Burden, P. and Wallis, J. (2000) A Visual Technique to Indicate Overall and Component Relevancy of Search-engine Results. In Tjoa, A. M., Wagner, R. R. and Al-Zobaidie, A. (eds) Proceedings of the 11 th International Workshop on Database and Expert Systems Applications (DEXA). Greenwich, London, 4-8 September. Los Alamitos, California: IEEE Computer Society Press, pp. 608-612. Grewal, R. S. (2001) A Visual Metaphor-Based Tool for a Search-engine User Interface. Ph.D. Thesis, University of Wolverhampton.

×