Usability Test Results Analysis

1,492 views
1,435 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,492
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Usability Test Results Analysis

  1. 1. SOLRpac
Usability
Test
Results
Analysis
 Question 1: You need to read The Sound and the Fury by William Faulkner for a literature course and you don't want to buy the book. Does the library own it and is it available in King Library? Completed: 14 Not completed: 0 Average time: 32 seconds Methods Utilized: Title search: 12, 75% Keyword search: 3, 19% Author search: 1, 6% Comments: concern that King library was lower on the list than Hamilton and others should have done a title search quot;this one is easier to readquot; - comparing the item location display with classic view Question 1a: Where is it located? Completed: 14 Not completed: 0 Average time: 5 seconds Methods Utilized: Browse page: 14, 100% Comments: didn't scroll down to see if it was available from other libraries Question 1b: You want to go get the book but there's no paper around to write down the location. The system has a feature that texts book and location information to your cell phone. How would you do that?
  2. 2. Completed: 13 Not completed: 1 Average time: 15 seconds Methods Utilized: Browse page: 12; 86% Advanced search options: 1; 7% Request item: 1, 7% Comments: quot;that's really good. I hate when I write it down and later I look at it and say I don't know what this is..quot; quot;Hm. Very cool.quot; quot;That is really nice, I could definitely see a lot of use for that.quot; quot;I really like that a lotquot; quot;Super usefulquot; quot;This would be the last thing I would attempt to do.quot; Question 2: You need to get some other novels written by William Faulkner, author of The Sound and the Fury. Show me how you would do that. Completed: 13 Not completed: 1 Average time: 1:06 minutes Methods Utilized: Author search: 9; 64% Keyword search: 2; 14% Incorrect use of facets: 2; 14% Author link: 1; 7% Comments: she thought there was a better way to do search but couldn't figure it out - 1-03 quot;okay, not clickablequot; referring to author's name quot;there's no a start over, is there?quot; quot;it'd be really nice if i could just click his name.quot; quot;there might be an author thing here...i guess notquot; - referring to facets sidebar Question 2a:
  3. 3. After you've found some books, you want to save them somehow so you can get back to them easily. Tag the items quot;ENG 142quot; so you can find them later. Completed: 13 Not completed: 1 Average time: 22 seconds Methods Utilized: Browse page: 13; 100% Comments: didn't notice button status change... didn't understand question / didn't understand concept of tagging quot;oh...that's really cool too.quot; Question 3: This literature course requires you to write a paper about Faulkner and his writings. You need to find some books written about William Faulkner. How would you do that? Completed: 11 Not completed: 1 Average time: 28 seconds Methods Utilized: Subject search: 11; 92% Keyword search: 1; 8 % Comments: with reference to facet: quot;very fancyquot; user said they'd like to see a description of item...such as an abstract.. liked the google books link quot;is there a search within results?quot; used google books link Question 3a: Can you find books in this set of results that are about quot;Yoknapatawpha Countyquot;? Completed: 10 Not completed: 4 Average time: 1:13 minutes
  4. 4. Methods Utilized: Advanced search options: 10; 48% Correct use of facets: 6; 29% Keyword search: 3; 14% Subject search: 1; 5% Ctrl-f: 1; 5% Comments: quot;there should be a way to search within thisquot; quot;is there a way to search through these resultsquot; quot;is there a search within results?quot; quot;i don't know how you would do that..search within the search.quot; Question 4: You are writing a paper on aspects of economic recessions for an Econonomics course. Can you find some available books on this subject? Completed: 14 Not completed: 0 Average time: 45 seconds Methods Utilized: Keyword search: 8; 50% Subject search: 8; 50% Comments: User said they are used to a quot;start overquot; link Question 4a: Where are they located? Completed: 14 Not completed: 0 Average time: 5 seconds Methods Utilized: Browse record: 14; 100% Comments:
  5. 5. - Question 4b: You need to compile a bibliography for the paper. Can you export one of the books to your RefWorks account? Completed: 12 Not completed: 0 Average time: 19 seconds Methods Utilized: Browse record: 12; 100% Comments: don't have refworks account Question 4c: If you don't have a RefWorks account, can you figure out how to get the citation for your bibliography? Completed: 11 Not completed: 2 Average time: 15 seconds Methods Utilized: Browse record: 10; 91% Mark this record: 1; 9% Comments: quot;if i don't have it then usually i use some other citation machinequot; quot;like this a lotquot; user said would just do it the traditional way typically quot;that's pretty sweet.quot; Question 5: You are taking a history course and your instructor wants you to read articles from his favorite journal, The Public Historian. Does the library own this journal?
  6. 6. Completed: 13 Not completed: 1 Average time: 43 seconds Methods Utilized: Title search: 12; 42% Keyword search: 4; 14% Advanced search options: 5; 18% Looked for journal title option: 7; 25% Comments: looking for quot;journal titlequot; in drop box quot;that's pretty coolquot; referring to browse by format Question 5a: Where is it located? Completed: 13 Not completed: 1 Average time: 5 seconds Methods Utilized: Browse record: 13; 100% Comments: didn't know what quot;king perquot; meant Question 6: You're taking a high level French course which requires you to read and report on any fiction book written in French. How would you find this item? Completed: 11 Not completed: 3 Average time: 1:26 minutes Methods Utilized: Browse and facets: 6; 35% quot;french fictionquot; keyword search: 4; 23%
  7. 7. quot;french fictionquot; subject search: 4; 23% Search and facets: 2; 12% french keyword search: 1; 6% Comments: quot;usually i just walk over to sectionquot; quot;this one has me stumpedquot;

×