Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Usability Testing of a Library Web Site: Librarians and Anthropologists Working Together<br />Allison Cowgill & Amanda Din...
University of Rochester Study<br />Ethnographic approach to studying campus libraries and their users<br />
The Library Study at Fresno State<br />September, 2008 - May, 2009 Goal:  “to discover information about student life that...
“Draw How You Feel When You Write a Paper.”<br />
Library Study Recommendations<br />Provide different search boxes for different kinds of holdings.<br />Attempt a redesign...
Web Usability Workgroup (WUW)<br />Decision to conduct a usability study and the formation of the Web Usability Workgroup ...
Usability Testing <br />Usability Testing demonstrates how users interact with the system. <br />Participants are asked to...
Process <br />Develop a plan <br />Purpose<br />Determine the user group to be tested<br />Pre-survey/Consent form<br />Ta...
Nuts & Bolts   <br />Subjects: Juniors  <br />Sample Size: 42 (plus 10 pre-tests) <br />Recruitment: On-site<br />People: ...
Benefitted from pre-testing and multiple run-throughs with team members and moderators <br />Challenges with script, wordi...
Coding & Data Entry <br />Subject Number, time stamp, task number (1-10) <br />Link Label (words clicked) & URL<br />Notes...
Discussion<br />
Upcoming SlideShare
Loading in …5
×

“Usability Testing of a Library Web Site: Librarians and Anthropologists Working Together”

1,780 views

Published on

Ethnography, Libraries, Library, Web_Design, Usability

Published in: Education
  • Be the first to comment

“Usability Testing of a Library Web Site: Librarians and Anthropologists Working Together”

  1. 1. Usability Testing of a Library Web Site: Librarians and Anthropologists Working Together<br />Allison Cowgill & Amanda Dinscore<br />Henry Madden Library <br />California State University, Fresno <br />California Association of Research Libraries<br />April, 2010 <br />Sacramento, CA<br />
  2. 2. University of Rochester Study<br />Ethnographic approach to studying campus libraries and their users<br />
  3. 3. The Library Study at Fresno State<br />September, 2008 - May, 2009 Goal: “to discover information about student life that campus librarians could use to both increase library usage and improve student users’ experience of library services.” <br />
  4. 4. “Draw How You Feel When You Write a Paper.”<br />
  5. 5. Library Study Recommendations<br />Provide different search boxes for different kinds of holdings.<br />Attempt a redesign that aims for a less institutional, more youthful and content-rich feel.<br />Move toward a Web 2.0 model.<br />Still Needed to know…<br />How do students use the site? <br />What tasks can students accomplish? <br />What assumptions are we making? <br />What can we discover that will inform our re-design? <br />
  6. 6. Web Usability Workgroup (WUW)<br />Decision to conduct a usability study and the formation of the Web Usability Workgroup (WUW)<br />Involvement of Anthropology professor, Hank Delcore, and his students in ANTH 111B (Intermediate Ethnographic Fieldwork) <br />“How people develop and use technological solutions (like the library's website) is one of the most complicated and important areas of modern life, so it's a natural anthropological attention.” Delcore, 2010<br />
  7. 7. Usability Testing <br />Usability Testing demonstrates how users interact with the system. <br />Participants are asked to complete a series of pre-defined tasks and to “think aloud” while completing them. <br />Benefits: <br />See what real users actually do (rather than what they say they do)<br />Provides quantitative data rather than opinion or conjecture <br />Participants complete common tasks (finding a book, article, etc…) <br />
  8. 8. Process <br />Develop a plan <br />Purpose<br />Determine the user group to be tested<br />Pre-survey/Consent form<br />Tasks to be performed (number & time) <br />Script & Moderator Instructions—ensures consistency<br />Test Design—how it will be conducted and how results are to be recorded<br />Pre-test <br />Recruit & test<br />Analyze the results <br />
  9. 9. Nuts & Bolts <br />Subjects: Juniors <br />Sample Size: 42 (plus 10 pre-tests) <br />Recruitment: On-site<br />People: 5 student moderators, 5 WUW members (Anthropology and library faculty)<br />Facilities: 4 small rooms for testing; welcome area <br />Equipment: 4 Macs<br />Software: Screenium<br />Test Documents: <br />Pre-Survey/Consent Form <br />Introduction Script <br />Moderator Instructions<br />Usability Test Activity<br />Cost: $636 ($520 for Starbucks gift cards; Screenium software site licenses $29 per computer) <br />
  10. 10. Benefitted from pre-testing and multiple run-throughs with team members and moderators <br />Challenges with script, wording of questions, issues that we hadn’t previously considered (e.g. using Google) <br />Benefits of using student moderators (objective; offered valuable insight)<br />Talk aloud method was sometimes challenging <br />Testing took less time than we thought<br />On-site recruitment worked better than expected <br />The $10 Starbucks card incentive worked well <br />Subjects took it seriously<br />Software (Screenium) worked well<br />Reflections <br />
  11. 11. Coding & Data Entry <br />Subject Number, time stamp, task number (1-10) <br />Link Label (words clicked) & URL<br />Notes (including quotes from subjects) <br />“Lostness” <br />Codes for task completion<br />Codes for positive & negative comments<br />Codes for non-verbal behaviors such as smiling, frowning, laughing<br />Data Analysis (in process) <br />
  12. 12. Discussion<br />

×