User testing for
the rest of Us
Youse are testing
for the rest of us
Web Directions User Experience 08
Melbourne

lnterpreting the Web
lnterpreting the Web
Usability Research
Usability research
Expert Review
Expert Review Review
Comparative
Comparative Review
User Testing
User Testing
Reducing Costs
Reducing Costs
Tips & Tricks…
Hati Hati!
Interpreting the Web

Usability = Translation

Interpreting the web
Bilingual
Fluent
Conduits
Ethics

Usability Research
lnterpreting the Web
lnterpreting the Web
Usability Research
Usability research
Expert Review
Expert Review Review
Comparative
Comparative Review
User Testing
User Testing
Reducing Costs
Reducing Costs
Tips & Tricks…
Hati Hati!

lnterpreting the Web
Usability research
Expert Review
Comparative Review
User Testing
Reducing Costs
Expert Review Tips & Tricks…

“Do error messages avoid an
anthropomorphic tone?”

“Do error messages avoid an
anthropomorphic tone?”

Usability Heuristics
Neilsen’s famous ten - 1990
Denise Pierotti, Xerox - 1998

Heuristics
• Homepage • Feedback Form
• Visual Design • Error Handling
• Coding • Navigation
• JavaScript • Search Interface
• Content • Search Results
• Accessibility

Home Page
• Is the site business clear?
• Is the site purpose is clear?
• Is search available?
• Does the Home Page support
multiple ways to reach content?

accessibility

lnterpreting the Web
Usability research
Expert Review
Comparative Review
User Testing
Reducing Costs
Tips & Tricks…
Comparative Review

User Testing
lnterpreting the Web
Usability research
Expert Review
Comparative Review
User Testing
Reducing Costs
Tips & Tricks…

format
one-to-one
focus group
lab-based
contextual
comparative

Stages
1. Prepare
2. Research
3. Report

Prepare
Prepare
Objectives
Profiles
Recruitment
Method
Tasks
Questionnaire

research
Research
Method
Note taking / recording
Analysing Results

report
Report
Format
Detail
Quality

lnterpreting the Web
lnterpreting the Web
Usability research
Reducing Cost Usability research
Expert Review
Expert Review Review
Comparative
Comparative Review
User Testing
User Testing
Reducing Costs
Reducing Costs
Tips & Tricks…
Hati Hati!

Cutting Back
• Interview location
• Documentation
• Recording Sessions
• Incentives

Cutting Back
• Reporting
• Participant numbers
• Do an Expert Review

But sometimes…
you shouldn’t cut back

What not to cut
• Planning
• Recruitment
• Incentives
• Analysis
• Recommendations
• Debriefing

Extreme Usability
Faster
Lower cost
Potential recruitment
weaknesses e.g. Surrogates

Guerilla Usability…?
Well suited to:
•Web Agencies
•Small in-house reviews
•Certain Agile phases

Traditional Usability…?

Traditional Usability…
More time for analysis
More detailed results
More time == Cost increase

Traditional Usability…
•Large organisations
•Government departments
•Independent evaluations
•When evidence or documentation is required

Tips & Tricks…
•Scheduling
•Self-recruitment
•Re-recruiting users
•Surrogate users
lnterpreting the Web
Usability research
Expert Review
Comparative Review
User Testing
Reducing Costs
Tips & Tricks…

Use a Checklist

… tips & tricks
•Incentives
•Leading participants
•Talking too much
•Rushing analysis
•Going in with set ideas

Questions….

scenariogirl.com
scenarioseven.com.au
slideshare.net/lisaherrod

Photo Credits
Pub Bogan – Sengsta
http://flickr.com/photos/sengster/2205138163/
Tree of light - JPhilipson
http://flickr.com/photos/jphilipson/2100627902/