Hands-On UsabilityTesting Jonathan Rubin UXPA-DC User Experience Intensive Feb. 27, 2013 @jonathan_rubin
Before we begin…1. What do you already know about usability testing?2. What do you want to learn today?
Limitations of Opinion “The accuracy of subjective reports is so poor as to suggest that any introspective access that may exist is not sufficient to produce generally correct or reliable reports.” - R. E. Nisbett and T. D. Wilson, On telling more than we can know: Verbal reports on mental processes, Psychological Review, Vol 84. (1977)
To improve a product…1. Reliable data is crucial
To improve a product…1. Reliable data is crucial2. Need to find out user expectations
Usability =The ease with which people canemploy a particular tool or otherhuman-made object in order toachieve a particular goal - Wikipedia
Usability = 5 E‟sEffectiveEfficientEngagingError TolerantEasy To Learn- Whitney Quesenbery (2004) „Balancing the 5Es:Usability‟
Your turn: What sites havethese?EffectiveEfficientEngagingError TolerantEasy To Learn
Usability Testing =Setting a series of tasks for people tocomplete and noting any problemsthey encounter– Andy Budd
What‟s involved in a usabilitytest• Participants performing meaningful tasks• Real users – not your BFF• Observers (you or design team)• Recording data for analysis
You can test ANYTHING• Hand-drawn sketch• Wireframe• Screenshot / JPG• HTML prototype• Live site• Competitor‟s site!
Why care about usability?• Simple errors can lead to big problems• If the customer isn‟t happy, nobody‟s happy.• If visitors can‟t easily access your info, why have a site at all?• Casual visitors have a different experience than those who work with a website every day.
Formal InformalRecruiting, testing done for DIYyouTrained Facilitators Facilitators-in-training (i.e. You)Smaller chance of bias Larger chance of biasLengthy to set up + Fast setup, useimplement immediatelyGorgeous Reports Word TemplatesExpensive ($5k and up) Cheap / free
Top Tasks – Why they camehere• Order a pizza• Find your contact information• Register for a class• Leave a comment• Get a rate quote• Learn about your services
Active Listening / Think-Aloud Protocol• Tester does 90% of talking• You = Therapist / Travel Agent• Open Ended Questions (if any)• Non-leading responses – “Thanks for the feedback!”• Take notes but give attention