1. U X
Guerrilla
Usability Testing
@johnwhalen #novaux 1
Thursday, February 14, 13

2. Gorilla Usability Testing
@johnwhalen #novaux 2
Thursday, February 14, 13

3. Brilliant Experience
User Research Strategy User Experience
Mobile
@johnwhalen #novaux @johnwhalen #novaux
Thursday, February 14, 13

4. User Research
Quantitative Qualitative
Generative Surveys Interviews
Adwords Ethnography
Evaluative A/B Testing Usability Testing
Analytics Eye Tracking
@johnwhalen #novaux
Thursday, February 14, 13

5. User Research
Quantitative Qualitative
Generative Surveys Interviews
Adwords Ethnography
Evaluative A/B Testing
Analytics
@johnwhalen #novaux
Thursday, February 14, 13

6. U X
1. Why usability test?
2.When?
3.What?
4. How?
5. Quick Tips
@johnwhalen #novaux
Thursday, February 14, 13

7. U X
Why usability test?
@johnwhalen #novaux
Thursday, February 14, 13

8. Why usability test?
@johnwhalen #novaux
Thursday, February 14, 13

9. U X
• Reduce project risk
• Uncover unexpected issues
• Fix problems early when easier/cheaper to fix
• Test assumptions / solve opinion battles
• Set baselines & measure improvement
• Improve customer metrics (conversion, retention)
• “It’s so cheap you’d be stupid not to”
Why usability test?
@johnwhalen #novaux
Thursday, February 14, 13

10. U X
Why guerrilla usability testing?
@johnwhalen #novaux
Thursday, February 14, 13

11. A. Because you don’t have $30-60k to pay
for a full-blown Usability Test
@johnwhalen #novaux
Thursday, February 14, 13

12. B. You want to do this quickly and often
to refine your designs
@johnwhalen #novaux
Thursday, February 14, 13

13. C. Because Eric Ries says so!
@johnwhalen #novaux
Thursday, February 14, 13

14. U X
1. Why usability test?
2. When?
3. What?
4. How?
5. Quick Tips
@johnwhalen #novaux
Thursday, February 14, 13

15. U X
Just after
users revolt?
When to usability test?
@johnwhalen #novaux
Thursday, February 14, 13

16. U X
When to usability test?
@johnwhalen #novaux
Thursday, February 14, 13

17. U X
• When you first get the idea and commit it to paper
• When you have several possible design solutions
• When you have a new/updated feature
• When there is just enough code to test (but not perfect)
• Ahead of a sprint
When to usability test?
@johnwhalen #novaux
Thursday, February 14, 13

18. U X
1. Why usability test?
2. When?
3. What?
4. How?
5. Quick Tips
@johnwhalen #novaux
Thursday, February 14, 13

19. U X
Paper Clickable
Prototype Prototype
Full
Interaction
What to test?
@johnwhalen #novaux
Thursday, February 14, 13

20. U X
1. Why usability test?
2. When?
3. What?
4. How?
5. Quick Tips
@johnwhalen #novaux
Thursday, February 14, 13

21. U X
$40,000 Eye Tracker? Probably not...
@johnwhalen #novaux
Thursday, February 14, 13

22. U X
Silverback Camtasia
Equipment
@johnwhalen #novaux
Thursday, February 14, 13

23. • Goals of the test
• Profile of desired test subjects
• Define tasks
• Write test script (intro, thank you)
• Design a post-test survey
Test Plan
@johnwhalen #novaux
Thursday, February 14, 13

24. Bad: Search for a bookcase.
Good: You have more than 200 books in boxes
in your living room. Find a way to organize them.
[Don’t lead the witness, let them answer the questions.]
Tasks
@johnwhalen #novaux
Thursday, February 14, 13

25. Hi,
can I film you with
my laptop?
Recruiting
@johnwhalen #novaux
Thursday, February 14, 13

26. • Bring a second person (opposite gender)
• Recruit friends of friends
• Consider posting adds in relevant groups online
• If needed, use recruiter
• Recruit 4-8 per test per user type
Recruiting
@johnwhalen #novaux
Thursday, February 14, 13

27. Record & Share Results
@johnwhalen #novaux
Thursday, February 14, 13

28. • Record users demographics, goals
• Make post-it note for each major event
• Record what user expected to happen
• Write down other apps / tools they regularly use
Record
@johnwhalen #novaux
Thursday, February 14, 13

29. U X
1. Why usability test?
2. When?
3. What?
4. How?
5. Quick Tips
@johnwhalen #novaux
Thursday, February 14, 13

30. • Define the goals of the test
• Outline research questions
• Discuss user personas and tasks
Plan
@johnwhalen #novaux
Thursday, February 14, 13

31. "Hi,
I'm from organization x
and we are doing some research
into how people use our website for y. I'm
just going around asking people to have a
quick look at our website, and recording what
they think about it. It is for internal use within
the company. Would you be interested in
taking part...it will literally only take a
couple of minutes..."
Prepare your recruiting pitch
@johnwhalen #novaux
Thursday, February 14, 13

32. Bring along one of:
developer, PM, designer, etc.
@johnwhalen #novaux
Thursday, February 14, 13

33. • Why?
• What were you expecting to happen?
• What are you thinking?
• Can you say more about that?
• What are you trying to do?
• If there was one thing you could change, what would it be?
Listen actively
@johnwhalen #novaux
Thursday, February 14, 13

34. • Be friendly and put participant at ease
• Start with a simple task
• Don’t give hints or ask leading questions
• Don’t rescue people too soon
• Don’t ask opinion-based questions
• Give encouraging but non-committal feedback
Be a good moderator
@johnwhalen #novaux
Thursday, February 14, 13

35. Prioritize findings! (Top 5)
@johnwhalen #novaux
Thursday, February 14, 13

36. Test!
Revise Revise
Prototype! Prototype!
Test!
Immediately make changes
@johnwhalen #novaux
Thursday, February 14, 13

37. Rev
Test! ised
prob as s
lem oon
is id as a
enti
fied
>
Revise Revise
Prototype! Prototype!
Test!
Immediately make changes
@johnwhalen #novaux
Thursday, February 14, 13

38. U X
Thank you!
Guerrilla
Usability Testing
@johnwhalen #novaux 37
Thursday, February 14, 13

39. John Whalen
jw@brilliantexperience.com
@johnwhalen
User Research Strategy User Experience
Mobile
BrilliantExperience.com
Thursday, February 14, 13