SlideShare a Scribd company logo
U     X




                      Guerrilla
                   Usability Testing
                            @johnwhalen   #novaux   1
Thursday, February 14, 13
Gorilla Usability Testing
                            @johnwhalen   #novaux   2
Thursday, February 14, 13
Brilliant Experience

       User Research        Strategy    User Experience
                                                          Mobile




@johnwhalen       #novaux      @johnwhalen   #novaux
Thursday, February 14, 13
User Research
                            Quantitative      Qualitative


         Generative           Surveys           Interviews
                              Adwords          Ethnography




         Evaluative          A/B Testing      Usability Testing
                              Analytics        Eye Tracking




                                @johnwhalen    #novaux
Thursday, February 14, 13
User Research
                            Quantitative      Qualitative


         Generative           Surveys          Interviews
                              Adwords         Ethnography




         Evaluative          A/B Testing
                              Analytics




                                @johnwhalen   #novaux
Thursday, February 14, 13
U      X


       1. Why usability test?
       2.When?
       3.What?
       4. How?
       5. Quick Tips

                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X




                            Why usability test?
                               @johnwhalen   #novaux
Thursday, February 14, 13
Why usability test?
                               @johnwhalen   #novaux
Thursday, February 14, 13
U      X
       • Reduce project risk
       • Uncover unexpected issues
       • Fix problems early when easier/cheaper to fix
       • Test assumptions / solve opinion battles
       • Set baselines & measure improvement
       • Improve customer metrics (conversion, retention)
       • “It’s so cheap you’d be stupid not to”



                            Why usability test?
                               @johnwhalen   #novaux
Thursday, February 14, 13
U      X




                 Why guerrilla usability testing?
                            @johnwhalen   #novaux
Thursday, February 14, 13
A. Because you don’t have $30-60k to pay
         for a full-blown Usability Test
                            @johnwhalen   #novaux
Thursday, February 14, 13
B. You want to do this quickly and often
              to refine your designs
                            @johnwhalen   #novaux
Thursday, February 14, 13
C. Because Eric Ries says so!
                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X


       1. Why usability test?
       2. When?
       3. What?
       4. How?
       5. Quick Tips

                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X



                                                           Just after
                                                         users revolt?




                            When to usability test?
                                 @johnwhalen   #novaux
Thursday, February 14, 13
U      X




                            When to usability test?
                                 @johnwhalen   #novaux
Thursday, February 14, 13
U      X
       • When you first get the idea and commit it to paper
       • When you have several possible design solutions
       • When you have a new/updated feature
       • When there is just enough code to test (but not perfect)
       • Ahead of a sprint




                            When to usability test?
                                 @johnwhalen   #novaux
Thursday, February 14, 13
U      X


       1. Why usability test?
       2. When?
       3. What?
       4. How?
       5. Quick Tips

                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X
                Paper                           Clickable
               Prototype                        Prototype




                                Full
                            Interaction




                            What to test?
                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X


       1. Why usability test?
       2. When?
       3. What?
       4. How?
       5. Quick Tips

                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X




         $40,000 Eye Tracker? Probably not...
                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X




             Silverback                             Camtasia


                             Equipment
                            @johnwhalen   #novaux
Thursday, February 14, 13
• Goals of the test
       • Profile of desired test subjects
       • Define tasks
       • Write test script (intro, thank you)
       • Design a post-test survey




                               Test Plan
                             @johnwhalen    #novaux
Thursday, February 14, 13
Bad: Search for a bookcase.

          Good: You have more than 200 books in boxes
          in your living room. Find a way to organize them.

          [Don’t lead the witness, let them answer the questions.]




                                 Tasks
                            @johnwhalen   #novaux
Thursday, February 14, 13
Hi,
                                                    can I film you with
                                                       my laptop?




                             Recruiting
                            @johnwhalen   #novaux
Thursday, February 14, 13
• Bring a second person (opposite gender)
          • Recruit friends of friends
          • Consider posting adds in relevant groups online
          • If needed, use recruiter
          • Recruit 4-8 per test per user type




                               Recruiting
                             @johnwhalen   #novaux
Thursday, February 14, 13
Record & Share Results
                                 @johnwhalen   #novaux
Thursday, February 14, 13
• Record users demographics, goals
          • Make post-it note for each major event
          • Record what user expected to happen
          • Write down other apps / tools they regularly use




                                Record
                            @johnwhalen   #novaux
Thursday, February 14, 13
U      X


       1. Why usability test?
       2. When?
       3. What?
       4. How?
       5. Quick Tips

                            @johnwhalen   #novaux
Thursday, February 14, 13
• Define the goals of the test
          • Outline research questions
          • Discuss user personas and tasks




                                  Plan
                            @johnwhalen   #novaux
Thursday, February 14, 13
"Hi,

                                                      I'm from organization x

                                                 and we are doing some research

                                              into how people use our website for y. I'm

                                            just going around asking people to have a

                                           quick look at our website, and recording what

                                            they think about it. It is for internal use within

                                             the company. Would you be interested in

                                               taking part...it will literally only take a

                                                   couple of minutes..."




                    Prepare your recruiting pitch
                            @johnwhalen   #novaux
Thursday, February 14, 13
Bring along one of:
                     developer, PM, designer, etc.
                            @johnwhalen   #novaux
Thursday, February 14, 13
• Why?
          • What were you expecting to happen?
          • What are you thinking?
          • Can you say more about that?
          • What are you trying to do?
          • If there was one thing you could change, what would it be?




                            Listen actively
                            @johnwhalen   #novaux
Thursday, February 14, 13
• Be friendly and put participant at ease
          • Start with a simple task
          • Don’t give hints or ask leading questions
          • Don’t rescue people too soon
          • Don’t ask opinion-based questions
          • Give encouraging but non-committal feedback




                            Be a good moderator
                               @johnwhalen   #novaux
Thursday, February 14, 13
Prioritize findings! (Top 5)
                               @johnwhalen   #novaux
Thursday, February 14, 13
Test!



     Revise                              Revise
   Prototype!                          Prototype!



                            Test!

                      Immediately make changes
                               @johnwhalen   #novaux
Thursday, February 14, 13
Rev
                            Test!                ised
                                          prob        as s
                                                lem         oon
                                                     is id       as a
                                                           enti
                                                                fied




                                                       >
     Revise                              Revise
   Prototype!                          Prototype!



                            Test!

                      Immediately make changes
                               @johnwhalen   #novaux
Thursday, February 14, 13
U     X



                                              Thank you!




                      Guerrilla
                   Usability Testing
                            @johnwhalen   #novaux          37
Thursday, February 14, 13
John Whalen
                                    jw@brilliantexperience.com
                                   @johnwhalen

       User Research         Strategy    User Experience
                                                            Mobile




                            BrilliantExperience.com

Thursday, February 14, 13

More Related Content

More from John Whalen

The Future of UX is here: AI and Cognitive Design
The Future of UX is here: AI and Cognitive DesignThe Future of UX is here: AI and Cognitive Design
The Future of UX is here: AI and Cognitive Design
John Whalen
 
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
John Whalen
 
Building Buy-In: Internally Positioning UX for Executive Impact
Building Buy-In: Internally Positioning UX for Executive ImpactBuilding Buy-In: Internally Positioning UX for Executive Impact
Building Buy-In: Internally Positioning UX for Executive Impact
John Whalen
 
User experience doesn't happen on a screen: It happens in the mind.
User experience doesn't happen on a screen: It happens in the mind.User experience doesn't happen on a screen: It happens in the mind.
User experience doesn't happen on a screen: It happens in the mind.
John Whalen
 
Design studio: A team alignment secret weapon - Modev MVP Conference
Design studio: A team alignment secret weapon - Modev MVP ConferenceDesign studio: A team alignment secret weapon - Modev MVP Conference
Design studio: A team alignment secret weapon - Modev MVP Conference
John Whalen
 
Emergent UX: Seducing the Six Minds - IXDA-NYC
Emergent UX: Seducing the Six Minds - IXDA-NYCEmergent UX: Seducing the Six Minds - IXDA-NYC
Emergent UX: Seducing the Six Minds - IXDA-NYC
John Whalen
 
Architecting Information for the Mind: Introducing Emergent UX
Architecting Information for the Mind: Introducing Emergent UXArchitecting Information for the Mind: Introducing Emergent UX
Architecting Information for the Mind: Introducing Emergent UX
John Whalen
 
Emergent UX: Seducing the Six Minds - Full Talk
Emergent UX: Seducing the Six Minds - Full TalkEmergent UX: Seducing the Six Minds - Full Talk
Emergent UX: Seducing the Six Minds - Full Talk
John Whalen
 
Emergent UX: Seducing the six minds
Emergent UX: Seducing the six mindsEmergent UX: Seducing the six minds
Emergent UX: Seducing the six minds
John Whalen
 
Maximizing the impact of UX in an agile environment: Mixing agile and Lean UX
Maximizing the impact of UX in an agile environment: Mixing agile and Lean UXMaximizing the impact of UX in an agile environment: Mixing agile and Lean UX
Maximizing the impact of UX in an agile environment: Mixing agile and Lean UX
John Whalen
 
Cognitive science of design in 10 minutes or less
Cognitive science of design in 10 minutes or lessCognitive science of design in 10 minutes or less
Cognitive science of design in 10 minutes or less
John Whalen
 
Implementing Lean UX: The Practical Guide to Lean User Experience
Implementing Lean UX: The Practical Guide to Lean User ExperienceImplementing Lean UX: The Practical Guide to Lean User Experience
Implementing Lean UX: The Practical Guide to Lean User Experience
John Whalen
 
Design Thinking Introduction & Workshop - NoVA UX
Design Thinking Introduction & Workshop - NoVA UXDesign Thinking Introduction & Workshop - NoVA UX
Design Thinking Introduction & Workshop - NoVA UX
John Whalen
 
Lean UX for Startups and Enterprise: Ten Secrets to Success
Lean UX for Startups and Enterprise: Ten Secrets to SuccessLean UX for Startups and Enterprise: Ten Secrets to Success
Lean UX for Startups and Enterprise: Ten Secrets to Success
John Whalen
 
UX Strategy and Lean UX
UX Strategy and Lean UXUX Strategy and Lean UX
UX Strategy and Lean UX
John Whalen
 
What is a user experience designer
What is a user experience designerWhat is a user experience designer
What is a user experience designer
John Whalen
 
Brain secrets every UXer needs to know
Brain secrets every UXer needs to knowBrain secrets every UXer needs to know
Brain secrets every UXer needs to know
John Whalen
 
The hybrids are coming: The Era of Touchscreen Hybrids
The hybrids are coming: The Era of Touchscreen HybridsThe hybrids are coming: The Era of Touchscreen Hybrids
The hybrids are coming: The Era of Touchscreen Hybrids
John Whalen
 
Top 11 usability recommendations for 2011
Top 11 usability recommendations for 2011Top 11 usability recommendations for 2011
Top 11 usability recommendations for 2011
John Whalen
 
Persuasive design
Persuasive design Persuasive design
Persuasive design
John Whalen
 

More from John Whalen (20)

The Future of UX is here: AI and Cognitive Design
The Future of UX is here: AI and Cognitive DesignThe Future of UX is here: AI and Cognitive Design
The Future of UX is here: AI and Cognitive Design
 
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...Building Buy-In: 
Internally Positioning UX 
for Executive Impact.  BigDesign...
Building Buy-In: 
Internally Positioning UX 
for Executive Impact. BigDesign...
 
Building Buy-In: Internally Positioning UX for Executive Impact
Building Buy-In: Internally Positioning UX for Executive ImpactBuilding Buy-In: Internally Positioning UX for Executive Impact
Building Buy-In: Internally Positioning UX for Executive Impact
 
User experience doesn't happen on a screen: It happens in the mind.
User experience doesn't happen on a screen: It happens in the mind.User experience doesn't happen on a screen: It happens in the mind.
User experience doesn't happen on a screen: It happens in the mind.
 
Design studio: A team alignment secret weapon - Modev MVP Conference
Design studio: A team alignment secret weapon - Modev MVP ConferenceDesign studio: A team alignment secret weapon - Modev MVP Conference
Design studio: A team alignment secret weapon - Modev MVP Conference
 
Emergent UX: Seducing the Six Minds - IXDA-NYC
Emergent UX: Seducing the Six Minds - IXDA-NYCEmergent UX: Seducing the Six Minds - IXDA-NYC
Emergent UX: Seducing the Six Minds - IXDA-NYC
 
Architecting Information for the Mind: Introducing Emergent UX
Architecting Information for the Mind: Introducing Emergent UXArchitecting Information for the Mind: Introducing Emergent UX
Architecting Information for the Mind: Introducing Emergent UX
 
Emergent UX: Seducing the Six Minds - Full Talk
Emergent UX: Seducing the Six Minds - Full TalkEmergent UX: Seducing the Six Minds - Full Talk
Emergent UX: Seducing the Six Minds - Full Talk
 
Emergent UX: Seducing the six minds
Emergent UX: Seducing the six mindsEmergent UX: Seducing the six minds
Emergent UX: Seducing the six minds
 
Maximizing the impact of UX in an agile environment: Mixing agile and Lean UX
Maximizing the impact of UX in an agile environment: Mixing agile and Lean UXMaximizing the impact of UX in an agile environment: Mixing agile and Lean UX
Maximizing the impact of UX in an agile environment: Mixing agile and Lean UX
 
Cognitive science of design in 10 minutes or less
Cognitive science of design in 10 minutes or lessCognitive science of design in 10 minutes or less
Cognitive science of design in 10 minutes or less
 
Implementing Lean UX: The Practical Guide to Lean User Experience
Implementing Lean UX: The Practical Guide to Lean User ExperienceImplementing Lean UX: The Practical Guide to Lean User Experience
Implementing Lean UX: The Practical Guide to Lean User Experience
 
Design Thinking Introduction & Workshop - NoVA UX
Design Thinking Introduction & Workshop - NoVA UXDesign Thinking Introduction & Workshop - NoVA UX
Design Thinking Introduction & Workshop - NoVA UX
 
Lean UX for Startups and Enterprise: Ten Secrets to Success
Lean UX for Startups and Enterprise: Ten Secrets to SuccessLean UX for Startups and Enterprise: Ten Secrets to Success
Lean UX for Startups and Enterprise: Ten Secrets to Success
 
UX Strategy and Lean UX
UX Strategy and Lean UXUX Strategy and Lean UX
UX Strategy and Lean UX
 
What is a user experience designer
What is a user experience designerWhat is a user experience designer
What is a user experience designer
 
Brain secrets every UXer needs to know
Brain secrets every UXer needs to knowBrain secrets every UXer needs to know
Brain secrets every UXer needs to know
 
The hybrids are coming: The Era of Touchscreen Hybrids
The hybrids are coming: The Era of Touchscreen HybridsThe hybrids are coming: The Era of Touchscreen Hybrids
The hybrids are coming: The Era of Touchscreen Hybrids
 
Top 11 usability recommendations for 2011
Top 11 usability recommendations for 2011Top 11 usability recommendations for 2011
Top 11 usability recommendations for 2011
 
Persuasive design
Persuasive design Persuasive design
Persuasive design
 

Guerrilla usability testing

  • 1. U X Guerrilla Usability Testing @johnwhalen #novaux 1 Thursday, February 14, 13
  • 2. Gorilla Usability Testing @johnwhalen #novaux 2 Thursday, February 14, 13
  • 3. Brilliant Experience User Research Strategy User Experience Mobile @johnwhalen #novaux @johnwhalen #novaux Thursday, February 14, 13
  • 4. User Research Quantitative Qualitative Generative Surveys Interviews Adwords Ethnography Evaluative A/B Testing Usability Testing Analytics Eye Tracking @johnwhalen #novaux Thursday, February 14, 13
  • 5. User Research Quantitative Qualitative Generative Surveys Interviews Adwords Ethnography Evaluative A/B Testing Analytics @johnwhalen #novaux Thursday, February 14, 13
  • 6. U X 1. Why usability test? 2.When? 3.What? 4. How? 5. Quick Tips @johnwhalen #novaux Thursday, February 14, 13
  • 7. U X Why usability test? @johnwhalen #novaux Thursday, February 14, 13
  • 8. Why usability test? @johnwhalen #novaux Thursday, February 14, 13
  • 9. U X • Reduce project risk • Uncover unexpected issues • Fix problems early when easier/cheaper to fix • Test assumptions / solve opinion battles • Set baselines & measure improvement • Improve customer metrics (conversion, retention) • “It’s so cheap you’d be stupid not to” Why usability test? @johnwhalen #novaux Thursday, February 14, 13
  • 10. U X Why guerrilla usability testing? @johnwhalen #novaux Thursday, February 14, 13
  • 11. A. Because you don’t have $30-60k to pay for a full-blown Usability Test @johnwhalen #novaux Thursday, February 14, 13
  • 12. B. You want to do this quickly and often to refine your designs @johnwhalen #novaux Thursday, February 14, 13
  • 13. C. Because Eric Ries says so! @johnwhalen #novaux Thursday, February 14, 13
  • 14. U X 1. Why usability test? 2. When? 3. What? 4. How? 5. Quick Tips @johnwhalen #novaux Thursday, February 14, 13
  • 15. U X Just after users revolt? When to usability test? @johnwhalen #novaux Thursday, February 14, 13
  • 16. U X When to usability test? @johnwhalen #novaux Thursday, February 14, 13
  • 17. U X • When you first get the idea and commit it to paper • When you have several possible design solutions • When you have a new/updated feature • When there is just enough code to test (but not perfect) • Ahead of a sprint When to usability test? @johnwhalen #novaux Thursday, February 14, 13
  • 18. U X 1. Why usability test? 2. When? 3. What? 4. How? 5. Quick Tips @johnwhalen #novaux Thursday, February 14, 13
  • 19. U X Paper Clickable Prototype Prototype Full Interaction What to test? @johnwhalen #novaux Thursday, February 14, 13
  • 20. U X 1. Why usability test? 2. When? 3. What? 4. How? 5. Quick Tips @johnwhalen #novaux Thursday, February 14, 13
  • 21. U X $40,000 Eye Tracker? Probably not... @johnwhalen #novaux Thursday, February 14, 13
  • 22. U X Silverback Camtasia Equipment @johnwhalen #novaux Thursday, February 14, 13
  • 23. • Goals of the test • Profile of desired test subjects • Define tasks • Write test script (intro, thank you) • Design a post-test survey Test Plan @johnwhalen #novaux Thursday, February 14, 13
  • 24. Bad: Search for a bookcase. Good: You have more than 200 books in boxes in your living room. Find a way to organize them. [Don’t lead the witness, let them answer the questions.] Tasks @johnwhalen #novaux Thursday, February 14, 13
  • 25. Hi, can I film you with my laptop? Recruiting @johnwhalen #novaux Thursday, February 14, 13
  • 26. • Bring a second person (opposite gender) • Recruit friends of friends • Consider posting adds in relevant groups online • If needed, use recruiter • Recruit 4-8 per test per user type Recruiting @johnwhalen #novaux Thursday, February 14, 13
  • 27. Record & Share Results @johnwhalen #novaux Thursday, February 14, 13
  • 28. • Record users demographics, goals • Make post-it note for each major event • Record what user expected to happen • Write down other apps / tools they regularly use Record @johnwhalen #novaux Thursday, February 14, 13
  • 29. U X 1. Why usability test? 2. When? 3. What? 4. How? 5. Quick Tips @johnwhalen #novaux Thursday, February 14, 13
  • 30. • Define the goals of the test • Outline research questions • Discuss user personas and tasks Plan @johnwhalen #novaux Thursday, February 14, 13
  • 31. "Hi, I'm from organization x and we are doing some research into how people use our website for y. I'm just going around asking people to have a quick look at our website, and recording what they think about it. It is for internal use within the company. Would you be interested in taking part...it will literally only take a couple of minutes..." Prepare your recruiting pitch @johnwhalen #novaux Thursday, February 14, 13
  • 32. Bring along one of: developer, PM, designer, etc. @johnwhalen #novaux Thursday, February 14, 13
  • 33. • Why? • What were you expecting to happen? • What are you thinking? • Can you say more about that? • What are you trying to do? • If there was one thing you could change, what would it be? Listen actively @johnwhalen #novaux Thursday, February 14, 13
  • 34. • Be friendly and put participant at ease • Start with a simple task • Don’t give hints or ask leading questions • Don’t rescue people too soon • Don’t ask opinion-based questions • Give encouraging but non-committal feedback Be a good moderator @johnwhalen #novaux Thursday, February 14, 13
  • 35. Prioritize findings! (Top 5) @johnwhalen #novaux Thursday, February 14, 13
  • 36. Test! Revise Revise Prototype! Prototype! Test! Immediately make changes @johnwhalen #novaux Thursday, February 14, 13
  • 37. Rev Test! ised prob as s lem oon is id as a enti fied > Revise Revise Prototype! Prototype! Test! Immediately make changes @johnwhalen #novaux Thursday, February 14, 13
  • 38. U X Thank you! Guerrilla Usability Testing @johnwhalen #novaux 37 Thursday, February 14, 13
  • 39. John Whalen jw@brilliantexperience.com @johnwhalen User Research Strategy User Experience Mobile BrilliantExperience.com Thursday, February 14, 13