TRENDS
                                         in       ti ng
                                     >         Tes
        ...
Think Aloud Techniques
Think Aloud Techniques

Concurrent (CTA)         Retrospective (RTA)

                   Vs.
Variation of RTA...

Show the participant their video
   after they’re done testing.
Usability “Labs”
Vs.

Source: Kent State University




                                Image source: facit digital
Ideal “Lab-Less” Set Up
Remote vs. In-person
     Testing


         Vs.
Remote Testing
                       Pros & Cons
Pros:                                            Cons:
Participants stay...
Remote Testing Paper
    Prototypes
     (Yes, it is possible!)
Remote Testing Tools
     • UserVue
     • GoToMeeting
     • LiveLook
     • Adobe Connect
     • Silverback
     • Many ...
Remote Testing Tips
• Disable IM programs, Outlook meeting
  reminders, or anything else that may be
  distracting
• Use a...
Automated Testing
(Unmoderated Remote Testing)
What You Can Learn
  • Analytic data
  • Task completion rates
  • Number of clicks/clickstream
  • Time on task
  • Satis...
When to Conduct
       Automated Testing?

Not a replacement for moderated testing or research.

 Best used to compliment ...
Automated Testing
     Tools
 • Keynote WebEffective $$$
 • UserZoom $$
 • Treejack & Chalkmark $
 • Loop11 (private beta)
Pre-defined Tasks
         vs.
Interview-based Tasks
Improv Testing Process
    1. Interview participant about how they use
       the product.
    2. Use the answers given in...
Questions?


www.usableinterface.com
Trends In  Usability  Testing
Trends In  Usability  Testing
Trends In  Usability  Testing
Upcoming SlideShare
Loading in …5
×

Trends In Usability Testing

2,184 views
2,136 views

Published on

Presented at the Wharton School of Business in Philadelphia for PhillyCHI on 6/24/09.

About the Presentation
Over the years, there have been some exciting developments in the way usability tests are facilitated. During this session we will take a closer look at the trends in the tools and techniques used in usability testing and discuss the benefits and drawbacks of each.

Some of the topics that will be covered include:

• Current Think Aloud (CTA) vs. Retrospective Think Aloud (RTA) Technique
• Pros and Cons
• How to moderate using RTA
• When to use RTA
• Remote Testing
• Pros and Cons
• Tips for proper facilitation
• Testing paper and low-fidelity prototypes remotely
• Overview of different remote testing tools
• Automated Testing (unmoderated remote testing)
• What you can and can’t learn
• When it should be used
• Overview of different automated testing tools
• Interview-based Tasks vs. Pre-defined Tasks
• Pros and cons
• Tips for proper facilitation
• Observer Debriefing
• Tips for proper facilitation
• Overview of different debriefing techniques

Videos and live demos of these trends will be included, which should make for an entertaining hands-on learning experience!

Published in: Design, Technology
0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,184
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
83
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

Trends In Usability Testing

  1. 1. TRENDS in ti ng > Tes il ity s ab U Kyle Soucy, Founding Principal follow me: UsableInterface PhillyCHI June 24, 2009 www.usableinterface.com
  2. 2. Think Aloud Techniques
  3. 3. Think Aloud Techniques Concurrent (CTA) Retrospective (RTA) Vs.
  4. 4. Variation of RTA... Show the participant their video after they’re done testing.
  5. 5. Usability “Labs”
  6. 6. Vs. Source: Kent State University Image source: facit digital
  7. 7. Ideal “Lab-Less” Set Up
  8. 8. Remote vs. In-person Testing Vs.
  9. 9. Remote Testing Pros & Cons Pros: Cons: Participants stay in their native environment. Can’t see the user’s facial expressions. Accessible to a larger & more diverse pool of Can’t see if the user is using peripheral participants. devices. Recruiting is easier. Less no shows & easier Dependent on an Internet connection. last minute replacements. Can only recruit participants with a high- Opportunity to gather ethnographic data. speed Internet connection. Cost & time savings. No travel & lab rental fees. Easier for observers to “attend” a session. Risk of compromising data because the participant is using a foreign PC is removed.
  10. 10. Remote Testing Paper Prototypes (Yes, it is possible!)
  11. 11. Remote Testing Tools • UserVue • GoToMeeting • LiveLook • Adobe Connect • Silverback • Many more...
  12. 12. Remote Testing Tips • Disable IM programs, Outlook meeting reminders, or anything else that may be distracting • Use a phone recording controller. • Use as few tools as possible • Back up, back up, back up!
  13. 13. Automated Testing (Unmoderated Remote Testing)
  14. 14. What You Can Learn • Analytic data • Task completion rates • Number of clicks/clickstream • Time on task • Satisfaction ratings • In-context feedback
  15. 15. When to Conduct Automated Testing? Not a replacement for moderated testing or research. Best used to compliment your qualitative research.
  16. 16. Automated Testing Tools • Keynote WebEffective $$$ • UserZoom $$ • Treejack & Chalkmark $ • Loop11 (private beta)
  17. 17. Pre-defined Tasks vs. Interview-based Tasks
  18. 18. Improv Testing Process 1. Interview participant about how they use the product. 2. Use the answers given in the interview to create tasks on the fly. When in doubt just ask, “what was the last thing you did when you used this product? Can you show me?”
  19. 19. Questions? www.usableinterface.com

×