Presented at the 2011 Usability Professionals Association Conference in Atlanta by Michael Rawlins

1. Tool Time 2
REMOTE TESTING TOOLS
YOU SHOULD KNOW ABOUT
Michael Rawlins, President, Connecticut UPA
Kath Straub, Usability.org
June, 2011

2. About Us
“...sometimes tools are like social
currency -- something to share, a way to
start a dialog and discourse...”
2

3. Why this topic
• Agility...
• Shrinking budgets
• Stakeholders need proof ‘earlier’
• Curiosity...
3

4. Why explore new tools?
• Time to market – an increasing issue for
product development
• A flood of new web-based tools over the
past three years
• Level-set - The traditional lab is not
dead... Perhaps newly augmented by
leaner tools

5. Proof...
“Your Canary in the Coal mine...”
5

6. Session Goals...
• Types of tools
• Significance in the development lifecycle
• Where best to apply
• We’ll leave a lot of time for Q&A...
6

7. Choice... but no loyalty?
7

8. 5 types of tools
• Heat Mapping
• Click location – recording the user clicks and creating a visual
activity map
• Screen Recording
• Tracking individual users – and creating a video for their session
• User Testing
• User testing tools that simulate traditional tasked based testing
tools
• User Feedback
• Tools that provide ability to solicit direct feedback from users
• Collaborative Peer Review
• Tools that provide ability to solicit direct feedback from UX peers

9. Heat Mapping Tools
9

10. Screen Recording Tool

11. User Testing Tools

12. User Feedback Tools

13. Peer Reviews
13

14. iPad apps
Intuition HQ
14

15. iPad Apps...
15

16. Pros…
• Try & buy model
• Inexpensive to engage
• Less invasive to users environment
• Inspires innovation (example: crowd
sourcing participates…)
• Produces credible results
• Creators expect user feedback to drive
the product

17. Cons…
• Control of the users environment
• No facial expressions
• Software not mature

18. Four Business Cases...
• Is the design directionally correct?
• How would a larger sampling users
respond to this design?
• Prove it too me in real-time!
• I need answers by the end of today!
18

19. Directionally Correct?
19

20. Larger Sample Says?
20

21. Prove it Now!
21

22. Findings on Demand...
22

23. Agility & Transparency
23

24. Great Reference Material…

25. Great Reference Material…

26. Great Reference Material…

27. Examples
• A/B testing
• Expectancy Test
• Mental Model
• First Impressions
• Baselining
25

28. What’s Next...
• Dive right in
• Push the software creators
• Experiment, innovate & explore...
26

29. You can contact us:
Questions… michael.rawlins@gmail.com
kath@usability.org

30. Thank you…