Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Get It Right the FirstTime
Through Cheap and Easy
DIY Usability Testing
Saturday,August 15th

Drupal Camp Asheville
2015	
...
Overview
• Introduction	

• What is Usability	

• Who,What,Where, and When	

• Free and/or Inexpensive Tools
2
Introduction
3
Disclaimer
Let’s get this out of the way first!
4
Disclaimer
I am not a Usability expert	

• I’ll share easy DIY techniques & tools	

I won’t tell you how to fix your websit...
Scope
What I’ll cover and what I won’t.
6
What we will cover
• What is usability?	

• Why should I bother?	

• How can I test my site?	

• How do I keep my site usa...
What we won’t cover
• Usability best practices	

• Statistical analysis of results	

• Every type of usability test
8
What is Usability?
9
What is usability?
“Usability testing refers to evaluating a
product or service by testing it with
representative users.Th...
What is usability?
“If there's one thing you learn by working on
a lot of different Web sites, it's that almost any
design...
Keep in mind
• Popular≠Good	

• Attractive≠Usable	

• Ugly≠Unusable
12
What, when,

and who to test?
13
What to test?
Anything or everything?
14
What should you test?
• Information Architecture	

• Navigation	

• User Interface elements	

• New Functionality	

• Crit...
When to test?
Is it too soon, or too late?
16
When to test
• The sooner the better	

• Tests should be part of any change process	

• Test early and test often!
17
Who to test?
Your opinion probably isn’t the one that matters.
18
Potential test subjects
• Actual site users	

• Representative site users	

• Crowdsourced	

• Artificial intelligence
19
Actual site users
Pros:	

• Most relevant to site	

Cons:	

• May have limited availability	

• May already have learned “...
Representative users
Pros:	

• Relevant to site	

• Usually new to the site	

Cons:	

• Only as relevant as your recruitin...
Crowdsourced
Pros:	

• Readily available	

• Usually new to the site	

Cons:	

• May not closely model actual site users	
...
Artificial intelligence
Pros:	

• Readily available	

• Complete tests in real time	

Cons:	

• May not closely model actua...
Which is right for you?
• What kind of site are you testing?	

• What is your site’s demographic?	

• What access do you h...
How to test?
25
Types of tests
One size does not fit all!
26
Formative Tests
• Used throughout the change process.	

• Support tool for decision making.	

• Different tools for differ...
Summative Tests
• Generally QA testing.	

• Determine if finished feature/site is usable.	

• Confirm improved usability.	

...
Types of testing
• Analytics 	

• User Testing	

• Usability Testing
29
Analytics
• Measure of actual user behavior.	

• May suggest usability problems.	

• Not a substitute for usability testin...
User Testing
• Based on user opinion.	

• Not tied to specific task completion.	

• Can provide insight into users desires ...
Usability testing
• Based on task completion.	

• Usually measurable.
32
Analytics
It takes time to collect data; start today!
33
Web Analytics
Formative
• Records actual site visitor interaction.	

• Can suggest usability problems.
34
Web Analytics
Possible tools
• Google Analytics (Google)	

• WebTrends Analytics (WebTrends)	

• AWStats (AWStats)
35
Heat Maps
Formative
• Records specific actual site visitor
interaction: mouse click and scroll depth.	

• Can suggest usabi...
Heat Maps
Possible tools
• Crazy Egg (Crazy Egg)	

• Hotjar (Hotjar)	

• Lucky Orange (Lucky Orange)	

• Google Analytics*...
User testing
Opinions are like noses, everyone’s got one.
38
User Surveys
Formative
• Ask users what they like or don’t like.	

• Good starting point for refining or adding
new feature...
User Surveys
Possible tools
• Paper	

• SurveyMonkey (SurveyMonkey)	

• SurveyGizmo (Widgix)	

• Qualtrics (Qualtrics)
40
A/B & Multivariate Tests
Formative
• Users are randomly given an
implementation.	

• Determine which implementation is mos...
A/B & Multivariate Tests
Possible tools
• GoogleWebsite Optimizer (Google)	

• CMS Specific tools (e.g. Drupal Multivariate...
Usability testing
Choose the test based on your question.
43
Open Card Sort
Formative
• Participants organize a list of items into
categories they provide.
44
Open Card Sort
Possible tools
• Index cards	

• Cardsort (Optimal Workshop)	

• UserZoom (UserZoom)
45
Closed Card Sort
Formative
• Participants organize a list of items into
categories you provide.
46
Closed Card Sort
Possible tools
• Index cards	

• Cardsort (Optimal Workshop)	

• UserZoom (UserZoom)
47
Tree Test
Formative
• Asks test participants where they would go
to find specific content. 	

• Tests the organization of co...
Tree Test
Possible tools
• Index cards	

• Treejack (Optimal Workshop)
49
Expectancy Test
Formative
• Tests a user’s impressions of an early
prototype of the interface.	

• Typically paper prototy...
Expectancy Test
Possible tools
• Paper Prototype	

• Wireframes	

• Design Concepts
51
5-Second Usability Test
Formative
• Tests individual pages (not homepage) for a
specific scenario and task.	

• Not suitabl...
5-Second Usability Test
Possible tools
• Paper Prototype	

• Wireframes	

• Design Concepts	

• FiveSecondTest (UsabilityH...
Visual Affordance Test
Formative
• Tests the “Clickability/Tappability.”	

• Show subject web page or design concept.	

• ...
Visual Affordance Test
Possible tools
• Paper Prototype	

• Wireframes	

• Design Concepts
55
Click Test
Summative
• Provide scenario and task.	

• User clicks on the design element to
complete task.
56
Click Test
Possible tools
• Paper Prototype	

• Wireframes	

• Design Concepts	

• Chalkmark (Optimal Workshop)	

• Flippa...
Sample-of-One Test
Summative
• Document fundamental errors in interface
layout, labels, content organization,
affordance, ...
Sample-of-One Test
Possible tools
• Silverback (Clearleft)	

• OpenHallway (OpenHallway)	

• TryMyUI (TryMyUI)	

• UXRecor...
Performance Test
Formative or Summative
• Can be to look for problems in existing site
or confirm function in a new site. 	...
Performance Test
Possible tools
• Silverback (Clearleft)	

• OpenHallway (OpenHallway)	

• TryMyUI (TryMyUI)	

• UXRecorde...
Free Exploration Test
Summative
• Observe users interaction with website for
set period of time (5 minutes?).	

• Use when...
Free Exploration Test
Possible tools
• Silverback (Clearleft)	

• OpenHallway (OpenHallway)	

• TryMyUI (TryMyUI)	

• UXRe...
Free and Inexpensive
TestingTools
64
Survey Monkey
Likes:	

• Robust question functionality & reporting.	

• Filter response data by response or URL.	

• Data ...
Survey Monkey
66
Survey Monkey
67
Survey Monkey
68
Survey Monkey
69
Survey Monkey
70
Survey Monkey
71
Survey Monkey
72
CrazyEgg
Likes:	

• Variety of ways to filter/visual data	

• Can test mobile and desktop	

Be Aware:	

• Not real time.	

...
Crazy Egg
74
Crazy Egg
75
Crazy Egg
76
Crazy Egg
77
Crazy Egg
78
Crazy Egg
79
Crazy Egg
80
Crazy Egg
81
Crazy Egg
82
Crazy Egg
83
Optimal Sort
Likes:	

• Easy to set up.	

• Can use for remote testing.	

Be Aware:	

• Normalizing data requires assumpti...
Optimal Sort
85
Optimal Sort
86
Optimal Sort
87
Optimal Sort
88
Optimal Sort
89
Optimal Sort
90
Treejack
Likes:	

• Easy to set up.	

• Can use for remote testing.	

Be Aware:	

• Not cheap if you need the full version...
Treejack
92
Treejack
93
Treejack
94
Treejack
95
Treejack
96
Chalkmark
Likes:	

• Easy to set up.	

• Can use for remote testing.	

Be Aware:	

• Only single response per question.	

...
Chalkmark
98
Chalkmark
99
Chalkmark
100
Chalkmark
101
Silverback
Likes:	

• Portable, works well on a standard laptop.	

• Does not require a dedicated usability lab.	

Be Awar...
Silverback
103
Conclusion
104
Conclusion
• No silver bullet to make sites usable.	

• Usability is a never-ending process.	

• Making sites more usable ...
Follow DesignHammer!
@DesignHammer

facebook.com/DesignHammer	

www.designhammer.com
106
Upcoming SlideShare
Loading in …5
×

Get It Right the First Time Through Cheap and Easy DIY Usability Testing - Drupal Camp Asheville 2015

1,058 views

Published on

“If you want a great site, you’ve got to test.” - Steve Krug, Usability Expert

At it’s most basic, usability is about insuring something, such as a website, works well. Without usability testing results, design and functionality decisions are based on opinion. Despite the understood importance, many organizations believe usability testing is too expensive and time consuming to fit their budget and schedule. We will show how usability tests can be performed both quickly and inexpensively using popular DIY usability techniques. We will cover both analog and online tools for user surveys, card sorting, tree testing, first click testing, and user testing. You don’t need a lot of participants either—many valuable tests may be performed with as few as five subjects.

Takeaways:

What is usability testing?
What, when, and who to test?
List of free and/or inexpensive usability tools
How to plan and run your own usability test?
What to do with the data when you are done?

Published in: Internet
  • Be the first to comment

  • Be the first to like this

Get It Right the First Time Through Cheap and Easy DIY Usability Testing - Drupal Camp Asheville 2015

  1. 1. Get It Right the FirstTime Through Cheap and Easy DIY Usability Testing Saturday,August 15th
 Drupal Camp Asheville 2015 ! Stephen Pashby @DH_Stephen @DesignHammer 1
  2. 2. Overview • Introduction • What is Usability • Who,What,Where, and When • Free and/or Inexpensive Tools 2
  3. 3. Introduction 3
  4. 4. Disclaimer Let’s get this out of the way first! 4
  5. 5. Disclaimer I am not a Usability expert • I’ll share easy DIY techniques & tools I won’t tell you how to fix your website • But I will point you in the right direction 5
  6. 6. Scope What I’ll cover and what I won’t. 6
  7. 7. What we will cover • What is usability? • Why should I bother? • How can I test my site? • How do I keep my site usable? 7
  8. 8. What we won’t cover • Usability best practices • Statistical analysis of results • Every type of usability test 8
  9. 9. What is Usability? 9
  10. 10. What is usability? “Usability testing refers to evaluating a product or service by testing it with representative users.The goal is to identify any usability problems, collect qualitative and quantitative data and determine the participant's satisfaction with the product.” usability.gov 10
  11. 11. What is usability? “If there's one thing you learn by working on a lot of different Web sites, it's that almost any design idea—no matter how appallingly bad— can be made usable in the right circumstances, with enough effort.” Steve Krug, author
 Don't Make MeThink: 
 A Common Sense Approach toWeb Usability 11
  12. 12. Keep in mind • Popular≠Good • Attractive≠Usable • Ugly≠Unusable 12
  13. 13. What, when,
 and who to test? 13
  14. 14. What to test? Anything or everything? 14
  15. 15. What should you test? • Information Architecture • Navigation • User Interface elements • New Functionality • Critical User Interactions • Everything! 15
  16. 16. When to test? Is it too soon, or too late? 16
  17. 17. When to test • The sooner the better • Tests should be part of any change process • Test early and test often! 17
  18. 18. Who to test? Your opinion probably isn’t the one that matters. 18
  19. 19. Potential test subjects • Actual site users • Representative site users • Crowdsourced • Artificial intelligence 19
  20. 20. Actual site users Pros: • Most relevant to site Cons: • May have limited availability • May already have learned “work arounds” • May require compensation 20
  21. 21. Representative users Pros: • Relevant to site • Usually new to the site Cons: • Only as relevant as your recruiting • May require compensation 21
  22. 22. Crowdsourced Pros: • Readily available • Usually new to the site Cons: • May not closely model actual site users • Generally fee based 22
  23. 23. Artificial intelligence Pros: • Readily available • Complete tests in real time Cons: • May not closely model actual human users 23
  24. 24. Which is right for you? • What kind of site are you testing? • What is your site’s demographic? • What access do you have to site users? 24
  25. 25. How to test? 25
  26. 26. Types of tests One size does not fit all! 26
  27. 27. Formative Tests • Used throughout the change process. • Support tool for decision making. • Different tools for different stages. 27
  28. 28. Summative Tests • Generally QA testing. • Determine if finished feature/site is usable. • Confirm improved usability. • Also used prior to making changes to determine and document any usability problems. 28
  29. 29. Types of testing • Analytics • User Testing • Usability Testing 29
  30. 30. Analytics • Measure of actual user behavior. • May suggest usability problems. • Not a substitute for usability testing. • May provide baseline to measure success of plans derived from usability testing. 30
  31. 31. User Testing • Based on user opinion. • Not tied to specific task completion. • Can provide insight into users desires or expectations. 31
  32. 32. Usability testing • Based on task completion. • Usually measurable. 32
  33. 33. Analytics It takes time to collect data; start today! 33
  34. 34. Web Analytics Formative • Records actual site visitor interaction. • Can suggest usability problems. 34
  35. 35. Web Analytics Possible tools • Google Analytics (Google) • WebTrends Analytics (WebTrends) • AWStats (AWStats) 35
  36. 36. Heat Maps Formative • Records specific actual site visitor interaction: mouse click and scroll depth. • Can suggest usability problems. 36
  37. 37. Heat Maps Possible tools • Crazy Egg (Crazy Egg) • Hotjar (Hotjar) • Lucky Orange (Lucky Orange) • Google Analytics* (Google)
 
 *sort of 37
  38. 38. User testing Opinions are like noses, everyone’s got one. 38
  39. 39. User Surveys Formative • Ask users what they like or don’t like. • Good starting point for refining or adding new features. 39
  40. 40. User Surveys Possible tools • Paper • SurveyMonkey (SurveyMonkey) • SurveyGizmo (Widgix) • Qualtrics (Qualtrics) 40
  41. 41. A/B & Multivariate Tests Formative • Users are randomly given an implementation. • Determine which implementation is most effective based on conversion rates. 41
  42. 42. A/B & Multivariate Tests Possible tools • GoogleWebsite Optimizer (Google) • CMS Specific tools (e.g. Drupal Multivariate) • Optimizely (Optimizely) 42
  43. 43. Usability testing Choose the test based on your question. 43
  44. 44. Open Card Sort Formative • Participants organize a list of items into categories they provide. 44
  45. 45. Open Card Sort Possible tools • Index cards • Cardsort (Optimal Workshop) • UserZoom (UserZoom) 45
  46. 46. Closed Card Sort Formative • Participants organize a list of items into categories you provide. 46
  47. 47. Closed Card Sort Possible tools • Index cards • Cardsort (Optimal Workshop) • UserZoom (UserZoom) 47
  48. 48. Tree Test Formative • Asks test participants where they would go to find specific content. • Tests the organization of content if navigation labels make sense to users • Test website’s pre-defined navigation. 48
  49. 49. Tree Test Possible tools • Index cards • Treejack (Optimal Workshop) 49
  50. 50. Expectancy Test Formative • Tests a user’s impressions of an early prototype of the interface. • Typically paper prototype, wireframes, or design concepts. 50
  51. 51. Expectancy Test Possible tools • Paper Prototype • Wireframes • Design Concepts 51
  52. 52. 5-Second Usability Test Formative • Tests individual pages (not homepage) for a specific scenario and task. • Not suitable for testing complex systems or user interaction. 52
  53. 53. 5-Second Usability Test Possible tools • Paper Prototype • Wireframes • Design Concepts • FiveSecondTest (UsabilityHub) 53
  54. 54. Visual Affordance Test Formative • Tests the “Clickability/Tappability.” • Show subject web page or design concept. • Subject indicate every item believed clickable, and items believed not clickable. 54
  55. 55. Visual Affordance Test Possible tools • Paper Prototype • Wireframes • Design Concepts 55
  56. 56. Click Test Summative • Provide scenario and task. • User clicks on the design element to complete task. 56
  57. 57. Click Test Possible tools • Paper Prototype • Wireframes • Design Concepts • Chalkmark (Optimal Workshop) • Flippa (UsabilityHub) 57
  58. 58. Sample-of-One Test Summative • Document fundamental errors in interface layout, labels, content organization, affordance, and functionality • Use single subject who fits main persona. 58
  59. 59. Sample-of-One Test Possible tools • Silverback (Clearleft) • OpenHallway (OpenHallway) • TryMyUI (TryMyUI) • UXRecorder (Foraker Labs) - Mobile 59
  60. 60. Performance Test Formative or Summative • Can be to look for problems in existing site or confirm function in a new site. • Provide participants a task with a scenario • Observe user interact with website. 60
  61. 61. Performance Test Possible tools • Silverback (Clearleft) • OpenHallway (OpenHallway) • TryMyUI (TryMyUI) • UXRecorder (Foraker Labs) - Mobile 61
  62. 62. Free Exploration Test Summative • Observe users interaction with website for set period of time (5 minutes?). • Use when navigation is no longer an issue. 62
  63. 63. Free Exploration Test Possible tools • Silverback (Clearleft) • OpenHallway (OpenHallway) • TryMyUI (TryMyUI) • UXRecorder (Foraker Labs) - Mobile 63
  64. 64. Free and Inexpensive TestingTools 64
  65. 65. Survey Monkey Likes: • Robust question functionality & reporting. • Filter response data by response or URL. • Data export to allow manipulation in excel. Be Aware: • Some features require more pricey plans. 65
  66. 66. Survey Monkey 66
  67. 67. Survey Monkey 67
  68. 68. Survey Monkey 68
  69. 69. Survey Monkey 69
  70. 70. Survey Monkey 70
  71. 71. Survey Monkey 71
  72. 72. Survey Monkey 72
  73. 73. CrazyEgg Likes: • Variety of ways to filter/visual data • Can test mobile and desktop Be Aware: • Not real time. • Not cheap to monitor entire sites. 73
  74. 74. Crazy Egg 74
  75. 75. Crazy Egg 75
  76. 76. Crazy Egg 76
  77. 77. Crazy Egg 77
  78. 78. Crazy Egg 78
  79. 79. Crazy Egg 79
  80. 80. Crazy Egg 80
  81. 81. Crazy Egg 81
  82. 82. Crazy Egg 82
  83. 83. Crazy Egg 83
  84. 84. Optimal Sort Likes: • Easy to set up. • Can use for remote testing. Be Aware: • Normalizing data requires assumptions. • Not cheap if you need the full version. 84
  85. 85. Optimal Sort 85
  86. 86. Optimal Sort 86
  87. 87. Optimal Sort 87
  88. 88. Optimal Sort 88
  89. 89. Optimal Sort 89
  90. 90. Optimal Sort 90
  91. 91. Treejack Likes: • Easy to set up. • Can use for remote testing. Be Aware: • Not cheap if you need the full version. 91
  92. 92. Treejack 92
  93. 93. Treejack 93
  94. 94. Treejack 94
  95. 95. Treejack 95
  96. 96. Treejack 96
  97. 97. Chalkmark Likes: • Easy to set up. • Can use for remote testing. Be Aware: • Only single response per question. • Not cheap if you need the full version. 97
  98. 98. Chalkmark 98
  99. 99. Chalkmark 99
  100. 100. Chalkmark 100
  101. 101. Chalkmark 101
  102. 102. Silverback Likes: • Portable, works well on a standard laptop. • Does not require a dedicated usability lab. Be Aware: • Mac only. • For on location testing. 102
  103. 103. Silverback 103
  104. 104. Conclusion 104
  105. 105. Conclusion • No silver bullet to make sites usable. • Usability is a never-ending process. • Making sites more usable is fun for all! 105
  106. 106. Follow DesignHammer! @DesignHammer
 facebook.com/DesignHammer www.designhammer.com 106

×