Lessons learned and tips for running user testing when you don't have a lot of time, staff, budget, or visual design or coding skills (or all of the above!). Presented at edUI 2018.
12
Content Prototypes
Low-fi, text-only method to create and
iterate on a touchpoint, a flow, or an
end-to-end journey
Create using:
Pen and paper Microsoft Word
Google Docs
13
Content Prototypes
During kick-off or initial discovery, use
content prototypes to draft and align
on:
• Overall narrative structure and flow of
information
• Tone of voice
• Words that work and words to avoid
14
Content Prototypes
For early rounds of design and iteration,
turn to content prototypes to:
• Gut-check copy as you integrate feedback
• Co-write revisions
• Head into hi-fi prototyping and design
with a complete and realistic draft of
content #noloremipsum
15
Content Prototypes
Working from something that already
exists? Content prototypes can help
you:
• Audit existing content
• Benchmark strengths
• Identify gaps
16
Wireframes
Simple approximation of a page’s
interface that specifically focuses on
order and hierarchy of content,
functionality, and intended behaviors
Test your wireframes before beginning
design and development work to
validate:
• Organization of content
• Prioritization of features
• Missing or unnecessary features
• Clarity and effectiveness of interface copy
17
Wireframes
Keep these best practices in mind:
• Do not wireframe with Lorem Ipsum!
Always work with real words. Always.
• Try to work at a small screen size to avoid
focusing too much on specific layout and
design choices.
Create using:
Pen and paper PowerPoint
Balsamiq Illustrator
Sketch Adobe Xd
Photo by Anomaly on Unsplash 21
Clickable Prototypes
High-fidelity, interactive representation
of your end-state product (site, app,
and so on)
Create using:
InVision Figma
Adobe XD Keynote/PowerPoint
24
People Around You
Coordinating times and location can
be easier.
You don’t necessarily have to
provide compensation for
participants.
You can act in the spur of the
moment and keep sessions short
and informal.
+
+
+
25
People Around You
They’re more familiar with your
brand, product, or services than the
average person.
Your team may be less
representative of your user base or
target audience.
-
-
Photo by NeONBRAND on Unsplash 26
Online User Testing
There’s usually a built-in pool of
research participants.
Testing sessions can happen
anywhere, any time.
You can opt to run unmoderated
sessions if you don’t have bandwidth
to facilitate the session live.
+
+
+
Photo by NeONBRAND on Unsplash 27
Online User Testing
Participants can be pretty
technologically savvy.
Getting multiple licenses for your
testing platform can get expensive.
If the test is unmoderated, you can’t
directly observe participants or ask
follow-up questions in the moment.
-
-
-
29
Guerilla User Testing
Users don’t have to be recruited and
scheduled ahead of time.
You can pull together a testing
session on relatively short notice.
No testing venue needed. You test
right there on the spot.
+
+
+
30
Guerilla User Testing
Testing sessions need to be kept
short. No more than five minutes.
You are limited to the pool of
potential participants at the location
you choose.
A public setting will likely be loud,
busy, and potentially distracting.
You must be comfortable with
approaching strangers.
-
-
-
-
Guerilla User Testing
• Scout the location ahead of time.
When is it busiest? How is the wifi?
• Prep your computer or device (create
a different profile, or clean up the
desktop and disable notifications).
• Keep technology as light as possible.
You want to be mobile!
• Have an incentive to help recruit
users.
32
Partner With a Local
Organization
The partner organization can help
facilitate recruiting and scheduling
participants.
You will be able to vet participants
ahead of time to ensure a good fit.
You can schedule testing sessions
for longer periods of time.
The partner organization may be
able to help coordinate a testing
venue as well.
+
+
+
+
The pool of participants may be less
diverse than desired.
Establishing this relationship can be
tricky and require quite a bit of
legwork.
-
-
33
Partner With a Local
Organization
37
Takes Notes By Hand
If your team prefers to be analog:
• Agree on areas of feedback and visual
shorthand ahead of time.
• Have a shared place where each person
can upload a copy of their notes.
• Debrief as a group at the end of the day to
capture key takeaways and agree on next
steps while everything is fresh.
38
Take Notes Digitally
If your team prefers an online solution,
check out Google Forms:
• Create a template to capture quantitative
and qualitative feedback.
• Export results to Google Sheets and
create charts, graphs, and other ways to
share the data you’ve collected.
39
Take Notes Digitally
If your team prefers an online solution,
check out Google Forms:
• Create a template to capture quantitative
and qualitative feedback.
• Export results to Google Sheets and
create charts, graphs, and other ways to
share the data you’ve collected.
40
Why Record Your Testing Sessions?
Go back later, verify
your observations, and
fill in gaps in your notes
Pull video clips or
quotes to include in
research recaps
Enable others in your
organization to view
the testing sessions
41
Record Screen and
User Reactions
There are many options to choose from. Some easy, affordable solutions include:
QuickTime
Record screen, audio, and mouse clicks
Available by default on Mac
For a PC-compatible alternative to QuickTime,
try CamStudio.
43
Record Screen and
User Reactions
There are many options to choose from. Some easy, affordable solutions include:
QuickTime
Record screen, audio, and mouse clicks
Available by default on Mac
For a PC-compatible alternative to QuickTime,
try CamStudio.
Silverback
Record screen, audio, mouse clicks, and
user reactions
https://silverbackapp.com/
45
Record Screen and
User Reactions
There are many options to choose from. Some easy, affordable solutions include:
QuickTime
Record screen, audio, and mouse clicks
Available by default on Mac
For a PC-compatible alternative to QuickTime,
try CamStudio.
Reflector
Display mobile or tablet screen on your laptop
Compatible with Mac, Windows and Android
http://www.airsquirrels.com/reflector/
Silverback
Record screen, audio, mouse clicks, and
user reactions
https://silverbackapp.com/
48
You Got This!
Anyone can put together an awesome user
testing session.
Consider methods that are less traditional
but equally effective. Work with whatcha got!
If you’re not already testing your ideas with
users, start today.
Books
Don’t Make Me Think – Steve Krug
http://sensible.com/dmmt.html
Rocket Surgery Made Easy – Steve Krug
http://sensible.com/rsme.html
Just Enough Research – Erika Hall
https://abookapart.com/products/just-enough-research
Guerilla User Testing
A Guide to the Art of Guerilla UX Testing
https://medium.springboard.com/a-guide-to-the-art-of-guerrilla-ux-testing-
69a1411d34fb
10 Tips for ‘Ambush Guerilla User Testing’
http://www.currybet.net/cbet_blog/2010/06/10-tips-for-ambush-guerilla-us.php
Getting Guerrilla With It
https://uxmag.com/articles/getting-guerrilla-with-it
Prototyping
High vs. Low Fidelity
https://www.nngroup.com/articles/ux-prototype-hi-lo-fidelity/
4 Ways to Get Started with Content Testing
https://www.slideshare.net/ShannonLeahy2/4-ways-to-get-started-with-content-
testing
Online User Testing Platforms
UsabilityHub
https://usabilityhub.com
Userlytics
https://www.userlytics.com
UserTesting
https://www.usertesting.com