1
What is a usability test?

2
Sit next to someone.
Watch. Listen.
Dana Chisnell

3
When
something
changes
Take
constraints
into account
Complement to Reveal
best practice remedies

4
Hesitating
Comments
Questions
Body
language
What to look for Behaviors

5
Ballot testing.
Dana Chisnell

The question
6

7
The question
How
successfully
do voters
vote?

The plan
8

9
1 day
Dana Chisnell

10
a ballot and instructions
Nancy Frishberg

11
voter participants
Dana Chisnell

12
observers
Dana Chisnell

13
results due: today

14

15

16
How we got value
 Used the ballots and instructions at hand
 Focused on one thing at a time
 Had participants generate and collect
data
 Drafted observers and debriefed

17
1. Plan, minimally
2. Get the team on
board
3. Use the LEO Kit
4. Recruit
participants
5. Conduct
sessions
Follow these steps: 6. Debrief and
decide

18
Conduct
sessions
 Rehearse (P1)
 Checklist of tasks
 Short, focused sessions
 Adjust what you’re doing, if you
need to
Dana Chisnell

19
Greet the
participant
Explain the test,
your role, and
their role
Watch the voter
vote
Ask follow-up
questions
Debrief with
participant
Session outline Debrief with
observers

20
Impartial,
unbiased
observing
No teaching!
Listen and watch
Ask open-ended
questions: Why?
Moderating, not training How? What?

21
Debrief and
decide
 What could cause a recount?
 What could make it difficult to
tell intent?
 What could draw unwanted
attention?
 What could cost money if it is
not fixed?
Dana Chisnell

22
Resources
• Usability Professionals’
Association:
www.usabilityprofessionals.org/
• LEO Usability Testing Kit:
www.usabilityprofessionals.org/
civiclife/voting/leo_testing.html
• Ballot Usability and Accessibility
Blog: ballotusability.blogspot.com/