Quick start guide to
guerrilla usability testing
Lily Dart
Head of Service Design
dxw
We use guerrilla testing
because it’s cheap,
simple and effective
@lily_dart
Quick start guide to guerrilla testing
“the art of pouncing on lone people
in cafes and public spaces, [then]
quickly filming them whilst they use
a website for a couple of minutes”
@lily_dart
@MartinBelam
Quick start guide to guerrilla testing
@lily_dart
Quick start guide to guerrilla testing
Each 10-15 min session includes:
@lily_dart
Quick start guide to guerrilla testing
Your introduction and explanation
Each 10-15 min session includes:
@lily_dart
Quick start guide to guerrilla testing
Gaining permission and written consent
Your introduction and explanation
Each 10-15 min session includes:
@lily_dart
Quick start guide to guerrilla testing
Gaining permission and written consent
Questions about your participant
Your introduction and explanation
Each 10-15 min session includes:
@lily_dart
Quick start guide to guerrilla testing
Gaining permission and written consent
Questions about your participant
Your introduction and explanation
Each 10-15 min session includes:
2 or 3 tasks for the participant
@lily_dart
Quick start guide to guerrilla testing
Evaluating usability
@lily_dart
Quick start guide to guerrilla testing
Evaluating usability
Can they navigate the site?
@lily_dart
Quick start guide to guerrilla testing
Evaluating usability
Can they understand your key messages?
Can they navigate the site?
@lily_dart
Quick start guide to guerrilla testing
Can they understand your key messages?
Can they complete user journeys?
Can they navigate the site?
Evaluating usability
@lily_dart
Quick start guide to guerrilla testing
Making feedback fairer
@lily_dart
Quick start guide to guerrilla testing
Help to push back on poor usability decisions
Making feedback fairer
@lily_dart
Quick start guide to guerrilla testing
Feedback about design decisions less personal
Help to push back on poor usability decisions
Making feedback fairer
@lily_dart
Quick start guide to guerrilla testing
Feedback about design decisions less personal
Measure websites against real metrics
Help to push back on poor usability decisions
Making feedback fairer
@lily_dart
Preparing a session
Quick start guide to guerrilla testing
@lily_dart
Quick start guide to guerrilla testing
Preparing a session
Venue
@lily_dart
Quick start guide to guerrilla testing
Preparing a session
Where will you find your audience?
Venue
@lily_dart
Quick start guide to guerrilla testing
Preparing a session
Can they stop for 10 minutes?
Where will you find your audience?
Venue
@lily_dart
Quick start guide to guerrilla testing
Can they stop for 10 minutes?
Will you have internet access?
Where will you find your audience?
Venue
Preparing a session
@lily_dart
Quick start guide to guerrilla testing
Preparing a session
Environment
@lily_dart
Quick start guide to guerrilla testing
Preparing a session
What time of day is best?
Environment
@lily_dart
Quick start guide to guerrilla testing
Preparing a session
Will people be distracted?
What time of day is best?
Environment
@lily_dart
Quick start guide to guerrilla testing
Will people be distracted?
Will they be alone, or with family or friends?
What time of day is best?
Environment
Preparing a session
@lily_dart
Quick start guide to guerrilla testing
Devices
Preparing a session
@lily_dart
Quick start guide to guerrilla testing
Preparing a session
Which devices does your audience use?
Devices
@lily_dart
Quick start guide to guerrilla testing
Can you record from that device?
Which devices does your audience use?
Devices
Preparing a session
@lily_dart
The script
Quick start guide to guerrilla testing
@lily_dart
Quick start guide to guerrilla testing
The script
Practised introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Who are you?
Practised introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Why are you there?
Who are you?
Practised introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Why are you there?
What do you want from them?
Who are you?
Practised introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Hi, do you have a minute?
My name is Lily and I work for a web agency. I’m here
asking people to take a look at a website and let me
know what they think, and recording the answers. In
return for your time, we’ll buy you a coffee or slice of
cake to say thank you.
Do you have 10 minutes to spend with me?
Example introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Hi, do you have a minute?
My name is Lily and I work for a web agency. I’m here
asking people to take a look at a website and let me
know what they think, and recording the answers. In
return for your time, we’ll buy you a coffee or slice of
cake to say thank you.
Do you have 10 minutes to spend with me?
Example introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Hi, do you have a minute?
My name is Lily and I work for a web agency. I’m here
asking people to take a look at a website and let me
know what they think, and recording the answers. In
return for your time, we’ll buy you a coffee or slice of
cake to say thank you.
Do you have 10 minutes to spend with me?
Example introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Hi, do you have a minute?
My name is Lily and I work for a web agency. I’m here
asking people to take a look at a website and let me
know what they think, and recording the answers. In
return for your time, we’ll buy you a coffee or slice of
cake to say thank you.
Do you have 10 minutes to spend with me?
Example introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Hi, do you have a minute?
My name is Lily and I work for a web agency. I’m here
asking people to take a look at a website and let me
know what they think, and recording the answers. In
return for your time, we’ll buy you a coffee or slice of
cake to say thank you.
Do you have 10 minutes to spend with me?
Example introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Hi, do you have a minute?
My name is Lily and I work for a web agency. I’m here
asking people to take a look at a website and let me
know what they think, and recording the answers. In
return for your time, we’ll buy you a coffee or slice of
cake to say thank you.
Do you have 10 minutes to spend with me?
Example introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Hi, do you have a minute?
My name is Lily and I work for a web agency. I’m here
asking people to take a look at a website and let me
know what they think, and recording the answers. In
return for your time, we’ll buy you a coffee or slice of
cake to say thank you.
Do you have 10 minutes to spend with me?
Example introduction
@lily_dart
Quick start guide to guerrilla testing
The script
Contextual questions
@lily_dart
Quick start guide to guerrilla testing
The script
Contextual questions
Are they part of your target audience?
@lily_dart
Quick start guide to guerrilla testing
The script
“What is your residential status?”
“Do you live with anyone?”
“Where do you live?”
“Are you employed?”
Example questions
@lily_dart
Quick start guide to guerrilla testing
The script
Contextual questions
Which audience segment are they part of?
Are they part of your target audience?
@lily_dart
Quick start guide to guerrilla testing
The script
Contextual questions
Which audience segment are they part of?
Are they aware of the product or service?
Are they part of your target audience?
@lily_dart
Quick start guide to guerrilla testing
The script
Scenarios
@lily_dart
Quick start guide to guerrilla testing
The script
You have just moved to Holloway Road in North
London and want to get your hair cut.
You’ve had bad experiences with hairdressers
before and want to be sure the salon has a
good reputation. Which salon would you go to,
and why?
Example scenario
@lily_dart
Quick start guide to guerrilla testing
The script
Scenarios
@lily_dart
Quick start guide to guerrilla testing
The script
Scenarios
Which user need are you testing?
@lily_dart
Quick start guide to guerrilla testing
The script
Scenarios
What might create that need?
Which user need are you testing?
@lily_dart
Quick start guide to guerrilla testing
The script
What might create that need?
When has a user fulfilled that need?
Which user need are you testing?
Scenarios
@lily_dart
Anatomy of a scenario
Quick start guide to guerrilla testing
@lily_dart
is easy for participants to
relate to
A good scenario
Anatomy of a scenario
Quick start guide to guerrilla testing
You have just moved to Holloway Road in North
London and want to get your hair cut.
You’ve had bad experiences with hairdressers
before and want to be sure the salon has a
good reputation. Which salon would you go to,
and why?
@lily_dart
Quick start guide to guerrilla testing
Example scenario
Anatomy of a scenario
@lily_dart
A good scenario
describes a problem for
participants to solve
Anatomy of a scenario
Quick start guide to guerrilla testing
You have just moved to Holloway Road in North
London and want to get your hair cut.
You’ve had bad experiences with hairdressers
before and want to be sure the salon has a
good reputation. Which salon would you go to,
and why?
@lily_dart
Quick start guide to guerrilla testing
Example scenario
Anatomy of a scenario
@lily_dart
A good scenario
has a realistic level
of detail
Anatomy of a scenario
Quick start guide to guerrilla testing
You have just moved to Holloway Road in North
London and want to get your hair cut.
You’ve had bad experiences with hairdressers
before and want to be sure the salon has a
good reputation. Which salon would you go to,
and why?
@lily_dart
Quick start guide to guerrilla testing
Example scenario
Anatomy of a scenario
@lily_dart
A good scenario
doesn’t hint to the
participant how to achieve
the goal
Anatomy of a scenario
Quick start guide to guerrilla testing
You have just moved to Holloway Road in
North London and want to get your hair cut.
You’ve had bad experiences with hairdressers
before and want to be sure the salon has a
good reputation. Which salon would you go to,
and why?
@lily_dart
Quick start guide to guerrilla testing
Example scenario
Anatomy of a scenario
@lily_dart
Running a session
Quick start guide to guerrilla testing
@lily_dart
Quick start guide to guerrilla testing
Running a session
Making participants comfortable
@lily_dart
Quick start guide to guerrilla testing
Running a session
You’re testing the site, not them
Making participants comfortable
@lily_dart
Quick start guide to guerrilla testing
Running a session
Set clear expectations about what will happen
You’re testing the site, not them
Making participants comfortable
@lily_dart
Quick start guide to guerrilla testing
Running a session
Set clear expectations about what will happen
Check-in with them regularly
You’re testing the site, not them
Making participants comfortable
@lily_dart
Quick start guide to guerrilla testing
Running a session
Set clear expectations about what will happen
Check-in with them regularly
You’re testing the site, not them
Making participants comfortable
Let them know they can stop at any time
@lily_dart
Quick start guide to guerrilla testing
Running a session
Before a scenario
ask participants to describe
their thoughts
@lily_dart
Quick start guide to guerrilla testing
Running a session
“Is this what you expected to see?”
“What would you do next?”
“What are you thinking at the moment?”
Open prompts
@lily_dart
Quick start guide to guerrilla testing
During a scenario
let participants identify
success
Running a session
@lily_dart
Quick start guide to guerrilla testing
After a scenario
get participants to tell you
what they’d do next
Running a session
@lily_dart
Quick start guide to guerrilla testing
In conclusion
@lily_dart
Quick start guide to guerrilla testing
Pick a location where your audience is
In conclusion
@lily_dart
Quick start guide to guerrilla testing
Focus your session on scenario based tasks
Pick a location where your audience is
In conclusion
@lily_dart
Quick start guide to guerrilla testing
Focus your session on scenario based tasks
Let participants decide success
Pick a location where your audience is
In conclusion
@lily_dart
Quick start guide to guerrilla testing
Focus your session on scenario based tasks
Let participants decide success
Pick a location where your audience is
In conclusion
Understand what they’d do next
@lily_dart
Quick start guide to guerrilla testing
Gives us the power to:
@lily_dart
Quick start guide to guerrilla testing
Push back on bad decisions
Gives us the power to:
@lily_dart
Quick start guide to guerrilla testing
Stop designing against client opinions
Push back on bad decisions
Gives us the power to:
@lily_dart
Quick start guide to guerrilla testing
Stop designing against client opinions
Measure against real metrics
Push back on bad decisions
Gives us the power to:
Thank you
Any questions?
@lily_dart
Quick start guide to guerrilla testing

The quick start guide to guerrilla usability testing

  • 1.
    Quick start guideto guerrilla usability testing Lily Dart Head of Service Design dxw
  • 2.
    We use guerrillatesting because it’s cheap, simple and effective @lily_dart Quick start guide to guerrilla testing
  • 3.
    “the art ofpouncing on lone people in cafes and public spaces, [then] quickly filming them whilst they use a website for a couple of minutes” @lily_dart @MartinBelam Quick start guide to guerrilla testing
  • 4.
    @lily_dart Quick start guideto guerrilla testing Each 10-15 min session includes:
  • 5.
    @lily_dart Quick start guideto guerrilla testing Your introduction and explanation Each 10-15 min session includes:
  • 6.
    @lily_dart Quick start guideto guerrilla testing Gaining permission and written consent Your introduction and explanation Each 10-15 min session includes:
  • 7.
    @lily_dart Quick start guideto guerrilla testing Gaining permission and written consent Questions about your participant Your introduction and explanation Each 10-15 min session includes:
  • 8.
    @lily_dart Quick start guideto guerrilla testing Gaining permission and written consent Questions about your participant Your introduction and explanation Each 10-15 min session includes: 2 or 3 tasks for the participant
  • 9.
    @lily_dart Quick start guideto guerrilla testing Evaluating usability
  • 10.
    @lily_dart Quick start guideto guerrilla testing Evaluating usability Can they navigate the site?
  • 11.
    @lily_dart Quick start guideto guerrilla testing Evaluating usability Can they understand your key messages? Can they navigate the site?
  • 12.
    @lily_dart Quick start guideto guerrilla testing Can they understand your key messages? Can they complete user journeys? Can they navigate the site? Evaluating usability
  • 13.
    @lily_dart Quick start guideto guerrilla testing Making feedback fairer
  • 14.
    @lily_dart Quick start guideto guerrilla testing Help to push back on poor usability decisions Making feedback fairer
  • 15.
    @lily_dart Quick start guideto guerrilla testing Feedback about design decisions less personal Help to push back on poor usability decisions Making feedback fairer
  • 16.
    @lily_dart Quick start guideto guerrilla testing Feedback about design decisions less personal Measure websites against real metrics Help to push back on poor usability decisions Making feedback fairer
  • 17.
    @lily_dart Preparing a session Quickstart guide to guerrilla testing
  • 18.
    @lily_dart Quick start guideto guerrilla testing Preparing a session Venue
  • 19.
    @lily_dart Quick start guideto guerrilla testing Preparing a session Where will you find your audience? Venue
  • 20.
    @lily_dart Quick start guideto guerrilla testing Preparing a session Can they stop for 10 minutes? Where will you find your audience? Venue
  • 21.
    @lily_dart Quick start guideto guerrilla testing Can they stop for 10 minutes? Will you have internet access? Where will you find your audience? Venue Preparing a session
  • 22.
    @lily_dart Quick start guideto guerrilla testing Preparing a session Environment
  • 23.
    @lily_dart Quick start guideto guerrilla testing Preparing a session What time of day is best? Environment
  • 24.
    @lily_dart Quick start guideto guerrilla testing Preparing a session Will people be distracted? What time of day is best? Environment
  • 25.
    @lily_dart Quick start guideto guerrilla testing Will people be distracted? Will they be alone, or with family or friends? What time of day is best? Environment Preparing a session
  • 26.
    @lily_dart Quick start guideto guerrilla testing Devices Preparing a session
  • 27.
    @lily_dart Quick start guideto guerrilla testing Preparing a session Which devices does your audience use? Devices
  • 28.
    @lily_dart Quick start guideto guerrilla testing Can you record from that device? Which devices does your audience use? Devices Preparing a session
  • 29.
    @lily_dart The script Quick startguide to guerrilla testing
  • 30.
    @lily_dart Quick start guideto guerrilla testing The script Practised introduction
  • 31.
    @lily_dart Quick start guideto guerrilla testing The script Who are you? Practised introduction
  • 32.
    @lily_dart Quick start guideto guerrilla testing The script Why are you there? Who are you? Practised introduction
  • 33.
    @lily_dart Quick start guideto guerrilla testing The script Why are you there? What do you want from them? Who are you? Practised introduction
  • 34.
    @lily_dart Quick start guideto guerrilla testing The script Hi, do you have a minute? My name is Lily and I work for a web agency. I’m here asking people to take a look at a website and let me know what they think, and recording the answers. In return for your time, we’ll buy you a coffee or slice of cake to say thank you. Do you have 10 minutes to spend with me? Example introduction
  • 35.
    @lily_dart Quick start guideto guerrilla testing The script Hi, do you have a minute? My name is Lily and I work for a web agency. I’m here asking people to take a look at a website and let me know what they think, and recording the answers. In return for your time, we’ll buy you a coffee or slice of cake to say thank you. Do you have 10 minutes to spend with me? Example introduction
  • 36.
    @lily_dart Quick start guideto guerrilla testing The script Hi, do you have a minute? My name is Lily and I work for a web agency. I’m here asking people to take a look at a website and let me know what they think, and recording the answers. In return for your time, we’ll buy you a coffee or slice of cake to say thank you. Do you have 10 minutes to spend with me? Example introduction
  • 37.
    @lily_dart Quick start guideto guerrilla testing The script Hi, do you have a minute? My name is Lily and I work for a web agency. I’m here asking people to take a look at a website and let me know what they think, and recording the answers. In return for your time, we’ll buy you a coffee or slice of cake to say thank you. Do you have 10 minutes to spend with me? Example introduction
  • 38.
    @lily_dart Quick start guideto guerrilla testing The script Hi, do you have a minute? My name is Lily and I work for a web agency. I’m here asking people to take a look at a website and let me know what they think, and recording the answers. In return for your time, we’ll buy you a coffee or slice of cake to say thank you. Do you have 10 minutes to spend with me? Example introduction
  • 39.
    @lily_dart Quick start guideto guerrilla testing The script Hi, do you have a minute? My name is Lily and I work for a web agency. I’m here asking people to take a look at a website and let me know what they think, and recording the answers. In return for your time, we’ll buy you a coffee or slice of cake to say thank you. Do you have 10 minutes to spend with me? Example introduction
  • 40.
    @lily_dart Quick start guideto guerrilla testing The script Hi, do you have a minute? My name is Lily and I work for a web agency. I’m here asking people to take a look at a website and let me know what they think, and recording the answers. In return for your time, we’ll buy you a coffee or slice of cake to say thank you. Do you have 10 minutes to spend with me? Example introduction
  • 41.
    @lily_dart Quick start guideto guerrilla testing The script Contextual questions
  • 42.
    @lily_dart Quick start guideto guerrilla testing The script Contextual questions Are they part of your target audience?
  • 43.
    @lily_dart Quick start guideto guerrilla testing The script “What is your residential status?” “Do you live with anyone?” “Where do you live?” “Are you employed?” Example questions
  • 44.
    @lily_dart Quick start guideto guerrilla testing The script Contextual questions Which audience segment are they part of? Are they part of your target audience?
  • 45.
    @lily_dart Quick start guideto guerrilla testing The script Contextual questions Which audience segment are they part of? Are they aware of the product or service? Are they part of your target audience?
  • 46.
    @lily_dart Quick start guideto guerrilla testing The script Scenarios
  • 47.
    @lily_dart Quick start guideto guerrilla testing The script You have just moved to Holloway Road in North London and want to get your hair cut. You’ve had bad experiences with hairdressers before and want to be sure the salon has a good reputation. Which salon would you go to, and why? Example scenario
  • 48.
    @lily_dart Quick start guideto guerrilla testing The script Scenarios
  • 49.
    @lily_dart Quick start guideto guerrilla testing The script Scenarios Which user need are you testing?
  • 50.
    @lily_dart Quick start guideto guerrilla testing The script Scenarios What might create that need? Which user need are you testing?
  • 51.
    @lily_dart Quick start guideto guerrilla testing The script What might create that need? When has a user fulfilled that need? Which user need are you testing? Scenarios
  • 52.
    @lily_dart Anatomy of ascenario Quick start guide to guerrilla testing
  • 53.
    @lily_dart is easy forparticipants to relate to A good scenario Anatomy of a scenario Quick start guide to guerrilla testing
  • 54.
    You have justmoved to Holloway Road in North London and want to get your hair cut. You’ve had bad experiences with hairdressers before and want to be sure the salon has a good reputation. Which salon would you go to, and why? @lily_dart Quick start guide to guerrilla testing Example scenario Anatomy of a scenario
  • 55.
    @lily_dart A good scenario describesa problem for participants to solve Anatomy of a scenario Quick start guide to guerrilla testing
  • 56.
    You have justmoved to Holloway Road in North London and want to get your hair cut. You’ve had bad experiences with hairdressers before and want to be sure the salon has a good reputation. Which salon would you go to, and why? @lily_dart Quick start guide to guerrilla testing Example scenario Anatomy of a scenario
  • 57.
    @lily_dart A good scenario hasa realistic level of detail Anatomy of a scenario Quick start guide to guerrilla testing
  • 58.
    You have justmoved to Holloway Road in North London and want to get your hair cut. You’ve had bad experiences with hairdressers before and want to be sure the salon has a good reputation. Which salon would you go to, and why? @lily_dart Quick start guide to guerrilla testing Example scenario Anatomy of a scenario
  • 59.
    @lily_dart A good scenario doesn’thint to the participant how to achieve the goal Anatomy of a scenario Quick start guide to guerrilla testing
  • 60.
    You have justmoved to Holloway Road in North London and want to get your hair cut. You’ve had bad experiences with hairdressers before and want to be sure the salon has a good reputation. Which salon would you go to, and why? @lily_dart Quick start guide to guerrilla testing Example scenario Anatomy of a scenario
  • 61.
    @lily_dart Running a session Quickstart guide to guerrilla testing
  • 62.
    @lily_dart Quick start guideto guerrilla testing Running a session Making participants comfortable
  • 63.
    @lily_dart Quick start guideto guerrilla testing Running a session You’re testing the site, not them Making participants comfortable
  • 64.
    @lily_dart Quick start guideto guerrilla testing Running a session Set clear expectations about what will happen You’re testing the site, not them Making participants comfortable
  • 65.
    @lily_dart Quick start guideto guerrilla testing Running a session Set clear expectations about what will happen Check-in with them regularly You’re testing the site, not them Making participants comfortable
  • 66.
    @lily_dart Quick start guideto guerrilla testing Running a session Set clear expectations about what will happen Check-in with them regularly You’re testing the site, not them Making participants comfortable Let them know they can stop at any time
  • 67.
    @lily_dart Quick start guideto guerrilla testing Running a session Before a scenario ask participants to describe their thoughts
  • 68.
    @lily_dart Quick start guideto guerrilla testing Running a session “Is this what you expected to see?” “What would you do next?” “What are you thinking at the moment?” Open prompts
  • 69.
    @lily_dart Quick start guideto guerrilla testing During a scenario let participants identify success Running a session
  • 70.
    @lily_dart Quick start guideto guerrilla testing After a scenario get participants to tell you what they’d do next Running a session
  • 71.
    @lily_dart Quick start guideto guerrilla testing In conclusion
  • 72.
    @lily_dart Quick start guideto guerrilla testing Pick a location where your audience is In conclusion
  • 73.
    @lily_dart Quick start guideto guerrilla testing Focus your session on scenario based tasks Pick a location where your audience is In conclusion
  • 74.
    @lily_dart Quick start guideto guerrilla testing Focus your session on scenario based tasks Let participants decide success Pick a location where your audience is In conclusion
  • 75.
    @lily_dart Quick start guideto guerrilla testing Focus your session on scenario based tasks Let participants decide success Pick a location where your audience is In conclusion Understand what they’d do next
  • 76.
    @lily_dart Quick start guideto guerrilla testing Gives us the power to:
  • 77.
    @lily_dart Quick start guideto guerrilla testing Push back on bad decisions Gives us the power to:
  • 78.
    @lily_dart Quick start guideto guerrilla testing Stop designing against client opinions Push back on bad decisions Gives us the power to:
  • 79.
    @lily_dart Quick start guideto guerrilla testing Stop designing against client opinions Measure against real metrics Push back on bad decisions Gives us the power to:
  • 80.
    Thank you Any questions? @lily_dart Quickstart guide to guerrilla testing