SlideShare a Scribd company logo
1 of 38
Download to read offline
Chris Bush
UX Practice Lead
@wearesigma / @suthen
Chris Bush
UX Practice Lead
@wearesigma / @suthen
Taking your research further
A bit about Sigma (our services and clients)
Why talk about guerrilla testing?
Getting started with guerrilla testing
Wrap up
 User Research & Testing
 Interface & Interaction Design
 Web, Mobile & Application Development
 Enterprise Content Management
 Training & Support
Expensive
- no budget
Time /
Resource
consuming
- delays
development
Not a primary
concern
- Focus on
traffic
acquisition
Pros:
• Users are often in a more informal environment
(comfortable and relaxed)
• Great for bringing in teams together to observe
users (and discuss)
• Help and support when defining tasks and
scenarios
• Less likely to introduce moderator bias
• Detailed external provider analysis and reports
• More likely to use advanced data collection
(Eye tracking)
Cons:
• Can be costly
• Less likely to want to invest in early stage testing
(Prototypes and early beta code)
• Less likely to perform iterative tests
Pros:
• Requires no specialist equipment - only low cost
software
• Very portable (on location, café, office, home)
• Great for early stage testing (Prototypes, etc.)
• Great for Rapid Iterative Testing and Evaluation
(RITE)
• Minimal overhead (Time, People, Cost)
Cons:
• Moderator or reviewer bias
• The team takes on responsibility for ensuring
everything is organised
(Users, Room, Tasks, Write up)
• Finding a good testing room is sometimes tricky
• Any users are better than none
but aim for two rounds: 5-10 per round
• Aim for a good cross-section of representative users
• Max 30-45 minutes to complete (around 5 tasks)
• Create meaningful tasks – word tasks as scenarios *
• Think aloud and retrospective think aloud
• Discussion guide – consistency is important
• Rotate tasks (ABC / BCA / CAB) to remove bias
• Use a scribe *
• Don’t be to specific
“Find and fill in the customer returns
form.”
• Allow users the opportunity to decide what the most
suitable solution is to the same problem
“After receiving your new camera you
have noticed the lens is cracked. Using the
site can you request a replacement.“
• Be pragmatic about leading questions
• But, always do a control test.
(you’re testing your questions at this point)
Sit back
from the
participant
Screen
projection
can be
useful
Scribe sits
away from
the main
study
• Use the most comfortable room
you can find
• Sit back from the user
• Try to be out of their field of view
• Use reflective questions
• Don’t be a Monster!
• If the user is struggling help them
• A second set of eyes helps to remove any bias
• It can save you hours of review time
• Define a coding system to help identify themes when
taking notes
• .N – Navigation
• .S – Search
• .C – Content / Information
• .D – Design
• .T – Trust and credibility
• Time code your notes
• Spend 30mins after each session doing light analysis.
Use a text
expander
http://www.90percentofeverything.com/2010/05/07/quick-tip-make-your-own-iphone-usability-testing-sled-for-5/
Interviews
Surveys
User
testing
Remote
User
testing
Interviews
Surveys
User
testing
Remote
User
testing
• Always aim to test on five to ten people and for best results run
two iterations of your tests
• Test your questions on real people before you do your test. They
nearly always need refinement
• Take time to set up your room to make it as comfortable as
possible.
• Remember to sit back from the user so they don’t feel like they
are being watched too closely.
• Use reflective questioning.
Participant: “Why did that happen when I clicked there?”
You: “Why do you think that happened?”
• Use a scribe to ensure you get the most out of the session. It also
helps remove any moderator bias.
• Code your notes as you go to save you time in analysis.
(-n for navigation issues, -f for form issues, etc.)
• Take 15mins after each session to review the analysis and
categorise the results. Do not try to solution new ideas at this
point, if you’re not careful you could end up distorting the results
of following studies.
• Lastly, If your project requires impartial validation consider using
a lab for your final round of testing
Guerrilla usability testing

More Related Content

What's hot

Paper Prototyping
Paper PrototypingPaper Prototyping
Paper PrototypingDavid Lamas
 
Pair Programming Styles
Pair Programming StylesPair Programming Styles
Pair Programming StylesAttila Bertók
 
UsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_WorkshopUsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_WorkshopUsability Matters
 
Better Software Through User Research
Better Software Through User ResearchBetter Software Through User Research
Better Software Through User ResearchAlexandra Leisse
 
Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]cmk22
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usabilitySimpleUsability
 
Startupcamp Basel: Rapid Prototyping & User Testing
Startupcamp Basel: Rapid Prototyping & User TestingStartupcamp Basel: Rapid Prototyping & User Testing
Startupcamp Basel: Rapid Prototyping & User TestingReto Laemmler
 
Game design 2 (2013): Lecture 11 - User Feedback in Game Design
Game design 2 (2013): Lecture 11 - User Feedback in Game DesignGame design 2 (2013): Lecture 11 - User Feedback in Game Design
Game design 2 (2013): Lecture 11 - User Feedback in Game DesignDavid Farrell
 
WORKSHOP: 7 Elements to Responsive design
WORKSHOP: 7 Elements to Responsive designWORKSHOP: 7 Elements to Responsive design
WORKSHOP: 7 Elements to Responsive designUsability Matters
 
Game design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UI
Game design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UIGame design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UI
Game design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UIDavid Farrell
 
How to Create Advanced Surveys with Logic, Conditions and Piping
How to Create Advanced Surveys with Logic, Conditions and PipingHow to Create Advanced Surveys with Logic, Conditions and Piping
How to Create Advanced Surveys with Logic, Conditions and PipingUserZoom
 
Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13
Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13
Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13David Farrell
 
World Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice GapWorld Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice GapKeith Instone
 

What's hot (20)

Paper Prototyping
Paper PrototypingPaper Prototyping
Paper Prototyping
 
Usability Testing Basics
Usability Testing BasicsUsability Testing Basics
Usability Testing Basics
 
Pair Programming Styles
Pair Programming StylesPair Programming Styles
Pair Programming Styles
 
UsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_WorkshopUsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_Workshop
 
Don't make me think
Don't make me thinkDon't make me think
Don't make me think
 
Better Software Through User Research
Better Software Through User ResearchBetter Software Through User Research
Better Software Through User Research
 
Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]Conducting Usability Research with a Team of One [Revised: October 2009]
Conducting Usability Research with a Team of One [Revised: October 2009]
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usability
 
Startupcamp Basel: Rapid Prototyping & User Testing
Startupcamp Basel: Rapid Prototyping & User TestingStartupcamp Basel: Rapid Prototyping & User Testing
Startupcamp Basel: Rapid Prototyping & User Testing
 
Paper Prototyping
Paper PrototypingPaper Prototyping
Paper Prototyping
 
Game design 2 (2013): Lecture 11 - User Feedback in Game Design
Game design 2 (2013): Lecture 11 - User Feedback in Game DesignGame design 2 (2013): Lecture 11 - User Feedback in Game Design
Game design 2 (2013): Lecture 11 - User Feedback in Game Design
 
WORKSHOP: 7 Elements to Responsive design
WORKSHOP: 7 Elements to Responsive designWORKSHOP: 7 Elements to Responsive design
WORKSHOP: 7 Elements to Responsive design
 
Module 10: Usability Testing
Module 10: Usability TestingModule 10: Usability Testing
Module 10: Usability Testing
 
Game design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UI
Game design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UIGame design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UI
Game design 2 (2013): Lecture 10 - Expert Evaluation Methods for Game UI
 
Let's get along
Let's get alongLet's get along
Let's get along
 
How to Create Advanced Surveys with Logic, Conditions and Piping
How to Create Advanced Surveys with Logic, Conditions and PipingHow to Create Advanced Surveys with Logic, Conditions and Piping
How to Create Advanced Surveys with Logic, Conditions and Piping
 
Prototype in HCI
Prototype in HCIPrototype in HCI
Prototype in HCI
 
Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13
Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13
Cognitive Walkthrough for Learning Through Game Mechanics at ECGBL13
 
Paper Prototyping
Paper PrototypingPaper Prototyping
Paper Prototyping
 
World Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice GapWorld Usability day: Bridging Research-Practice Gap
World Usability day: Bridging Research-Practice Gap
 

Similar to Guerrilla usability testing

Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface designZdeněk Lanc
 
User Experience Basics for Product Management
User Experience Basics for Product ManagementUser Experience Basics for Product Management
User Experience Basics for Product ManagementRoger Hart
 
Lightweight and ‘guerrilla’ usability testing for digital humanities projects
Lightweight and ‘guerrilla’ usability testing for digital humanities projectsLightweight and ‘guerrilla’ usability testing for digital humanities projects
Lightweight and ‘guerrilla’ usability testing for digital humanities projectsMia
 
Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience - Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience - UXPA International
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityUser Vision
 
UX in Action: IBM Watson
UX in Action: IBM WatsonUX in Action: IBM Watson
UX in Action: IBM WatsonUserTesting
 
Remote research uxpa talk
Remote research uxpa talkRemote research uxpa talk
Remote research uxpa talkGavin Fung
 
More Than Usability
More Than UsabilityMore Than Usability
More Than UsabilityRazan Sadeq
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype TestingDave Hora
 
Remote Moderated Usability Testing & Tools
Remote Moderated Usability Testing & ToolsRemote Moderated Usability Testing & Tools
Remote Moderated Usability Testing & ToolsSusan Price
 
UX Research in an Agile World
UX Research in an Agile WorldUX Research in an Agile World
UX Research in an Agile WorldHirajaved10
 
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)Northern User Experience
 
Introduction to Design Thinking & Correlation to Scrum
Introduction to Design Thinking & Correlation to ScrumIntroduction to Design Thinking & Correlation to Scrum
Introduction to Design Thinking & Correlation to ScrumJeff ANGAMA
 
Live Conversation: Connecting with customers in real time
Live Conversation: Connecting with customers in real timeLive Conversation: Connecting with customers in real time
Live Conversation: Connecting with customers in real timeUserTesting
 
Guerilla Human Computer Interaction and Customer Based Design
Guerilla Human Computer Interaction and Customer Based DesignGuerilla Human Computer Interaction and Customer Based Design
Guerilla Human Computer Interaction and Customer Based DesignQuentin Christensen
 
Rapid Prototyping in UX Design
Rapid Prototyping in UX DesignRapid Prototyping in UX Design
Rapid Prototyping in UX DesignStephen Denning
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerTao Zhang
 
Get the most out of getting out of the building
Get the most out of getting out of the buildingGet the most out of getting out of the building
Get the most out of getting out of the buildingTodd Warren
 

Similar to Guerrilla usability testing (20)

Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface design
 
User Experience Basics for Product Management
User Experience Basics for Product ManagementUser Experience Basics for Product Management
User Experience Basics for Product Management
 
Lightweight and ‘guerrilla’ usability testing for digital humanities projects
Lightweight and ‘guerrilla’ usability testing for digital humanities projectsLightweight and ‘guerrilla’ usability testing for digital humanities projects
Lightweight and ‘guerrilla’ usability testing for digital humanities projects
 
Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience - Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience -
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usability
 
UX in Action: IBM Watson
UX in Action: IBM WatsonUX in Action: IBM Watson
UX in Action: IBM Watson
 
Remote research uxpa talk
Remote research uxpa talkRemote research uxpa talk
Remote research uxpa talk
 
More Than Usability
More Than UsabilityMore Than Usability
More Than Usability
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
 
Jan Moons at WUD16
Jan Moons at WUD16Jan Moons at WUD16
Jan Moons at WUD16
 
Remote Moderated Usability Testing & Tools
Remote Moderated Usability Testing & ToolsRemote Moderated Usability Testing & Tools
Remote Moderated Usability Testing & Tools
 
UX Research in an Agile World
UX Research in an Agile WorldUX Research in an Agile World
UX Research in an Agile World
 
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
 
Introduction to Design Thinking & Correlation to Scrum
Introduction to Design Thinking & Correlation to ScrumIntroduction to Design Thinking & Correlation to Scrum
Introduction to Design Thinking & Correlation to Scrum
 
Live Conversation: Connecting with customers in real time
Live Conversation: Connecting with customers in real timeLive Conversation: Connecting with customers in real time
Live Conversation: Connecting with customers in real time
 
Guerilla Human Computer Interaction and Customer Based Design
Guerilla Human Computer Interaction and Customer Based DesignGuerilla Human Computer Interaction and Customer Based Design
Guerilla Human Computer Interaction and Customer Based Design
 
Rapid Prototyping in UX Design
Rapid Prototyping in UX DesignRapid Prototyping in UX Design
Rapid Prototyping in UX Design
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian Primer
 
Get the most out of getting out of the building
Get the most out of getting out of the buildingGet the most out of getting out of the building
Get the most out of getting out of the building
 

More from Nexer Digital

Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Nexer Digital
 
Embedding service design: blood, sweat, tears and tantrums
Embedding service design: blood, sweat, tears and tantrums Embedding service design: blood, sweat, tears and tantrums
Embedding service design: blood, sweat, tears and tantrums Nexer Digital
 
Imran Hussain- Co-design by community - May 2023.pdf
Imran Hussain-  Co-design by community - May 2023.pdfImran Hussain-  Co-design by community - May 2023.pdf
Imran Hussain- Co-design by community - May 2023.pdfNexer Digital
 
Natalie Pearce - From CX to EX: Good culture needs good design
Natalie Pearce - From CX to EX: Good culture needs good designNatalie Pearce - From CX to EX: Good culture needs good design
Natalie Pearce - From CX to EX: Good culture needs good designNexer Digital
 
Audree Fletcher - Designing in the dark
Audree Fletcher - Designing in the darkAudree Fletcher - Designing in the dark
Audree Fletcher - Designing in the darkNexer Digital
 
Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...
Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...
Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...Nexer Digital
 
Shabira Papain - Inclusive design: Luxury or must-have?
Shabira Papain - Inclusive design: Luxury or must-have?Shabira Papain - Inclusive design: Luxury or must-have?
Shabira Papain - Inclusive design: Luxury or must-have?Nexer Digital
 
James Plunkett - Digital transformation in context: You’re part of something ...
James Plunkett - Digital transformation in context: You’re part of something ...James Plunkett - Digital transformation in context: You’re part of something ...
James Plunkett - Digital transformation in context: You’re part of something ...Nexer Digital
 
Jas Kang - Design imperatives at Depatment for Education using OKRs
Jas Kang - Design imperatives at Depatment for Education using OKRsJas Kang - Design imperatives at Depatment for Education using OKRs
Jas Kang - Design imperatives at Depatment for Education using OKRsNexer Digital
 
Helen Lawson - Death and other difficult words (Camp Digital 2022)
Helen Lawson - Death and other difficult words (Camp Digital 2022)Helen Lawson - Death and other difficult words (Camp Digital 2022)
Helen Lawson - Death and other difficult words (Camp Digital 2022)Nexer Digital
 
Sarah Mace - The better your culture, the better your user experience
Sarah Mace - The better your culture, the better your user experienceSarah Mace - The better your culture, the better your user experience
Sarah Mace - The better your culture, the better your user experienceNexer Digital
 
Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)
Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)
Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)Nexer Digital
 
Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work
Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work
Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work Nexer Digital
 
Rachel Coldicutt - We are all technologists now!
Rachel Coldicutt - We are all technologists now!Rachel Coldicutt - We are all technologists now!
Rachel Coldicutt - We are all technologists now!Nexer Digital
 
Gerry McGovern - Earth Experience Design (Camp Digital 2022)
Gerry McGovern - Earth Experience Design (Camp Digital 2022)Gerry McGovern - Earth Experience Design (Camp Digital 2022)
Gerry McGovern - Earth Experience Design (Camp Digital 2022)Nexer Digital
 
Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)
Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)
Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)Nexer Digital
 
Notes from the dyslexic side of the screen - Lisa Matthews - Nexer Digital ...
Notes from the dyslexic side of the screen - Lisa Matthews  - Nexer Digital  ...Notes from the dyslexic side of the screen - Lisa Matthews  - Nexer Digital  ...
Notes from the dyslexic side of the screen - Lisa Matthews - Nexer Digital ...Nexer Digital
 
Alt text as poetry for gov campnorth
Alt text as poetry for gov campnorthAlt text as poetry for gov campnorth
Alt text as poetry for gov campnorthNexer Digital
 
An introduction to content design
An introduction to content designAn introduction to content design
An introduction to content designNexer Digital
 
Sigma's Farewell to the Wellcome Genome Campus, January 2020
Sigma's Farewell to the Wellcome Genome Campus, January 2020Sigma's Farewell to the Wellcome Genome Campus, January 2020
Sigma's Farewell to the Wellcome Genome Campus, January 2020Nexer Digital
 

More from Nexer Digital (20)

Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Embedding service design: blood, sweat, tears and tantrums
Embedding service design: blood, sweat, tears and tantrums Embedding service design: blood, sweat, tears and tantrums
Embedding service design: blood, sweat, tears and tantrums
 
Imran Hussain- Co-design by community - May 2023.pdf
Imran Hussain-  Co-design by community - May 2023.pdfImran Hussain-  Co-design by community - May 2023.pdf
Imran Hussain- Co-design by community - May 2023.pdf
 
Natalie Pearce - From CX to EX: Good culture needs good design
Natalie Pearce - From CX to EX: Good culture needs good designNatalie Pearce - From CX to EX: Good culture needs good design
Natalie Pearce - From CX to EX: Good culture needs good design
 
Audree Fletcher - Designing in the dark
Audree Fletcher - Designing in the darkAudree Fletcher - Designing in the dark
Audree Fletcher - Designing in the dark
 
Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...
Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...
Erere Ikogho - Enhancing NHS Clinical Quality Improvement: Integrating User R...
 
Shabira Papain - Inclusive design: Luxury or must-have?
Shabira Papain - Inclusive design: Luxury or must-have?Shabira Papain - Inclusive design: Luxury or must-have?
Shabira Papain - Inclusive design: Luxury or must-have?
 
James Plunkett - Digital transformation in context: You’re part of something ...
James Plunkett - Digital transformation in context: You’re part of something ...James Plunkett - Digital transformation in context: You’re part of something ...
James Plunkett - Digital transformation in context: You’re part of something ...
 
Jas Kang - Design imperatives at Depatment for Education using OKRs
Jas Kang - Design imperatives at Depatment for Education using OKRsJas Kang - Design imperatives at Depatment for Education using OKRs
Jas Kang - Design imperatives at Depatment for Education using OKRs
 
Helen Lawson - Death and other difficult words (Camp Digital 2022)
Helen Lawson - Death and other difficult words (Camp Digital 2022)Helen Lawson - Death and other difficult words (Camp Digital 2022)
Helen Lawson - Death and other difficult words (Camp Digital 2022)
 
Sarah Mace - The better your culture, the better your user experience
Sarah Mace - The better your culture, the better your user experienceSarah Mace - The better your culture, the better your user experience
Sarah Mace - The better your culture, the better your user experience
 
Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)
Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)
Kylie Havelock - Tailored advice services in the modern age (Camp Digital 2022)
 
Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work
Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work
Sharon O'Dea and Hanna Karppi - A Human-Centred Future of Work
 
Rachel Coldicutt - We are all technologists now!
Rachel Coldicutt - We are all technologists now!Rachel Coldicutt - We are all technologists now!
Rachel Coldicutt - We are all technologists now!
 
Gerry McGovern - Earth Experience Design (Camp Digital 2022)
Gerry McGovern - Earth Experience Design (Camp Digital 2022)Gerry McGovern - Earth Experience Design (Camp Digital 2022)
Gerry McGovern - Earth Experience Design (Camp Digital 2022)
 
Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)
Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)
Older Adults: Are We Really Designing for Our Future Selves? (BAD Conf. 2022)
 
Notes from the dyslexic side of the screen - Lisa Matthews - Nexer Digital ...
Notes from the dyslexic side of the screen - Lisa Matthews  - Nexer Digital  ...Notes from the dyslexic side of the screen - Lisa Matthews  - Nexer Digital  ...
Notes from the dyslexic side of the screen - Lisa Matthews - Nexer Digital ...
 
Alt text as poetry for gov campnorth
Alt text as poetry for gov campnorthAlt text as poetry for gov campnorth
Alt text as poetry for gov campnorth
 
An introduction to content design
An introduction to content designAn introduction to content design
An introduction to content design
 
Sigma's Farewell to the Wellcome Genome Campus, January 2020
Sigma's Farewell to the Wellcome Genome Campus, January 2020Sigma's Farewell to the Wellcome Genome Campus, January 2020
Sigma's Farewell to the Wellcome Genome Campus, January 2020
 

Recently uploaded

Artificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfArtificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfscitechtalktv
 
2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Calllward7
 
社内勉強会資料  Mamba - A new era or ephemeral
社内勉強会資料   Mamba - A new era or ephemeral社内勉強会資料   Mamba - A new era or ephemeral
社内勉強会資料  Mamba - A new era or ephemeralNABLAS株式会社
 
How I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prisonHow I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prisonPayment Village
 
一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理cyebo
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理pyhepag
 
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理pyhepag
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理pyhepag
 
basics of data science with application areas.pdf
basics of data science with application areas.pdfbasics of data science with application areas.pdf
basics of data science with application areas.pdfvyankatesh1
 
Formulas dax para power bI de microsoft.pdf
Formulas dax para power bI de microsoft.pdfFormulas dax para power bI de microsoft.pdf
Formulas dax para power bI de microsoft.pdfRobertoOcampo24
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictJack Cole
 
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdfGenerative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdfEmmanuel Dauda
 
AI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfAI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfMichaelSenkow
 
Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Jon Hansen
 
Pre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptxPre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptxStephen266013
 
2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group MeetingAlison Pitt
 
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...Amil baba
 
Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...
Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...
Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...Valters Lauzums
 
Easy and simple project file on mp online
Easy and simple project file on mp onlineEasy and simple project file on mp online
Easy and simple project file on mp onlinebalibahu1313
 

Recently uploaded (20)

Artificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdfArtificial_General_Intelligence__storm_gen_article.pdf
Artificial_General_Intelligence__storm_gen_article.pdf
 
2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call2024 Q1 Tableau User Group Leader Quarterly Call
2024 Q1 Tableau User Group Leader Quarterly Call
 
社内勉強会資料  Mamba - A new era or ephemeral
社内勉強会資料   Mamba - A new era or ephemeral社内勉強会資料   Mamba - A new era or ephemeral
社内勉強会資料  Mamba - A new era or ephemeral
 
How I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prisonHow I opened a fake bank account and didn't go to prison
How I opened a fake bank account and didn't go to prison
 
一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理一比一原版纽卡斯尔大学毕业证成绩单如何办理
一比一原版纽卡斯尔大学毕业证成绩单如何办理
 
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
一比一原版加利福尼亚大学尔湾分校毕业证成绩单如何办理
 
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
一比一原版(Monash毕业证书)莫纳什大学毕业证成绩单如何办理
 
一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理一比一原版西悉尼大学毕业证成绩单如何办理
一比一原版西悉尼大学毕业证成绩单如何办理
 
Slip-and-fall Injuries: Top Workers' Comp Claims
Slip-and-fall Injuries: Top Workers' Comp ClaimsSlip-and-fall Injuries: Top Workers' Comp Claims
Slip-and-fall Injuries: Top Workers' Comp Claims
 
basics of data science with application areas.pdf
basics of data science with application areas.pdfbasics of data science with application areas.pdf
basics of data science with application areas.pdf
 
Formulas dax para power bI de microsoft.pdf
Formulas dax para power bI de microsoft.pdfFormulas dax para power bI de microsoft.pdf
Formulas dax para power bI de microsoft.pdf
 
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflictSupply chain analytics to combat the effects of Ukraine-Russia-conflict
Supply chain analytics to combat the effects of Ukraine-Russia-conflict
 
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdfGenerative AI for Trailblazers_ Unlock the Future of AI.pdf
Generative AI for Trailblazers_ Unlock the Future of AI.pdf
 
AI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdfAI Imagen for data-storytelling Infographics.pdf
AI Imagen for data-storytelling Infographics.pdf
 
Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)Atlantic Grupa Case Study (Mintec Data AI)
Atlantic Grupa Case Study (Mintec Data AI)
 
Pre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptxPre-ProductionImproveddsfjgndflghtgg.pptx
Pre-ProductionImproveddsfjgndflghtgg.pptx
 
2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting2024 Q2 Orange County (CA) Tableau User Group Meeting
2024 Q2 Orange County (CA) Tableau User Group Meeting
 
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...
 
Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...
Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...
Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...
 
Easy and simple project file on mp online
Easy and simple project file on mp onlineEasy and simple project file on mp online
Easy and simple project file on mp online
 

Guerrilla usability testing

  • 1. Chris Bush UX Practice Lead @wearesigma / @suthen
  • 2. Chris Bush UX Practice Lead @wearesigma / @suthen
  • 3. Taking your research further A bit about Sigma (our services and clients) Why talk about guerrilla testing? Getting started with guerrilla testing Wrap up
  • 4.  User Research & Testing  Interface & Interaction Design  Web, Mobile & Application Development  Enterprise Content Management  Training & Support
  • 5.
  • 6.
  • 7.
  • 8.
  • 9. Expensive - no budget Time / Resource consuming - delays development Not a primary concern - Focus on traffic acquisition
  • 10.
  • 11.
  • 12. Pros: • Users are often in a more informal environment (comfortable and relaxed) • Great for bringing in teams together to observe users (and discuss) • Help and support when defining tasks and scenarios • Less likely to introduce moderator bias • Detailed external provider analysis and reports • More likely to use advanced data collection (Eye tracking) Cons: • Can be costly • Less likely to want to invest in early stage testing (Prototypes and early beta code) • Less likely to perform iterative tests
  • 13. Pros: • Requires no specialist equipment - only low cost software • Very portable (on location, café, office, home) • Great for early stage testing (Prototypes, etc.) • Great for Rapid Iterative Testing and Evaluation (RITE) • Minimal overhead (Time, People, Cost) Cons: • Moderator or reviewer bias • The team takes on responsibility for ensuring everything is organised (Users, Room, Tasks, Write up) • Finding a good testing room is sometimes tricky
  • 14.
  • 15. • Any users are better than none but aim for two rounds: 5-10 per round • Aim for a good cross-section of representative users • Max 30-45 minutes to complete (around 5 tasks) • Create meaningful tasks – word tasks as scenarios * • Think aloud and retrospective think aloud • Discussion guide – consistency is important • Rotate tasks (ABC / BCA / CAB) to remove bias • Use a scribe *
  • 16. • Don’t be to specific “Find and fill in the customer returns form.” • Allow users the opportunity to decide what the most suitable solution is to the same problem “After receiving your new camera you have noticed the lens is cracked. Using the site can you request a replacement.“ • Be pragmatic about leading questions • But, always do a control test. (you’re testing your questions at this point)
  • 17.
  • 18.
  • 19.
  • 20.
  • 21. Sit back from the participant Screen projection can be useful Scribe sits away from the main study
  • 22. • Use the most comfortable room you can find • Sit back from the user • Try to be out of their field of view • Use reflective questions • Don’t be a Monster! • If the user is struggling help them
  • 23. • A second set of eyes helps to remove any bias • It can save you hours of review time • Define a coding system to help identify themes when taking notes • .N – Navigation • .S – Search • .C – Content / Information • .D – Design • .T – Trust and credibility • Time code your notes • Spend 30mins after each session doing light analysis.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 31.
  • 32.
  • 35.
  • 36. • Always aim to test on five to ten people and for best results run two iterations of your tests • Test your questions on real people before you do your test. They nearly always need refinement • Take time to set up your room to make it as comfortable as possible. • Remember to sit back from the user so they don’t feel like they are being watched too closely. • Use reflective questioning. Participant: “Why did that happen when I clicked there?” You: “Why do you think that happened?”
  • 37. • Use a scribe to ensure you get the most out of the session. It also helps remove any moderator bias. • Code your notes as you go to save you time in analysis. (-n for navigation issues, -f for form issues, etc.) • Take 15mins after each session to review the analysis and categorise the results. Do not try to solution new ideas at this point, if you’re not careful you could end up distorting the results of following studies. • Lastly, If your project requires impartial validation consider using a lab for your final round of testing