SlideShare a Scribd company logo
How to help newbies run UX
tests
Agenda
Why listen?
Newbie Mistakes
How to avoid them
Q&A
1
2
3
4
Lee Duddell
UX Director, UserZoom
Why listen?
Researchers
How to train non-researchers
Everyone else
Common mistakes to avoid
Why me?
Meet Matt, he’s new to UX testing
He’s motivated to test because he wants to delete design debate!
In this Sprint he’s working on the voucher code journey
He starts building his study in UserZoom
1. He builds a screener
2. Here’s the first screen that participants see...
3. He adds a scenario
It’s Friday morning and you’re at work in a swanky office in Soho.
The team you’re in have been working very hard and you want to reward
them, there are 5 of them, with lunch. You’ve asked them and they all fancy
Sushi, but you need it delivered by 12:30 (it’s 10:30 now). One of them is
vegan, another milk intolerant. So you search Google for “Central London
Sushi Delivery”.
You’re at checkout and want to use a voucher code you found online.
4. Asks people to compare two designs
Which design do you prefer?
vs
5. He wants feedback on an Invision prototype
Five mistakes
1. Easy to guess screeners
2. No scenario
3. Too much scenario
4. Asking about design (rather than observing behaviour)
5. Tasks, that aren’t
What have your Matts done?
How do we help Matt?
Three ways to help Matt
1
Training Workshop
2
Encourage teamwork
3
Make a guardrail
Training Workshop (3 hours, up to 12 people)
1. Internal Case Study
2. Testing process = Question > Build > Test > Launch > Results
3. Map research questions to example studies
4. Build a simple design test + critique it
5. Build a think out loud test + critique it Helps Matt see the
importance of good
study design
TRAINING EXAMPLE MAPPING QUESTIONS
Early stage designs and concepts
Your Design Questions
● How can I improve this new page design?
● What is most/least appealing/important on this page?
● Is the messaging clear?
● What are users' first impressions?
● What's missing from the new design?
● What do users expect will happen next?
● Where do they click or tap, and why?
Run a Click Test
Click Test results
Building & critiquing
2. Encourage Teamwork
1. Set time in Sprint for team to agree research questions
2. Peer review of studies pre-launch to test questions
3. Lean on researchers to help/advise
3. Guardrail
1. Start with image-based studies + think out loud
2. Setup “approved” screeners
3. Use study templates and question/task banks
4. UserZoom Academy...
https://academy.userzoom.com
Three things to remember to help Matt
1
Writing tasks does not
come naturally
2
Run a training workshop
to build together
3
Start with two simple
study types
Questions?

More Related Content

What's hot

UX Research - Overview
UX Research - OverviewUX Research - Overview
UX Research - Overview
Mike Gallers
 
2014 Evolving Your UX Process 1up
2014 Evolving Your UX Process 1up2014 Evolving Your UX Process 1up
2014 Evolving Your UX Process 1upTom Brinck
 
#flashtest: User Research Live
#flashtest: User Research Live#flashtest: User Research Live
#flashtest: User Research Live
UXPA Boston
 
Tips for involving users in your website design - commercial property markete...
Tips for involving users in your website design - commercial property markete...Tips for involving users in your website design - commercial property markete...
Tips for involving users in your website design - commercial property markete...
estatesgazette.com, RBI
 
UI/UX Foundations - Research
UI/UX Foundations - ResearchUI/UX Foundations - Research
UI/UX Foundations - Research
Meg Kurdziolek
 
Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...
Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...
Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...
Joshua Ledwell
 
Applying UX Principles As A Product Owner
Applying UX Principles As A Product OwnerApplying UX Principles As A Product Owner
Applying UX Principles As A Product Owner
UXDXConf
 
User-centered Design
User-centered DesignUser-centered Design
User-centered Design
uxdesign101
 
Design Sprint
Design SprintDesign Sprint
Design Sprint
Celeste North
 
Tackle the Problem with Design Thinking - GDSC UAD
Tackle the Problem with Design Thinking - GDSC UADTackle the Problem with Design Thinking - GDSC UAD
Tackle the Problem with Design Thinking - GDSC UAD
gallangsadewa
 
Personas: Where Product Meets User Needs
Personas: Where Product Meets User NeedsPersonas: Where Product Meets User Needs
Personas: Where Product Meets User Needs
Perfetti Media
 
How to Combine Design Methods with Agile & Remain Sane
How to Combine Design Methodswith Agile & Remain SaneHow to Combine Design Methodswith Agile & Remain Sane
How to Combine Design Methods with Agile & Remain Sane
Den Tserkovnyi
 
Webinar - Skin in the Game: Getting Stakeholders Involved In Your UX Research
Webinar - Skin in the Game: Getting Stakeholders Involved In Your UX ResearchWebinar - Skin in the Game: Getting Stakeholders Involved In Your UX Research
Webinar - Skin in the Game: Getting Stakeholders Involved In Your UX Research
UserZoom
 
The Secret Sauce for Effective Usability Testing
The Secret Sauce for Effective Usability Testing The Secret Sauce for Effective Usability Testing
The Secret Sauce for Effective Usability Testing
Diane Bowen
 
Cuss hajar!
Cuss hajar!Cuss hajar!
User Centered Design for Projects
User Centered Design for ProjectsUser Centered Design for Projects
User Centered Design for Projects
Peter Boersma
 
UXPA DC Redux 2013 Notetaker Perspective 10-25-2013.ppt
UXPA DC Redux 2013 Notetaker Perspective 10-25-2013.pptUXPA DC Redux 2013 Notetaker Perspective 10-25-2013.ppt
UXPA DC Redux 2013 Notetaker Perspective 10-25-2013.ppt
UserWorks
 
Product Design Process at Sorabel
Product Design Process at SorabelProduct Design Process at Sorabel
Product Design Process at Sorabel
Rayi Christian Wicaksono
 
Data-driven design
Data-driven designData-driven design
Data-driven design
Rayi Christian Wicaksono
 

What's hot (20)

UX Process
UX ProcessUX Process
UX Process
 
UX Research - Overview
UX Research - OverviewUX Research - Overview
UX Research - Overview
 
2014 Evolving Your UX Process 1up
2014 Evolving Your UX Process 1up2014 Evolving Your UX Process 1up
2014 Evolving Your UX Process 1up
 
#flashtest: User Research Live
#flashtest: User Research Live#flashtest: User Research Live
#flashtest: User Research Live
 
Tips for involving users in your website design - commercial property markete...
Tips for involving users in your website design - commercial property markete...Tips for involving users in your website design - commercial property markete...
Tips for involving users in your website design - commercial property markete...
 
UI/UX Foundations - Research
UI/UX Foundations - ResearchUI/UX Foundations - Research
UI/UX Foundations - Research
 
Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...
Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...
Research Ready to Build: Compelling Artefacts that Speak Your Agile Team's La...
 
Applying UX Principles As A Product Owner
Applying UX Principles As A Product OwnerApplying UX Principles As A Product Owner
Applying UX Principles As A Product Owner
 
User-centered Design
User-centered DesignUser-centered Design
User-centered Design
 
Design Sprint
Design SprintDesign Sprint
Design Sprint
 
Tackle the Problem with Design Thinking - GDSC UAD
Tackle the Problem with Design Thinking - GDSC UADTackle the Problem with Design Thinking - GDSC UAD
Tackle the Problem with Design Thinking - GDSC UAD
 
Personas: Where Product Meets User Needs
Personas: Where Product Meets User NeedsPersonas: Where Product Meets User Needs
Personas: Where Product Meets User Needs
 
How to Combine Design Methods with Agile & Remain Sane
How to Combine Design Methodswith Agile & Remain SaneHow to Combine Design Methodswith Agile & Remain Sane
How to Combine Design Methods with Agile & Remain Sane
 
Webinar - Skin in the Game: Getting Stakeholders Involved In Your UX Research
Webinar - Skin in the Game: Getting Stakeholders Involved In Your UX ResearchWebinar - Skin in the Game: Getting Stakeholders Involved In Your UX Research
Webinar - Skin in the Game: Getting Stakeholders Involved In Your UX Research
 
The Secret Sauce for Effective Usability Testing
The Secret Sauce for Effective Usability Testing The Secret Sauce for Effective Usability Testing
The Secret Sauce for Effective Usability Testing
 
Cuss hajar!
Cuss hajar!Cuss hajar!
Cuss hajar!
 
User Centered Design for Projects
User Centered Design for ProjectsUser Centered Design for Projects
User Centered Design for Projects
 
UXPA DC Redux 2013 Notetaker Perspective 10-25-2013.ppt
UXPA DC Redux 2013 Notetaker Perspective 10-25-2013.pptUXPA DC Redux 2013 Notetaker Perspective 10-25-2013.ppt
UXPA DC Redux 2013 Notetaker Perspective 10-25-2013.ppt
 
Product Design Process at Sorabel
Product Design Process at SorabelProduct Design Process at Sorabel
Product Design Process at Sorabel
 
Data-driven design
Data-driven designData-driven design
Data-driven design
 

Similar to How to Help Newbies Run UX Tests

Usability Testing On A Budget
Usability Testing On A BudgetUsability Testing On A Budget
Usability Testing On A Budget
Chas Grundy
 
Navigating Whiteboard Challenges
Navigating Whiteboard ChallengesNavigating Whiteboard Challenges
Navigating Whiteboard Challenges
Chibueze Etoniru
 
Lean User Research - UXPA 2013 Workshop
Lean User Research - UXPA 2013 WorkshopLean User Research - UXPA 2013 Workshop
Lean User Research - UXPA 2013 Workshop
Cassy Rowe
 
Google Design sprint
Google Design sprintGoogle Design sprint
Google Design sprint
Bruno Mendes
 
Design Sprint Methods
Design Sprint MethodsDesign Sprint Methods
Design Sprint Methods
The World Bank
 
Design Sprints
Design SprintsDesign Sprints
Design Sprints
Kate Hanson
 
Design sprint sharing of DS team
Design sprint sharing of DS team Design sprint sharing of DS team
Design sprint sharing of DS team
Jen-Chieh Ko
 
EXPERIMENT mixtape
EXPERIMENT mixtapeEXPERIMENT mixtape
EXPERIMENT mixtape
stanforddnext
 
How to Work With UX Designers by Toast Associate Director PM
How to Work With UX Designers by Toast Associate Director PMHow to Work With UX Designers by Toast Associate Director PM
How to Work With UX Designers by Toast Associate Director PM
Product School
 
Pairing w developers_stpconpics
Pairing w developers_stpconpicsPairing w developers_stpconpics
Pairing w developers_stpconpics
Lanette Creamer
 
Design sprint slideshare
Design sprint slideshareDesign sprint slideshare
Design sprint slideshare
Faren faren
 
Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface design
Zdeněk Lanc
 
Pragmatic guide to AB testing - Agile and Automation days 2019
Pragmatic guide to AB testing - Agile and Automation days 2019Pragmatic guide to AB testing - Agile and Automation days 2019
Pragmatic guide to AB testing - Agile and Automation days 2019
Jakub Kurcek
 
Resource and technology design process
Resource and technology  design processResource and technology  design process
Resource and technology design process
Robby Jackson
 
Stop! Collaborate & Strategize: Part 4
Stop! Collaborate & Strategize: Part 4Stop! Collaborate & Strategize: Part 4
Stop! Collaborate & Strategize: Part 4
UXPA International
 
Mission Possible Day 3.ping.pong2014
Mission Possible   Day 3.ping.pong2014Mission Possible   Day 3.ping.pong2014
Mission Possible Day 3.ping.pong2014jmori
 
Our Usability Study Process
Our Usability Study ProcessOur Usability Study Process
Our Usability Study Process
June UX
 
Sprint school slidepack final
Sprint school slidepack finalSprint school slidepack final
Sprint school slidepack final
Design Lab
 
More Than Usability
More Than UsabilityMore Than Usability
More Than Usability
Razan Sadeq
 
Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...
Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...
Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...
Jagriti Pande
 

Similar to How to Help Newbies Run UX Tests (20)

Usability Testing On A Budget
Usability Testing On A BudgetUsability Testing On A Budget
Usability Testing On A Budget
 
Navigating Whiteboard Challenges
Navigating Whiteboard ChallengesNavigating Whiteboard Challenges
Navigating Whiteboard Challenges
 
Lean User Research - UXPA 2013 Workshop
Lean User Research - UXPA 2013 WorkshopLean User Research - UXPA 2013 Workshop
Lean User Research - UXPA 2013 Workshop
 
Google Design sprint
Google Design sprintGoogle Design sprint
Google Design sprint
 
Design Sprint Methods
Design Sprint MethodsDesign Sprint Methods
Design Sprint Methods
 
Design Sprints
Design SprintsDesign Sprints
Design Sprints
 
Design sprint sharing of DS team
Design sprint sharing of DS team Design sprint sharing of DS team
Design sprint sharing of DS team
 
EXPERIMENT mixtape
EXPERIMENT mixtapeEXPERIMENT mixtape
EXPERIMENT mixtape
 
How to Work With UX Designers by Toast Associate Director PM
How to Work With UX Designers by Toast Associate Director PMHow to Work With UX Designers by Toast Associate Director PM
How to Work With UX Designers by Toast Associate Director PM
 
Pairing w developers_stpconpics
Pairing w developers_stpconpicsPairing w developers_stpconpics
Pairing w developers_stpconpics
 
Design sprint slideshare
Design sprint slideshareDesign sprint slideshare
Design sprint slideshare
 
Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface design
 
Pragmatic guide to AB testing - Agile and Automation days 2019
Pragmatic guide to AB testing - Agile and Automation days 2019Pragmatic guide to AB testing - Agile and Automation days 2019
Pragmatic guide to AB testing - Agile and Automation days 2019
 
Resource and technology design process
Resource and technology  design processResource and technology  design process
Resource and technology design process
 
Stop! Collaborate & Strategize: Part 4
Stop! Collaborate & Strategize: Part 4Stop! Collaborate & Strategize: Part 4
Stop! Collaborate & Strategize: Part 4
 
Mission Possible Day 3.ping.pong2014
Mission Possible   Day 3.ping.pong2014Mission Possible   Day 3.ping.pong2014
Mission Possible Day 3.ping.pong2014
 
Our Usability Study Process
Our Usability Study ProcessOur Usability Study Process
Our Usability Study Process
 
Sprint school slidepack final
Sprint school slidepack finalSprint school slidepack final
Sprint school slidepack final
 
More Than Usability
More Than UsabilityMore Than Usability
More Than Usability
 
Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...
Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...
Sprinting for Innovation - A talk and workshop by Jagriti for Google Business...
 

More from UserZoom

Retail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviorsRetail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviors
UserZoom
 
[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote Research[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote Research
UserZoom
 
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
UserZoom
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
UserZoom
 
How to Work Collaboratively on the User Experience
How to Work Collaboratively on the User ExperienceHow to Work Collaboratively on the User Experience
How to Work Collaboratively on the User Experience
UserZoom
 
UX Research for the Masses
UX Research for the MassesUX Research for the Masses
UX Research for the Masses
UserZoom
 
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
UserZoom
 
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX InsightsHow to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
UserZoom
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
UserZoom
 
How to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across TeamsHow to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across Teams
UserZoom
 
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
UserZoom
 
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
UserZoom
 
Telling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics ModelTelling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics Model
UserZoom
 
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
UserZoom
 
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
UserZoom
 
A Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoomA Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoom
UserZoom
 
Optimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI MetricsOptimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
UserZoom
 
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
UserZoom
 
Telling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive DashboardsTelling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive Dashboards
UserZoom
 
Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...
Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...
Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...
UserZoom
 

More from UserZoom (20)

Retail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviorsRetail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviors
 
[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote Research[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote Research
 
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
 
How to Work Collaboratively on the User Experience
How to Work Collaboratively on the User ExperienceHow to Work Collaboratively on the User Experience
How to Work Collaboratively on the User Experience
 
UX Research for the Masses
UX Research for the MassesUX Research for the Masses
UX Research for the Masses
 
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
 
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX InsightsHow to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
 
How to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across TeamsHow to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across Teams
 
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
 
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
 
Telling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics ModelTelling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics Model
 
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
 
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
 
A Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoomA Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoom
 
Optimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI MetricsOptimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
 
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
 
Telling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive DashboardsTelling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive Dashboards
 
Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...
Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...
Demystifying Sample Size - How Many Participants Do You Really Need for UX Re...
 

Recently uploaded

The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 

Recently uploaded (20)

The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 

How to Help Newbies Run UX Tests

  • 1. How to help newbies run UX tests
  • 2. Agenda Why listen? Newbie Mistakes How to avoid them Q&A 1 2 3 4 Lee Duddell UX Director, UserZoom
  • 3. Why listen? Researchers How to train non-researchers Everyone else Common mistakes to avoid
  • 5. Meet Matt, he’s new to UX testing He’s motivated to test because he wants to delete design debate!
  • 6. In this Sprint he’s working on the voucher code journey
  • 7. He starts building his study in UserZoom
  • 8. 1. He builds a screener
  • 9. 2. Here’s the first screen that participants see...
  • 10. 3. He adds a scenario It’s Friday morning and you’re at work in a swanky office in Soho. The team you’re in have been working very hard and you want to reward them, there are 5 of them, with lunch. You’ve asked them and they all fancy Sushi, but you need it delivered by 12:30 (it’s 10:30 now). One of them is vegan, another milk intolerant. So you search Google for “Central London Sushi Delivery”. You’re at checkout and want to use a voucher code you found online.
  • 11. 4. Asks people to compare two designs Which design do you prefer? vs
  • 12. 5. He wants feedback on an Invision prototype
  • 13. Five mistakes 1. Easy to guess screeners 2. No scenario 3. Too much scenario 4. Asking about design (rather than observing behaviour) 5. Tasks, that aren’t
  • 14. What have your Matts done?
  • 15. How do we help Matt?
  • 16. Three ways to help Matt 1 Training Workshop 2 Encourage teamwork 3 Make a guardrail
  • 17. Training Workshop (3 hours, up to 12 people) 1. Internal Case Study 2. Testing process = Question > Build > Test > Launch > Results 3. Map research questions to example studies 4. Build a simple design test + critique it 5. Build a think out loud test + critique it Helps Matt see the importance of good study design
  • 18. TRAINING EXAMPLE MAPPING QUESTIONS Early stage designs and concepts Your Design Questions ● How can I improve this new page design? ● What is most/least appealing/important on this page? ● Is the messaging clear? ● What are users' first impressions? ● What's missing from the new design? ● What do users expect will happen next? ● Where do they click or tap, and why? Run a Click Test
  • 21. 2. Encourage Teamwork 1. Set time in Sprint for team to agree research questions 2. Peer review of studies pre-launch to test questions 3. Lean on researchers to help/advise
  • 22. 3. Guardrail 1. Start with image-based studies + think out loud 2. Setup “approved” screeners 3. Use study templates and question/task banks 4. UserZoom Academy...
  • 24. Three things to remember to help Matt 1 Writing tasks does not come naturally 2 Run a training workshop to build together 3 Start with two simple study types