SlideShare a Scribd company logo
1 of 97
Download to read offline
How to run 100 user tests in two days 
Daniel Sauble, UX designer at Puppet Labs
Hi
I design. 
tools for sysadmins
I speak. 
at events like this
I write. 
@djsauble on Medium
I run. 
≤ 50 km at a go
I live, eat, and breathe Puppet.
It’s automation for sysadmins.
I get to solve those problems.
It’s a great job.
We’re hiring. 
puppetlabs.com/about/careers
Definitions 
What am I talking about?
User testing.
What does it take?
When do you do it?
Note: qualitative != quantitative
So what’s the problem? 
We don’t do enough user testing.
How many of you user test?
Do you want to do more?
Therein lies the problem.
If we don’t, we can’t converge.
If we can’t, we don’t add value.
I want to add value.
What’s your barrier to entry?
Lack of time?
… resources?
… participants?
… organizational support?
All of the above?
What’s the solution? 
Getting the biggest bang for the buck.
We need to fail fast and early.
Each iteration needs feedback.
That means a lot of user tests.
How many user tests?
Let’s say 5 participants per…
…at 5 iterations…
…with 4 projects to user test.
That’s 100 participants. Boom.
Do user testing at a conference.
Can you do this on a budget?
Yes.
1. Write some studies.
2. Pick a conference.
3. Set up a booth.
4. Analyze results in real-time.
5. Iterate on the design.
6. Repeat.
I’ve yet to achieve nirvana.
How to pull this off. 
And why conferences are your best bet.
This is what we did.
This is what we learned.
1. Conferences keep you lean.
2. They help you pop bubbles.
3. They grow with you.
4. They can be tamed.
5. They may help competitors.
6. They help build empathy.
Do your coworkers user test?
Here’s their opportunity.
It’s not about data.
It’s about people.
7. Conferences are scary.
Training helps.
8. Digital is your (best) friend.
9. Don’t fear failure. Best it.
With retrospectives!
10. There isn’t a #10.
Wrapping up 
That was a lot. Let me sum up.
If an intern can do this, you can.
Still intimidated? Start small.
Three takeaways:
1. Conferences > recruiting
2. Process, process, process
3. Act on what you learn.
That’s it! Go forth and user test.
Thank you! 
danielsauble.com

More Related Content

What's hot

Making a Plan: Industrial Revolution Unit A
Making a Plan: Industrial Revolution Unit A Making a Plan: Industrial Revolution Unit A
Making a Plan: Industrial Revolution Unit A
mbrilla
 
Solution Flow - Reflection for Design Thinking
Solution Flow - Reflection for Design Thinking Solution Flow - Reflection for Design Thinking
Solution Flow - Reflection for Design Thinking
Meamya Christie
 
Achieving Work/Life Balance Keynote Address
Achieving Work/Life Balance Keynote AddressAchieving Work/Life Balance Keynote Address
Achieving Work/Life Balance Keynote Address
TargetX
 
Personal skills audit
Personal skills auditPersonal skills audit
Personal skills audit
Sophie Wright
 
Take ithome
Take ithomeTake ithome
Take ithome
Vijaya M
 

What's hot (18)

5. pre production final
5. pre production final 5. pre production final
5. pre production final
 
Agile Retrospectives
Agile Retrospectives Agile Retrospectives
Agile Retrospectives
 
Making a Plan: Industrial Revolution Unit A
Making a Plan: Industrial Revolution Unit A Making a Plan: Industrial Revolution Unit A
Making a Plan: Industrial Revolution Unit A
 
Solution Flow - Reflection for Design Thinking
Solution Flow - Reflection for Design Thinking Solution Flow - Reflection for Design Thinking
Solution Flow - Reflection for Design Thinking
 
The three takeaways
The three takeawaysThe three takeaways
The three takeaways
 
Achieving Work/Life Balance Keynote Address
Achieving Work/Life Balance Keynote AddressAchieving Work/Life Balance Keynote Address
Achieving Work/Life Balance Keynote Address
 
How to Beat Procrastination - 30 November 2009
How to Beat Procrastination - 30 November 2009How to Beat Procrastination - 30 November 2009
How to Beat Procrastination - 30 November 2009
 
Sparx 2016 Sep - FAQ
Sparx 2016 Sep - FAQSparx 2016 Sep - FAQ
Sparx 2016 Sep - FAQ
 
Personal skills audit
Personal skills auditPersonal skills audit
Personal skills audit
 
Why We Procrastinate
Why We ProcrastinateWhy We Procrastinate
Why We Procrastinate
 
Take ithome
Take ithomeTake ithome
Take ithome
 
Problem solving in 'brain on' mode
Problem solving in 'brain on' modeProblem solving in 'brain on' mode
Problem solving in 'brain on' mode
 
B417 ws four v0.2
B417 ws four v0.2B417 ws four v0.2
B417 ws four v0.2
 
Change final master may15
Change final master may15Change final master may15
Change final master may15
 
9 Ways to Be More Productive - Backed by Science
9 Ways to Be More Productive - Backed by Science9 Ways to Be More Productive - Backed by Science
9 Ways to Be More Productive - Backed by Science
 
DSS ( Decision Supporting System )
DSS ( Decision Supporting System )DSS ( Decision Supporting System )
DSS ( Decision Supporting System )
 
How to overcome procrastination ppt.pptx
How to overcome procrastination  ppt.pptxHow to overcome procrastination  ppt.pptx
How to overcome procrastination ppt.pptx
 
Ready Retreat: Task Management
Ready Retreat: Task ManagementReady Retreat: Task Management
Ready Retreat: Task Management
 

Similar to How to Run 100 User Tests in Two Days

Interviewing Virtual Assistants and How to Manage Them
Interviewing Virtual Assistants and How to Manage ThemInterviewing Virtual Assistants and How to Manage Them
Interviewing Virtual Assistants and How to Manage Them
Richard Smith
 
Prototype & Test
Prototype & TestPrototype & Test
Prototype & Test
scarranco09
 

Similar to How to Run 100 User Tests in Two Days (20)

Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15
 
QA's lead role in agile transformations
QA's lead role in agile transformationsQA's lead role in agile transformations
QA's lead role in agile transformations
 
Interviewing Virtual Assistants and How to Manage Them
Interviewing Virtual Assistants and How to Manage ThemInterviewing Virtual Assistants and How to Manage Them
Interviewing Virtual Assistants and How to Manage Them
 
Getting to Product-Market Fit Quickly
Getting to Product-Market Fit QuicklyGetting to Product-Market Fit Quickly
Getting to Product-Market Fit Quickly
 
MVP Types, Tools and Social Impact
MVP Types, Tools and Social ImpactMVP Types, Tools and Social Impact
MVP Types, Tools and Social Impact
 
SXSW - Diving Deep: Best Practices For Interviewing Users
SXSW - Diving Deep: Best Practices For Interviewing UsersSXSW - Diving Deep: Best Practices For Interviewing Users
SXSW - Diving Deep: Best Practices For Interviewing Users
 
Wait A Moment? How High Workload Kills Efficiency! - Roman Pickl
Wait A Moment? How High Workload Kills Efficiency! - Roman PicklWait A Moment? How High Workload Kills Efficiency! - Roman Pickl
Wait A Moment? How High Workload Kills Efficiency! - Roman Pickl
 
Pragmatic guide to AB testing - Agile and Automation days 2019
Pragmatic guide to AB testing - Agile and Automation days 2019Pragmatic guide to AB testing - Agile and Automation days 2019
Pragmatic guide to AB testing - Agile and Automation days 2019
 
Agent of Change
Agent of ChangeAgent of Change
Agent of Change
 
What made you a software testing leader?
What made you a software testing leader?What made you a software testing leader?
What made you a software testing leader?
 
Module 8 discussion.docx
Module 8 discussion.docxModule 8 discussion.docx
Module 8 discussion.docx
 
Startup Weekend - Validate Your Idea, Crash Course in User Research
Startup Weekend - Validate Your Idea, Crash Course in User ResearchStartup Weekend - Validate Your Idea, Crash Course in User Research
Startup Weekend - Validate Your Idea, Crash Course in User Research
 
Crucial confrontations
Crucial confrontationsCrucial confrontations
Crucial confrontations
 
Creating impact with project sprints
Creating impact with project sprints   Creating impact with project sprints
Creating impact with project sprints
 
Lean User Research - UXPA 2013 Workshop
Lean User Research - UXPA 2013 WorkshopLean User Research - UXPA 2013 Workshop
Lean User Research - UXPA 2013 Workshop
 
Navigating Whiteboard Challenges
Navigating Whiteboard ChallengesNavigating Whiteboard Challenges
Navigating Whiteboard Challenges
 
Discussing Design Without Losing your Mind [Code and Creativity 10/7]
Discussing Design Without Losing your Mind [Code and Creativity 10/7]Discussing Design Without Losing your Mind [Code and Creativity 10/7]
Discussing Design Without Losing your Mind [Code and Creativity 10/7]
 
Cycles: The simplest, proven way to build your business
Cycles: The simplest, proven way to build your businessCycles: The simplest, proven way to build your business
Cycles: The simplest, proven way to build your business
 
Prototype & Test
Prototype & TestPrototype & Test
Prototype & Test
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
 

Recently uploaded

Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
instagramfab782445
 
call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
dollysharma2066
 
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
amitlee9823
 
Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...
gajnagarg
 
Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)
amitlee9823
 
How to Build a Simple Shopify Website
How to Build a Simple Shopify WebsiteHow to Build a Simple Shopify Website
How to Build a Simple Shopify Website
mark11275
 
ab-initio-training basics and architecture
ab-initio-training basics and architectureab-initio-training basics and architecture
ab-initio-training basics and architecture
saipriyacoool
 

Recently uploaded (20)

Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
Abortion pill for sale in Muscat (+918761049707)) Get Cytotec Cash on deliver...
 
call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️call girls in Dakshinpuri  (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
call girls in Dakshinpuri (DELHI) 🔝 >༒9953056974 🔝 genuine Escort Service 🔝✔️✔️
 
8377087607, Door Step Call Girls In Majnu Ka Tilla (Delhi) 24/7 Available
8377087607, Door Step Call Girls In Majnu Ka Tilla (Delhi) 24/7 Available8377087607, Door Step Call Girls In Majnu Ka Tilla (Delhi) 24/7 Available
8377087607, Door Step Call Girls In Majnu Ka Tilla (Delhi) 24/7 Available
 
The hottest UI and UX Design Trends 2024
The hottest UI and UX Design Trends 2024The hottest UI and UX Design Trends 2024
The hottest UI and UX Design Trends 2024
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
 
Call Girls Jalgaon Just Call 8617370543Top Class Call Girl Service Available
Call Girls Jalgaon Just Call 8617370543Top Class Call Girl Service AvailableCall Girls Jalgaon Just Call 8617370543Top Class Call Girl Service Available
Call Girls Jalgaon Just Call 8617370543Top Class Call Girl Service Available
 
Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...
Just Call Vip call girls Etawah Escorts ☎️9352988975 Two shot with one girl (...
 
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
 
High Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
High Profile Escorts Nerul WhatsApp +91-9930687706, Best ServiceHigh Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
High Profile Escorts Nerul WhatsApp +91-9930687706, Best Service
 
Gamestore case study UI UX by Amgad Ibrahim
Gamestore case study UI UX by Amgad IbrahimGamestore case study UI UX by Amgad Ibrahim
Gamestore case study UI UX by Amgad Ibrahim
 
❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.
❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.
❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.
 
Hingoli ❤CALL GIRL 8617370543 ❤CALL GIRLS IN Hingoli ESCORT SERVICE❤CALL GIRL
Hingoli ❤CALL GIRL 8617370543 ❤CALL GIRLS IN Hingoli ESCORT SERVICE❤CALL GIRLHingoli ❤CALL GIRL 8617370543 ❤CALL GIRLS IN Hingoli ESCORT SERVICE❤CALL GIRL
Hingoli ❤CALL GIRL 8617370543 ❤CALL GIRLS IN Hingoli ESCORT SERVICE❤CALL GIRL
 
Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Basapura ☎ 7737669865☎ Book Your One night Stand (Bangalore)
 
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
 
How to Build a Simple Shopify Website
How to Build a Simple Shopify WebsiteHow to Build a Simple Shopify Website
How to Build a Simple Shopify Website
 
ab-initio-training basics and architecture
ab-initio-training basics and architectureab-initio-training basics and architecture
ab-initio-training basics and architecture
 
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
 
Sector 104, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 104, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 104, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 104, Noida Call girls :8448380779 Model Escorts | 100% verified
 
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
 

How to Run 100 User Tests in Two Days