SlideShare a Scribd company logo
1 of 44
Download to read offline
Cheap and efficient tools
Engaging users in design when there is no budget and there is no time
iQ Content




             iQ Content
             Usability | Design | Content | Analytics




                 0:00 / 4:59


                                                        2
Does this sound familiar?



 “We won’t be doing any user testing
 for this project. There is just no
 budget for it, and we don’t have
 time“



                                       3
The Holy Trinity


                    Quick




                     User
                   research

          Cheap               Valuable




                                         4
Prototyping          User testing      Traffic analysis




My night at the Odeon         Nua
                     Sarah is joining                         Nua
What people say:                      Photos:
                                  What do you like?
Far far away, behind the word
mountains,


                      This week's offers                           Nua

  Post                                   Upload!


                      Far far away,      Far far away,     Far far away,
                      behind the word    behind the word   behind the word
                      mountains,         mountains,        mountains,

                         Vote!              Vote!            Vote!

                                                                             5
Prototyping          User testing
                     User testing       Traffic analysis




        My night at the Odeon                              Nua
        What people say:                          Photos:

        Far far away, behind the word
        mountains,




              Post                                  Upload!




                                                                 6
Prototyping   User testing   Traffic analysis
                             Traffic analysis




                 Before                         After




                                                        7
Prototyping   User testing   Traffic analysis




                                Quick




    IMAGE MAP PROTOTYPES
            User
                              research

              Cheap                             Valuable




                                                           8
9
10
Prototyping   User testing   Traffic analysis




GOOD THINGS:

Not a single line of code
required




                                                11
Prototyping   User testing   Traffic analysis




MORE GOOD THINGS:

Starting from existing
wireframes, an image map
prototype can be built by an
interaction designer in 3 to 5
hours


                                                12
Prototyping   User testing   Traffic analysis




EVEN MORE GOOD THINGS:

Image map prototypes
provide enough interactivity
to test static web pages




                                                13
Prototyping   User testing   Traffic analysis




BAD THINGS:

You can’t use them to test
pages that require user input
or move (i.e. web forms,
animations, effects,
transitions, etc)


                                                14
Prototyping   User testing   Traffic analysis




                                Quick




              HYBRID PROTOTYPES
                     User
                   research

              Cheap                             Valuable




                                                           15
Prototyping   User testing   Traffic analysis




                                                16
Prototyping   User testing   Traffic analysis




                                                17
Prototyping   User testing   Traffic analysis




                                                18
Prototyping   User testing   Traffic analysis




                                   http://url.ie/2i4h
                                                        19
Prototyping      User testing
                 User testing   Traffic analysis




                            Quick




         USER research
               TESTING
                User


         Cheap                                Valuable




                                                         20
Prototyping   User testing
              User testing   Traffic analysis




STANDARD APPROACH:

Tests carried out in lab with 2
laptops (Windows OS), USB
keyboard and mouse, monitor,
webcam, microphone and Morae



                                                21
Prototyping   User testing
              User testing   Traffic analysis




STANDARD APPROACH:

Protocol: 6 to 8 participants
compensated with €60 - €70
for 1-hour tests spread along
2 days



                                                22
Prototyping   User testing
              User testing   Traffic analysis




INFORMAL APPROACH:

Tests carried out in client’s point
of contact with customers (e.g.
bank branch) with 2 laptops (Mac
OS), USB keyboard and mouse,
monitor and Silverback


                                                23
Prototyping   User testing
              User testing   Traffic analysis




INFORMAL APPROACH:

Protocol: 15 to 20 participants
compensated with €20 for 15-
minute tests spread along 2
days



                                                24
Prototyping   User testing
               User testing   Traffic analysis




INFORMAL APPROACH GOOD
THINGS:

Cheaper and faster




                                                 25
Prototyping   User testing
                User testing   Traffic analysis




USER TESTING WITH 7 USERS:

                FIXED COSTS             VARIABLE COSTS     DAYS



STANDARD             €3,385                       €1,700    2



INFORMAL             €2,940                       €140      1




                                                                  26
Prototyping   User testing
               User testing   Traffic analysis




INFORMAL APPROACH BAD
THINGS:

Impossible to recruit
participants of a certain profile




                                                 27
Prototyping   User testing
               User testing   Traffic analysis




INFORMAL APPROACH BAD
THINGS:

Participants will be already your
client’s customers: you’ll learn
nothing about prospective
customers’ behaviour


                                                 28
Prototyping   User testing
               User testing   Traffic analysis




INFORMAL APPROACH BAD
THINGS:

Tests must be short and very
focused: no time for pre-test
questionnaires or debriefing
interviews


                                                 29
Prototyping   User testing
              User testing   Traffic analysis




THE TRICK: USE BOTH

Use the standard approach for
exploration, and the informal
approach for validation




                                                30
Prototyping   User testing
              User testing   Traffic analysis




THE BENEFIT: MORE ITERATIONS

Combining the standard and informal
approaches, we have squeezed one
more round of user testing in our
projects



                                                31
Prototyping   User testing
               User testing   Traffic analysis




THE BENEFIT: MORE ITERATIONS

Before: 2 rounds of standard testing
After: 1 round of standard testing, 2
rounds of informal testing




                                                 32
=
Our initial assumption




  Testing IA = Card sorting
Donna Spencer:

Card sorting is a “tool that helps us
understand people we are
designing for”
Testing IA = Card sorting
Piece 1: Identify key user tasks
Piece 2 - carefully craft wording
Piece 3: image map prototypes x 2
The tests - Round 1
   12 users
   2 days
   initially tested the live site as well
   rotated which version was served first
Key insights




  Visible second level nav was critical
  Home link very useful
  Terminology, like “plans & costs” vs. “plans & services”
Round 2
  Validate new IA
  Focus on new and existing page designs
  Just 5 users this time
What did the prototypes do for us?
 Ease of prototyping
  allowed us to
  quickly adapt to
  completely new
  test plan

 Shrunk distance
  between testing
  artefact and the
  real thing


 Made us confident
  in our result

More Related Content

Similar to Cheap and efficient user testing tools

COSC 426 Lect. 7: Evaluating AR Applications
COSC 426 Lect. 7: Evaluating AR ApplicationsCOSC 426 Lect. 7: Evaluating AR Applications
COSC 426 Lect. 7: Evaluating AR ApplicationsMark Billinghurst
 
Building an mvp that works for users
Building an mvp that works for users Building an mvp that works for users
Building an mvp that works for users Ariadna Font Llitjos
 
Usability testing for qualitative researchers
Usability testing for qualitative researchersUsability testing for qualitative researchers
Usability testing for qualitative researchersResearchShare
 
Usability testing for qualitative researchers
Usability testing for qualitative researchersUsability testing for qualitative researchers
Usability testing for qualitative researchersKay Corry Aubrey
 
Pmc tips and tricks for usability testing
Pmc tips and tricks for usability testingPmc tips and tricks for usability testing
Pmc tips and tricks for usability testingpmcfinland
 
Prototyping For Early Validation by Michael Hawley, Mad*Pow
Prototyping For Early Validation by Michael Hawley, Mad*PowPrototyping For Early Validation by Michael Hawley, Mad*Pow
Prototyping For Early Validation by Michael Hawley, Mad*PowUIDesign Group
 
User Testing: Losing Weight (UX Cocktail Hour)
User Testing: Losing Weight (UX Cocktail Hour)User Testing: Losing Weight (UX Cocktail Hour)
User Testing: Losing Weight (UX Cocktail Hour)Paul Veugen
 
Web Usability (Slideshare Version)
Web Usability (Slideshare Version)Web Usability (Slideshare Version)
Web Usability (Slideshare Version)Carles Farré
 
Improved Knowledge from Data: Building an Immersive Data Analysis Platform
Improved Knowledge from Data: Building an Immersive Data Analysis PlatformImproved Knowledge from Data: Building an Immersive Data Analysis Platform
Improved Knowledge from Data: Building an Immersive Data Analysis PlatformFelipe Pedroso
 
Exploring and Integrating UX in Open Source Software Development
Exploring and Integrating UX in Open Source Software Development Exploring and Integrating UX in Open Source Software Development
Exploring and Integrating UX in Open Source Software Development Victoria Bondarchuk
 
iMinds Living Lab
iMinds Living LabiMinds Living Lab
iMinds Living LabMediatuin
 
Remote Testing Methods & Tools Webinar
Remote Testing Methods & Tools WebinarRemote Testing Methods & Tools Webinar
Remote Testing Methods & Tools WebinarUserZoom
 
Behavior Driven Testing for Multichannel Enterprise Applications
Behavior Driven Testing for Multichannel Enterprise ApplicationsBehavior Driven Testing for Multichannel Enterprise Applications
Behavior Driven Testing for Multichannel Enterprise ApplicationsBamdad Dashtban
 
Ux research to go ux day_sf 2013_userlens
Ux research to go ux day_sf 2013_userlensUx research to go ux day_sf 2013_userlens
Ux research to go ux day_sf 2013_userlensUser Lens
 
Evaluation and User Study in HCI
Evaluation and User Study in HCIEvaluation and User Study in HCI
Evaluation and User Study in HCIByungkyu (Jay) Kang
 
Prototyping for Early Validation - Michael Hawley, 2009
Prototyping for Early Validation - Michael Hawley, 2009Prototyping for Early Validation - Michael Hawley, 2009
Prototyping for Early Validation - Michael Hawley, 2009Mad*Pow
 

Similar to Cheap and efficient user testing tools (20)

COSC 426 Lect. 7: Evaluating AR Applications
COSC 426 Lect. 7: Evaluating AR ApplicationsCOSC 426 Lect. 7: Evaluating AR Applications
COSC 426 Lect. 7: Evaluating AR Applications
 
Building an mvp that works for users
Building an mvp that works for users Building an mvp that works for users
Building an mvp that works for users
 
Usability testing for qualitative researchers
Usability testing for qualitative researchersUsability testing for qualitative researchers
Usability testing for qualitative researchers
 
Usability testing for qualitative researchers
Usability testing for qualitative researchersUsability testing for qualitative researchers
Usability testing for qualitative researchers
 
Pmc tips and tricks for usability testing
Pmc tips and tricks for usability testingPmc tips and tricks for usability testing
Pmc tips and tricks for usability testing
 
Prototyping For Early Validation by Michael Hawley, Mad*Pow
Prototyping For Early Validation by Michael Hawley, Mad*PowPrototyping For Early Validation by Michael Hawley, Mad*Pow
Prototyping For Early Validation by Michael Hawley, Mad*Pow
 
Parents
ParentsParents
Parents
 
User Testing: Losing Weight (UX Cocktail Hour)
User Testing: Losing Weight (UX Cocktail Hour)User Testing: Losing Weight (UX Cocktail Hour)
User Testing: Losing Weight (UX Cocktail Hour)
 
Web Usability (Slideshare Version)
Web Usability (Slideshare Version)Web Usability (Slideshare Version)
Web Usability (Slideshare Version)
 
User Research 101
User Research 101User Research 101
User Research 101
 
Improved Knowledge from Data: Building an Immersive Data Analysis Platform
Improved Knowledge from Data: Building an Immersive Data Analysis PlatformImproved Knowledge from Data: Building an Immersive Data Analysis Platform
Improved Knowledge from Data: Building an Immersive Data Analysis Platform
 
Exploring and Integrating UX in Open Source Software Development
Exploring and Integrating UX in Open Source Software Development Exploring and Integrating UX in Open Source Software Development
Exploring and Integrating UX in Open Source Software Development
 
iMinds Living Lab
iMinds Living LabiMinds Living Lab
iMinds Living Lab
 
Remote Testing Methods & Tools Webinar
Remote Testing Methods & Tools WebinarRemote Testing Methods & Tools Webinar
Remote Testing Methods & Tools Webinar
 
Behavior Driven Testing for Multichannel Enterprise Applications
Behavior Driven Testing for Multichannel Enterprise ApplicationsBehavior Driven Testing for Multichannel Enterprise Applications
Behavior Driven Testing for Multichannel Enterprise Applications
 
Levi McCusker UXD
Levi McCusker UXDLevi McCusker UXD
Levi McCusker UXD
 
Ux research to go ux day_sf 2013_userlens
Ux research to go ux day_sf 2013_userlensUx research to go ux day_sf 2013_userlens
Ux research to go ux day_sf 2013_userlens
 
Evaluation and User Study in HCI
Evaluation and User Study in HCIEvaluation and User Study in HCI
Evaluation and User Study in HCI
 
Designing with data
Designing with dataDesigning with data
Designing with data
 
Prototyping for Early Validation - Michael Hawley, 2009
Prototyping for Early Validation - Michael Hawley, 2009Prototyping for Early Validation - Michael Hawley, 2009
Prototyping for Early Validation - Michael Hawley, 2009
 

More from Belen Barros Pena

DIY Mobile Usability Testing - SXSW Interactive 2012
DIY Mobile Usability Testing - SXSW Interactive 2012DIY Mobile Usability Testing - SXSW Interactive 2012
DIY Mobile Usability Testing - SXSW Interactive 2012Belen Barros Pena
 
Fragmentation in mobile design: fact or fiction
Fragmentation in mobile design: fact or fictionFragmentation in mobile design: fact or fiction
Fragmentation in mobile design: fact or fictionBelen Barros Pena
 
Mobile fragmentation, fact or myth?
Mobile fragmentation, fact or myth?Mobile fragmentation, fact or myth?
Mobile fragmentation, fact or myth?Belen Barros Pena
 
A simple mobile testing lab using a document camera
A simple mobile testing lab using a document cameraA simple mobile testing lab using a document camera
A simple mobile testing lab using a document cameraBelen Barros Pena
 
A simple mobile testing lab using our Meccano home-made rig
A simple mobile testing lab using our Meccano home-made rigA simple mobile testing lab using our Meccano home-made rig
A simple mobile testing lab using our Meccano home-made rigBelen Barros Pena
 
UX Sofia 2012 - DIY Mobile Usability Testing Workshop
UX Sofia 2012 - DIY Mobile Usability Testing WorkshopUX Sofia 2012 - DIY Mobile Usability Testing Workshop
UX Sofia 2012 - DIY Mobile Usability Testing WorkshopBelen Barros Pena
 
DIY mobile usability testing - IA Summit 2011
DIY mobile usability testing - IA Summit 2011DIY mobile usability testing - IA Summit 2011
DIY mobile usability testing - IA Summit 2011Belen Barros Pena
 

More from Belen Barros Pena (8)

DIY Mobile Usability Testing - SXSW Interactive 2012
DIY Mobile Usability Testing - SXSW Interactive 2012DIY Mobile Usability Testing - SXSW Interactive 2012
DIY Mobile Usability Testing - SXSW Interactive 2012
 
Fragmentation in mobile design: fact or fiction
Fragmentation in mobile design: fact or fictionFragmentation in mobile design: fact or fiction
Fragmentation in mobile design: fact or fiction
 
Mobile fragmentation, fact or myth?
Mobile fragmentation, fact or myth?Mobile fragmentation, fact or myth?
Mobile fragmentation, fact or myth?
 
A simple mobile testing lab using a document camera
A simple mobile testing lab using a document cameraA simple mobile testing lab using a document camera
A simple mobile testing lab using a document camera
 
A simple mobile testing lab using our Meccano home-made rig
A simple mobile testing lab using our Meccano home-made rigA simple mobile testing lab using our Meccano home-made rig
A simple mobile testing lab using our Meccano home-made rig
 
UX Sofia 2012 - DIY Mobile Usability Testing Workshop
UX Sofia 2012 - DIY Mobile Usability Testing WorkshopUX Sofia 2012 - DIY Mobile Usability Testing Workshop
UX Sofia 2012 - DIY Mobile Usability Testing Workshop
 
DIY mobile usability testing - IA Summit 2011
DIY mobile usability testing - IA Summit 2011DIY mobile usability testing - IA Summit 2011
DIY mobile usability testing - IA Summit 2011
 
I heart mobile
I heart mobileI heart mobile
I heart mobile
 

Recently uploaded

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...panagenda
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 

Recently uploaded (20)

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 

Cheap and efficient user testing tools

  • 1. Cheap and efficient tools Engaging users in design when there is no budget and there is no time
  • 2. iQ Content iQ Content Usability | Design | Content | Analytics 0:00 / 4:59 2
  • 3. Does this sound familiar? “We won’t be doing any user testing for this project. There is just no budget for it, and we don’t have time“ 3
  • 4. The Holy Trinity Quick User research Cheap Valuable 4
  • 5. Prototyping User testing Traffic analysis My night at the Odeon Nua Sarah is joining Nua What people say: Photos: What do you like? Far far away, behind the word mountains, This week's offers Nua Post Upload! Far far away, Far far away, Far far away, behind the word behind the word behind the word mountains, mountains, mountains, Vote! Vote! Vote! 5
  • 6. Prototyping User testing User testing Traffic analysis My night at the Odeon Nua What people say: Photos: Far far away, behind the word mountains, Post Upload! 6
  • 7. Prototyping User testing Traffic analysis Traffic analysis Before After 7
  • 8. Prototyping User testing Traffic analysis Quick IMAGE MAP PROTOTYPES User research Cheap Valuable 8
  • 9. 9
  • 10. 10
  • 11. Prototyping User testing Traffic analysis GOOD THINGS: Not a single line of code required 11
  • 12. Prototyping User testing Traffic analysis MORE GOOD THINGS: Starting from existing wireframes, an image map prototype can be built by an interaction designer in 3 to 5 hours 12
  • 13. Prototyping User testing Traffic analysis EVEN MORE GOOD THINGS: Image map prototypes provide enough interactivity to test static web pages 13
  • 14. Prototyping User testing Traffic analysis BAD THINGS: You can’t use them to test pages that require user input or move (i.e. web forms, animations, effects, transitions, etc) 14
  • 15. Prototyping User testing Traffic analysis Quick HYBRID PROTOTYPES User research Cheap Valuable 15
  • 16. Prototyping User testing Traffic analysis 16
  • 17. Prototyping User testing Traffic analysis 17
  • 18. Prototyping User testing Traffic analysis 18
  • 19. Prototyping User testing Traffic analysis http://url.ie/2i4h 19
  • 20. Prototyping User testing User testing Traffic analysis Quick USER research TESTING User Cheap Valuable 20
  • 21. Prototyping User testing User testing Traffic analysis STANDARD APPROACH: Tests carried out in lab with 2 laptops (Windows OS), USB keyboard and mouse, monitor, webcam, microphone and Morae 21
  • 22. Prototyping User testing User testing Traffic analysis STANDARD APPROACH: Protocol: 6 to 8 participants compensated with €60 - €70 for 1-hour tests spread along 2 days 22
  • 23. Prototyping User testing User testing Traffic analysis INFORMAL APPROACH: Tests carried out in client’s point of contact with customers (e.g. bank branch) with 2 laptops (Mac OS), USB keyboard and mouse, monitor and Silverback 23
  • 24. Prototyping User testing User testing Traffic analysis INFORMAL APPROACH: Protocol: 15 to 20 participants compensated with €20 for 15- minute tests spread along 2 days 24
  • 25. Prototyping User testing User testing Traffic analysis INFORMAL APPROACH GOOD THINGS: Cheaper and faster 25
  • 26. Prototyping User testing User testing Traffic analysis USER TESTING WITH 7 USERS: FIXED COSTS VARIABLE COSTS DAYS STANDARD €3,385 €1,700 2 INFORMAL €2,940 €140 1 26
  • 27. Prototyping User testing User testing Traffic analysis INFORMAL APPROACH BAD THINGS: Impossible to recruit participants of a certain profile 27
  • 28. Prototyping User testing User testing Traffic analysis INFORMAL APPROACH BAD THINGS: Participants will be already your client’s customers: you’ll learn nothing about prospective customers’ behaviour 28
  • 29. Prototyping User testing User testing Traffic analysis INFORMAL APPROACH BAD THINGS: Tests must be short and very focused: no time for pre-test questionnaires or debriefing interviews 29
  • 30. Prototyping User testing User testing Traffic analysis THE TRICK: USE BOTH Use the standard approach for exploration, and the informal approach for validation 30
  • 31. Prototyping User testing User testing Traffic analysis THE BENEFIT: MORE ITERATIONS Combining the standard and informal approaches, we have squeezed one more round of user testing in our projects 31
  • 32. Prototyping User testing User testing Traffic analysis THE BENEFIT: MORE ITERATIONS Before: 2 rounds of standard testing After: 1 round of standard testing, 2 rounds of informal testing 32
  • 33.
  • 34. =
  • 35. Our initial assumption Testing IA = Card sorting
  • 36. Donna Spencer: Card sorting is a “tool that helps us understand people we are designing for”
  • 37. Testing IA = Card sorting
  • 38. Piece 1: Identify key user tasks
  • 39. Piece 2 - carefully craft wording
  • 40. Piece 3: image map prototypes x 2
  • 41. The tests - Round 1  12 users  2 days  initially tested the live site as well  rotated which version was served first
  • 42. Key insights  Visible second level nav was critical  Home link very useful  Terminology, like “plans & costs” vs. “plans & services”
  • 43. Round 2  Validate new IA  Focus on new and existing page designs  Just 5 users this time
  • 44. What did the prototypes do for us?  Ease of prototyping allowed us to quickly adapt to completely new test plan  Shrunk distance between testing artefact and the real thing  Made us confident in our result