REMOTE DESIGN RESEARCH
INTERACTION 10
I’M NATE BOLT
I’M NATE BOLT
ROBOTIC DOG TREATS
I’M NATE BOLT
ROBOTIC DOG TREATS
DINOSAUR EXPLAINS IA
10 YEARS
234 STUDIES
2,815 PARTICIPANTS (MODERATED)
89 ORGANIZATIONS
19,120 HOURS
#ixd10 #Remote
7
#ixd10 #Remote
SO ANYWAY WHAT’s UP WITH YOU?



 Have you conducted remote testing before?
 Biggest concern (about remote silly)?
THE REMOTE
DESIGN RESEARCH
SITUATION
DESIGN RESEARCH

CONCEPT        ETHNOGRAPHY
TESTING

               PERSONA
SURVEYS
               DEVELOPMENT

IDEATION
 ...
Remote Research

                                  In person
                                  Remote
Definition:

Research...
THE WHOLE
REMOTE
PART OF THIS
When does remote win?
Native Environment
Cheap ethnography, not cheap lab.
Real Time
Allows self-motivated tasks.
I’ll trade you time
for physical presence
Involved Observers
Easier to collaborate in real time.
Geography
When does remote fail?
Bandwidth
Yes, it’s an issue.
Translation
It’s expensive and difficult to do live.
Minors
     Consent is a bear.
Especially if they’re under 13.
Faces
Most users don’t have webcams.
 Webcams are a little invasive.
Designing
REMOTE STUDIES
TIME-AWARE Tasks
Told to find purple pumps.   Has to wear this for sister’s wedding this
                                  ...
Real Time OBservers
Portable Research
Change on the fly




      “No one seems engaged in the laptop customizer”
“Let’s add questions about who they get recomm...
prototypes, wireframes,
  Sketches = heck yes
TOOLS
Usabilla


Clicks & Questions
Heatmaps
You do your own recruiting
$49 - $199
Loop11 (un-moderated)
PlainFrame SNEAK PREVIEW
Communication

phone               Skype / VOIP

Reliable            Cheap or free
Can be expensive    Harder for users
fo...
Screen-sharing

Standalone       Integrated
 Adobe Connect    UserVue
 LiveLook
 WebEx
 GoToMeeting
Adobe Acrobat Connect - $39/mo
Recording Tools

Hardware       Software
 Phone Patch   Camtasia (Windows)
 Cables        iShowU HD (Mac)
Recruiting
FOR REMOTE
Recruiting Options
                                              realness
Grab someone in the hallway
Grab someone who isn...
Gold Standard
 Live recruiting
 Get as close as you can
Recruiting Options

Ethnio
Links or house ads to online forms
Recruiting agencies
Customer email lists
Panels
Craigslist/o...
use Ethnio when

Website access
Some budget
Quotas are relatively simple
use forms when

You can place a link but not code
Low budget
Quotas are relatively complex
Options:
   Google Docs
   Wufoo
use Agencies when


No website access
People whine about first-time visitors
Higher budget
Online recruiting failed
Customer lists


 Sub-segments
 Ownership requirements
 No website access
PANELS
Craigslist


When other methods don’t work
No dough
Takes a while
Embarrassing to admit to your friends
Live Recruiting Math


 Target: 6 recruits/hour
 Allow for: 1% response (low average)
 You Need: 8-10,000 uniques/day
Paying Incentives

Collect minimal
personal info
Deliver quickly
Appropriate for
location
HOW TO BE
graceful
 When All Your
TECHNOLOGY
BREAKS
What they worry about
WHO ARE YOU AND CAN I
     TRUST YOU?
IF YOU CAN SEE MY SCREEN,
   CAN YOU SEE MY FACE?
WILL YOU BE ABLE TO TAKE
CONTROL OF MY COMPUTER?
WILL YOU HELP ME GET THE
          PLUG IN
OFF MY COMPUTER AT THE END?
WILL THIS WORK IF I HAVE A
FIREWALL/PROXY/STRICT IT
      DEPARTMENT?
IS THIS GOING TO END UP ON
         YOUTUBE?
Advanced Techniques
      High Emotions
OXYMORON?
Remote empathy
hybrid studies


Numbers actually do lie sometimes
And they don’t tell you the why
3-5 remote interviews is all you need
mobile Research?
Advanced Techniques
    One to many moderation




    Multi-threading
Burn the script
Find out what matters.
The Future
remoteusability.com
@boltron
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Remote Research at IxD10
Upcoming SlideShare
Loading in …5
×

Remote Research at IxD10

6,393 views
5,991 views

Published on

My talk on Remote Research from the 2010 IxD10 conference in Savannah.

Published in: Technology, Business

Remote Research at IxD10

  1. REMOTE DESIGN RESEARCH INTERACTION 10
  2. I’M NATE BOLT
  3. I’M NATE BOLT ROBOTIC DOG TREATS
  4. I’M NATE BOLT ROBOTIC DOG TREATS DINOSAUR EXPLAINS IA
  5. 10 YEARS 234 STUDIES 2,815 PARTICIPANTS (MODERATED) 89 ORGANIZATIONS 19,120 HOURS
  6. #ixd10 #Remote
  7. 7 #ixd10 #Remote
  8. SO ANYWAY WHAT’s UP WITH YOU? Have you conducted remote testing before? Biggest concern (about remote silly)?
  9. THE REMOTE DESIGN RESEARCH SITUATION
  10. DESIGN RESEARCH CONCEPT ETHNOGRAPHY TESTING PERSONA SURVEYS DEVELOPMENT IDEATION NEEDS GAME BASED ASSESSMENT ELICITATION
  11. Remote Research In person Remote Definition: Research where the participant is not sharing physical space with the researcher. % of qualitative research done remotely* *Source: BP’s best guess
  12. THE WHOLE REMOTE PART OF THIS
  13. When does remote win?
  14. Native Environment Cheap ethnography, not cheap lab.
  15. Real Time Allows self-motivated tasks.
  16. I’ll trade you time for physical presence
  17. Involved Observers Easier to collaborate in real time.
  18. Geography
  19. When does remote fail?
  20. Bandwidth Yes, it’s an issue.
  21. Translation It’s expensive and difficult to do live.
  22. Minors Consent is a bear. Especially if they’re under 13.
  23. Faces Most users don’t have webcams. Webcams are a little invasive.
  24. Designing REMOTE STUDIES
  25. TIME-AWARE Tasks Told to find purple pumps. Has to wear this for sister’s wedding this weekend. Doesn’t care. Whole different interview.
  26. Real Time OBservers
  27. Portable Research
  28. Change on the fly “No one seems engaged in the laptop customizer” “Let’s add questions about who they get recommendations from”
  29. prototypes, wireframes, Sketches = heck yes
  30. TOOLS
  31. Usabilla Clicks & Questions Heatmaps You do your own recruiting $49 - $199
  32. Loop11 (un-moderated)
  33. PlainFrame SNEAK PREVIEW
  34. Communication phone Skype / VOIP Reliable Cheap or free Can be expensive Harder for users for international Can combine with Conference calls screensharing to needed for stress user’s observers connection The Past The Future
  35. Screen-sharing Standalone Integrated Adobe Connect UserVue LiveLook WebEx GoToMeeting
  36. Adobe Acrobat Connect - $39/mo
  37. Recording Tools Hardware Software Phone Patch Camtasia (Windows) Cables iShowU HD (Mac)
  38. Recruiting FOR REMOTE
  39. Recruiting Options realness Grab someone in the hallway Grab someone who isn’t directly involved in your project IM your friends for a quick look Panels and recruiting agencies Real customers from marketing lists Site intercepts
  40. Gold Standard Live recruiting Get as close as you can
  41. Recruiting Options Ethnio Links or house ads to online forms Recruiting agencies Customer email lists Panels Craigslist/online ads
  42. use Ethnio when Website access Some budget Quotas are relatively simple
  43. use forms when You can place a link but not code Low budget Quotas are relatively complex Options: Google Docs Wufoo
  44. use Agencies when No website access People whine about first-time visitors Higher budget Online recruiting failed
  45. Customer lists Sub-segments Ownership requirements No website access
  46. PANELS
  47. Craigslist When other methods don’t work No dough Takes a while Embarrassing to admit to your friends
  48. Live Recruiting Math Target: 6 recruits/hour Allow for: 1% response (low average) You Need: 8-10,000 uniques/day
  49. Paying Incentives Collect minimal personal info Deliver quickly Appropriate for location
  50. HOW TO BE graceful When All Your TECHNOLOGY BREAKS
  51. What they worry about
  52. WHO ARE YOU AND CAN I TRUST YOU?
  53. IF YOU CAN SEE MY SCREEN, CAN YOU SEE MY FACE?
  54. WILL YOU BE ABLE TO TAKE CONTROL OF MY COMPUTER?
  55. WILL YOU HELP ME GET THE PLUG IN OFF MY COMPUTER AT THE END?
  56. WILL THIS WORK IF I HAVE A FIREWALL/PROXY/STRICT IT DEPARTMENT?
  57. IS THIS GOING TO END UP ON YOUTUBE?
  58. Advanced Techniques High Emotions
  59. OXYMORON? Remote empathy
  60. hybrid studies Numbers actually do lie sometimes And they don’t tell you the why 3-5 remote interviews is all you need
  61. mobile Research?
  62. Advanced Techniques One to many moderation Multi-threading
  63. Burn the script Find out what matters.
  64. The Future
  65. remoteusability.com
  66. @boltron

×