Remote Research at IxD10

7,039 views

Published on

My talk on Remote Research from the 2010 IxD10 conference in Savannah.

Published in: Technology, Business

Remote Research at IxD10

  1. REMOTE DESIGN RESEARCH INTERACTION 10
  2. I’M NATE BOLT
  3. I’M NATE BOLT ROBOTIC DOG TREATS
  4. I’M NATE BOLT ROBOTIC DOG TREATS DINOSAUR EXPLAINS IA
  5. 10 YEARS 234 STUDIES 2,815 PARTICIPANTS (MODERATED) 89 ORGANIZATIONS 19,120 HOURS
  6. #ixd10 #Remote
  7. 7 #ixd10 #Remote
  8. SO ANYWAY WHAT’s UP WITH YOU? Have you conducted remote testing before? Biggest concern (about remote silly)?
  9. THE REMOTE DESIGN RESEARCH SITUATION
  10. DESIGN RESEARCH CONCEPT ETHNOGRAPHY TESTING PERSONA SURVEYS DEVELOPMENT IDEATION NEEDS GAME BASED ASSESSMENT ELICITATION
  11. Remote Research In person Remote Definition: Research where the participant is not sharing physical space with the researcher. % of qualitative research done remotely* *Source: BP’s best guess
  12. THE WHOLE REMOTE PART OF THIS
  13. When does remote win?
  14. Native Environment Cheap ethnography, not cheap lab.
  15. Real Time Allows self-motivated tasks.
  16. I’ll trade you time for physical presence
  17. Involved Observers Easier to collaborate in real time.
  18. Geography
  19. When does remote fail?
  20. Bandwidth Yes, it’s an issue.
  21. Translation It’s expensive and difficult to do live.
  22. Minors Consent is a bear. Especially if they’re under 13.
  23. Faces Most users don’t have webcams. Webcams are a little invasive.
  24. Designing REMOTE STUDIES
  25. TIME-AWARE Tasks Told to find purple pumps. Has to wear this for sister’s wedding this weekend. Doesn’t care. Whole different interview.
  26. Real Time OBservers
  27. Portable Research
  28. Change on the fly “No one seems engaged in the laptop customizer” “Let’s add questions about who they get recommendations from”
  29. prototypes, wireframes, Sketches = heck yes
  30. TOOLS
  31. Usabilla Clicks & Questions Heatmaps You do your own recruiting $49 - $199
  32. Loop11 (un-moderated)
  33. PlainFrame SNEAK PREVIEW
  34. Communication phone Skype / VOIP Reliable Cheap or free Can be expensive Harder for users for international Can combine with Conference calls screensharing to needed for stress user’s observers connection The Past The Future
  35. Screen-sharing Standalone Integrated Adobe Connect UserVue LiveLook WebEx GoToMeeting
  36. Adobe Acrobat Connect - $39/mo
  37. Recording Tools Hardware Software Phone Patch Camtasia (Windows) Cables iShowU HD (Mac)
  38. Recruiting FOR REMOTE
  39. Recruiting Options realness Grab someone in the hallway Grab someone who isn’t directly involved in your project IM your friends for a quick look Panels and recruiting agencies Real customers from marketing lists Site intercepts
  40. Gold Standard Live recruiting Get as close as you can
  41. Recruiting Options Ethnio Links or house ads to online forms Recruiting agencies Customer email lists Panels Craigslist/online ads
  42. use Ethnio when Website access Some budget Quotas are relatively simple
  43. use forms when You can place a link but not code Low budget Quotas are relatively complex Options: Google Docs Wufoo
  44. use Agencies when No website access People whine about first-time visitors Higher budget Online recruiting failed
  45. Customer lists Sub-segments Ownership requirements No website access
  46. PANELS
  47. Craigslist When other methods don’t work No dough Takes a while Embarrassing to admit to your friends
  48. Live Recruiting Math Target: 6 recruits/hour Allow for: 1% response (low average) You Need: 8-10,000 uniques/day
  49. Paying Incentives Collect minimal personal info Deliver quickly Appropriate for location
  50. HOW TO BE graceful When All Your TECHNOLOGY BREAKS
  51. What they worry about
  52. WHO ARE YOU AND CAN I TRUST YOU?
  53. IF YOU CAN SEE MY SCREEN, CAN YOU SEE MY FACE?
  54. WILL YOU BE ABLE TO TAKE CONTROL OF MY COMPUTER?
  55. WILL YOU HELP ME GET THE PLUG IN OFF MY COMPUTER AT THE END?
  56. WILL THIS WORK IF I HAVE A FIREWALL/PROXY/STRICT IT DEPARTMENT?
  57. IS THIS GOING TO END UP ON YOUTUBE?
  58. Advanced Techniques High Emotions
  59. OXYMORON? Remote empathy
  60. hybrid studies Numbers actually do lie sometimes And they don’t tell you the why 3-5 remote interviews is all you need
  61. mobile Research?
  62. Advanced Techniques One to many moderation Multi-threading
  63. Burn the script Find out what matters.
  64. The Future
  65. remoteusability.com
  66. @boltron

×