Remote ResearchWorkshop
Photo Credit: recados-orkut.net
Remote Design Research                                        In person                                        RemoteDefini...
#UXLX #RR
Bayesian methods Adaptive1995Infer when users needed help Decision Theory &Animated pedagogical Systems Groupagency
“ Misunderstood animated  pedagogical agent or spawn of  Satan? ”
Bad Research
1) Academic Focus2) Lab-based3) False Premise
THAT IS WHY WE WENT REMOTE
Btw I’m Nate Bolt
12 YEARS293 STUDIES3,108 PARTICIPANTS (MODERATED)118 ORGANIZATIONS21,610 HOURS
“SOCIAL IMPACT OF DIGITAL TECHNOLOGY”
A DINOSAUR FAMILYEXPLAINS INFORMATION ARCHITECTURE
SF to PARISIN TWO MINUTES
jumboltron.com
OMG PLEASEBUY THISBOOK
Let’s jump right in
What’s New with UX Research Tools?
BUT FIRST
Moderated   versus   Automated
Moderated   versus   Automated10%                  90%
Moderated   versus   Automated                           Photo Credit: singularityhub.com
ModeratedGoToMeeting 5.2Integrated RecordingThat’s really awesome
ModeratedHuggingAt Mozillaand MailChimp                Photo Credit: Diane Loviglio, Mozilla
AutomatedUsabillaMobile
HOW TO BEgraceful  When All YourTECHNOLOGYBREAKS
Follow the buddy system
It’s laptop time
remoteresear.ch
remoteresear.ch/lisbon
(BROWSER TIME)
IN CASE THE INTERNET FAILSResearch experienceMost important thing to get out of today?Biggest fear or skepticism about rem...
Thanks, Volunteer!
Four Takeaways1. See moderated method &   recording with GoToMeeting2. Automated with Usabilla3.Self-moderated tablet hugg...
Eff you sales guy
RecruitingWHAT WE’LL COVER TODAY   Moderated                         Contextual Inquiry                         Automated ...
SOME THOUGHTS ON WEB ANALYTICSWhat do helicopters do in action movies?                             Explode
“ How much practical research  experience do I need to have for  this workshop? ”                     - Many People
“ Will this be a long lecture or an  actual workshop? ”                   - Some Guy on Twitter
“ Can we do contextual inquiries  remotely? ”           - Nick Dunlavey | @ndunlavey
The physical and computing ecosystem
Now we do a little experiment
EXERCISE #1               “Giraffe”Binder PDF Page 4Table groupsPick one moderator and one participant(they need to be in d...
remoteresear.ch/lisbon“The Workshop Binder”
MODERATOR InstructionsYour participant has a sheet of paper and that’s itGoal: find out what kind of physical taskinstructi...
It’s A RACEYou only have 10 minutes to do thismax.
Surprises?
Was there emotion?
WHEN DOES REMOTE WIN?
Marv.Creative director UX designer product managerdeveloper IA co-founder.
Marv’s Boss.He’s always on a plane and loves birds.
Hey Marv, I want to savesome money on research.
NATIVE ENVIRONMENTCHEAP ETHNOGRAPHY, NOT CHEAP LAB.
TIME-AWARERESEARCH IS THE BEST
I’LL TRADE YOU TIMEFOR PHYSICAL PRESENCE
INVOLVED OBSERVERSEasier to collaborate in real time.
GEOGRAPHYTITLE TEXT
WHEN DOES REMOTE LOSE?
Hey Marv, I want feedbackon our MMO video gamefrom 13yo English speakingkids in France & LatinAmerica with webcams.
I guess, Boss.Might be hardto do withremote testing.
BANDWIDTHYes, it’s an issue.
TRANSLATIONIt’s expensive and difficult to do live.
MINORS     Consent is a bear.Especially if they’re under 13.
FACESMost users don’t have webcams.Webcams are a little invasive.
YOUR BOSS
SUPER DUPER SECURITY
AN EPIC FAIL.
We basically didBad Research
Kids will lie for coinsPeople mis-assessed their English levelsBandwidth was really a problemKids don’t play when their pa...
HOW TO FIND ACTUAL SPEAKERS OF YOUR      LANGUAGE IN ANY COUNTRY:“ What happens when you let go of a balloon? ”“ Quest-ce ...
DESIGNINGREMOTE STUDIES
Yo Marv, get me someinsight on WHY people arebailing out of checkout.
Sure, Boss.Let’s combinemethods.Intercept &observe 10users live, anddo 10 self-moderated withusertesting.com
TIME-AWARE TASKSTold to find purple pumps.   Has to wear this for sister’s wedding this                                    ...
HEART & SOUL OF REMOTE RESEARCHNot scheduling participants.
REAL TIME OBSERVERS
TITLE TEXT
PROTOTYPES, WIREFRAMES,      SKETCHES?
HECK YES.
RECRUITINGFOR REMOTE
RECRUITING OPTIONSEthnioLinks or house ads to online formsRecruiting agenciesCustomer email listsPanelsCraigslist/online ads
RECRUITING OPTIONS                                           realnessGrab someone in the hallwayGrab someone who isn’t dir...
SITE ISN’T AN OPTIONGEO IPMEMBERS ONLY
GOLD STANDARDLive recruitingGet as close as youcan
USE ETHNIO WHENWebsite accessSome budgetQuotas are relatively simple
USE FORMS WHENYou can place a link but not codeLow budgetQuotas are relatively complexOptions:   Google Docs   Wufoo
USE AGENCIES WHENNo website accessPeople whine about first-timevisitorsHigher budgetOnline recruiting failed
CUSTOMER LISTSSub-segmentsOwnershiprequirementsNo website access
PANEL
SORT OF
CRAIGSLISTWhen other methods don’t workNo doughTakes a whileEmbarrassing to admit to your friends
LIVE RECRUITING MATHTarget: 6 recruits/hourAllow for: 1% response (low averageYou Need: 10,000 uniques/day
TITLE TEXT
remoteresear.ch/samples  “Online Consent”
Paying IncentivesCollect minimalpersonal infoDeliver quicklyAppropriate forlocation
Screener constraintsKeep it shortDifferent from surveysWho gets paid?
MODERATED must-haves  Consent  Tech set-up  The beef  De-installation  Thanks & incentive
AUTOMATED must-haves Expectation setting Instructions The beef Thanks & incentive
RecruitingSame: Good “talkers”Same: Demographic fitsDifferent: Relevant currenttasksDifferent: Compatible tech
Logistics: What & HowProvide testtargetAccessCredentials
Logistics: Who & WhenHow to connect with the userManaging time zonesSession length
Paying IncentivesCollect minimalpersonal infoDeliver quicklyAppropriate forlocation
STAGED IncentivesFor Contextual InquiryStart with $75, then at the end offer$25 more for environment photosSelf-made diary ...
Advanced planning:            hybrid studiesWhy use only one method?Some methods don’t tell you the why3-5 remote intervie...
EXERCISE #2okay, draft a screener  Binder PDF Page 6  Use ethn.io or dev.ethn.io (beta) or wufoo  Under 8 Questions  Advan...
remoteresear.ch/lisbon“The Workshop Binder”
Marv-o - what in the worlddoes automated/unmoderated/asynchronous researchmean?
Sure, boss.There is anAVALANCHEof UX TOOLS.
“At least a littlebehavioral”No surveys.No standard webanalytics.
Since 2007
Can tools make us better      researchers?
5CATEGORIES
ModeratedSelf-Moderated       For A Long TimeAutomated Live       ConceptualAutomated StaticWeb Analytics
Talk To PeoplePeople Talk To A Machine        For A Long TimeTasks On A Live Site        Tasks On ConceptsTasks On ImagesF...
InsightAmmunition          For Ad AgenciesMore Ammunition          I.A. & NavigationStill More AmmunitionJust Better Analy...
ModeratedSelf-Moderated       For A Long TimeAutomated Live       ConceptualAutomated Static             Deep             ...
Moderated                         OpinionsSelf-Moderated       For A Long TimeAutomated Live       ConceptualAutomated Sta...
Moderated                Ad Agencies                           Love ItSelf-Moderated       For A Long TimeAutomated Live  ...
Moderated                Jared Spool                           Hates ItSelf-Moderated       For A Long TimeAutomated Live ...
Moderated                         }Self-Moderated       For A Long Time                             MobileAutomated Live  ...
Remote Research ToolkitUNMODERATED (AKA AUTOMATED)
3 partsProvide test targetRecord user behaviorCapture comments (optional)
USABILLAClicks & QuestionsHeatmapsYou do your own recruiting$49 - $199
LOOP11 (UN-MODERATED)       TITLE TEXT
TITLE TEXT
GOTOMEETING - $39/MO
TITLE TEXT
WHAT WE USE. A LOT.• Ethnio + GTM• Usabilla + Usertesting.com• Guerrilla mobile
EXERCISE #3Either “unmoderated” or “practice interviewing”      usertesting.com - 1 free user      CODE: uxlisbon2012     ...
RESULTS
REMEMBER, BEgraceful  When All YourTECHNOLOGYBREAKS
WHAT THEY WORRY ABOUT
WHO ARE YOU AND CAN    I TRUST YOU?
IF YOU CAN SEE MY     SCREEN, CAN YOU SEE MY      FACE?
WILL YOU BE ABLE    TO TAKE CONTROL OF MY   COMPUTER?
WILL YOU HELP ME GET     THE PLUG-INOFF MY COMPUTER AT      THE END?
WILL THIS WORK IF I HAVE AFIREWALL/PROXY/STRICT IT      DEPARTMENT?
IS THIS GOING TO END        UP ON      YOUTUBE?
OXYMORON?REMOTE EMPATHY
Taking NotesSecond monitor ifpossibleExcel Hack(remoteresear.ch/samples)
Observer InvolvementIMCampfire (!)Integrated ChatPassing Notes
HYBRID STUDIESNumbers actually do lie sometimesAnd they don’t tell you the why3-5 remote interviews is all you need
So, what could go wrong?
3 points of failure   Technology       yours       participant’s       observer’s   Recruiting   Test Design
Control what you can controlWhich is, your set up.You wouldn’t go backpackingwithout checking your gear.Do it 24 hours in ...
Prepare for what    you can’t controlUser’s dog trips over powercordInternet affected by localweatherUser can’t installDoes...
Mid-SessionTech Problems
Live Recruiting        ProblemsWhat if they gave a study and nobody                came?
Increase exposureWhen you’re not gettingenough viewsWhen the wrong type ofusers are responding
Increase incentivesWhen it’s cheaperWhen you’re almost gettingenoughWhen segments are tough
Switch methodsWhen base traffic level isn’t high enough
Script Problems    Cut the BS.
ADVANCED TECHNIQUES One to many moderation  Multi-threading
PORTABLE RESEARCH
BURN THE SCRIPTFIND OUT WHAT MATTERS.
ADVANCED TECHNIQUES    High Emotions
TITLE TEXT
MOBILE MOBILE   THE FUTUREMOBILE MOBILEMOBILE MOBILEMOBILE MOBILE
DUAL LENSSTREAMINGFIELD RESEARCH• Livestream• Flip Cam• It’s the view  finder, silly• Actual duct  tape
DISCOUNTS!!Usertesting.com 1 free user. uxlisbon2012Usabilla 2 months free of any plan. Sign upfor an account, but cancel ...
DISCOUNTS!!remoteresear.ch/lisbon(look in the slides)(for, well, that last slide)
nate@boltpeters.com  @boltron
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
UX Lx 2012 - Nate Bolt
Upcoming SlideShare
Loading in...5
×

UX Lx 2012 - Nate Bolt

11,420

Published on

Published in: Technology

UX Lx 2012 - Nate Bolt

  1. 1. Remote ResearchWorkshop
  2. 2. Photo Credit: recados-orkut.net
  3. 3. Remote Design Research In person RemoteDefinition:Research where theparticipant is not sharingphysical space with theresearcher. % of qualitative research done remotely* * Source: My wild guess
  4. 4. #UXLX #RR
  5. 5. Bayesian methods Adaptive1995Infer when users needed help Decision Theory &Animated pedagogical Systems Groupagency
  6. 6. “ Misunderstood animated pedagogical agent or spawn of Satan? ”
  7. 7. Bad Research
  8. 8. 1) Academic Focus2) Lab-based3) False Premise
  9. 9. THAT IS WHY WE WENT REMOTE
  10. 10. Btw I’m Nate Bolt
  11. 11. 12 YEARS293 STUDIES3,108 PARTICIPANTS (MODERATED)118 ORGANIZATIONS21,610 HOURS
  12. 12. “SOCIAL IMPACT OF DIGITAL TECHNOLOGY”
  13. 13. A DINOSAUR FAMILYEXPLAINS INFORMATION ARCHITECTURE
  14. 14. SF to PARISIN TWO MINUTES
  15. 15. jumboltron.com
  16. 16. OMG PLEASEBUY THISBOOK
  17. 17. Let’s jump right in
  18. 18. What’s New with UX Research Tools?
  19. 19. BUT FIRST
  20. 20. Moderated versus Automated
  21. 21. Moderated versus Automated10% 90%
  22. 22. Moderated versus Automated Photo Credit: singularityhub.com
  23. 23. ModeratedGoToMeeting 5.2Integrated RecordingThat’s really awesome
  24. 24. ModeratedHuggingAt Mozillaand MailChimp Photo Credit: Diane Loviglio, Mozilla
  25. 25. AutomatedUsabillaMobile
  26. 26. HOW TO BEgraceful When All YourTECHNOLOGYBREAKS
  27. 27. Follow the buddy system
  28. 28. It’s laptop time
  29. 29. remoteresear.ch
  30. 30. remoteresear.ch/lisbon
  31. 31. (BROWSER TIME)
  32. 32. IN CASE THE INTERNET FAILSResearch experienceMost important thing to get out of today?Biggest fear or skepticism about remote research?
  33. 33. Thanks, Volunteer!
  34. 34. Four Takeaways1. See moderated method & recording with GoToMeeting2. Automated with Usabilla3.Self-moderated tablet hugging4.Quick incentive payment
  35. 35. Eff you sales guy
  36. 36. RecruitingWHAT WE’LL COVER TODAY Moderated Contextual Inquiry Automated Results Pitfalls
  37. 37. SOME THOUGHTS ON WEB ANALYTICSWhat do helicopters do in action movies? Explode
  38. 38. “ How much practical research experience do I need to have for this workshop? ” - Many People
  39. 39. “ Will this be a long lecture or an actual workshop? ” - Some Guy on Twitter
  40. 40. “ Can we do contextual inquiries remotely? ” - Nick Dunlavey | @ndunlavey
  41. 41. The physical and computing ecosystem
  42. 42. Now we do a little experiment
  43. 43. EXERCISE #1 “Giraffe”Binder PDF Page 4Table groupsPick one moderator and one participant(they need to be in different locations) 10 minutes of moderating
  44. 44. remoteresear.ch/lisbon“The Workshop Binder”
  45. 45. MODERATOR InstructionsYour participant has a sheet of paper and that’s itGoal: find out what kind of physical taskinstructions onlineHint: ask them to give you a play by play of whatthey are doingTry and follow along with your own paper NO helping, even if you could.
  46. 46. It’s A RACEYou only have 10 minutes to do thismax.
  47. 47. Surprises?
  48. 48. Was there emotion?
  49. 49. WHEN DOES REMOTE WIN?
  50. 50. Marv.Creative director UX designer product managerdeveloper IA co-founder.
  51. 51. Marv’s Boss.He’s always on a plane and loves birds.
  52. 52. Hey Marv, I want to savesome money on research.
  53. 53. NATIVE ENVIRONMENTCHEAP ETHNOGRAPHY, NOT CHEAP LAB.
  54. 54. TIME-AWARERESEARCH IS THE BEST
  55. 55. I’LL TRADE YOU TIMEFOR PHYSICAL PRESENCE
  56. 56. INVOLVED OBSERVERSEasier to collaborate in real time.
  57. 57. GEOGRAPHYTITLE TEXT
  58. 58. WHEN DOES REMOTE LOSE?
  59. 59. Hey Marv, I want feedbackon our MMO video gamefrom 13yo English speakingkids in France & LatinAmerica with webcams.
  60. 60. I guess, Boss.Might be hardto do withremote testing.
  61. 61. BANDWIDTHYes, it’s an issue.
  62. 62. TRANSLATIONIt’s expensive and difficult to do live.
  63. 63. MINORS Consent is a bear.Especially if they’re under 13.
  64. 64. FACESMost users don’t have webcams.Webcams are a little invasive.
  65. 65. YOUR BOSS
  66. 66. SUPER DUPER SECURITY
  67. 67. AN EPIC FAIL.
  68. 68. We basically didBad Research
  69. 69. Kids will lie for coinsPeople mis-assessed their English levelsBandwidth was really a problemKids don’t play when their parents are home
  70. 70. HOW TO FIND ACTUAL SPEAKERS OF YOUR LANGUAGE IN ANY COUNTRY:“ What happens when you let go of a balloon? ”“ Quest-ce qui se passe quand vous lâchez unballon? ”
  71. 71. DESIGNINGREMOTE STUDIES
  72. 72. Yo Marv, get me someinsight on WHY people arebailing out of checkout.
  73. 73. Sure, Boss.Let’s combinemethods.Intercept &observe 10users live, anddo 10 self-moderated withusertesting.com
  74. 74. TIME-AWARE TASKSTold to find purple pumps. Has to wear this for sister’s wedding this weekend. Doesn’t care. Whole different interview.
  75. 75. HEART & SOUL OF REMOTE RESEARCHNot scheduling participants.
  76. 76. REAL TIME OBSERVERS
  77. 77. TITLE TEXT
  78. 78. PROTOTYPES, WIREFRAMES, SKETCHES?
  79. 79. HECK YES.
  80. 80. RECRUITINGFOR REMOTE
  81. 81. RECRUITING OPTIONSEthnioLinks or house ads to online formsRecruiting agenciesCustomer email listsPanelsCraigslist/online ads
  82. 82. RECRUITING OPTIONS realnessGrab someone in the hallwayGrab someone who isn’t directly involvedin your projectIM your friends for a quick lookPanels and recruiting agenciesReal customers from marketing listsSite intercepts
  83. 83. SITE ISN’T AN OPTIONGEO IPMEMBERS ONLY
  84. 84. GOLD STANDARDLive recruitingGet as close as youcan
  85. 85. USE ETHNIO WHENWebsite accessSome budgetQuotas are relatively simple
  86. 86. USE FORMS WHENYou can place a link but not codeLow budgetQuotas are relatively complexOptions: Google Docs Wufoo
  87. 87. USE AGENCIES WHENNo website accessPeople whine about first-timevisitorsHigher budgetOnline recruiting failed
  88. 88. CUSTOMER LISTSSub-segmentsOwnershiprequirementsNo website access
  89. 89. PANEL
  90. 90. SORT OF
  91. 91. CRAIGSLISTWhen other methods don’t workNo doughTakes a whileEmbarrassing to admit to your friends
  92. 92. LIVE RECRUITING MATHTarget: 6 recruits/hourAllow for: 1% response (low averageYou Need: 10,000 uniques/day
  93. 93. TITLE TEXT
  94. 94. remoteresear.ch/samples “Online Consent”
  95. 95. Paying IncentivesCollect minimalpersonal infoDeliver quicklyAppropriate forlocation
  96. 96. Screener constraintsKeep it shortDifferent from surveysWho gets paid?
  97. 97. MODERATED must-haves Consent Tech set-up The beef De-installation Thanks & incentive
  98. 98. AUTOMATED must-haves Expectation setting Instructions The beef Thanks & incentive
  99. 99. RecruitingSame: Good “talkers”Same: Demographic fitsDifferent: Relevant currenttasksDifferent: Compatible tech
  100. 100. Logistics: What & HowProvide testtargetAccessCredentials
  101. 101. Logistics: Who & WhenHow to connect with the userManaging time zonesSession length
  102. 102. Paying IncentivesCollect minimalpersonal infoDeliver quicklyAppropriate forlocation
  103. 103. STAGED IncentivesFor Contextual InquiryStart with $75, then at the end offer$25 more for environment photosSelf-made diary studies
  104. 104. Advanced planning: hybrid studiesWhy use only one method?Some methods don’t tell you the why3-5 remote interviews is all you need
  105. 105. EXERCISE #2okay, draft a screener Binder PDF Page 6 Use ethn.io or dev.ethn.io (beta) or wufoo Under 8 Questions Advanced Bonus: create an automated and moderated screener
  106. 106. remoteresear.ch/lisbon“The Workshop Binder”
  107. 107. Marv-o - what in the worlddoes automated/unmoderated/asynchronous researchmean?
  108. 108. Sure, boss.There is anAVALANCHEof UX TOOLS.
  109. 109. “At least a littlebehavioral”No surveys.No standard webanalytics.
  110. 110. Since 2007
  111. 111. Can tools make us better researchers?
  112. 112. 5CATEGORIES
  113. 113. ModeratedSelf-Moderated For A Long TimeAutomated Live ConceptualAutomated StaticWeb Analytics
  114. 114. Talk To PeoplePeople Talk To A Machine For A Long TimeTasks On A Live Site Tasks On ConceptsTasks On ImagesFancy-Ass Analytics
  115. 115. InsightAmmunition For Ad AgenciesMore Ammunition I.A. & NavigationStill More AmmunitionJust Better Analytics
  116. 116. ModeratedSelf-Moderated For A Long TimeAutomated Live ConceptualAutomated Static Deep Behavioral UXWeb Analytics Insight
  117. 117. Moderated OpinionsSelf-Moderated For A Long TimeAutomated Live ConceptualAutomated StaticWeb Analytics
  118. 118. Moderated Ad Agencies Love ItSelf-Moderated For A Long TimeAutomated Live ConceptualAutomated StaticWeb Analytics
  119. 119. Moderated Jared Spool Hates ItSelf-Moderated For A Long TimeAutomated Live ConceptualAutomated StaticWeb Analytics
  120. 120. Moderated }Self-Moderated For A Long Time MobileAutomated Live ConceptualAutomated Static
  121. 121. Remote Research ToolkitUNMODERATED (AKA AUTOMATED)
  122. 122. 3 partsProvide test targetRecord user behaviorCapture comments (optional)
  123. 123. USABILLAClicks & QuestionsHeatmapsYou do your own recruiting$49 - $199
  124. 124. LOOP11 (UN-MODERATED) TITLE TEXT
  125. 125. TITLE TEXT
  126. 126. GOTOMEETING - $39/MO
  127. 127. TITLE TEXT
  128. 128. WHAT WE USE. A LOT.• Ethnio + GTM• Usabilla + Usertesting.com• Guerrilla mobile
  129. 129. EXERCISE #3Either “unmoderated” or “practice interviewing” usertesting.com - 1 free user CODE: uxlisbon2012 usabilla - 2 months free (Sign up for an account, but cancel on the payment page. Send an email to support@usabilla.com and mention UXLX) ethnio - 1 month free or trial. CODE: WORKSHOPLOVE
  130. 130. RESULTS
  131. 131. REMEMBER, BEgraceful When All YourTECHNOLOGYBREAKS
  132. 132. WHAT THEY WORRY ABOUT
  133. 133. WHO ARE YOU AND CAN I TRUST YOU?
  134. 134. IF YOU CAN SEE MY SCREEN, CAN YOU SEE MY FACE?
  135. 135. WILL YOU BE ABLE TO TAKE CONTROL OF MY COMPUTER?
  136. 136. WILL YOU HELP ME GET THE PLUG-INOFF MY COMPUTER AT THE END?
  137. 137. WILL THIS WORK IF I HAVE AFIREWALL/PROXY/STRICT IT DEPARTMENT?
  138. 138. IS THIS GOING TO END UP ON YOUTUBE?
  139. 139. OXYMORON?REMOTE EMPATHY
  140. 140. Taking NotesSecond monitor ifpossibleExcel Hack(remoteresear.ch/samples)
  141. 141. Observer InvolvementIMCampfire (!)Integrated ChatPassing Notes
  142. 142. HYBRID STUDIESNumbers actually do lie sometimesAnd they don’t tell you the why3-5 remote interviews is all you need
  143. 143. So, what could go wrong?
  144. 144. 3 points of failure Technology yours participant’s observer’s Recruiting Test Design
  145. 145. Control what you can controlWhich is, your set up.You wouldn’t go backpackingwithout checking your gear.Do it 24 hours in advance. Orelse.
  146. 146. Prepare for what you can’t controlUser’s dog trips over powercordInternet affected by localweatherUser can’t installDoesn’t know how to install
  147. 147. Mid-SessionTech Problems
  148. 148. Live Recruiting ProblemsWhat if they gave a study and nobody came?
  149. 149. Increase exposureWhen you’re not gettingenough viewsWhen the wrong type ofusers are responding
  150. 150. Increase incentivesWhen it’s cheaperWhen you’re almost gettingenoughWhen segments are tough
  151. 151. Switch methodsWhen base traffic level isn’t high enough
  152. 152. Script Problems Cut the BS.
  153. 153. ADVANCED TECHNIQUES One to many moderation Multi-threading
  154. 154. PORTABLE RESEARCH
  155. 155. BURN THE SCRIPTFIND OUT WHAT MATTERS.
  156. 156. ADVANCED TECHNIQUES High Emotions
  157. 157. TITLE TEXT
  158. 158. MOBILE MOBILE THE FUTUREMOBILE MOBILEMOBILE MOBILEMOBILE MOBILE
  159. 159. DUAL LENSSTREAMINGFIELD RESEARCH• Livestream• Flip Cam• It’s the view finder, silly• Actual duct tape
  160. 160. DISCOUNTS!!Usertesting.com 1 free user. uxlisbon2012Usabilla 2 months free of any plan. Sign upfor an account, but cancel on the paymentpage. Send an email tosupport@usabilla.com and mention UXLXEthnio 1 month free any plan.WORKSHOPLOVE
  161. 161. DISCOUNTS!!remoteresear.ch/lisbon(look in the slides)(for, well, that last slide)
  162. 162. nate@boltpeters.com @boltron
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×