Juliette Melton at BayCHI: Real World Remote Research
Upcoming SlideShare
Loading in...5
×
 

Juliette Melton at BayCHI: Real World Remote Research

on

  • 1,650 views

Remote research can raise the quality and lower the costs of your user research efforts; using a combination of surveys, video, screensharing, and phone, you can connect with a much broader range of ...

Remote research can raise the quality and lower the costs of your user research efforts; using a combination of surveys, video, screensharing, and phone, you can connect with a much broader range of users than you could using traditional lab-based usability tests, while using resources more efficiently than you would doing contextual research. In this workshop-style talk, Juliette Melton will cover recruiting sources, technology tools, and caveats you might not have thought of, including managing time zones and participant distraction. We will also address pros and cons of increasingly popular non-scripted research services.

Statistics

Views

Total Views
1,650
Slideshare-icon Views on SlideShare
1,524
Embed Views
126

Actions

Likes
2
Downloads
15
Comments
0

5 Embeds 126

http://juliemelton.com 119
http://www.slideshare.net 4
http://webcache.googleusercontent.com 1
http://74.125.45.132 1
http://translate.googleusercontent.com 1

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Juliette Melton at BayCHI: Real World Remote Research Juliette Melton at BayCHI: Real World Remote Research Presentation Transcript

  • Real World Remote Research Juliette Melton Deluxify User Experience
  • What is remote research? flickr.com/striatic
  • Who has done this? flickr.com/striatic
  • Why and why not to go remote flickr.com/johnida
  • Selling remote research... • Ease of recruiting • Recruiting quality • Participant’s real environment • No limit to the number of observers • If real-time recruiting, using actual tasks
  • ... but there are some caveats • Limited to participants with fast internet access • Lots of opportunities for tech failure • Can’t see participant faces
  • ... but there are some caveats • Timezones • Languages • Doesn’t work for mobile • Secret works in process • Consent for minors
  • Go remote if: • You can share what you’re studying • You don’t have easy access to your target users • You’re not focusing on mobile research • You’re not working with minors
  • Exercise • What big questions is your organization facing? • How are you addressing those big questions?
  • How to do remote research flickr.com/62327186@N00
  • Components • Participant • Moderator • Observer(s) • Tasks • Computer
  • Components • Participant • Participant’s computer • Moderator • Internet access • Screensharing software • Observer(s) Plus: • Phone • Tasks • Moderator/observer • Computer communication • Recording mechanism
  • Whither scheduling? • Scheduled, moderated • Non-scheduled, moderated • Non-scheduled, non-moderated
  • Scheduled & moderated • Pro: Doesn’t require access to code • Pro: Could be easiest transition from in-person studies • Con: Tasks aren’t authentic • Con: Scheduling takes time
  • People • Participant • Moderator • Observer(s)
  • Recruiting • House ads • Event websites • Customer lists • Recruiting agencies • Twitter
  • Recruiting • House ads • Event websites • Customer lists • Recruiting agencies • Twitter • Mechanical Turk
  • Scheduling • Survey to collect information • Ask for: name, age, internet access, willing to install plug-in, time zone, email address, phone number • Email back with confirmation, proposed times • Information you can refer back to on the phone
  • Audio • Easiest: call landline or mobile via Skype • Skype-to-Skype quality isn’t great • Record on your computer • Use a good quality headset! • Better quality: use patch to record your landline
  • Screen Sharing • WebEx • Adobe Connect (don’t need Pro version) • GoToMeeting • LiveLook • Try whatever your company already has!
  • Recording • Mac: iShowU HD • PC: Camtasia • PC: UserVue (discontinued)
  • Moderation • Introduce yourself and remind them of the email you sent • Help the participant install whatever plug-in they need to use the screen sharing software • Get approval to record
  • Moderation • “It's a little weird doing this and not being able to see each other! Could you just tell me a bit about yourself? Where you live, how old you are, and the kind of work that you do?”
  • Moderation • “We’re testing the website, not you” • Make it clear that you’re listening • Stay focused and comfortable • Respect participant’s time • Let your colleagues know that you’re in a testing session
  • Pro Tips • Keep a timer in the recording frame • Include your notes in the recording frame • Edit video to make a “best of” montage • Give yourself plenty of set up time!
  • Dealing with tech failure • Be apologetic • Reschedule, if possible • Increase the incentive amount • Sometimes it just won't work
  • Non-scheduled & moderated • Pro: Get real users of your site engaged in authentic tasks • Pro: Reduced recruiting time • Con: Requires access to code • Con: Need lots of site traffic
  • Ethnio • Live recruiting tool from Bolt | Peters • ethnio.com • (Also check out their book Remote Research)
  • Non-scheduled & non-moderated • Pro: Get real users of your site engaged in authentic tasks • Pro: Reduced recruiting time • Con: No control over moderation sessions • Con: Can’t adjust sessions on the fly
  • Non-scheduled & non-moderated Usabilla Source: mashable.com
  • Non-scheduled & non-moderated Usabilla Source: mashable.com Text Text
  • Real projects flickr.com/denniskatinas
  • Lumos Labs • Goal: Understand customer behavior related to daily game playing • Participants: Current customers • Recruiting: Twitter, email newsletter, blog • Why remote: User diversity, ease of recruiting
  • LendAround • Goal: Interviews with potential customers as formative research • Audio only • Recruiting: Mechanical Turk • Why remote: Easier to reach very specific user types
  • flickr.com/haraldfelgner
  • Exercise • Would remote research be useful for your organization? • Is there a project that you know about that would benefit from a remote component?
  • Questions? flickr/a-g
  • Thanks! Juliette Melton Deluxify User Experience deluxify.com @j