The RTFM of Usability at LUXR June 2011

  • 868 views
Uploaded on

 

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
868
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
5
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • 1. None\n2. Doesn’t matter - start small. Key thing, iterate!\n3. Steve Krug: “Recruit loosely and grade on a curve”\n
  • \n
  • \n
  • \n
  • 1. None\n2. Doesn’t matter - start small. Key thing, iterate!\n3. Steve Krug: “Recruit loosely and grade on a curve”\n
  • 1. None\n2. Doesn’t matter - start small. Key thing, iterate!\n3. Steve Krug: “Recruit loosely and grade on a curve”\n
  • \n
  • 1. None\n2. Doesn’t matter - start small. Key thing, iterate!\n3. Steve Krug: “Recruit loosely and grade on a curve”\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • 1. None\n2. Doesn’t matter - start small. Key thing, iterate!\n3. Steve Krug: “Recruit loosely and grade on a curve”\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Reassure - no pressure, joke\n
  • Reassure - no pressure, joke\n
  • Imagine you are at home, what would you do next?\n
  • Probe. Why?\n
  • Probe. Why?\n
  • probe. Thinkaloud\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • I’d like US to finish on time ...\n
  • \n

Transcript

  • 1. Testing Your Baby“How do I get Janice and theluxr mafia off my back?” Rick Boardman @uxrick luxr Jun/17/2011
  • 2. Cast Product/Biz UX User EngThanks to Braden Kowitz for smiley graphics
  • 3. Think Usability? Intro to Intro to(Speaker/ How to Lean UX Task generative Personas Intersect What are methods? Analysis? Lecture) interviewing Distinguish & POVs Brainstorm you building btw needs w/ Biz & Analytics Distro in next week & insights Agile? & next 3 mo? User Customer/ Solution Needs Uses Features Prototype Story/ Test Empathy Problem Ideation Release How do we test our DefinitionMake hypotheses? Make persona(Method/ Practice with of target user(s) Framing Wireframes Mock Activity) partner Brainstorm dashboard POV madlib Practice Ecosystem & Storyboard Sketches synthesizing Distribution Flows empathy map map How to test conversion Refine survey Compare personas Prioritize How to events? questions created by diff based on tech/ test? Test with real team members biz/distro users &Check Product Design Guild What are How to(Method/ riskiest How to test? Activity) Show partner test? hypotheses? map Interview real users? Thurs Fri Sat
  • 4. http://www.all-tribes.com/eng/catalog/rtfm-vol2-girls-mastic-p-51.html
  • 5. How do I do Unix? http://www.all-tribes.com/eng/catalog/rtfm-vol2-girls-mastic-p-51.html
  • 6. RTFM!How do I do Unix?Read The F****** Manual http://www.all-tribes.com/eng/catalog/rtfm-vol2-girls-mastic-p-51.html
  • 7. Pic: http://www.flickr.com/photos/victoriapeckham/164175205
  • 8. How do we test our hypotheses?Pic: http://www.flickr.com/photos/victoriapeckham/164175205
  • 9. How do we LTYFU! test our hypotheses? Listen To Your F****** UsersPic: http://www.flickr.com/photos/victoriapeckham/164175205
  • 10. Head in sand Guess Ask Janice Ask Jason Which method?Demo at “Launch and cognitive walkthrough SXSW see” Analytics expert review Usability testing Friends n’ Family A/B testing Dogfooding Funnel analysis remote testing Contextual interviews Beta click/5sec testsFocus groups Surveys Show to David Pogue
  • 11. Head in sand Guess Ask Dave Ask Enrique Which method?Demo at SXSW H ere’s a dirty “Launch and cognitive walkthrough see” secUsability expert review ... ret .testing Friends n’ Family Analytics A/B testing s shhhh Funnel analysis sssDogfooding remote testing Contextual interviews Beta click/5sec testsFocus groups Surveys Show to David Pogue
  • 12. Head in sand Guess Ask Dave Ask Enrique Which method? Demo at H ere’s a dirty “Launch and cognitive walkthrough TheeUsability.testingsFriends kFamily yeta.l.l. ucn’ * SXSW see” Analytics s cr expert review A/B testing s shhhh Funnel analysis sssDogfooding remote testing Contextual interviews Beta click/5sec tests Focus groups Surveys Show to David Pogue*More diplomatically: they have strengths and weaknesses
  • 13. Head in sand Guess Ask Dave Ask Enrique Which method? Demo at H ere’s a dirty “Launch and cognitive walkthrough TheeUsability.testingsFriends kFamily yeta.l.l. ucn’ * SXSW see” Analytics s cr expert review A/B testing s shhhh Funnel analysis sssDogfooding remote testing Contextual interviews BetaFocus groups Surveys Especiallytests one click/5sec this Show to David Pogue*More diplomatically: they have strengths and weaknesses
  • 14. WTF? ... thats not very helpful ...
  • 15. Sol ution: Trian gulateMult iple M ethods AnalyticsUsability Offer Janice beer
  • 16. A nalytic s suck*Analytics are useful but have strengths and weaknesses
  • 17. Why Analytics Suck1. Tell you <what> not <why>2. Hard to isolate specific effects3. Which numbers do I pay attention to?
  • 18. OoooAAARRRR, got a dashboard? Link: Metrics for Pirates
  • 19. Example Conversion Dashboard (note: *not* actuals… your mileage may vary) Stage Conversion Status Conv. Est. Value % (*not* cost)Acquisition Visitors -> Site/Widget/Landing Page 60% $.05 (2+ pages, 10+ sec, 1+ clicks = don’t abandon)Activation “Happy” 1st Visit; Usage/Signup 15% $.25 (clicks/time/pages, email/profile reg, feature usage)Retention Users Come Back; Multiple Visits 5% $1 (1-3x visits/mo; email/feed open rate / CTR) Referral Users Refer Others 1% $5 (cust sat >=8; viral K factor > 1; ) Revenue Users Pay / Generate $$$ 2% $50 (first txn, break-even, target profitability) Link: Metrics for Pirates
  • 20. Re mote ( autom ated) Usa bility S ucks**Remote usability is useful but has strengths and weaknesses
  • 21. Why Remote (Automated) Usability Sucks1. Participant quality2. Hard to dig deep3. Need high-fidelity prototype4. Don’t get to meet fun people (i.e. miss out on useful context)
  • 22. Why Remote (Automated) Usability Sucks1. Participant quality Useful tool but2. Hard to dig deep dangerous too3. Need high-fidelity prototype4. Don’t get to meet fun people (i.e. miss out on useful context)
  • 23. Live U sability S ucks**Live usability is useful but has strengths and weaknesses
  • 24. Why Live Usability Sucks1. Pricey? ($$$ and time)2. Hard to cover large sample3. You have to talk to people
  • 25. Usability testing• Watch your product in action with a target user• Follow some tricks to make as objective as possible erview bonus : opportunity Live int for m ore generative research!
  • 26. Usability Howto1. Identify research goal -> Scenario2. Recruit3. Prepare interview outline, pilot test!4. Test! - Intro (welcome/confidential/reassure/thinkaloud) - Record / take notes - Debrief5. Review, GET CODING, and iterate
  • 27. Golden Rule of Usability
  • 28. Golden Rules of UsabilityParticipant should do 90% of the talking Shut up
  • 29. Golden Rules of UsabilityParticipant should do 90% of the talking An Sh d ITE RuTEup At !
  • 30. Things to look for• Obvious usability issues• Bugs• Opportunities• Don’t forget Delights!
  • 31. Lean UX questions1. What gear do I need?2. How many users?3.Which users?
  • 32. observation test room room 1-way mirroreyetracking UI usb mic EngModerator User PM 32
  • 33. Observer / notetaker / prototype debugger /Moderator User coffee maker (optional but nice) 33
  • 34. Lean UX questions1. What gear do I need?2. How many users?3.Which users?
  • 35. Lean UX questions 1. What gear do I need? 2. How many users? >=0* 3.Which users?* 2: Ideally, small n and iterate. If no one available, do awalkthrough!
  • 36. Lean UX questions 1. What gear do I need? 2. How many users? >=0* 3.Which users? Any** 2: Ideally, small n and iterate. If no one available, do awalkthrough! Focus on core interaction flow.* 3: Start with your neighbour or Janice, then focus.
  • 37. Awesome2 hour read http://www.sensible.com/rocketsurgery/index.html
  • 38. Interview Practice
  • 39. Interview Practice I’m super nervous ... am I being tested?
  • 40. Interview Practice What do I do next? Should I sign up? Is this OK?
  • 41. Interview Practice I HATE IT. THIS IS &^**(}ED UP, MAN.
  • 42. Interview Practice I LOVE THIS. ITS THE BEST THING EVER
  • 43. Interview Practice <click> <click> <done> <silence>
  • 44. Interview Practice Well it looks like you can use this menu to browse and you can use that button to signup <i.e. here’s a guided tour>
  • 45. Interview Practice Weather wafflewaffle waffle Superbowl waffle waffle waffle waffle waffle waffle waffle waffle waffle waffle waffle waffle Superbowl ...
  • 46. Interview Practice ?
  • 47. Interview Practice Let me show you the product! What we’re trying to do here ...
  • 48. Interview Practice This is my baby. What do you love about it?
  • 49. Interview Practice This is my baby. What annoys you about it?
  • 50. Interview Practice Weather wafflewaffle waffle Superbowl waffle waffle waffle waffle waffle waffle waffle waffle waffle waffle waffle waffle Superbowl ...
  • 51. Interview Practice Lets do a focus group
  • 52. Interview Practice ?
  • 53. GO FORTH & LTYFU! Q & A!