Design for Usability Test

863 views
805 views

Published on

The presentation file for OpenHCI 2009 at Taipei

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
863
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
38
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Design for Usability Test

  1. 1. DESIGN FOR USABILITY TESTING by Mumin Yu, User Experience Consultant, USER XING Jen Wang, User Experience Specialist, MiTAC
  2. 2. What Are We Gonna Do Today
  3. 3. Don’t worry. It is not that bad.
  4. 4. A TYPICAL USABILITY TEST
  5. 5. http://reportwritingskills.com/images/report_writing_skills11.jpg
  6. 6. http://www.pod.usace.army.mil/images/I-Want-You-Flat.jpg
  7. 7. http://theotherthomasotter.files.wordpress.com/2007/06/asug07-moraescreengrabs01.png
  8. 8. http://reportwritingskills.com/images/report_writing_skills11.jpg
  9. 9. PLANNING RECRUITING TESTING ANALYZING REPORTING
  10. 10. PLANNING RECRUITING TESTING ANALYZING REPORTING
  11. 11. GET OTHERS INVOLVED
  12. 12. http://www.cyber-cinema.com/gallery/others.jpg
  13. 13. Designers Top Managers Product Managers Sales Marketings Engineers Customer Services
  14. 14. The more/earlier you communicate your plan, the better the result will be.
  15. 15. GIVE ME A BREAK
  16. 16. If you are feeling tired, so is the participant!
  17. 17. Make no session longer than 2 hours.
  18. 18. Do no more than 4 sessions a day.
  19. 19. Allow at least 60 minutes break between sessions.
  20. 20. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  21. 21. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  22. 22. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  23. 23. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  24. 24. THINK OUT OF THE LAB
  25. 25. On Treadmill http://www.bodyqueststore.com/Commercial/Treadmills/Nautilus%20718%20Treadmill.jpg
  26. 26. On Foot
  27. 27. In Car
  28. 28. PLANNING RECRUITING TESTING ANALYZING REPORTING
  29. 29. PLANNING RECRUITING TESTING ANALYZING REPORTING
  30. 30. SHOW THEM THE MONEY
  31. 31. http://blogs.edmunds.com/greencaradvisor/money_stack.jpg
  32. 32. Enough to motivate them, but not enough for them to pretend
  33. 33. NT$1000 per hour seems to work just fine for now.
  34. 34. What if you don’t have the money?
  35. 35. GIFT CERTIFICATE
  36. 36. FOOD http://www.singleandhappy.net/.a/6a00e554e9a52b88330112797c5b5328a4-320wi
  37. 37. SCHOOL CREDIT
  38. 38. THANK YOU http://upload.wikimedia.org/wikipedia/commons/thumb/6/6a/Heart_left-highlight_jon_01.svg/491px-Heart_left-highlight_jon_01.svg.png
  39. 39. SNOWBALL EFFECT
  40. 40. http://wpcontent.answers.com/wikipedia/commons/thumb/2/23/Giant_snowball_Oxford.jpg/180px-Giant_snowball_Oxford.jpg
  41. 41. You still need to do the screening yourself
  42. 42. PLANNING RECRUITING TESTING ANALYZING REPORTING
  43. 43. PLANNING RECRUITING TESTING ANALYZING REPORTING
  44. 44. A GOOD EXAMPLE OF A BAD EXAMPLE http://www.breadwig.com/uploads/sketches/bunnies/000554.jpg
  45. 45. Shut Up and Listen/Watch!
  46. 46. RULES OF ENGAGEMENT
  47. 47. You need participants to move on to the next task because time is limited.
  48. 48. You need to bring participants back on track because they have gone too far down the wrong path.
  49. 49. Participants are stuck. You think you can learn more if they continue.
  50. 50. Moderator, please give them more time.
  51. 51. WATCH YOURSELF
  52. 52. WATCH OUT FOR Less-than-neutral questions Unfocused sessions Annoying gestures Repeating words Facial expressions more...
  53. 53. PLANNING RECRUITING TESTING ANALYZING REPORTING
  54. 54. PLANNING RECRUITING TESTING ANALYZING REPORTING
  55. 55. METRICS
  56. 56. (!" '!" !"#$%&'%!()*+,)$-.+ &!" %!" $!" #!" !" )*+,-"#" )*+,-"$" )*+,-"%" )*+,-"&" )*+,-"'" )*+,-"(" )*+,-"." PERFORMANCE METRICS
  57. 57. PERFORMANCE Task success Time-on-task Errors Efficiency Learnability
  58. 58. )" (" !"#$%&'()'*+&,-.*+/01' '" &" %" $" #" !" *+,"-./"011" 7.-8501,"9:" *+,"-./"4-.?"3.?" 7.-8501,";9.5/" 23124.5/"6+-4" -;<+=;>.-"23.+210" /."@1/5@-"/." 03+AA+-=".A>.-0" 03.AA+-=" ISSUED-BASED METRICS
  59. 59. ISSUES Producing an error Assuming a task is complete when it is not Preventing task completion Creating some level of confusion Not seeing something that should be noticed Assuming something is correct when it is not
  60. 60. ()*+,-.*))" '!!" &!" %!" $!" #!" 607)+0871." !" /0)*"1+"()*" /0)*"1+"2*03.4.5" SELF-REPORTED METRICS
  61. 61. SELF REPORTS After-Scenario Questionnaire (ASQ) Post-Study System Usability Questionnaire (PSSUQ) Computer System Usability Questionnaire (CSUQ) System Usability Scale (SUS) Questionnaire for User Interface Satisfaction (QUIS) Usefulness, Satisfaction, and Ease of Use Questionnaire (USE)
  62. 62. BEHAVIORAL & PHYSIOLOGICAL METRICS http://www.simpleusability.com/images/heuga-home-eye-plot.jpg
  63. 63. BEHAVIOR & PHYSIOLOGY Verbal behaviors Facial expression Eye-tracking Pupillary Skin conductance Heart rate
  64. 64. PLANNING RECRUITING TESTING ANALYZING REPORTING
  65. 65. PLANNING RECRUITING TESTING ANALYZING REPORTING
  66. 66. Number of usability reports to read 5 4 3 2 1 1 2 3 4 5 Hours slept during office hours USABILITY REPORTS VS OFFICE HOURS SLEPT http://www.slideshare.net/gregbell/usability-20
  67. 67. Not everyone needs to read a long report.
  68. 68. So you need to have a more effective way to communicate your findings
  69. 69. A VIDEO IS WORTH A THOUSAND WORDS
  70. 70. CASE STUDY

×