Your SlideShare is downloading. ×
Design for Usability Test
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Design for Usability Test

703
views

Published on

The presentation file for OpenHCI 2009 at Taipei

The presentation file for OpenHCI 2009 at Taipei

Published in: Technology, Business

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
703
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
36
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. DESIGN FOR USABILITY TESTING by Mumin Yu, User Experience Consultant, USER XING Jen Wang, User Experience Specialist, MiTAC
  • 2. What Are We Gonna Do Today
  • 3. Don’t worry. It is not that bad.
  • 4. A TYPICAL USABILITY TEST
  • 5. http://reportwritingskills.com/images/report_writing_skills11.jpg
  • 6. http://www.pod.usace.army.mil/images/I-Want-You-Flat.jpg
  • 7. http://theotherthomasotter.files.wordpress.com/2007/06/asug07-moraescreengrabs01.png
  • 8. http://reportwritingskills.com/images/report_writing_skills11.jpg
  • 9. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 10. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 11. GET OTHERS INVOLVED
  • 12. http://www.cyber-cinema.com/gallery/others.jpg
  • 13. Designers Top Managers Product Managers Sales Marketings Engineers Customer Services
  • 14. The more/earlier you communicate your plan, the better the result will be.
  • 15. GIVE ME A BREAK
  • 16. If you are feeling tired, so is the participant!
  • 17. Make no session longer than 2 hours.
  • 18. Do no more than 4 sessions a day.
  • 19. Allow at least 60 minutes break between sessions.
  • 20. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  • 21. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  • 22. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  • 23. Projects Sun Aug 30 – Sat Sep 5, 2009 (Taipei) Sunday 8/30 Monday 8/31 Tuesday 9/1 Wednesday 9/2 Thursday 9/3 Friday 9/4 Saturday 9/5 9am 10am Test Session Test Session Test Session 10am - 12pm 10am - 11:30am 10am - 11am 11am 12pm Test Session 12pm - 1pm 1pm Test Session 1pm - 2:30pm Test Session 2pm 1:30pm - 3:30pm Test Session 3pm 2:30pm - 3:30pm Test Session 4pm 3:30pm - 5pm Test Session Test Session 5pm 4:30pm - 6:30pm 4:30pm - 5:30pm 6pm 7pm 8pm
  • 24. THINK OUT OF THE LAB
  • 25. On Treadmill http://www.bodyqueststore.com/Commercial/Treadmills/Nautilus%20718%20Treadmill.jpg
  • 26. On Foot
  • 27. In Car
  • 28. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 29. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 30. SHOW THEM THE MONEY
  • 31. http://blogs.edmunds.com/greencaradvisor/money_stack.jpg
  • 32. Enough to motivate them, but not enough for them to pretend
  • 33. NT$1000 per hour seems to work just fine for now.
  • 34. What if you don’t have the money?
  • 35. GIFT CERTIFICATE
  • 36. FOOD http://www.singleandhappy.net/.a/6a00e554e9a52b88330112797c5b5328a4-320wi
  • 37. SCHOOL CREDIT
  • 38. THANK YOU http://upload.wikimedia.org/wikipedia/commons/thumb/6/6a/Heart_left-highlight_jon_01.svg/491px-Heart_left-highlight_jon_01.svg.png
  • 39. SNOWBALL EFFECT
  • 40. http://wpcontent.answers.com/wikipedia/commons/thumb/2/23/Giant_snowball_Oxford.jpg/180px-Giant_snowball_Oxford.jpg
  • 41. You still need to do the screening yourself
  • 42. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 43. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 44. A GOOD EXAMPLE OF A BAD EXAMPLE http://www.breadwig.com/uploads/sketches/bunnies/000554.jpg
  • 45. Shut Up and Listen/Watch!
  • 46. RULES OF ENGAGEMENT
  • 47. You need participants to move on to the next task because time is limited.
  • 48. You need to bring participants back on track because they have gone too far down the wrong path.
  • 49. Participants are stuck. You think you can learn more if they continue.
  • 50. Moderator, please give them more time.
  • 51. WATCH YOURSELF
  • 52. WATCH OUT FOR Less-than-neutral questions Unfocused sessions Annoying gestures Repeating words Facial expressions more...
  • 53. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 54. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 55. METRICS
  • 56. (!" '!" !"#$%&'%!()*+,)$-.+ &!" %!" $!" #!" !" )*+,-"#" )*+,-"$" )*+,-"%" )*+,-"&" )*+,-"'" )*+,-"(" )*+,-"." PERFORMANCE METRICS
  • 57. PERFORMANCE Task success Time-on-task Errors Efficiency Learnability
  • 58. )" (" !"#$%&'()'*+&,-.*+/01' '" &" %" $" #" !" *+,"-./"011" 7.-8501,"9:" *+,"-./"4-.?"3.?" 7.-8501,";9.5/" 23124.5/"6+-4" -;<+=;>.-"23.+210" /."@1/5@-"/." 03+AA+-=".A>.-0" 03.AA+-=" ISSUED-BASED METRICS
  • 59. ISSUES Producing an error Assuming a task is complete when it is not Preventing task completion Creating some level of confusion Not seeing something that should be noticed Assuming something is correct when it is not
  • 60. ()*+,-.*))" '!!" &!" %!" $!" #!" 607)+0871." !" /0)*"1+"()*" /0)*"1+"2*03.4.5" SELF-REPORTED METRICS
  • 61. SELF REPORTS After-Scenario Questionnaire (ASQ) Post-Study System Usability Questionnaire (PSSUQ) Computer System Usability Questionnaire (CSUQ) System Usability Scale (SUS) Questionnaire for User Interface Satisfaction (QUIS) Usefulness, Satisfaction, and Ease of Use Questionnaire (USE)
  • 62. BEHAVIORAL & PHYSIOLOGICAL METRICS http://www.simpleusability.com/images/heuga-home-eye-plot.jpg
  • 63. BEHAVIOR & PHYSIOLOGY Verbal behaviors Facial expression Eye-tracking Pupillary Skin conductance Heart rate
  • 64. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 65. PLANNING RECRUITING TESTING ANALYZING REPORTING
  • 66. Number of usability reports to read 5 4 3 2 1 1 2 3 4 5 Hours slept during office hours USABILITY REPORTS VS OFFICE HOURS SLEPT http://www.slideshare.net/gregbell/usability-20
  • 67. Not everyone needs to read a long report.
  • 68. So you need to have a more effective way to communicate your findings
  • 69. A VIDEO IS WORTH A THOUSAND WORDS
  • 70. CASE STUDY