Usability Testing Materials

619 views
570 views

Published on

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
619
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
11
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Usability Testing Materials

  1. 1. Usability TestingWednesday, February 29, 12
  2. 2. Usability is mostly common sense.Wednesday, February 29, 12
  3. 3. notWednesday, February 29, 12
  4. 4. Wednesday, February 29, 12
  5. 5. notWednesday, February 29, 12
  6. 6. Wednesday, February 29, 12
  7. 7. But you still need a plan.Wednesday, February 29, 12
  8. 8. Test MaterialsWednesday, February 29, 12
  9. 9. • Guidelines for observers • Orientation script • Background questionnaire • Data collection instruments • Agreement & consent forms • Pre-test questionnaire • Task scenarios • Post-test questionnaire • Debriefing guideWednesday, February 29, 12
  10. 10. Guidelines for observersWednesday, February 29, 12
  11. 11. what to do not to doWednesday, February 29, 12
  12. 12. • Introduce yourself • Find out what they need? Anxious? • Let them know what they’re in for. • protocols • testing methods • testing reasonsWednesday, February 29, 12
  13. 13. Orientation ScriptWednesday, February 29, 12
  14. 14. Guidelines (p. 156-57)Wednesday, February 29, 12
  15. 15. Guidelines (p. 156-57) • Tone • Length • VerbatimWednesday, February 29, 12
  16. 16. Demonstrate neutrality.Wednesday, February 29, 12
  17. 17. Wednesday, February 29, 12
  18. 18. you areWednesday, February 29, 12
  19. 19. Wednesday, February 29, 12
  20. 20. but you do need to care about them.Wednesday, February 29, 12
  21. 21. Wednesday, February 29, 12
  22. 22. Wednesday, February 29, 12
  23. 23. The act of observing peoplecan’t help but affect the results.Wednesday, February 29, 12
  24. 24. Background QuestionnaireWednesday, February 29, 12
  25. 25. classifiers from screening processWednesday, February 29, 12
  26. 26. why?Wednesday, February 29, 12
  27. 27. Wednesday, February 29, 12
  28. 28. data collectionWednesday, February 29, 12
  29. 29. What data will address the problem statement/ research question?Wednesday, February 29, 12
  30. 30. How will you collect the data?Wednesday, February 29, 12
  31. 31. Who is going to do what?Wednesday, February 29, 12
  32. 32. Performance DataWednesday, February 29, 12
  33. 33. “objective measures of behavior, such as error rates, time, and counts of observed behavior elements”Wednesday, February 29, 12
  34. 34. Preference dataWednesday, February 29, 12
  35. 35. “more subjective data that measures the participant’s feelings or opinions of the product.”Wednesday, February 29, 12
  36. 36. Performance Data:Wednesday, February 29, 12
  37. 37. • number of errors • % of tasks completed successfully • # and type of hints/prompts needed • # of omitted steps or procedures • Scores on comprehension testsWednesday, February 29, 12
  38. 38. Time to... • complete a task • recover from an error • achieve a criterion level of competence • spent reading v workingWednesday, February 29, 12
  39. 39. Preference DataWednesday, February 29, 12
  40. 40. • Preference between versions • Suggestions for improvement • Number of negative references to product • Rationales for performance • Ratings or rankings of productWednesday, February 29, 12
  41. 41. (see pgs 166 - 167)Wednesday, February 29, 12
  42. 42. What type of information will you collect?Wednesday, February 29, 12
  43. 43. Wednesday, February 29, 12
  44. 44. Listen to the client. Pay attention to your site.Wednesday, February 29, 12
  45. 45. First things first:Wednesday, February 29, 12
  46. 46. Where are you going to test?Wednesday, February 29, 12
  47. 47. These documents are used in varying contexts.Wednesday, February 29, 12
  48. 48. Wednesday, February 29, 12
  49. 49. Wednesday, February 29, 12
  50. 50. Wednesday, February 29, 12
  51. 51. Ideally, testing is done in the context the document will be used in.Wednesday, February 29, 12
  52. 52. How are you going to record data?Wednesday, February 29, 12
  53. 53. Wednesday, February 29, 12
  54. 54. MoraeWednesday, February 29, 12
  55. 55. Manual data collectionWednesday, February 29, 12
  56. 56. Observe and take notes on every action.Wednesday, February 29, 12
  57. 57. Develop a code.Wednesday, February 29, 12
  58. 58. • You might write “T” when the subject stops reading and does not perform any action to signify that they were thinking • You might write “F” when the subject flips back and forth to locate something • You might write “W” when the subject wanders around.Wednesday, February 29, 12
  59. 59. To use this method, start a table with the elapsed time in one column and the action which occurs in the other.Wednesday, February 29, 12
  60. 60. By carefully noting what the subject does at each stage, you can locate the difficult parts.Wednesday, February 29, 12
  61. 61. Nondisclosure Forms Recording Permission Informed Consent FormWednesday, February 29, 12
  62. 62. Pre-test Questionnaires InterviewsWednesday, February 29, 12
  63. 63. Task ScenariosWednesday, February 29, 12
  64. 64. • Results they will strive to achieve • Motives for performing the work • Actual data/names rather than generalities • State of system when task is initiated • Any other materials they need to complete the taskWednesday, February 29, 12
  65. 65. be realistic provide motivationWednesday, February 29, 12
  66. 66. sequence tasksWednesday, February 29, 12
  67. 67. Wednesday, February 29, 12
  68. 68. Determine levels of interactionWednesday, February 29, 12
  69. 69. The difference between strictly observing a person navigating a document or using a product and participating in what they do is significant.Wednesday, February 29, 12
  70. 70. But it is also a matter of degree– decide in advance just how much you will interact with your test subjects.Wednesday, February 29, 12
  71. 71. Wednesday, February 29, 12
  72. 72. silent observationWednesday, February 29, 12
  73. 73. talk-aloud protocolsWednesday, February 29, 12
  74. 74. Post-test QuestionsWednesday, February 29, 12
  75. 75. • Major items related to specific research questions • Items related to trends/patterns among participants • Items related to things you can’t directly observeWednesday, February 29, 12
  76. 76. Question Forms/FormatsWednesday, February 29, 12
  77. 77. Likert ScaleWednesday, February 29, 12
  78. 78. Semantic DifferentialsWednesday, February 29, 12
  79. 79. Debriefing GuideWednesday, February 29, 12

×