• Compile                   • Summarize data                   • Analyze data                   • Develop recommendations ...
Data AnalysisWednesday, March 28, 12
next 2 weeks:Wednesday, March 28, 12
Wednesday, March 28, 12
Wednesday, March 28, 12
Step 1: CompileWednesday, March 28, 12
Wednesday, March 28, 12
Get it into a pile.Wednesday, March 28, 12
Get your piles sorted.Wednesday, March 28, 12
Ideally:Wednesday, March 28, 12
compile as you test.Wednesday, March 28, 12
further test the test.Wednesday, March 28, 12
keep the data legible.Wednesday, March 28, 12
• Type handwritten notes                   • Verify data captures                   • Back up filesWednesday, March 28, 12
Organize raw data.Wednesday, March 28, 12
Do whatever it takes to                      get it done.Wednesday, March 28, 12
• lists                   • tallies                   • matrices                   • stories                   • structure...
Wednesday, March 28, 12
Wednesday, March 28, 12
Wednesday, March 28, 12
Wednesday, March 28, 12
Goal:Wednesday, March 28, 12
Wednesday, March 28, 12
Step 2: summarizeWednesday, March 28, 12
1. task accuracyWednesday, March 28, 12
number of errors made               per taskWednesday, March 28, 12
• categorize errors by type                    • ommission                    • commissionWednesday, March 28, 12
# of participants who performed:                     • successfully                     • successfully but with some assis...
Vital Statistics:Wednesday, March 28, 12
% performing successfully, including those               who needed assistance                   • regardless of time limi...
If this percentage is                      very low, you’ve got a                         serious problem.Wednesday, March...
% performing successfully                   • including those who corrected errorsWednesday, March 28, 12
% performing successfully within               benchmark                   • indicative of efficiencyWednesday, March 28, 12
2. task timingsWednesday, March 28, 12
Wednesday, March 28, 12
summarize                          preference dataWednesday, March 28, 12
Limited choice questions:                   • Sum by choice                   • Chart trendsWednesday, March 28, 12
Free-form questions:                          • Group into meaningful categories                           •   Ex: particu...
Summarize other measures                   • Unnecessary returns to main navigation                   • Number/type of hin...
Summarize by Group/VersionWednesday, March 28, 12
(see pages 255 - 259)Wednesday, March 28, 12
3: analyze dataWednesday, March 28, 12
What didn’t succeed?Wednesday, March 28, 12
Wednesday, March 28, 12
What were the                           difficulties?Wednesday, March 28, 12
What were the                          error sources?Wednesday, March 28, 12
Prioritize problems                              by severityWednesday, March 28, 12
Severity descriptions &                     definitions: p. 262Wednesday, March 28, 12
Upcoming SlideShare
Loading in …5
×

Usability Testing: analyzing data

473 views
411 views

Published on

Published in: Technology, Design
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
473
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Usability Testing: analyzing data

  1. 1. • Compile • Summarize data • Analyze data • Develop recommendations • Produce the final reportWednesday, March 28, 12
  2. 2. Data AnalysisWednesday, March 28, 12
  3. 3. next 2 weeks:Wednesday, March 28, 12
  4. 4. Wednesday, March 28, 12
  5. 5. Wednesday, March 28, 12
  6. 6. Step 1: CompileWednesday, March 28, 12
  7. 7. Wednesday, March 28, 12
  8. 8. Get it into a pile.Wednesday, March 28, 12
  9. 9. Get your piles sorted.Wednesday, March 28, 12
  10. 10. Ideally:Wednesday, March 28, 12
  11. 11. compile as you test.Wednesday, March 28, 12
  12. 12. further test the test.Wednesday, March 28, 12
  13. 13. keep the data legible.Wednesday, March 28, 12
  14. 14. • Type handwritten notes • Verify data captures • Back up filesWednesday, March 28, 12
  15. 15. Organize raw data.Wednesday, March 28, 12
  16. 16. Do whatever it takes to get it done.Wednesday, March 28, 12
  17. 17. • lists • tallies • matrices • stories • structure models • flow diagramsWednesday, March 28, 12
  18. 18. Wednesday, March 28, 12
  19. 19. Wednesday, March 28, 12
  20. 20. Wednesday, March 28, 12
  21. 21. Wednesday, March 28, 12
  22. 22. Goal:Wednesday, March 28, 12
  23. 23. Wednesday, March 28, 12
  24. 24. Step 2: summarizeWednesday, March 28, 12
  25. 25. 1. task accuracyWednesday, March 28, 12
  26. 26. number of errors made per taskWednesday, March 28, 12
  27. 27. • categorize errors by type • ommission • commissionWednesday, March 28, 12
  28. 28. # of participants who performed: • successfully • successfully but with some assistance • assistance types, tasks, productsWednesday, March 28, 12
  29. 29. Vital Statistics:Wednesday, March 28, 12
  30. 30. % performing successfully, including those who needed assistance • regardless of time limits • regardless of assistance neededWednesday, March 28, 12
  31. 31. If this percentage is very low, you’ve got a serious problem.Wednesday, March 28, 12
  32. 32. % performing successfully • including those who corrected errorsWednesday, March 28, 12
  33. 33. % performing successfully within benchmark • indicative of efficiencyWednesday, March 28, 12
  34. 34. 2. task timingsWednesday, March 28, 12
  35. 35. Wednesday, March 28, 12
  36. 36. summarize preference dataWednesday, March 28, 12
  37. 37. Limited choice questions: • Sum by choice • Chart trendsWednesday, March 28, 12
  38. 38. Free-form questions: • Group into meaningful categories • Ex: particular screen, doc section, etc.Wednesday, March 28, 12
  39. 39. Summarize other measures • Unnecessary returns to main navigation • Number/type of hints and prompts • Times site map was accessed • Points of hesitation (and for how long)Wednesday, March 28, 12
  40. 40. Summarize by Group/VersionWednesday, March 28, 12
  41. 41. (see pages 255 - 259)Wednesday, March 28, 12
  42. 42. 3: analyze dataWednesday, March 28, 12
  43. 43. What didn’t succeed?Wednesday, March 28, 12
  44. 44. Wednesday, March 28, 12
  45. 45. What were the difficulties?Wednesday, March 28, 12
  46. 46. What were the error sources?Wednesday, March 28, 12
  47. 47. Prioritize problems by severityWednesday, March 28, 12
  48. 48. Severity descriptions & definitions: p. 262Wednesday, March 28, 12

×