Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

CHI: evaluation

833 views

Published on

Published in: Technology, Health & Medicine
  • Be the first to comment

  • Be the first to like this

CHI: evaluation

  1. 1. CHI: evaluatie#chikul12Leuven, 14 February 2012Erik Duvalhttp://erikduval.wordpress.com@ErikDuval 1
  2. 2. http://www.slideshare.net/erik.duval2
  3. 3. Criteria for evaluation: what do you think?• ... • ...
  4. 4. criteria• Usability• Usefulness• Meaning• (aesthetic) Qualities• Sociability
  5. 5. criteria• Usability • Learnability• Usefulness • Efficiency• Meaning • Memorability• (aesthetic) Qualities • Accuracy• Sociability • Satisfaction [Nielsen, 1993]
  6. 6. • formatief • tijdens het ontwikkelen • om te verbeteren• summatief • op het einde • om te bewijzen dat “het (niet) werkt”
  7. 7. http://semanticstudios.com/publications/semantics/000029.php
  8. 8. Criteria
  9. 9. Criteria• Time
  10. 10. Criteria• Time • to learn the application
  11. 11. Criteria• Time • to learn the application • to perform task
  12. 12. Criteria• Time • to learn the application • to perform task • that users remember how and what
  13. 13. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors
  14. 14. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number
  15. 15. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind
  16. 16. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind• Subjective feeling of satisfaction
  17. 17. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind• Subjective feeling of satisfaction Often a compromise - important to make explicit
  18. 18. methods- questionnaire- usability engineering- by experts- usage tracking
  19. 19. questionnaires http://hcibib.org/perlman/question.html
  20. 20. http://www.cc.gatech.edu/gvu/images/lab/usability-lab.jpg Usability Lab
  21. 21. Usability engineering•‘Think-aloud protocol‘ •Video recording with annotation •Log, remarks, etc. for analysis•‘Discount usability engineering’•Comparative test of user interface
  22. 22. By experts
  23. 23. By experts•in HCI or domain
  24. 24. By experts•in HCI or domain•very effective
  25. 25. By experts•in HCI or domain•very effective•delicate relation with developers
  26. 26. By experts•in HCI or domain•very effective•delicate relation with developers•target
  27. 27. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems
  28. 28. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems •suggest solutions
  29. 29. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems •suggest solutions•through checklist of guidelines
  30. 30. User tracking• “attention metadata”• google analytics
  31. 31. Participants• representative • computer experience, language, task, motivation, education, etc. • gender, age• have to know they are not being evaluated• relationship • colleagues, friends, family, ...
  32. 32. they are ... human beings
  33. 33. how many? Text http://www.useit.com/alertbox/20000319.html http://www.useit.com/alertbox/20000319.html
  34. 34. • every test user finds fraction L of usability issues• independent test users n users find fraction 1-(1-L)n• L=31% 85% for n=5, 99% for n=15 L=8% 35% for n=5
  35. 35. Factors that influence usability: what do you think?•... •...
  36. 36. Factoren: Cognitief
  37. 37. Factoren: Cognitief•cognitive
  38. 38. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...
  39. 39. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality
  40. 40. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)
  41. 41. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)•cultural
  42. 42. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)•cultural •i18n
  43. 43. Trash can in Thailand
  44. 44. Trash can in Thailand
  45. 45. http://emurgency.eu/ http://www.role-project.eu/ http://www.stellarnet.eu/ Questions? http://erikduval.wordpress.com/ @ErikDuval Thanks! 22

×