CHI: evaluation

815 views

Published on

Published in: Technology, Health & Medicine
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
815
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
15
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • CHI: evaluation

    1. 1. CHI: evaluatie#chikul12Leuven, 14 February 2012Erik Duvalhttp://erikduval.wordpress.com@ErikDuval 1
    2. 2. http://www.slideshare.net/erik.duval2
    3. 3. Criteria for evaluation: what do you think?• ... • ...
    4. 4. criteria• Usability• Usefulness• Meaning• (aesthetic) Qualities• Sociability
    5. 5. criteria• Usability • Learnability• Usefulness • Efficiency• Meaning • Memorability• (aesthetic) Qualities • Accuracy• Sociability • Satisfaction [Nielsen, 1993]
    6. 6. • formatief • tijdens het ontwikkelen • om te verbeteren• summatief • op het einde • om te bewijzen dat “het (niet) werkt”
    7. 7. http://semanticstudios.com/publications/semantics/000029.php
    8. 8. Criteria
    9. 9. Criteria• Time
    10. 10. Criteria• Time • to learn the application
    11. 11. Criteria• Time • to learn the application • to perform task
    12. 12. Criteria• Time • to learn the application • to perform task • that users remember how and what
    13. 13. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors
    14. 14. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number
    15. 15. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind
    16. 16. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind• Subjective feeling of satisfaction
    17. 17. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind• Subjective feeling of satisfaction Often a compromise - important to make explicit
    18. 18. methods- questionnaire- usability engineering- by experts- usage tracking
    19. 19. questionnaires http://hcibib.org/perlman/question.html
    20. 20. http://www.cc.gatech.edu/gvu/images/lab/usability-lab.jpg Usability Lab
    21. 21. Usability engineering•‘Think-aloud protocol‘ •Video recording with annotation •Log, remarks, etc. for analysis•‘Discount usability engineering’•Comparative test of user interface
    22. 22. By experts
    23. 23. By experts•in HCI or domain
    24. 24. By experts•in HCI or domain•very effective
    25. 25. By experts•in HCI or domain•very effective•delicate relation with developers
    26. 26. By experts•in HCI or domain•very effective•delicate relation with developers•target
    27. 27. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems
    28. 28. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems •suggest solutions
    29. 29. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems •suggest solutions•through checklist of guidelines
    30. 30. User tracking• “attention metadata”• google analytics
    31. 31. Participants• representative • computer experience, language, task, motivation, education, etc. • gender, age• have to know they are not being evaluated• relationship • colleagues, friends, family, ...
    32. 32. they are ... human beings
    33. 33. how many? Text http://www.useit.com/alertbox/20000319.html http://www.useit.com/alertbox/20000319.html
    34. 34. • every test user finds fraction L of usability issues• independent test users n users find fraction 1-(1-L)n• L=31% 85% for n=5, 99% for n=15 L=8% 35% for n=5
    35. 35. Factors that influence usability: what do you think?•... •...
    36. 36. Factoren: Cognitief
    37. 37. Factoren: Cognitief•cognitive
    38. 38. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...
    39. 39. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality
    40. 40. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)
    41. 41. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)•cultural
    42. 42. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)•cultural •i18n
    43. 43. Trash can in Thailand
    44. 44. Trash can in Thailand
    45. 45. http://emurgency.eu/ http://www.role-project.eu/ http://www.stellarnet.eu/ Questions? http://erikduval.wordpress.com/ @ErikDuval Thanks! 22

    ×