CHI: evaluation

  • 617 views
Uploaded on

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
617
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
13
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n

Transcript

  • 1. CHI: evaluatie#chikul12Leuven, 14 February 2012Erik Duvalhttp://erikduval.wordpress.com@ErikDuval 1
  • 2. http://www.slideshare.net/erik.duval2
  • 3. Criteria for evaluation: what do you think?• ... • ...
  • 4. criteria• Usability• Usefulness• Meaning• (aesthetic) Qualities• Sociability
  • 5. criteria• Usability • Learnability• Usefulness • Efficiency• Meaning • Memorability• (aesthetic) Qualities • Accuracy• Sociability • Satisfaction [Nielsen, 1993]
  • 6. • formatief • tijdens het ontwikkelen • om te verbeteren• summatief • op het einde • om te bewijzen dat “het (niet) werkt”
  • 7. http://semanticstudios.com/publications/semantics/000029.php
  • 8. Criteria
  • 9. Criteria• Time
  • 10. Criteria• Time • to learn the application
  • 11. Criteria• Time • to learn the application • to perform task
  • 12. Criteria• Time • to learn the application • to perform task • that users remember how and what
  • 13. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors
  • 14. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number
  • 15. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind
  • 16. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind• Subjective feeling of satisfaction
  • 17. Criteria• Time • to learn the application • to perform task • that users remember how and what• Errors • number • kind• Subjective feeling of satisfaction Often a compromise - important to make explicit
  • 18. methods- questionnaire- usability engineering- by experts- usage tracking
  • 19. questionnaires http://hcibib.org/perlman/question.html
  • 20. http://www.cc.gatech.edu/gvu/images/lab/usability-lab.jpg Usability Lab
  • 21. Usability engineering•‘Think-aloud protocol‘ •Video recording with annotation •Log, remarks, etc. for analysis•‘Discount usability engineering’•Comparative test of user interface
  • 22. By experts
  • 23. By experts•in HCI or domain
  • 24. By experts•in HCI or domain•very effective
  • 25. By experts•in HCI or domain•very effective•delicate relation with developers
  • 26. By experts•in HCI or domain•very effective•delicate relation with developers•target
  • 27. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems
  • 28. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems •suggest solutions
  • 29. By experts•in HCI or domain•very effective•delicate relation with developers•target •identify problems •suggest solutions•through checklist of guidelines
  • 30. User tracking• “attention metadata”• google analytics
  • 31. Participants• representative • computer experience, language, task, motivation, education, etc. • gender, age• have to know they are not being evaluated• relationship • colleagues, friends, family, ...
  • 32. they are ... human beings
  • 33. how many? Text http://www.useit.com/alertbox/20000319.html http://www.useit.com/alertbox/20000319.html
  • 34. • every test user finds fraction L of usability issues• independent test users n users find fraction 1-(1-L)n• L=31% 85% for n=5, 99% for n=15 L=8% 35% for n=5
  • 35. Factors that influence usability: what do you think?•... •...
  • 36. Factoren: Cognitief
  • 37. Factoren: Cognitief•cognitive
  • 38. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...
  • 39. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality
  • 40. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)
  • 41. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)•cultural
  • 42. Factoren: Cognitief•cognitive •fatigue, boredom, stress, fear, ...•personality •gender (‘abort’)•cultural •i18n
  • 43. Trash can in Thailand
  • 44. Trash can in Thailand
  • 45. http://emurgency.eu/ http://www.role-project.eu/ http://www.stellarnet.eu/ Questions? http://erikduval.wordpress.com/ @ErikDuval Thanks! 22