Your SlideShare is downloading. ×
Usability evaluation in exclusive domains_presentation
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Usability evaluation in exclusive domains_presentation

624
views

Published on


0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
624
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1.
    • Asbjørn Følstad
    • 1st European workshop on HCI design and evaluation
    • Limassol, Cyprus, April 8., 2011
    • Usability evaluation in exclusive domains: How to access domain knowledge
    Thoughts in progress! Conclusions up for discussion
  • 2.
    • The two loves of the usability evaluator
    Usability testing Usability inspection
  • 3.
    • The two loves of the usability evaluator
    Usability testing Usability inspection considering users observing users What do we miss by not accessing the user’s knowledge during our usability evaluations?
  • 4.
    • We do not miss much, unless the user …
    What do we miss by not accessing the user’s knowledge during our usability evaluations? … holds domain knowledge we cannot access
  • 5. What we may miss if the user knows more of the domain than the usability evaluator: Review of two studies of usability evaluation methods that allow us to access the users’ knowledge.
  • 6.
    • Mobile applications for
      • Medical personnel at hospital wards
      • Parking wardens
      • Political advisors
    • Evaluated with groups of either
      • Domain experts
      • Usability experts
    • Consider: Three cases of Group-based expert walkthrough *
    *) an inspection method allowing domain experts to serve as usability inspectors 12 % overlap in findings between evaluator groups Domain experts: 59 % domain specific findings Usability experts: 15 % domain specific findings Følstad, A., 2007. Work-domain experts as evaluators: usability inspection of domain-specific work-support systems. International Journal of Human– Computer Interaction 22 (3), 217–245.
  • 7.
    • Mobile applications for
      • Medical personnel at hospital wards
      • Parking wardens
      • Political advisors
    • Evaluated with groups of either
      • Domain experts
      • Usability experts
    • Consider: Three cases of Group-based expert walkthrough *
    *) an inspection method allowing domain experts to serve as usability inspectors 54 % of domain experts’ findings given high priority by client 27 % of usability experts’ findings given the same priority Følstad, A., 2007. Work-domain experts as evaluators: usability inspection of domain-specific work-support systems. International Journal of Human– Computer Interaction 22 (3), 217–245 .
  • 8.
    • Mobile applications for
      • Mobile sales personnel
      • Medical emergency personnel
    • Usability issues identified through
      • Observation (in the interaction phases)
      • User dialogue (in the interpretation phases)
    • Consider also: Two cases of cooperative usability testing*
    *) usability testing with phases of interpretative dialogue with the user participant
    • Findings through user dialogue ...
    • covered a broader range of themes:
    • Static design
    • Interaction design
    • Needed information
    • Needed functionality
    • Req’s for use
    • Req’s for content
    • Technical issues
    Følstad, A. & Hornbæk, K. (2010) Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability Testing. Journal of systems and software, 83, 2019-2030.
  • 9.
    • Mobile applications for
      • Mobile sales personnel
      • Medical emergency personnel
    • Usability issues identified through
      • Observation (in the interaction phases)
      • User dialogue (in the interpretation phases)
    • Consider also: Two cases of cooperative usability testing*
    *) usability testing with phases of interpretative dialogue with the user participant Findings through user dialogue ... had similar impact on subsequent development compared to findings through observation Følstad, A. & Hornbæk, K. (2010) Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability Testing. Journal of systems and software, 83, 2019-2030.
  • 10. Why did it pay off to access the users’ knowledge in these cases?
  • 11.
    • Domain
    • exclusiveness*
    *) The unavailability of domain knowledge to the outsiders of a specific domain Level of training Level of specialization High High Low Low Specialist (Medical care at hospital wards; medical emergency response) Generalist (General office work; project leadership) Popular (eCommerce and eGovernment customership) Limited training (Professional sales; parking enforcemenet)
  • 12. In conclusion: When doing usability evaluation in exclusive domains … … consider using methods that allow you to access the domain knowledge of users