Your SlideShare is downloading. ×
0
<ul><li>Asbjørn Følstad </li></ul><ul><li>1st European workshop on HCI design and evaluation  </li></ul><ul><li>Limassol, ...
<ul><li>The two loves of the usability evaluator </li></ul>Usability testing Usability inspection
<ul><li>The two loves of the usability evaluator </li></ul>Usability testing Usability inspection considering users observ...
<ul><li>We do not miss much, unless the user … </li></ul>What do we miss by not accessing the user’s knowledge during our ...
What we may miss if the user knows more of the domain than the usability evaluator:  Review of two studies of usability ev...
<ul><li>Mobile applications for  </li></ul><ul><ul><li>Medical personnel at hospital wards </li></ul></ul><ul><ul><li>Park...
<ul><li>Mobile applications for  </li></ul><ul><ul><li>Medical personnel at hospital wards </li></ul></ul><ul><ul><li>Park...
<ul><li>Mobile applications for  </li></ul><ul><ul><li>Mobile sales personnel </li></ul></ul><ul><ul><li>Medical emergency...
<ul><li>Mobile applications for  </li></ul><ul><ul><li>Mobile sales personnel </li></ul></ul><ul><ul><li>Medical emergency...
Why did it pay off to access the users’ knowledge in these cases?
<ul><li>Domain  </li></ul><ul><li>exclusiveness* </li></ul>*)  The unavailability of domain knowledge to the outsiders of ...
In conclusion: When doing usability evaluation in exclusive domains … …  consider using methods that allow you to access t...
Upcoming SlideShare
Loading in...5
×

Usability evaluation in exclusive domains_presentation

648

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
648
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Usability evaluation in exclusive domains_presentation"

  1. 1. <ul><li>Asbjørn Følstad </li></ul><ul><li>1st European workshop on HCI design and evaluation </li></ul><ul><li>Limassol, Cyprus, April 8., 2011 </li></ul><ul><li>Usability evaluation in exclusive domains: How to access domain knowledge </li></ul>Thoughts in progress! Conclusions up for discussion
  2. 2. <ul><li>The two loves of the usability evaluator </li></ul>Usability testing Usability inspection
  3. 3. <ul><li>The two loves of the usability evaluator </li></ul>Usability testing Usability inspection considering users observing users What do we miss by not accessing the user’s knowledge during our usability evaluations?
  4. 4. <ul><li>We do not miss much, unless the user … </li></ul>What do we miss by not accessing the user’s knowledge during our usability evaluations? … holds domain knowledge we cannot access
  5. 5. What we may miss if the user knows more of the domain than the usability evaluator: Review of two studies of usability evaluation methods that allow us to access the users’ knowledge.
  6. 6. <ul><li>Mobile applications for </li></ul><ul><ul><li>Medical personnel at hospital wards </li></ul></ul><ul><ul><li>Parking wardens </li></ul></ul><ul><ul><li>Political advisors </li></ul></ul><ul><li>Evaluated with groups of either </li></ul><ul><ul><li>Domain experts </li></ul></ul><ul><ul><li>Usability experts </li></ul></ul><ul><li>Consider: Three cases of Group-based expert walkthrough * </li></ul>*) an inspection method allowing domain experts to serve as usability inspectors 12 % overlap in findings between evaluator groups Domain experts: 59 % domain specific findings Usability experts: 15 % domain specific findings Følstad, A., 2007. Work-domain experts as evaluators: usability inspection of domain-specific work-support systems. International Journal of Human– Computer Interaction 22 (3), 217–245.
  7. 7. <ul><li>Mobile applications for </li></ul><ul><ul><li>Medical personnel at hospital wards </li></ul></ul><ul><ul><li>Parking wardens </li></ul></ul><ul><ul><li>Political advisors </li></ul></ul><ul><li>Evaluated with groups of either </li></ul><ul><ul><li>Domain experts </li></ul></ul><ul><ul><li>Usability experts </li></ul></ul><ul><li>Consider: Three cases of Group-based expert walkthrough * </li></ul>*) an inspection method allowing domain experts to serve as usability inspectors 54 % of domain experts’ findings given high priority by client 27 % of usability experts’ findings given the same priority Følstad, A., 2007. Work-domain experts as evaluators: usability inspection of domain-specific work-support systems. International Journal of Human– Computer Interaction 22 (3), 217–245 .
  8. 8. <ul><li>Mobile applications for </li></ul><ul><ul><li>Mobile sales personnel </li></ul></ul><ul><ul><li>Medical emergency personnel </li></ul></ul><ul><li>Usability issues identified through </li></ul><ul><ul><li>Observation (in the interaction phases) </li></ul></ul><ul><ul><li>User dialogue (in the interpretation phases) </li></ul></ul><ul><li>Consider also: Two cases of cooperative usability testing* </li></ul>*) usability testing with phases of interpretative dialogue with the user participant <ul><li>Findings through user dialogue ... </li></ul><ul><li>covered a broader range of themes: </li></ul><ul><li>Static design </li></ul><ul><li>Interaction design </li></ul><ul><li>Needed information </li></ul><ul><li>Needed functionality </li></ul><ul><li>Req’s for use </li></ul><ul><li>Req’s for content </li></ul><ul><li>Technical issues </li></ul>Følstad, A. & Hornbæk, K. (2010) Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability Testing. Journal of systems and software, 83, 2019-2030.
  9. 9. <ul><li>Mobile applications for </li></ul><ul><ul><li>Mobile sales personnel </li></ul></ul><ul><ul><li>Medical emergency personnel </li></ul></ul><ul><li>Usability issues identified through </li></ul><ul><ul><li>Observation (in the interaction phases) </li></ul></ul><ul><ul><li>User dialogue (in the interpretation phases) </li></ul></ul><ul><li>Consider also: Two cases of cooperative usability testing* </li></ul>*) usability testing with phases of interpretative dialogue with the user participant Findings through user dialogue ... had similar impact on subsequent development compared to findings through observation Følstad, A. & Hornbæk, K. (2010) Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability Testing. Journal of systems and software, 83, 2019-2030.
  10. 10. Why did it pay off to access the users’ knowledge in these cases?
  11. 11. <ul><li>Domain </li></ul><ul><li>exclusiveness* </li></ul>*) The unavailability of domain knowledge to the outsiders of a specific domain Level of training Level of specialization High High Low Low Specialist (Medical care at hospital wards; medical emergency response) Generalist (General office work; project leadership) Popular (eCommerce and eGovernment customership) Limited training (Professional sales; parking enforcemenet)
  12. 12. In conclusion: When doing usability evaluation in exclusive domains … … consider using methods that allow you to access the domain knowledge of users
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×