Post-test feedback
mechanisms
Assessing user experiences in 2 ways
Presented by Carol Barnum, Ph.D.
UX Firm, LLC
SUS
PRC
System Usability Scale
Strongly
Disagree
Strongly
Agree
1. I think that I would like to use this website frequently.
2. I ...
Average score
68
International hotel group
“green” initiative
Round 1
54
Round 2
73
SUS scores for 1st and 2nd test
SUS scores for 3rd test
Round 1
54
Round 2
73
Round 3
94!!!!!!
Microsoft creates desirability toolkit
1. Faces Questionnaire
2. Product Reaction Cards
118 Cards
6 Faces
What’s in the cards?
In person
 Spread them out on table
 Instruct user to
◦ walk along the table and pick up cards that express the user’s e...
Magic happens!
Several examples
14
3 TV weather websites
0
5
10
15
20
25
30
35
40
Positive
Negative
Positive
Negative
Positive
Negative
Station A
Station ...
Repeated positive card selections
focused on ease of use,
relevance, and speed

Easy-to-use
Helpful
Straightforward

Fas...
International “green” initiative
Round 1= 
SUS = 52
42% PRC
positive
Round 2= 
SUS = 73
82% PRC
positive
Round 3 =  
S...
The 1-2 punch. Use both!
For more . . .
http://booksite.elsevier.com
/barnum/testingessentials/
Contact
carolbarnum@uxfirm.com
Post-test feedback mechanisms
Upcoming SlideShare
Loading in …5
×

Post-test feedback mechanisms

610 views

Published on

Presentation at 14th ErgoDesign conference, Brazil. Reviews my two favorite tools for feedback after usability testing.

Published in: Design, Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
610
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
3
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Positive Words
    Clean
    Clear
    Convenient
    Easy-to-use (3)
    Effective
    Entertaining
    Fast (2)
    Helpful (3)
    Inviting
    Personal
    Relevant (2)
    Reliable (2)
    Secure
    Straightforward (3)
    Trustworthy
    Usable
    Useful (2)
    Valuable
  • Post-test feedback mechanisms

    1. 1. Post-test feedback mechanisms Assessing user experiences in 2 ways Presented by Carol Barnum, Ph.D. UX Firm, LLC
    2. 2. SUS PRC
    3. 3. System Usability Scale Strongly Disagree Strongly Agree 1. I think that I would like to use this website frequently. 2. I found this website unnecessarily complex. 3. I thought this website was easy to use. 4. I think that I would need assistance to be able to use this website. 5. I found the various functions in this website were well integrated. 6. I thought there was too much inconsistency in this website. 7. I would imagine that most people would learn to use this website very quickly. 8. I found this website very cumbersome/awkward to use. 9. I felt very confident using this website. 10. I needed to learn a lot of things before I could get going with this website. This questionnaire is based on the System Usability Scale (SUS), which was developed by John Brooke while working at Digital Equipment Corporation. © Digital Equipment Corporation, 1986.
    4. 4. Average score 68
    5. 5. International hotel group “green” initiative
    6. 6. Round 1 54 Round 2 73 SUS scores for 1st and 2nd test
    7. 7. SUS scores for 3rd test Round 1 54 Round 2 73 Round 3 94!!!!!!
    8. 8. Microsoft creates desirability toolkit 1. Faces Questionnaire 2. Product Reaction Cards 118 Cards 6 Faces
    9. 9. What’s in the cards?
    10. 10. In person  Spread them out on table  Instruct user to ◦ walk along the table and pick up cards that express the user’s experience ◦ Share the meaning of the cards ◦ User’s story emerges In remote testing  Provide a Word table or Excel spreadsheet ◦ User highlights selections ◦ Explains choices In analysis  Count the total number of cards selected  Collate the results in clusters of similar/same cards  Present the results in a word cloud or other visual display How to use the cards
    11. 11. Magic happens!
    12. 12. Several examples
    13. 13. 14 3 TV weather websites 0 5 10 15 20 25 30 35 40 Positive Negative Positive Negative Positive Negative Station A Station B Station C 26/13 39/5 24/17
    14. 14. Repeated positive card selections focused on ease of use, relevance, and speed  Easy-to-use Helpful Straightforward  Fast Relevant Reliable Useful
    15. 15. International “green” initiative Round 1=  SUS = 52 42% PRC positive Round 2=  SUS = 73 82% PRC positive Round 3 =   SUS = 96 100% PRC positive
    16. 16. The 1-2 punch. Use both!
    17. 17. For more . . . http://booksite.elsevier.com /barnum/testingessentials/ Contact carolbarnum@uxfirm.com

    ×