Your SlideShare is downloading. ×
0
Triggered Think-Aloud Protocol:  Using Eye Tracking to Improve Usability Test Moderation               Beverly Freeman | P...
We        Think-Aloud    “Thinking aloud may be   the single most valuableusability engineering method.”
Concurrent vs. Retrospective Think-Aloud                                       +                           –CTA           ...
Gaze-Cued RTA                        +                            –Gaze-Cued RTA   ET video provides an                add...
Triggered Think-Aloud Protocol (TTA)• Modified form of CTA• Moderator uses real-time gaze data as an input to  determine w...
Triggered Think-Aloud Protocol (TTA)                         Yes                      NoInstructions to   “Share anything ...
What We Want to Avoid            “What are you          “Did you           looking at now?”       notice…?” “You want me t...
TTA: A Preliminary Case Study• Refrain from probing                   • Probe away!    – Avoid interfering with discovery ...
Using TTA: Factors to Consider1. Research goals   –   Formative vs. summative2. Participant characteristics   –   Talkativ...
Next Steps for Us • Refinement of TTA protocol   – Initial participant instructions   – Moderator probes and prompts• Exp...
Upcoming SlideShare
Loading in...5
×

Triggered Think Aloud Protocol for Eye Tracking (CHI 2011 Presentation)

1,079

Published on

Short presentation shared at CHI 2011. Describes a concurrent think-aloud protocol that uses eye tracking data to inform usability moderation in real time. The desire is to improve when and how probes are administered while minimally influencing task behavior. The original paper is in the CHI 2011 conference proceedings.

Published in: Design, Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,079
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
17
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Transcript of "Triggered Think Aloud Protocol for Eye Tracking (CHI 2011 Presentation)"

  1. 1. Triggered Think-Aloud Protocol: Using Eye Tracking to Improve Usability Test Moderation Beverly Freeman | PayPal | CHI 2011
  2. 2. We Think-Aloud “Thinking aloud may be the single most valuableusability engineering method.”
  3. 3. Concurrent vs. Retrospective Think-Aloud + –CTA Thoughts are captured while fresh Talking may interfere with doing(concurrent think-aloud)RTA Task performance is uninterrupted Memory decay, fabrication(retrospective think-aloud) Task performance Verbalization of task performance
  4. 4. Gaze-Cued RTA + –Gaze-Cued RTA ET video provides an additional memory aid Participants may freak out! Memory decay, fabrication Task performance Verbalization of task performance
  5. 5. Triggered Think-Aloud Protocol (TTA)• Modified form of CTA• Moderator uses real-time gaze data as an input to determine when and how to prompt Gaze-Cued RTA: TTA: Gaze data  Participant Gaze data  Moderator  Participant
  6. 6. Triggered Think-Aloud Protocol (TTA) Yes NoInstructions to “Share anything that “Continually think aloud” would help me better participants understand your experience”Moderator Triggered by observed Triggered by periods of behaviors (e.g. “How silence prompts would you describe what you’re seeing?”)
  7. 7. What We Want to Avoid “What are you “Did you looking at now?” notice…?” “You want me to keep “Oh right! I should’vetalking? Um, I’m typing noticed this thing overin my password now...” here…” Task performance Verbalization of task performance
  8. 8. TTA: A Preliminary Case Study• Refrain from probing • Probe away! – Avoid interfering with discovery – Capture initial interpretation
  9. 9. Using TTA: Factors to Consider1. Research goals – Formative vs. summative2. Participant characteristics – Talkative vs. reticent participants3. Experience characteristics – Static vs. dynamic content – First-time encounter vs. habituated experience – Diversity of user intents / strategies4. ?5. ?6. ?
  10. 10. Next Steps for Us • Refinement of TTA protocol – Initial participant instructions – Moderator probes and prompts• Experimental research – Investigate impact of various factors (think-aloud variation, participant characteristics, experience characteristics, etc.) on behavior and verbal commentsThank you!Questions?bfreeman@paypal.com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×