Comparing Information Graphics: A Critical Look at Eye Tracking Joe Goldberg and Jon Helfman BELIV ‘10 – 4/10/10
Introduction <ul><li>How to select the most appropriate graph type? </li></ul><ul><li>Consider three graphs, showing ident...
Eye Tracking Challenges: Practice-Related <ul><li>When is Eye Tracking Appropriate, and What Can it Tell Us? </li></ul><ul...
Eye Tracking Challenges: Technical <ul><li>How to Define Fixations? </li></ul><ul><ul><li>Several methods </li></ul></ul><...
Comparison of Information Graphics: An Evaluation Study <ul><li>Objective </li></ul><ul><ul><li>Which graph type(s) best s...
Graph Stimuli <ul><li>Each 4-graph set: </li></ul><ul><ul><li>15x15 cm, Center of screen </li></ul></ul>1 job candidate pe...
Completion vs. First Fixation Times <ul><li>Completion Times Include Scanning, Decision Making, and Validation </li></ul>D...
Scanning Strategies <ul><li>Two Different Comparison Strategies </li></ul><ul><ul><li>Bar Graphs: Most of first bar graph ...
Discussion Questions <ul><li>How can eye tracking methods help evaluate information visualizations? </li></ul><ul><li>What...
Upcoming SlideShare
Loading in …5
×

Scanning Between Graph Visualizations: An Eye Tracking Evaluation.

1,158 views

Published on

Presenter: Joseph Goldberg, Jonathan Helfman
BELIV 2010 Workshop
http://www.beliv.org/beliv2010/

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,158
On SlideShare
0
From Embeds
0
Number of Embeds
14
Actions
Shares
0
Downloads
15
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Scanning Between Graph Visualizations: An Eye Tracking Evaluation.

  1. 1. Comparing Information Graphics: A Critical Look at Eye Tracking Joe Goldberg and Jon Helfman BELIV ‘10 – 4/10/10
  2. 2. Introduction <ul><li>How to select the most appropriate graph type? </li></ul><ul><li>Consider three graphs, showing identical data. Can eye tracking methods help determine which graph type(s) </li></ul><ul><ul><li>Are easiest to comprehend? </li></ul></ul><ul><ul><li>Are most appropriate for tasks? </li></ul></ul><ul><ul><li>Can be compared efficiently? </li></ul></ul><ul><li>Eye tracking may potentially reveal trends that are not easily observed by traditional usability metrics...but, eye tracking brings its own set of challenges </li></ul>
  3. 3. Eye Tracking Challenges: Practice-Related <ul><li>When is Eye Tracking Appropriate, and What Can it Tell Us? </li></ul><ul><li>Designing and Conducting Studies </li></ul><ul><ul><li>Length/number of tasks? </li></ul></ul><ul><ul><li>Allow mouse? Voice? </li></ul></ul><ul><ul><li>Recruitment profile? Number? </li></ul></ul><ul><ul><li>Allow dynamic stimuli? </li></ul></ul><ul><li>Analyzing and Reporting Data </li></ul><ul><ul><li>How much time required? </li></ul></ul><ul><ul><li>Use quantitative metrics? </li></ul></ul><ul><ul><li>Spatial (heatmaps) vs. temporal (scanpaths)? </li></ul></ul><ul><ul><li>How to aggregate eye tracking scanpaths? </li></ul></ul><ul><ul><li>How to extract scanning strategy from data? </li></ul></ul><ul><ul><li>When are results significant enough to be meaningful? </li></ul></ul>
  4. 4. Eye Tracking Challenges: Technical <ul><li>How to Define Fixations? </li></ul><ul><ul><li>Several methods </li></ul></ul><ul><li>How to Define AOIs? </li></ul><ul><ul><li>Padding </li></ul></ul><ul><ul><li>Overlap, hierarchy </li></ul></ul><ul><li>Assign Fixations to AOIs? </li></ul><ul><ul><li>Spatial location + path? </li></ul></ul><ul><li>Gaze Location Error </li></ul><ul><ul><li>Calibration </li></ul></ul><ul><ul><li>Foveal Area/Resolution </li></ul></ul><ul><ul><li>Attentional Dissociation </li></ul></ul><ul><li>Manage Scanpath Interruptions? </li></ul><ul><li>How to Define Metrics? </li></ul><ul><ul><li>No best practices or standards </li></ul></ul>
  5. 5. Comparison of Information Graphics: An Evaluation Study <ul><li>Objective </li></ul><ul><ul><li>Which graph type(s) best support relative comparison along multiple dimensions, within and between graphs? </li></ul></ul><ul><ul><li>Compare bar, line, and spider graphs </li></ul></ul><ul><li>Participants: 5 graph users (Oracle colleagues) </li></ul><ul><li>Apparatus: Tobii T60 Eye Tracking system </li></ul><ul><li>6 Tasks (same order) </li></ul><ul><ul><li>3 Easy (2 dimensions, 1 graph) </li></ul></ul><ul><ul><ul><li>“ Should Candidate 2 be hired, considering only job dimensions a and b?” </li></ul></ul></ul><ul><ul><li>3 Difficult (8 dimensions, 2 graphs) </li></ul></ul><ul><ul><ul><li>“ Which job candidate exceeded the greatest number of job requirements: 2 or 4?” </li></ul></ul></ul>
  6. 6. Graph Stimuli <ul><li>Each 4-graph set: </li></ul><ul><ul><li>15x15 cm, Center of screen </li></ul></ul>1 job candidate per graph, indicated by number Job dimensions indicated by a-h Job requirements Candidate abilities
  7. 7. Completion vs. First Fixation Times <ul><li>Completion Times Include Scanning, Decision Making, and Validation </li></ul>Decision making, validation, uncertainty
  8. 8. Scanning Strategies <ul><li>Two Different Comparison Strategies </li></ul><ul><ul><li>Bar Graphs: Most of first bar graph dimensions viewed before second bar graph viewed </li></ul></ul><ul><ul><li>Spider Graphs: Much more reciprocal scanning between dimensions, compared to bar graphs </li></ul></ul>
  9. 9. Discussion Questions <ul><li>How can eye tracking methods help evaluate information visualizations? </li></ul><ul><li>What are the most appropriate metrics? </li></ul><ul><li>Can eye tracking methods evaluate dynamic, interactive visualization usability? </li></ul><ul><li>How to aggregate and represent group scanning strategies on visualizations? </li></ul><ul><li>Is there a ‘standard practice’ for eye tracking methods? </li></ul>

×