Comparing Benchmark Task and Insight Evaluation Methods.
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Comparing Benchmark Task and Insight Evaluation Methods.

on

  • 536 views

Presenter: Chris North, Purvi Saraiya

Presenter: Chris North, Purvi Saraiya
BELIV 2010 Workshop
http://www.beliv.org/beliv2010/

Statistics

Views

Total Views
536
Views on SlideShare
516
Embed Views
20

Actions

Likes
0
Downloads
5
Comments
0

3 Embeds 20

http://www.beliv.org 17
http://www.slideshare.net 2
http://webcache.googleusercontent.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Comparing Benchmark Task and Insight Evaluation Methods. Presentation Transcript

  • 1. Comparing Benchmark Task and Insight Evaluation Methods Purvi Saraiya, Chris North, Karen Duca Virginia Tech BELIV 2010
  • 2. Single-Time Viz Multi-Time Viz Multi-Graph Viz 1 2 3 4 5 6 (Timepoints) Non-Smokers Smokers Non-Smokers Smokers 1 2 3 4 5 6 (Timepoints)
  • 3. Comparison of Results Benchmark task method result Insight method result Confirm Timepoint analysis on Multi-Time Viz Refute Topology tasks on Multi-Graph Viz Less insight Extend Hypothesis tasks on Single-Time Viz Outlier node tasks on Multi-Time Viz Refute ??? Confirm Timepoint analysis on Single-Time Viz More insight Not tested Slow / inaccurate Fast / accurate
  • 4. Other interesting stuff
    • Importance of interaction to insight
    • Subjectivity Threat
    • Task method = choice of tasks ecological validity
    • Insight method = coding of insights repeatability
  • 5. Question
    • Which is more important to know:
    • Tasks a visualization supports
    • or
    • Tasks a visualization promotes
    • ?
  • 6. Studies using VAST Challenge
  • 7. Controlled Ethnography !?
    • VAST Challenges – overcoming the problems with ethnography (esp. in intell)
    (contextual) interviews observational lab study Gain rich insight into analysts’ processes, Quantify findings with repeatability, Introduce interventions generate scenario confirm findings