Comparing Benchmark Task and Insight Evaluation Methods.
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

Comparing Benchmark Task and Insight Evaluation Methods.

  • 551 views
Uploaded on

Presenter: Chris North, Purvi Saraiya...

Presenter: Chris North, Purvi Saraiya
BELIV 2010 Workshop
http://www.beliv.org/beliv2010/

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
551
On Slideshare
531
From Embeds
20
Number of Embeds
3

Actions

Shares
Downloads
5
Comments
0
Likes
0

Embeds 20

http://www.beliv.org 17
http://www.slideshare.net 2
http://webcache.googleusercontent.com 1

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Comparing Benchmark Task and Insight Evaluation Methods Purvi Saraiya, Chris North, Karen Duca Virginia Tech BELIV 2010
  • 2. Single-Time Viz Multi-Time Viz Multi-Graph Viz 1 2 3 4 5 6 (Timepoints) Non-Smokers Smokers Non-Smokers Smokers 1 2 3 4 5 6 (Timepoints)
  • 3. Comparison of Results Benchmark task method result Insight method result Confirm Timepoint analysis on Multi-Time Viz Refute Topology tasks on Multi-Graph Viz Less insight Extend Hypothesis tasks on Single-Time Viz Outlier node tasks on Multi-Time Viz Refute ??? Confirm Timepoint analysis on Single-Time Viz More insight Not tested Slow / inaccurate Fast / accurate
  • 4. Other interesting stuff
    • Importance of interaction to insight
    • Subjectivity Threat
    • Task method = choice of tasks ecological validity
    • Insight method = coding of insights repeatability
  • 5. Question
    • Which is more important to know:
    • Tasks a visualization supports
    • or
    • Tasks a visualization promotes
    • ?
  • 6. Studies using VAST Challenge
  • 7. Controlled Ethnography !?
    • VAST Challenges – overcoming the problems with ethnography (esp. in intell)
    (contextual) interviews observational lab study Gain rich insight into analysts’ processes, Quantify findings with repeatability, Introduce interventions generate scenario confirm findings