Your SlideShare is downloading. ×
  • Like
Comparing Benchmark Task and Insight Evaluation Methods.
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Comparing Benchmark Task and Insight Evaluation Methods.

  • 283 views
Published

Presenter: Chris North, Purvi Saraiya …

Presenter: Chris North, Purvi Saraiya
BELIV 2010 Workshop
http://www.beliv.org/beliv2010/

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
283
On SlideShare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
6
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Comparing Benchmark Task and Insight Evaluation Methods Purvi Saraiya, Chris North, Karen Duca Virginia Tech BELIV 2010
  • 2. Single-Time Viz Multi-Time Viz Multi-Graph Viz 1 2 3 4 5 6 (Timepoints) Non-Smokers Smokers Non-Smokers Smokers 1 2 3 4 5 6 (Timepoints)
  • 3. Comparison of Results Benchmark task method result Insight method result Confirm Timepoint analysis on Multi-Time Viz Refute Topology tasks on Multi-Graph Viz Less insight Extend Hypothesis tasks on Single-Time Viz Outlier node tasks on Multi-Time Viz Refute ??? Confirm Timepoint analysis on Single-Time Viz More insight Not tested Slow / inaccurate Fast / accurate
  • 4. Other interesting stuff
    • Importance of interaction to insight
    • Subjectivity Threat
    • Task method = choice of tasks ecological validity
    • Insight method = coding of insights repeatability
  • 5. Question
    • Which is more important to know:
    • Tasks a visualization supports
    • or
    • Tasks a visualization promotes
    • ?
  • 6. Studies using VAST Challenge
  • 7. Controlled Ethnography !?
    • VAST Challenges – overcoming the problems with ethnography (esp. in intell)
    (contextual) interviews observational lab study Gain rich insight into analysts’ processes, Quantify findings with repeatability, Introduce interventions generate scenario confirm findings