Course assignment on mixed methods analysis

1. Navigating Tomorrow’s Web:
From Searching and Browsing to Visual Exploration
Marian Dork, Carey Williamson, Sheelagh Carpendale
Analyzed and Presented by:
Amelia Cole & Varshita Sher
IAT834 - Mixed Methods
Spring 2017

2. Research Problem
1.ii. Introduction: Problem

3. Unmoderated
remote (web)
study
1. i) Introduction: HACT
Context

4. Humans
763 participants
Average age is 30
79.2% male
50.2% from western
countries
42% web experts
1i. Introduction: HACT

5. Activity
1.i. Introduction: HACT
No predetermined tasks.
Users explored interface.

6. Technology
VisGets: A Data Visualization Tool
Online Demo > http://mariandoerk.de/visgets/demo/
1. i) Introduction: HACT

7. Research Goals
2: Implied Goals
Gain a better understanding of
visual exploration on the Web

8. Research Questions
1. iii) Introduction: Research Questions
What are the possible benefits of visual exploration?
What are the possible challenges of visual exploration?
How does a visual exploration system perform during use?

9. Methodology
3. i, ii, iiii) Research Methods
Pragmatism
Unmoderated usability evaluation
Convergent Parallel Mixed Methods Design
QUANT + QUAL
Mixed in Interpretation

10. Variables
3. iv) Research Methods
Data Collection

11. Factors and Analysis Methods
3. v) Research Methods
Quantitative
Backend system data
Frontend UI data
Correlational analysis
Qualitative
Feedback form
(comments & critiques)
Thematic analysis

12. Benefits
x. + Results
Multiple
search
dimensions
High-level
information
seeking
Exploratory
or comparative
information

13. Challenges
x. + Results
Learning
Curve
Adaptive
Visualizations
Empty
Results

14. Performance
x. + Results
S—-L—-O—-W

15. Why Mixed Methods?
4. i, ii, iii) Analysis of Mixed Methods
User needs/perception System Performance
Data AnalysisApproach Data Collection

16. Strengths of Mixed Methods
5. i, ii, iii) Analysis of Mixed Methods
Multi-faceted
view of data
Simple to execute
Data in same phase
Explains
unexpected results
Data AnalysisApproach Data Collection

17. 6. Analysis of Mixed Methods
Limitations
Limited population
& dataset
Single Coder?
Variation in
participation levels
Data AnalysisApproach Data Collection

18. • Soft claims / High-level findings
• Possible future research directions
• Did not include potential confounds
Quality of Interpretations
7. Analysis of Quality

19. • Detailed limitations provided
• Pathway to future research areas for visual search
Quality of Design Knowledge
8. Analysis of Design Knowledge

21. Appendix
System responsiveness
Client Processing
(29.5%)
Network Transit
(42.8%)
Server processing
(27.5%)
TimeLocation TagsText Queries

22. Key Terms
Multi-faceted
Having many definable aspects that make up a subject or
object.
Visual exploration
High-level form of information seeking.
Search-and-Browse Paradigm
Traditional means of discovering text-based content on the Web.
3. iv) Research Methods
Web-based information visualization
A multifaceted interactive graphical representation of
information can that be manipulated by interacting via the
graphical elements or traditional text queries.