Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Making sense of (big) data -
visual analytics and provenance
Dr Kai Xu
Associate Professor in Data Analytics
Middlesex Uni...
Outline
• Introduction
• What is Sensemaking
• Supporting Sensemaking: VAST Challenge 2014
• What is (Analytic) Provenance...
Outline
• Introduction
• What is Sensemaking
• Supporting Sensemaking: VAST Challenge 2014
• What is (Analytic) Provenance...
Data Visualisation – Simple
• Leverage visual cognition for data analysis
Data Visualisation – less simple
Design new visualisations
Evaluate them
Develop visualisation tools
Outline
• Introduction
• What is Sensemaking
• Supporting Sensemaking: VAST Challenge 2014
• What is (Analytic) Provenance...
What is sensemaking?
• Making sense of data, reasoning, and make
decisions
• It is something we do everyday:
• Plan a holi...
Sensemaking
Data Analysis
& Visualisation
Reasoning Decision
Sensemaking example: what is the
best camera for about £500?
What is the best
camera for £500?
Pixel number
Sensor size
Im...
Making Sense of Data
Outline
• Introduction
• What is Sensemaking
• Supporting Sensemaking: VAST Challenge 2014
• What is (Analytic) Provenance...
VAST Challenge 2014
• Visual Analytics Science & Technology (VAST) Challenge
• Provide dataset and analysis tasks
• Entry:...
The Data
Our Entry
• Honourable mention: “Effective Support for
Analytic Sensemaking”
• SAVI: Social Analytics Visualisation
• Temp...
SAVI – Social Analytics VIsualisation
SAVI – Histogram
SAVI – Entity List
SAVI – Message Timeline
Nguyen, P. H., Xu, K., Walker, R., and Wong, B. W. TimeSets: Timeline
visualization with set relat...
SAVI – Map View
SAVI – Map
SAVI – Event Details
SenseMAP - SenseMaking with
Analytic Provenance
SenseMAP – Findings
SenseMAP – Reasoning Space
SenseMAP – Process Provenance
Video
Discussions
• Sensemaking is not just one visualisation
• Timeline, entity list, map, visual narrative, etc.
• Many aspect...
Outline
• Introduction
• What is Sensemaking
• Supporting Sensemaking: VAST Challenge 2014
• What is (Analytic) Provenance...
Provenance
• What is provenance?
‘A record of ownership of a work of art
or an antique, used as a guide to
authenticity or...
2 degree
in Antarctica
was it taken? did it?
was the measurement taken?
what
where
When Who
How
Analytic provenance
• How users make sense of data
• The data and visualisations used
• The findings
• The hypothesis and ...
Outline
• Introduction
• What is Sensemaking
• Supporting Sensemaking: VAST Challenge 2014
• What is (Analytic) Provenance...
Sensemaking example: what is the
best camera for about £500?
What is the best
camera for £500?
Pixel number
Sensor size
Im...
This is usually what it looks like
after one hour
• What is relevant and what is not?
• Where are information about image ...
SenseMap – a map of analytic
provenance
• What can you do when you don’t have a map to
start with
• Track where you have b...
SenseMap – A map of sensemaking
Browser enhancement
History
Map
Knowledge
Map
Browser View
• Sensemaking support
• highlight, take note
• set representative
image in History Map
• Provenance capture
•...
History Map (information collection)
Knowledge Map (information
curation)
Demo - £500 camera
Discussion
• SenseMap to support
browser-based online
sensemaking
• Capture and visualise
the analytic provenance
• Suppor...
Summary
• Sensemaking is how people understand, reason,
and make decisions with data
• Analytic provenance captures the ri...
• SenseMap2 is available as a Chrome extension
• Just search for ‘SenseMap’ in chrome web store.
• Looking for collaborati...
Upcoming SlideShare
Loading in …5
×

Making sense of (big) data - visual analytics and provenance

909 views

Published on

This is the talk I given at the data+visual meeting in London in Aug 2016

Published in: Data & Analytics
  • Be the first to comment

Making sense of (big) data - visual analytics and provenance

  1. 1. Making sense of (big) data - visual analytics and provenance Dr Kai Xu Associate Professor in Data Analytics Middlesex University, London, UK k.xu@mdx.ac.uk https://kaixu.me
  2. 2. Outline • Introduction • What is Sensemaking • Supporting Sensemaking: VAST Challenge 2014 • What is (Analytic) Provenance • Navigating Big Data: SenseMap
  3. 3. Outline • Introduction • What is Sensemaking • Supporting Sensemaking: VAST Challenge 2014 • What is (Analytic) Provenance • Navigating Big Data: SenseMap
  4. 4. Data Visualisation – Simple • Leverage visual cognition for data analysis
  5. 5. Data Visualisation – less simple
  6. 6. Design new visualisations
  7. 7. Evaluate them
  8. 8. Develop visualisation tools
  9. 9. Outline • Introduction • What is Sensemaking • Supporting Sensemaking: VAST Challenge 2014 • What is (Analytic) Provenance • Navigating Big Data: SenseMap
  10. 10. What is sensemaking? • Making sense of data, reasoning, and make decisions • It is something we do everyday: • Plan a holiday, buy a car, understand an illness, … • Defence, policing, investment, medical diagnosis, … • The task is usually not well defined • Can’t run a google search or SQL query to find the answer • Involve many different data • Explorative and iterative
  11. 11. Sensemaking Data Analysis & Visualisation Reasoning Decision
  12. 12. Sensemaking example: what is the best camera for about £500? What is the best camera for £500? Pixel number Sensor size Image quality chromatic aberration?! Noise reduction What does experts say? Online reviews What does my friend say? Smart phone Compact Full frame? Micro 4/3? Sony RX100 Nikon D750Samsung Galaxy S7 What are the price? How do I compare? Panasonic LX100 Form factor Models
  13. 13. Making Sense of Data
  14. 14. Outline • Introduction • What is Sensemaking • Supporting Sensemaking: VAST Challenge 2014 • What is (Analytic) Provenance • Navigating Big Data: SenseMap
  15. 15. VAST Challenge 2014 • Visual Analytics Science & Technology (VAST) Challenge • Provide dataset and analysis tasks • Entry: visual analytics systems • VAST Challenge 2014 – Mini Challenge 3 • Data: tweets • Task: solve a kidnap case Making sense of data, reasoning, and make decisions The task is usually not well defined Can’t run a google search or SQL query to find the answer × Involve many different data Explorative and iterative
  16. 16. The Data
  17. 17. Our Entry • Honourable mention: “Effective Support for Analytic Sensemaking” • SAVI: Social Analytics Visualisation • Temporal, geo-spatial, and text analysis visualisation • SenseMap: SenseMaking with analytic provenance • Notes and findings • Visual reasoning • Visual narrative construction • Collaboration • Analytic provenance
  18. 18. SAVI – Social Analytics VIsualisation
  19. 19. SAVI – Histogram
  20. 20. SAVI – Entity List
  21. 21. SAVI – Message Timeline Nguyen, P. H., Xu, K., Walker, R., and Wong, B. W. TimeSets: Timeline visualization with set relations. Information Visualization (2016)
  22. 22. SAVI – Map View
  23. 23. SAVI – Map
  24. 24. SAVI – Event Details
  25. 25. SenseMAP - SenseMaking with Analytic Provenance
  26. 26. SenseMAP – Findings
  27. 27. SenseMAP – Reasoning Space
  28. 28. SenseMAP – Process Provenance
  29. 29. Video
  30. 30. Discussions • Sensemaking is not just one visualisation • Timeline, entity list, map, visual narrative, etc. • Many aspects of the underlying data • The visual analytics tool needs to support different types of sensemaking tasks • Help identify starting point • Capture/record findings • Connection between different views/data items • Reasoning and construct narrative
  31. 31. Outline • Introduction • What is Sensemaking • Supporting Sensemaking: VAST Challenge 2014 • What is (Analytic) Provenance • Navigating Big Data: SenseMap
  32. 32. Provenance • What is provenance? ‘A record of ownership of a work of art or an antique, used as a guide to authenticity or quality’ • Data Provenance: • Data source and collection • Data processing and analysis • This is not that new • Meta-data • Context • Why should we care? Who? When? Where? hoW? Why? What? Which? The 7 ‘W’
  33. 33. 2 degree in Antarctica was it taken? did it? was the measurement taken? what where When Who How
  34. 34. Analytic provenance • How users make sense of data • The data and visualisations used • The findings • The hypothesis and evidence • The reasoning process and conclusions • Example: Should we invade Iraq? • It is always easier after the event • The actual question: was it the right decision to invade Iraq with the information and time available then. • Can be used to support Sensemaking Who? When? Where? hoW? Why? What? Which? The 7 ‘W’
  35. 35. Outline • Introduction • What is Sensemaking • Supporting Sensemaking: VAST Challenge 2014 • What is (Analytic) Provenance • Navigating Big Data: SenseMap
  36. 36. Sensemaking example: what is the best camera for about £500? What is the best camera for £500? Pixel number Sensor size Image quality chromatic aberration?! Noise reduction What does experts say? Online reviews What does my friend say? Smart phone Compact Full frame? Micro 4/3? Sony RX100 Nikon D750Samsung Galaxy S7 What are the price? How do I compare? Panasonic LX100 Form factor Models
  37. 37. This is usually what it looks like after one hour • What is relevant and what is not? • Where are information about image quality? • How to compare the models? • Where did I left off two days ago? • How do I explain to my wife?
  38. 38. SenseMap – a map of analytic provenance • What can you do when you don’t have a map to start with • Track where you have been • Build the map as you go
  39. 39. SenseMap – A map of sensemaking Browser enhancement History Map Knowledge Map
  40. 40. Browser View • Sensemaking support • highlight, take note • set representative image in History Map • Provenance capture • action type, timing, context, relationship
  41. 41. History Map (information collection)
  42. 42. Knowledge Map (information curation)
  43. 43. Demo - £500 camera
  44. 44. Discussion • SenseMap to support browser-based online sensemaking • Capture and visualise the analytic provenance • Support information collection and curation • Early stage of the sensemaking process
  45. 45. Summary • Sensemaking is how people understand, reason, and make decisions with data • Analytic provenance captures the rich context of this process: seven ‘W’s • There are still many open problems for sensemaking support • Data visualisation tools based on analytic provenance can potentially provide a solution • SAVI (TimeSets) + SenseMap • SenseMap2: navigating information place
  46. 46. • SenseMap2 is available as a Chrome extension • Just search for ‘SenseMap’ in chrome web store. • Looking for collaboration • Research: data visualisation in general. • Development: new tools or existing ones. • Others: PhD, joint funding proposal, etc. • Contact • k.xu@mdx.ac.uk • https://kaixu.me

×