Uncover & mitigate
bias in data
visualisations.
Neil Barnes
PMG
https://www.slideshare.net/neil_barnes
https://www.linkedin.com/in/neil-barnes-54119327/
Copyright 2024 PMG Worldwide LLC. All rights Reserved
2
Bias exists in three
core areas of data
visualisation. ANALYSIS
DATA
COGNITIVE
VISUAL
Copyright 2024 PMG Worldwide LLC. All rights Reserved
3
We cannot eliminate
bias, but we can
uncover & mitigate.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
4
Datasets are often
incomplete, causing
survivorship bias.
DATA
COGNITIVE
VISUAL
Copyright 2024 PMG Worldwide LLC. All rights Reserved
5
High Accuracy
High Precision
High Accuracy
Low Precision
Low Accuracy
High Precision
Low Accuracy
Low Precision
Accuracy Precision
Accuracy &
precision enable
understanding of
survivorship bias.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
6
Critical thinking to
identify extent of
survivorship bias.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
7
Critical thinking
applied to Google
Analytics data.
Bias Accuracy Precision
Cookie banner Low High
Ad blocker Low High
Browser cookie Low High
Data modelling Low High
Users vs people Low High
Attribution Low High
Bot traffic Low High
Sampling Low High
Copyright 2024 PMG Worldwide LLC. All rights Reserved
8
The human brain
processes 35,000
decisions every day.
DATA
COGNITIVE
VISUAL
Copyright 2024 PMG Worldwide LLC. All rights Reserved
9
Cognitive bias is the
human brain taking
shortcuts, to reach
decisions at speed.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
10
Framing effect
Copyright 2024 PMG Worldwide LLC. All rights Reserved
11
Conversion rate has
doubled…
Copyright 2024 PMG Worldwide LLC. All rights Reserved
12
… or 90% of our
audience do not
convert.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
13
Whilst conversion rate has doubled
YOY, 90% of our audience do not
convert. Continual improvement
provides an exciting growth opportunity.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
14
Causal illusion
Copyright 2024 PMG Worldwide LLC. All rights Reserved
15
Correlation is
incorrectly implied as
causation.
P=0.64
Copyright 2024 PMG Worldwide LLC. All rights Reserved
16
Increased ice cream
consumption
causing more shark
attacks?!
Copyright 2024 PMG Worldwide LLC. All rights Reserved
17
Increased shark
attacks causing
people to eat more
ice cream?!
Copyright 2024 PMG Worldwide LLC. All rights Reserved
18
P=0.61
P=0.85
Air temperature is the causation
Copyright 2024 PMG Worldwide LLC. All rights Reserved
19
Anchoring effect
Copyright 2024 PMG Worldwide LLC. All rights Reserved
20
Our first reaction is
to panic that CPC
sessions are in sharp
decline.
This Year Last Year
CPC sessions 479,310 634,825
Copyright 2024 PMG Worldwide LLC. All rights Reserved
21
See the whole picture & mitigate anchoring
effect
This Year Last Year % change
CPC sessions 479,310 634,825 -24%
Spend £923,530 £1,006,122 -8%
Cost/session £1.93 £1.58 22%
Engagement % 53% 49% 8%
Revenue £4,406,517 £4,385,059 0%
ROAS 477% 436% 9%
Copyright 2024 PMG Worldwide LLC. All rights Reserved
22
We can mitigate
visual bias, with a
high level of control.
DATA
COGNITIVE
VISUAL
Copyright 2024 PMG Worldwide LLC. All rights Reserved
23
Scale manipulation
Copyright 2024 PMG Worldwide LLC. All rights Reserved
24
Trend exaggeration
through a biased
scale.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
25
A fair scale provides
an unbiased view of
the visualisation.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
26
Bias can also occur
using an inconsistent
timeframe.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
27
Making trends
appear biased &
difficult to interpret.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
28
Correlation illusion
Copyright 2024 PMG Worldwide LLC. All rights Reserved
29
There is no
correlation in this
dataset.
P=0.08
Copyright 2024 PMG Worldwide LLC. All rights Reserved
30
A ‘best-fit’ trend line
introduces bias &
implies correlation.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
31
A ‘best-fit’ trend line
introduces bias &
implies correlation.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
32
A ‘best-fit’ trend line
introduces bias &
implies correlation.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
33
Visual distortion
Copyright 2024 PMG Worldwide LLC. All rights Reserved
34
Pie & donut charts
introduce visual
distortion & bias.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
35
3 dimensional
visuals exaggerate
biases further.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
36
A bar chart provides
clarity & mitigates
bias.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
37
Colour choice can
bias how data is
visualised.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
38
Cognitive bias
introduced through
choice of colour.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
39
Cognitive bias
introduced through
colour shading.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
40
Accessibility is
critical, in mitigating
visual bias.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
41
Add symbol markers
to provide visual
distinction.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
42
Patterns provide
visual distinction to
bar charts.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
43
Alt text, to provide
text descriptions for
data visuals.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
44
Tables & shapes aid accessibility
This Year Last Year % change
CPC sessions 479,310 634,825 -24%
Spend £923,530 £1,006,122 -8%
Cost/session £1.93 £1.58 22%
Engagement % 53% 49% 8%
Revenue £4,406,517 £4,385,059 0%
ROAS 477% 436% 9%
Copyright 2024 PMG Worldwide LLC. All rights Reserved
45
Five takeaways to
uncover & mitigate
bias in visualisations.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
46
Bias exists in three
core areas of data
visualisation.
DATA
COGNITIVE
VISUAL
Copyright 2024 PMG Worldwide LLC. All rights Reserved
47
High Accuracy
High Precision
High Accuracy
Low Precision
Low Accuracy
High Precision
Low Accuracy
Low Precision
Accuracy Precision
Survivorship
bias in data can
be identified by
thinking critically.
Copyright 2024 PMG Worldwide LLC. All rights Reserved
48
Cognitive biases:
Framing effect
Causal illusion
Anchoring effect
Copyright 2024 PMG Worldwide LLC. All rights Reserved
49
Visual biases:
Scale manipulation
Correlation illusion
Visual distortion
Colour choice
Copyright 2024 PMG Worldwide LLC. All rights Reserved
50
Accessibility:
Data markers
Patterns
Alt text
Tables & shapes
Copyright 2024 PMG Worldwide LLC. All rights Reserved
51
Uncover & mitigate
bias in data
visualisations.
Thank you!
Neil Barnes
PMG
https://www.slideshare.net/neil_barnes
https://www.linkedin.com/in/neil-barnes-54119327/

Uncover mitigate bias data visualisation

  • 1.
    Uncover & mitigate biasin data visualisations. Neil Barnes PMG https://www.slideshare.net/neil_barnes https://www.linkedin.com/in/neil-barnes-54119327/
  • 2.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 2 Bias exists in three core areas of data visualisation. ANALYSIS DATA COGNITIVE VISUAL
  • 3.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 3 We cannot eliminate bias, but we can uncover & mitigate.
  • 4.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 4 Datasets are often incomplete, causing survivorship bias. DATA COGNITIVE VISUAL
  • 5.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 5 High Accuracy High Precision High Accuracy Low Precision Low Accuracy High Precision Low Accuracy Low Precision Accuracy Precision Accuracy & precision enable understanding of survivorship bias.
  • 6.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 6 Critical thinking to identify extent of survivorship bias.
  • 7.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 7 Critical thinking applied to Google Analytics data. Bias Accuracy Precision Cookie banner Low High Ad blocker Low High Browser cookie Low High Data modelling Low High Users vs people Low High Attribution Low High Bot traffic Low High Sampling Low High
  • 8.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 8 The human brain processes 35,000 decisions every day. DATA COGNITIVE VISUAL
  • 9.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 9 Cognitive bias is the human brain taking shortcuts, to reach decisions at speed.
  • 10.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 10 Framing effect
  • 11.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 11 Conversion rate has doubled…
  • 12.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 12 … or 90% of our audience do not convert.
  • 13.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 13 Whilst conversion rate has doubled YOY, 90% of our audience do not convert. Continual improvement provides an exciting growth opportunity.
  • 14.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 14 Causal illusion
  • 15.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 15 Correlation is incorrectly implied as causation. P=0.64
  • 16.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 16 Increased ice cream consumption causing more shark attacks?!
  • 17.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 17 Increased shark attacks causing people to eat more ice cream?!
  • 18.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 18 P=0.61 P=0.85 Air temperature is the causation
  • 19.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 19 Anchoring effect
  • 20.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 20 Our first reaction is to panic that CPC sessions are in sharp decline. This Year Last Year CPC sessions 479,310 634,825
  • 21.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 21 See the whole picture & mitigate anchoring effect This Year Last Year % change CPC sessions 479,310 634,825 -24% Spend £923,530 £1,006,122 -8% Cost/session £1.93 £1.58 22% Engagement % 53% 49% 8% Revenue £4,406,517 £4,385,059 0% ROAS 477% 436% 9%
  • 22.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 22 We can mitigate visual bias, with a high level of control. DATA COGNITIVE VISUAL
  • 23.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 23 Scale manipulation
  • 24.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 24 Trend exaggeration through a biased scale.
  • 25.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 25 A fair scale provides an unbiased view of the visualisation.
  • 26.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 26 Bias can also occur using an inconsistent timeframe.
  • 27.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 27 Making trends appear biased & difficult to interpret.
  • 28.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 28 Correlation illusion
  • 29.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 29 There is no correlation in this dataset. P=0.08
  • 30.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 30 A ‘best-fit’ trend line introduces bias & implies correlation.
  • 31.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 31 A ‘best-fit’ trend line introduces bias & implies correlation.
  • 32.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 32 A ‘best-fit’ trend line introduces bias & implies correlation.
  • 33.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 33 Visual distortion
  • 34.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 34 Pie & donut charts introduce visual distortion & bias.
  • 35.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 35 3 dimensional visuals exaggerate biases further.
  • 36.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 36 A bar chart provides clarity & mitigates bias.
  • 37.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 37 Colour choice can bias how data is visualised.
  • 38.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 38 Cognitive bias introduced through choice of colour.
  • 39.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 39 Cognitive bias introduced through colour shading.
  • 40.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 40 Accessibility is critical, in mitigating visual bias.
  • 41.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 41 Add symbol markers to provide visual distinction.
  • 42.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 42 Patterns provide visual distinction to bar charts.
  • 43.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 43 Alt text, to provide text descriptions for data visuals.
  • 44.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 44 Tables & shapes aid accessibility This Year Last Year % change CPC sessions 479,310 634,825 -24% Spend £923,530 £1,006,122 -8% Cost/session £1.93 £1.58 22% Engagement % 53% 49% 8% Revenue £4,406,517 £4,385,059 0% ROAS 477% 436% 9%
  • 45.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 45 Five takeaways to uncover & mitigate bias in visualisations.
  • 46.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 46 Bias exists in three core areas of data visualisation. DATA COGNITIVE VISUAL
  • 47.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 47 High Accuracy High Precision High Accuracy Low Precision Low Accuracy High Precision Low Accuracy Low Precision Accuracy Precision Survivorship bias in data can be identified by thinking critically.
  • 48.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 48 Cognitive biases: Framing effect Causal illusion Anchoring effect
  • 49.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 49 Visual biases: Scale manipulation Correlation illusion Visual distortion Colour choice
  • 50.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 50 Accessibility: Data markers Patterns Alt text Tables & shapes
  • 51.
    Copyright 2024 PMGWorldwide LLC. All rights Reserved 51 Uncover & mitigate bias in data visualisations.
  • 52.