The document provides information about how humans perceive and process information. It discusses topics like cognition, cognitive science, learning styles, sensation and perception, visual perception, memory, Gestalt principles, and machine perception. For example, it explains that cognition encompasses many intellectual functions and processes like attention, memory, reasoning, and decision making. It also outlines several Gestalt principles of visual organization like similarity, proximity, and closure.

1. data & content design
Frieda Brioschi - frieda.brioschi@gmail.com
Emma Tracanella - emma.tracanella@gmail.com
HOW WE PERCEIVE INFORMATION
LESSON 6 - 2019/20

2. WITH YOUR DATA PROJECT
LET’S START

3. data & content design
LESSON 6
4
UPDATES ON YOUR PROJECT
Photo by William Iven on Unsplash

4. PAST
A LESSON FROM THE

5. data & content design
LESSON 6
BULLET HOLES ON PLANES
During World War II, researchers from the
Center for Naval Analyses had conducted
a study of the damage done to aircraft that
had returned from missions, and had
recommended that armor be added to the
areas that showed the most damage (red
dots).
6

6. data & content design
LESSON 6
A DIFFERENT PERSPECTIVE
But Abraham Wald, a mathematician, came to
a different conclusion: the red dots only
represented the damage on planes that came
home.
The holes in the returning aircraft, then,
represented areas where a bomber could take
damage and still return home safely.
7
Wald proposed that the Navy reinforce areas where the returning
aircraft were unscathed, since those were the areas that, if hit, would
cause the plane to be lost.

7. data & content design
LESSON 6
THE SURVIVORSHIP BIAS
It's the logical error of concentrating on the people or things that made it past
some selection process and overlooking those that did not, typically because of
their lack of visibility. This can lead to false conclusions in several different ways.
(Wikipedia)
In our story, it’s when everyone considered what survived instead of focusing on
the ones that didn’t.
8

8. INFORMATION
PERCEIVING AND PROCESSING

9. data & content design
THE MENTAL ACTION OR PROCESS OF ACQUIRING
KNOWLEDGE AND UNDERSTANDING THROUGH
THOUGHT, EXPERIENCE, AND THE SENSES.
- lexico.com
LESSON 6
10

10. data & content design
LESSON 6
COGNITION
It encompasses many aspects of intellectual functions and processes such as
attention, the formation of knowledge, memory and working memory, judgment
and evaluation, reasoning and "computation", problem solving and decision
making, comprehension and production of language.
Cognitive processes use existing knowledge and generate new knowledge.
(Wikipedia)
11

11. data & content design
LESSON 6
COGNITIVE SCIENCE
According to George Miller, fields that
contributed to the birth of cognitive
science, includ linguistics, neuroscience,
artificial intelligence, philosophy,
anthropology, and psychology.
▸ Img by Charles Lowe, CC-BY-SA
12

12. data & content design
LESSON 6
HOW WE LEARN
How we process information and experiences (what we do with new information and
experiences) varies along a continuum from “reflective observation” to “active
experimentation.” We process our experiences by reflecting about them, filtering new
learning through our experiences. Then we process new learning by acting on it, by trying
things out.
The combination of how we perceive and process information and experiences forms our
unique learning style.
▸ https://fyi.extension.wisc.edu/wateroutreach/water-outreach-education/what-are-beps/knowledge-
area-beps-2/learning-styles-introduction/learning-styles-perceiving-and-processing-information/
13

13. data & content design
LESSON 6
LEARNING STYLES
We perceive and process information and experiences in different ways.
We perceive something new through our senses (direct experience), and then we
use our cognitive abilities to identify the new thing (abstract conceptualization).
This movement along the “perceiving” dimension is related to the “processing”
dimension.
People are equipped with senses that help us to take in the world around us. Our
senses have the ability to convert real-world information into electrical information
that can be processed by the brain. The way we interpret this information is what
leads to our experiences of the world.
14

14. data & content design
LESSON 6
SENSATION AND PERCEPTION
The physical process during which our sensory organs—those involved with
hearing and taste, for example—respond to external stimuli is called sensation.
After our brain receives the electrical signals, we make sense of all this
stimulation and begin to appreciate the complex world around us. This
psychological process—making sense of the stimuli—is called perception.
▸ https://nobaproject.com/modules/sensation-and-perception
15

15. data & content design
LESSON 6
EXPERIENCE MATTERS
It is clear that our experience influences how our brain processes things.
Your past experience has changed the way you perceive the writing in the triangle!
16

16. data & content design
LESSON 6
ELLEMME FOR IGPDECAUX @PORTA GARIBALDI
17

17. data & content design
LESSON 6
HUMAN FIELD OF VISION
18Img by Zyxwv99, CC-BY-SA

18. data & content design
LESSON 6
VISUAL PERCEPTION
19
Visual perception is important because most information that we receive is
conveyed visually.
How do we read or pick up information from complex visual stimuli?
We do it by jumping our eye around to pick up different parts of the image that
we're looking at, because we can only really get detailed information from the
central part of the field of view.
So in order to see all the different parts we have to jump around, through
multiple eye fixations to pick up the information.

19. data & content design
LESSON 6
..AND YOU?
20

20. data & content design
LESSON 6
GOLDEN RULES
21
▸ Make important information visible ("Did users actually see the information
that I was trying to present to them or did they miss it entirely?”)
▸ Information that is not immediately visible and perceivable by readers, is
less likely to be noticed ("Did people ever actually see the information that
you are trying to present to them?”)
▸ https://www.coursera.org/lecture/introtoux-principles-and-processes/visual-perception-part-1-v7dlk

21. data & content design
LESSON 6
KOLB'S EXPERIENTIAL LEARNING
22https://en.wikipedia.org/wiki/Kolb's_experiential_learning

22. VISUALIZATION
TOWARDS DATA
Photo by ev on Unsplash

23. data & content design
LESSON 6
BASICS
▸ Visual perception is selective. We selectively pay attention to
things that catch our attention.
▸ Our eyes are drawn to familiar patterns. Visualization must take
into account what people know and expect.
▸ Our working memory is very limited.
▸ daydreamingnumbers.com/blog/visual-perception-data-visualization/
24

24. data & content design
Visual memory is a form of memory which preserves some characteristics of our
senses pertaining to visual experience.
The iconic and working memories are the ones that interact with visualizations
LESSON 6
VISUAL MEMORY
25

25. data & content design
LESSON 6
ICONIC AND WORKING
▸ Iconic: when we see the information remains in the iconic memory for a tiny
period of time; during it we process and store information automatically. This
process is called preattentive processing and it happens automatically, even
before we pay attention to the information. The preattentive process detects
several visual attributes.
▸ Working: The sensory information that is of interest to us is processed in the
working memory. The capacity of our working memory is between 5 to 9 similar
items (Miller’s Law: seven, plus or minus two). This capacity can be increased
by chunking, that is grouping similar items together.
26

26. data & content design
LESSON 6
CHUNKING
Data visualizations take advantage of chunking. When information is displayed in
the form of visuals that show meaningful patterns, more information can be chunked
together. Hence, when we look at a visual, we can process a great deal more
information than what we can when looking at the data in the form of a table.
For a visualization to be effective, we need to pay attention to not providing more
data than what our brains can process. It is also important to display the visual on a
screen or a single location, such that we can see it without having to scroll or
bounce back and forth between multiple locations.
27

27. data & content design
LESSON 6
GESTALT PRINCIPLES
Gestalt theory is based on the idea that the human brain will attempt to simplify and
organize complex images or designs that consist of many elements, by
subconsciously arranging the parts into an organized system that creates a whole,
rather than just a series of disparate elements.
There are six individual principles commonly associated with gestalt theory:
similarity, continuation, closure, proximity, figure/ground, and symmetry & order.
▸ https://www.toptal.com/designers/ui/gestalt-principles-of-design
28

28. data & content design
LESSON 6
SIMILARITY
Objects that share similar attributes (e.g., color or shape) are perceived as a group.
29
The squares here are all
equally spaced and the same
size, but we automatically
group them by color, even
though there's no rhyme or
reason to their placement.

29. data & content design
LESSON 6
PROXIMITY
30
Objects that are close together are perceived as a group.

30. data & content design
LESSON 6
CLOSURE
Open structures are perceived as closed, complete, and regular whenever there is a
way that they can be reasonably interpreted as such.
31
The brain completes the
white shapes, even
though they're not well
defined.

31. data & content design
LESSON 6
CONTINUITY
Objects that are aligned together or appear to be a continuation of one another are
perceived as a group.
32
The eye tends to want to
follow the straight line from
one end of this figure to the
other, and the curved line
from the top to the bottom,
even when the lines change
color midway through.

32. data & content design
LESSON 6
ENCLOSURE
Objects that appear to have a boundary around them (e.g., formed by a line or area
of common color) are perceived as a group.
33
Faces or a vase?

33. data & content design
LESSON 6
CONNECTION
Objects that are connected (e.g., by a line) are perceived as a group.
34

34. data & content design
LESSON 6
TEMPERATURE ANOMALIES BY COUNTRY
35
https://www.youtube.com/watch?v=PhbdyNnUliM

35. PERCEPTION
MACHINE
PHOTO BY JAREDD CRAIG ON UNSPLASH

36. data & content design
LESSON 6
MACHINE PERCEPTION
Machine perception is the capability of a computer system to interpret data in a manner that
is similar to the way humans use their senses to relate to the world around them.
The basic method that the computers take in and respond to their environment is through the
attached hardware. Until recently input was limited to a keyboard, or a mouse, but advances
in technology, both in hardware and software, have allowed computers to take in sensory
input in a way similar to humans.
Machine perception allows the computer to use this sensory input, as well as conventional
computational means of gathering information, to gather information with greater accuracy
and to present it in a way that is more comfortable for the user.
These include computer vision, machine hearing, and machine touch.
37

37. data & content design
LESSON 6
FACIAL RECOGNITION SYSTEM
A facial recognition system is a technology capable of identifying or verifying a
person from a digital image or a video frame from a video source.
There are multiple methods in which facial recognition systems work, but in general,
they work by comparing selected facial features from given image with faces within
a database.
Although the accuracy of facial recognition system as a biometric technology is
lower than iris recognition and fingerprint recognition, it is widely adopted due to its
contactless and non-invasive process.
38

38. data & content design
THIS RECOGNITION PROBLEM IS MADE DIFFICULT BY THE GREAT VARIABILITY IN HEAD
ROTATION AND TILT, LIGHTING INTENSITY AND ANGLE, FACIAL EXPRESSION, AGING, ETC.
(…)
YET THE METHOD OF CORRELATION (OR PATTERN MATCHING) OF UNPROCESSED OPTICAL
DATA, WHICH IS OFTEN USED BY SOME RESEARCHERS, IS CERTAIN TO FAIL IN CASES
WHERE THE VARIABILITY IS GREAT. IN PARTICULAR, THE CORRELATION IS VERY LOW
BETWEEN TWO PICTURES OF THE SAME PERSON WITH TWO DIFFERENT HEAD ROTATIONS.
Woody Bledsoe, 1966
LESSON 4
39

39. data & content design
LESSON 6
DEEPFACE
DeepFace is a deep learning facial recognition system created by a research group
at Facebook.
It identifies human faces in digital images. It employs a nine-layer neural net with
over 120 million connection weights, and was trained on four million images
uploaded by Facebook users.
The system is said to be 97% accurate, compared to 85% for the FBI's Next
Generation Identification system.
40

40. data & content design
LESSON 6
FB FACE RECOGNITION
41

41. data & content design
LESSON 6
APPLE FACE ID
Apple introduced Face ID on the flagship iPhone X as a biometric authentication system.
Face ID has a facial recognition sensor: "Romeo" the module that projects more than 30,000
infrared dots onto the user's face, and "Juliet" the module that reads the pattern. The pattern is sent
to a local "Secure Enclave" in the device's CPU to confirm a match with the phone owner's face.
The system will not work with eyes closed, in an effort to prevent unauthorized access.
The technology learns from changes in a user's appearance, and therefore works with hats, scarves,
glasses, and many sunglasses, beard and makeup.
It also works in the dark. This is done by using a "Flood Illuminator", which is a dedicated infrared
flash that throws out invisible infrared light onto the user's face to properly read the 30,000 facial
points.[34]
42
https://en.wikipedia.org/wiki/Facial_recognition_system

42. data & content design
LESSON 6
CHINESE AIRPORTS
43
https://www.youtube.com/watch?v=wcM5-E4Kz
As of late 2017, China has deployed
facial recognition and artificial
intelligence technology in Xinjiang.
Reporters visiting the region found
surveillance cameras installed every
hundred meters or so in several cities,
as well as facial recognition checkpoints
at areas like gas stations, shopping
centers, and mosque entrances.
https://www.youtube.com/watch?v=wcM5-E4Kze4

43. data & content design
LESSON 6
ANTI-FACIAL RECOGNITION SYSTEMS
44

44. data & content design
LESSON 6
ENOVIA SMART ROBOTS
45
Smart Robots has developed a
universal device that enables the
integration of cobots with human
activities.
The device can map the workspace in
real time, to recognize objects, to
command the robot to interact with
users and adapt to them, and to self-
learn new commands through
gestures.

45. data & content design
LESSON 6
277 PEOPLE IN 177 CARS
46
https://imgur.com/gallery/sCvRIEd

46. PERCEPTION
REPRESENTATION AND
Photo by ev on Unsplash

47. data & content design
LESSON 6
YOUR BIRTHDAY DATA
48
7/24/1997
4/25/1998
7/5/1996
7/17/1999
2/14/1998
7/20/1998
6/10/1998
5/13/1997
4/15/2019
5/8/1996
5/27/1994
2/10/1999
1/9/1997
9/5/1995
1/23/1998
3/24/1998
2/22/2019
3/28/1998
9/7/1999
11/6/1996
7/7/1998
5/8/1996

48. data & content design
LESSON 6
YOUR BIRTHDAY DATA - YEAR
49

49. data & content design
LESSON 6
YOUR BIRTHDAY DATA - DAY & MONTH
50