Keynote for World IA Day, answering the question "When, Where and How does Understanding occur?" Specifically, this talk discussed (1) interactions (and embodiement) (2) how new technology is changing the "information environments" we design for, and (3) a bit about perceptions and cognition.
6. What is the purpose of a map?
Navigation
Orientation
Discovery
Deļ¬nition
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
-paths and core
-iPhone navigation example
8. ā¦or this map?
By studying the similarities and diļ¬erences between human genes and those of other
organisms, researchers can discover the functions of particular genes and identify
which genes are critical for life.
11. What is the purpose of a map?
Navigation
Orientation
Discovery
Deļ¬nition
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
-paths and core
-iPhone navigation example
12. What is the purpose of a map?
Navigation
Orientation
Discovery
Deļ¬nition
Understanding
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
What patterns do I
see? How do things
relate? What can I
infer from this?
-paths and core
-iPhone navigation example
13. DESIGN FOR
UNDERSTANDING
Navigation
Orientation
Discovery
Deļ¬nition
Understanding
How do I get to...?
Where am I? Where
can I go from here
What is nearby?
What can I do from
here?
Where are the edges?
What are the
boundaries?
What patterns do I
see? How do things
relate? What can I
infer from this?
-paths and core
-iPhone navigation example
Learning through playful,
visual interactions.
22. āThe approach to teaching without
words that Iām proposing makes heavy
use of interactivity and instant
informative feedback.ā
STMath
http://www.creativitypost.com/education/teaching_without_words
25. from āToward a Deeper Understanding of the Role of Interaction in Information Visualizationā
26. Name
User Intent
Select
mark something as interesting
Explore
show me something else
Reconfigure
show me a different arrangement
Encode
show me a different
representation
Abstract/Elaborate
show me more or less detail
Filter
show me something
conditionally
Connect
show me related items
from āToward a Deeper Understanding of the Role of Interaction in Information Visualizationā
28. 3 Basic Interactions:
Conversing
conveying intended actions to a VR through language
(i.e., the mouth and talking).
Manipulating
touching, grasping, or handling visually perceptible
aspectsofaVR(i.e.,thehandsandhandling)
Navigating
moving from one location or piece of information in a
VR to another (i.e., the feet and walking).
from āInteraction and the epistemic potential of digital librariesā
29. 3 Basic Interactions:
Conversing
conveying intended actions to a VR through language
(i.e., the mouth and talking).
Manipulating
touching, grasping, or handling visually perceptible
13 Task-Based Interactions:
aspectsofaVR(i.e.,thehandsandhandling)
Navigating
Animating
Composing
moving from one initiatingor piece of information in a creating a new VR by putting
location and, optionally,
VR to another (i.e., the feet and walking).
controlling motion in a VR.
together independent visual
elements.
Annotating
placing informative marks, or
Cutting
meta-information, on or around a
removing extraneous elements
VR.
from a VR.
Chunking
grouping independent, but related,
visual elements into a uniļ¬ed
visual structure.
Cloning
creating an identical copy of a VR,
in whole or in part.
Filtering
exposing, concealing, or
transforming elements of a VR
that possess certain characteristics
or match certain criteria.
Fragmenting
dismantling aVR into its
component parts.
Collecting
gathering visual elements for
future use.
from āInteraction and the epistemic potential of digital librariesā
Probing
acquiring more detailed
information from a VR.
Rearranging
altering the spatial position and/or
the orientation of a VR, or the
components within it.
Repicturing
displaying a VR in a new or
different way
Searching
looking for, or ascertaining the
position of, speciļ¬c features,
elements or structures in a VR.
30. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Interactions
31. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Embodied Interactions
41. PRAGMATIC
(Actions performed to bring one physically closer to a goal)
VS
EPISTEMIC ACTIONS
(Actions that use the world to improve cognition)
Thinking, then doing.
Thinking through doing.
from āInteraction and the epistemic potential of digital librariesā
42. When, Where and How does
Understanding occur?
through interactions
directly with information
that help reveal patterns
Embodied Interactions
43. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Information Environments
that help reveal patterns
57. āThe āpolar bear bookā as it came to be known helped a
generation of information architects and user experience
designers make sense of the Web through structure,
organization, navigation, and search. Today, much of what
we wrote remains relevant, and yet new questions arise as
the world and the Web intertwingleā¦
How do we rise to the new challenges of creating paths and
places that bridge physical, digital, and cognitive spaces?ā
TOOLS / OBJECTS
āP E T E R M O RV I L L E
!
OTHER
PEOPLE
PHYSICAL
ENVIRONMENTS
(from the foreward to Pervasive Information Architecture)
āthe structural design of information environmentsā
60. Line between Digital and Physical is blurring
The world is becoming our information environment
61. Line between Digital and Physical is blurring
The world is becoming our information environment
Interactions will be much richer (and complex)
62. Line between Digital and Physical is blurring
The world is becoming our information environment
Interactions will be much richer (and complex)
#EXCITING!!
66. 10 distinct sensory modalities:
1. Visual (seeing)
2. Auditory (hearing)
3. Olfactory (smelling)
4. Gustatory (tasting)
5. Vestibular (sense of balance and body movement)
Everything your brain knows, it knows
because of your body (your senses)
6. Tactile (touching)
7. Thermoreceptive (feeling temperature)
8. Proprioceptive (positioning and movement of the extremities)
9. Introceptive (body condition and organ activity)
10. Nocioceptive (feeling pain)
(from Michael Haverkamp)
76. Dan Rubin
@Dan_Rubin_NY
Enchanted objects are incredibly purpose built - and you won't
need nav or a ui #enchantobj #SXSW
āFrom Human-Computer Interaction
to Human-Information Interactionā
78. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Information Environments
that help reveal patterns
79. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
81. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
82. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
Internal Representations
86. HEARING
TASTE
SMELL
TOUCH
VISION
(THE WORLD OUT THERE)
STIMULUS
(THE WORLD YOU PERCEIVE)
SENSORY ORGANS
PERCEPTUAL ORGAN
ICONIC
MEMORY
SHORT-TERM
MEMORY
BALANCE
Reality
PAIN
TIME
TEMPERATURE
AND
MORE!
Simulation
LONG-TERM
MEMORY
87. (THE WORLD YOU PERCEIVE)
(THE WORLD OUT THERE)
Reality
Simulation
101. Your brain constructs (an experience) of reality.
Perception is not a process of active
absorption but of active construction based
on prior experiences and memories.
102. Why do we know these are all the letter A?
A A A
A
A A A A
A AA A
111. āMessage of Love from the Dolpinsā
(Message dāAmour des Dauphins)
If you look at the vase youāll probably agree
that it depicts a man holding and kissing a
woman from behind. What if I told you that
the image in fact depicts a number of
dolphins?
In fact it depicts both - itās all a matter of how
your brain interprets it. Kids, who are
āinexperiencedā tend to see the dolphins.
Grownups tend to see the loving couple, Some
grownups canāt even see the dolphins if they
try really hard.
Itās all about what the brain expects and
knows. If you know how to see a certain
pattern, youāre more likely to see that pattern.
112. āMessage of Love from the Dolpinsā
(Message dāAmour des Dauphins)
If you look at the vase youāll probably agree
that it depicts a man holding and kissing a
woman from behind. What if I told you that
the image in fact depicts a number of
dolphins?
In fact it depicts both - itās all a matter of how
your brain interprets it. Kids, who are
āinexperiencedā tend to see the dolphins.
Grownups tend to see the loving couple, Some
grownups canāt even see the dolphins if they
try really hard.
Itās all about what the brain expects and
knows. If you know how to see a certain
pattern, youāre more likely to see that pattern.
113. Changing the label on wine
bottles changes the taste
http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price
114. brain scans confirmed that
people don't just think the
more expensive (but identical)
wine tasted betterāit actually
really did taste betterā¦
Changing the label on wine
bottles changes the taste
http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price
115.
116. āHow fast was the car going when
it hit the other car?ā
āHow fast was the car going when
it smashed into the other car?ā
117. āHow fast was the car going when
it hit the other car?ā
āHow fast was the car going when
it smashed into the other car?ā
118. When, Where and How does
Understanding occur?
through interactions
Embodied Interactions
directly with information
Spatial-Visual
Information Environments
that help reveal patterns
Internal Representations
122. MACHINES TALKING TO MACHINES
INFORMATION ENVIRONMENTS
ā¦and that whole
āpervasive IAā thing
Wearables
Digital
Things
Digital
Environments
PEOPLE
TOOLS / OBJECTS
Connected Media /
Devices
The World āOutsideā
INTERACTIONS
The World āInsideā
REPRESENTATIONS
Perception & Cognition
PHYSICAL
ENVIRONMENTS
124. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
125. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
Maps that celebrate and amplify
human ingenuity.
126. We need new maps.
Maps that help us, as practictioners,
architect exciting new information systems.
Maps that celebrate and amplify
human ingenuity.
Maps that help us to understand
what is unknown.