1.
Characteristics of Human receptors and
effectors
Problems of Current Human machine
interactions
Take advantages of human organs

2.
Receptors: 10**9 bit/sec of information
(Sight: 10**6 .. 10**8 bit/sec)
Effectors: 10**7 bit/sec of information
Humans World
Human has receptors (5 senses) and effectors with
100 billion neurons in total.

3.
Eyes for seeing
Ears for hearing
Haptic
Tongue for tasting
Nasal for smelling

4.
Audio organs for speaking
Hand/finger/body muscle
motor systems

5.
Commanding
(click, tap)
Text Input
(keyboard)
Pointing
(mouse,
tap)

6.
Voice
become
noises to
the
others.
Voice
doesn’t
keep
privacy.

7.
Seeing is
3D Current HMI
is 2D

8.
Commanding
(click, tap)
Text Input
(keyboard)
Pointing
(mouse,
tap)
Those are very simple
operations. Finger dexterity
is far beyond current HMI.
Finger is
slower than
seeing.
Finger is
slower than
speaking.

9.
Real interaction is multi-
modal.
• E.g., you look ahead while
driving a car by hand/foot, and
you can speak while driving.
Current HMI is uni-modal.
• Seeing for machine output
• Finger manipulation for machine
input

10.
Multi-
modal,
parallel
process
Wearable
monitor
system
Gaze
tracking (3D)
as a pointing
method
Silent speech
Muscle or
gesture
language +
Finger-ware
Haptic, BMI,
…?