MutiModal Technology, Mobile & Wearable Computing

1. Multi-Modal Technology

2. Multi-Modal Systems
Use more than one sense (mode) of
interaction
Eg: visual or aural (perceived by ear) senses
– a text processor may speak the words
as well as echoing them to the screen.

3. Multi-Media Systems
Use a number of different media to
communicate information
Eg: a computer-based teaching system –
may use video, animation, text and still
images (different media).

4. Alternative Modes of HCI
Touch in the interface
Sound in the interface
Handwriting recognition
Gesture recognition

5. Alternative Modes of HCI
Touch in the interface
Electronic braille displays
Force feedback devices in VR equipment
Sound in the interface
Speech-based word processors
Interactive systems that give feedback
Mobile application

6. Alternative Modes of HCI
Handwriting recognition
PDA such as Palm Pilot
Tablet PC
Gesture recognition
Data glove
Positioning sensing devices such as MIT
Media Room

7. Wearable Computing
Yuanfang Cai
Dec. 6, 2000

8. What is wearable computing
 Wearable
 Portable while
operational
 Hand-free or one-
handed operation
 unobtrusive
 Augmented reality
 situation aware

9. Wearable Computing
Wearable computing facilities a new form
of human computer interaction comprising
a small body-worn computer that is
always on and always ready and
accessible.

10. Wearable Computing
The computer is always with the user and
always interacting, completely intertwined
with the user.
should be a continuation of its user,
working like a natural part of the body,
not an external apparatus
Allows the user to explore virtual
environments and see the real world with
virtual objects superimposed

11. >>Wearable Computer Implementation>>Input Device
 speech recognizer
 keyboard alternative including chording keyboards and special
purpose keyboards
 mouse alternatives including trackballs, joysticks
 tab alternatives including buttons, dial
 eye trackers
 head trackers
 pen
 gesturing
 bar code reader
 video capture devices, microphones
 other exotic devices such as skin sensors

12. >>Wearable Computer Implementation>>Input Device
Wireless Finger Ring
 Detection of finger-tip typing
 Wireless Link
 Block Diagrams
 Chording METHOD

13. >>Wearable Computer Implementation>>Output
Device
head mounted displays (HMDs)
flat panels, text to speech
tactile output
non speech auditory output
paper and olfactory output (scent)

14. >>Wearable Computer Implementation>>Output
Device
Augmented Reality
Typical Augmented Reality System
Display Technologies in Augmented
Reality

15. Mobile Computing
Mobile computing is the ability to use
computing capability without a pre-
defined location and/or connection to a
network to publish and/or subscribe to
information.

16. Mobile Computing
Systems running on small, lightweight
computing devices
Technology so small it fits in one’s hand or
pocket
Portability-are fundamentally different from
stationary machines such as desktop computers
Small Storage Capacity
Low Power
Allows user to access information while moving
through physical space