The document describes the Sixth Sense, a wearable gestural interface developed by Pranav Mistry that augments the physical world with digital information and allows interaction through natural hand gestures. It consists of a camera, projector, mirror, and mobile device. The camera tracks hand gestures which are sent to the mobile device for processing. The projector then displays information on surfaces based on the gestures. Some example applications include drawing on surfaces, making calls, and accessing maps and photos through gestures.

1. PRESENTATION TOPIC

2. CONTENTS
Introduction
Components
Working
Application

3. • wearable gestural interface that augments the physical world around
us with digital information and lets us use natural hand gestures to
interact with that information.
• it was developed by Pranav Mistry, a PhD student in the Fluid
Interfaces Group at the MIT Media Lab.
• Intangible Tangible (digital info.)
• allowing us to interact with this information via natural hand

4. COMPONENTS
• Camera
• Microphone(optional)
• Projector
• Mirror
• Mobile component
• Coloured markers

5. • Captures an object
• tracks the user’s hand gestures
• It sends the data to smart
phone
• digital eye,
Smart phone
projector Project visual info.
• Display info. sent from smart
phone on any surface/object

6. • mirror is significant as the
projector dangles pointing
downwards from the neck.
• Processes the video data.
• Other software searches the
Web and interprets the hand
gestures.
COLOURED MARKERS
• Helpsthewebcam torecognizegestures.
• Act as interaction instructions for the projected
applicationinterfaces.

7. HOW IT WORK ?
camera
projector
Smart phone
mirror object

9. Draw on any surface by tracking user’s index
fingure.
MULTIMEDIA READING EXPERIENCES
project related videos onto newspaper
articles you are reading
Draw a circle on your wrist to get a virtual watch

10. MAKE A CALL
project a keypad onto your hand, then use that
virtual keypad to make a call.
Call up a map
call up the map of our choice.
use thumbs and index fingers to navigate.
Take pictures
snap a photo.
Brows on any object and perform operation on that
photos.

11. • Portable
• Supports multi-touch and multi-user interaction
• Connectedness between world and information
• Cost effective
• Data access directly from machine in real time
• It is an open source

12. • Recognizes the objects around us, displaying information
automatically and letting us to access it in any way we need.
• The Sixth Sense prototype implements several applications
that demonstrate the usefulness, viability and flexibility of the
system
• Allowing us to interact with this information via natural hand
gestures
• The potential of becoming the ultimate "transparent" user
interface for accessing information about everything around us