EVOLUTION OF THE TECHNOLOGY
Sixth sense is a wearable gesture interface that augments the physical world around
us with the digital world.
This technology is developed by Pranav Mistry ,a PhD student of MIT Media Lab.
It lets us use natural hand gestures to interact with the digital world.
It comprises a pocket projector ,a mirror and a camera. The hardware components
are coupled in pendent like mobile wearable device.
Captures an object in view and tracks the users hand gestures.
Can recognize individuals, pictures, books etc.
Acts as an digital eye, connecting you to the world of digital information.
Sends data to the mobile device for processing.
The projector projects visual information enabling surfaces and physical objects used as interfaces.
A tiny LED projector displays data sent from smart phone on any surface.
The projector itself contains a battery inside, with 3 hours of battery life.
The downward facing projector projects the output The web enabled smart phone in the
image on the mirror.
The mirror reflects image on the desired surface.
user’s pocket is used to process data.
It is at the tip of the user’s fingers.
Marking the user’s fingers with red, yellow, green, blue tape help the web
cam recognize the gestures.
The movement and arrangement of these makers are interpreted into gestures
that act as interaction instructions for the projected application interfaces
HOW IT WORKS?
Send for processing
If you fashion your index fingers and thumbs into a
square ( “framing” gesture) we can take a snap.
After taking the photos, we can project them onto a
surface, and use gestures to sort through the
photos, and organize and resize them.
We can arrange those pictures. The user can zoom in
or zoom out by just using hand movements
GETS BOOK INFORMATION
The system can project Amazon ratings on that book, as
well as reviews and all other relevant information.
FEED INFORMATION ON PEOPLE
The system will project some relevant information about a person
such what he/she does, where they work, and so on.
GET FLIGHT UPDATES
The system will recognize your boarding pass and you know
whether your flight is on time and if the gate has changed.
MAKE A CALL
You can use sixth sense to project a keypad onto your hand, then
use the that key pad to make a call.
CREATES MULTIMEDIA READING
Sixth sense can be programmed to project related videos onto
news paper articles you are reading.
The drawing application lets the user draw on any surface by
tracking the fingertip movements of the user’s index finger
CHECK THE TIME
Draw a circle on your wrist to get virtual watch that gives
you the correct time
Microphone from the camera clips on to the
paper now the sound of the paper is now exactly
untouching the paper. Then camera tracks the
where the fingers are moving
GETS PRODUCT INFORMATION
Sixth sense uses image recognition or marker technology to
recognize products we pick up and feed us information on
Supports multi-touch and multi-user interaction
Connectedness between world and information
Data access directly from machine in real time
Mind map the idea anywhere
Sixth Sense recognizes the objects around us , displaying information
automatically and letting us to access it in any way we need.
The Sixth Sense prototype implements several applications that
demonstrate the usefulness, viability and flexibility of the system.