Sense is a wearable gesture interface
that augments the physical world around us
with digital information and lets you use
natural hand gestures to interact with that
It is developed by Pranav Mistry,a Phd
student in the Fluid Interfaces Group at MIT
Sixth sense prototype is comprised of - a
pocket projector,a mirror and a camera.
camera,mirror and projector are
smartphone device that can easily fit into
A software then processes the data that is
collected by capturing device and produces
Pen that can draw in 3d
Google Maps in physical
Why sixth sense
physical world is painted with digital
can carry your digital world with you
wherever you go.
can start with any wall or any other
surface as an interface even your palm.
It captures an object in view and tracks the
users hand gestures.
It sends data to smartphone.
It acts as a digital eye,connecting you to
world of digital information.
The projector projects visual information enabling
surfaces and physical objects to be used as
The projector contains a battery inside with 3 hours
of battery life.
A tiny LED projector displays data sent from the
smartphone on any surface in view.
3) COLOR MARKERS:
It is at the tip of user's fingers.
Marking the user's fingers with color tapes
helps the web cam recognize gestures.
The movements and arrangements of these
markers are interpreted into gestures that act as
instructions for projected application interfaces.
The usage of mirror is significant as the
projector dangles pointing downwards from
A web enabled smartphone in user's pocket
processes the video data.
Other software searches web and interprets
the hand gestures.
Firstly,the images, pictures or gestures
are captured by the camera.
These images are then send to smartphone
After being processed,the information is
send to the projector.
The projector projects the images onto the
The mirror displays the information on the
Check the time: Draw a circle on your
wrist to get a virtual watch that gives you
2) Create multimedia reading experiences:
Sixth sense can be programmed to project
related videos onto newspaper articles
you are reading.
3) Make a call:
You can use sixth sense to project keypad
onto your hand,then virtual keypad to make a
4) Call a map:
With map application,we can call up map of
our choice and then use thumbs and index
fingers to navigate a map.
5) Drawing application:
By using sixth sense prototype,we can draw
on any surface by using our fingers.
6 ) Zooming features:
By using sixth sense prototype,the user can
zoom in or zoom out pictures by using
intuitive hand movements.
Connects digital world and physical world.
Supports multitouch and multiuser
Data access directly from machine in real
sense recognizes the objects around
us,displaying information automatically and
letting us to access it in anyway we need.
simple,it is almost like installing a digital
system(computer) into our body and further
making it as sixth sense of our body.
sixth sense prototype implements
several applications that demonstrate the
usefulness and flexibility of system.