SixthSense is a wearable gesture-based device developed by Pranav Mistry that allows users to interact with information projected onto physical surfaces using natural hand gestures. It consists of a pocket projector, webcam, and mirror worn around the neck. The webcam tracks color markers on the user's fingers to recognize gestures and interact with projected interfaces for applications like making calls, viewing maps, checking the time, and obtaining information about books, products, and flights by scanning them. The system uses computer vision algorithms and augmented reality to seamlessly integrate digital information into the physical world in an intuitive way.

3. Extra Sensory Perception.
It involves the reception of information that not gained
through any of our five senses.
Aims to integrate online information and technology into
every day life

4. Sixth Sense Technology”, is the one of the latest invention
in the present technical arena.
It was developed by Pranav Mistry, a PhD student in the Fluid
Interfaces Group at the MIT Media Lab(Media Lab researchers
design Technologies).
SixthSense is a wearable “gesture based” device and lets
people use natural hand gestures to interact with that
information.
One great part of the device is its ability to scan objects or
even people and project out information regarding what you
are looking at.

5. Color Markers
Camera
Projector
Smart Phone
Mirror
Color Markers
Marking the user’s fingers with red,
yellow, green, and blue tape helps the
webcam to recognize gestures.
The movements and arrangements of
these markers are interpreted and that act
as interaction instructions for the projected
application interfaces.

6. Color Markers
Camera
Projector
Smart Phone
Mirror
Camera
A webcam captures and recognizes an
object in view and tracks the user’s hand
gestures using computer-vision based
techniques.
It sends the data to the smart phone.

7. Color Markers
Camera
Projector
Smart Phone
Mirror
Projector
A tiny LED projector displays data sent
from the smart phone on any surface
around the person.

8. Color Markers
Camera
Projector
Smart Phone
Mirror
Smart Phone
Smartphone runs the SixthSense
software, handles the connection to the
internet , processes the video data and
interprets the hand gestures form web cam
also sends data to projector for project the
application interface

9. Color Markers
Camera
Projector
Smart Phone
Mirror
Mirror
The usage of the mirror is significant as
the projector dangles pointing downwards
from the neck.

11. The Recent SixthSense prototype is composed of a
pocket projector, a mirror and a web camera and which is
hanged around the neck of a person.

13. AUGUMENTED REALITY
COMPUTER VISION BASED ALGORITHM

14. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get Product information
Get flight updates
Take pictures….etc
Make a call
Make a call by extend hand
on front of the projector the
number will appear for click

15. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
Call up a map
It lets the user to display
map on any physical surface
for find the destination,
user can use thumb and
index fingers for zoom and
navigate map

16. Check the time
To know the time by drawing a
circle on the wrist and watch will
appear
Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures

17. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
Multimedia reading experience
SixthSense system augments
physical objects the user is
interacting with by projecting
more information about these
object on them

18. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
Drawing application
The drawing application lets
the user draw on any surface by
tracking the fingertip movement
of the user index finger.

19. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
Get book information
SixthSense recognize the book
you pick up and gives the reviews
about the book also shows
Amazon rating on that book

20. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
Get product information
SixthSense recognize the
product you pick up feeds you
information on those product.

21. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
Get flight updates
The system will recognize the
boarding pass let you to know
that whether u r flight is on time
and if the gate is changed

22. Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
Take pictures
If we fashion our index fingers
and thumb fingers in to a square
, the system will snap a photo.

23. Gesture controlled wearable device
Portable and easy to carry
Open source and cost effective
User friendly interface
Support multi touch interface

24. To get rid of color markers
To incorporate camera and projector inside mobile
computing device
Applying this technology in various interest like gaming
,education...etc
To have a 3D tracking

25. The key here that SixthSense system recognize the objects
around you, displaying information automatically and let you
to access it in any way you want , In the simplest possible way.