The document describes SixthSense, a wearable gesture-based device that allows users to interact with information projected onto physical surfaces using natural hand gestures. The SixthSense prototype consists of a pocket projector, mirror, and webcam hung around the user's neck. It uses computer vision techniques to track colored markers on the user's fingers to recognize gestures and project augmented information about objects, maps, time, etc. onto nearby surfaces. The system aims to seamlessly integrate digital information into everyday physical environments and interactions through an open source, cost-effective, and user-friendly gesture interface.

3. Extra Sensory Perception.
It involves the reception of information that not gained
through any of our five senses.
Aims to integrate online information and technology into
every day life

4. Sixth Sense Technology”, is the one of the latest invention
in the present technical arena.
It was developed by Pranav Mistry, a PhD student in the Fluid
Interfaces Group at the MIT Media Lab(Media Lab researchers
design Technologies).
SixthSense is a wearable “gesture based” device and lets
people use natural hand gestures to interact with that
information.
One great part of the device is its ability to scan objects or
even people and project out information regarding what you
are looking at.

5. Color Markers
Color Markers
Camera
Projector
Smart Phone
Mirror
Marking the user’s fingers with red,
yellow, green, and blue tape helps the
webcam to recognize gestures.
The movements and arrangements of
these markers are interpreted and that act
as interaction instructions for the projected
application interfaces.

6. Color Markers
Camera
Camera
Projector
Smart Phone
Mirror
A webcam captures and recognizes an
object in view and tracks the user’s hand
gestures using computer-vision based
techniques.
It sends the data to the smart phone.

7. Color Markers
Projector
Camera
Projector
Smart Phone
Mirror
A tiny LED projector displays data sent
from the smart phone on any surface
around the person.

8. Smart Phone
Color Markers
Camera
Projector
Smart Phone
Mirror
Smartphone runs the SixthSense
software, handles the connection to the
internet , processes the video data and
interprets the hand gestures form web cam
also sends data to projector for project the
application interface

9. Color Markers
Mirror
Camera
Projector
Smart Phone
Mirror
The usage of the mirror is significant as
the projector dangles pointing downwards
from the neck.

11. The Recent SixthSense prototype is composed of a
pocket projector, a mirror and a web camera and which is
hanged around the neck of a person.

13. AUGUMENTED REALITY
COMPUTER VISION BASED ALGORITHM

14. Make a call
Make a call
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get Product information
Get flight updates
Take pictures….etc
Make a call by extend hand
on front of the projector the
number will appear for click

15. Make a call
Call up a map
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
It lets the user to display
map on any physical surface
for find the destination,
user can use thumb and
index fingers for zoom and
navigate map

16. Make a call
Check the time
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
To know the time by drawing a
circle on the wrist and watch will
appear

17. Make a call
Multimedia reading experience
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
SixthSense system augments
physical objects the user is
interacting with by projecting
more information about these
object on them

18. Make a call
Drawing application
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
The drawing application lets
the user draw on any surface by
tracking the fingertip movement
of the user index finger.

19. Make a call
Get book information
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
SixthSense recognize the book
you pick up and gives the reviews
about the book also shows
Amazon rating on that book

20. Make a call
Get product information
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
SixthSense recognize the
product you pick up feeds you
information on those product.

21. Make a call
Get flight updates
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
The system will recognize the
boarding pass let you to know
that whether u r flight is on time
and if the gate is changed

22. Make a call
Take pictures
Call up a map
Check the time
Multimedia reading experience
Drawing application
Get Book information
Get product information
Get flight updates
Take pictures
If we fashion our index fingers
and thumb fingers in to a square
, the system will snap a photo.

23. Gesture controlled wearable device
Portable and easy to carry
Open source and cost effective
User friendly interface
Support multi touch interface

24. To get rid of color markers
To incorporate camera and projector inside mobile
computing device
Applying this technology in various interest like gaming
,education...etc
To have a 3D tracking

25. The key here that SixthSense system recognize the objects
around you, displaying information automatically and let you
to access it in any way you want , In the simplest possible way.