Sixth Sense Technology, developed by Pranav Mistry, integrates digital information into the physical environment, allowing users to interact with it through natural hand gestures using a portable device comprised of a camera, projector, mirror, smartphone, and color markers. The technology enables various applications, such as making calls, checking maps, and accessing product information, but faces challenges regarding market release, privacy, and health concerns. Despite its advantages in portability and multi-user interaction, further engineering and modifications are necessary before it can be commercially available.

1. Prepared By,
FATHIMA MIZNA.K
1 sem BCA
SAFI INSTITUTE OF
ADVANCE STUDY, VAZHAYUR
WEARYOURWORLD!!

2. INTRODUCTION
 Sixth Sense Technology integrates
digital information into the physical
world and its objects, making the
entire world, your computer.
 It can turn any surface into a
touch-screen for computing,
controlled by simple hand gestures.
 It is not a technology which is
aimed at changing human habits
but causing computers and other
machines to adapt to human needs.
 It also supports multi user and
multi touch provisions.

3. HISTORY
 Steve Mann is the
father of Sixth
Sense technology
who made a
wearable computer
in 1970.
STEVE MANN

4. There afterit was used and
implemented by an Indian,
Pranav Mistry , a PhDstudent in
the Fluid Interfaces Group at the
MIT Media Lab.

5. PRANAV MISTRY, The developer of
sixth sense device.

7. About the technology
• Sixth Sense is a wearable gestural interface that augments the
physical world around us with digital information and lets us use
natural hand gestures to interact with that information.
• It was developed by Pranav Mistry, a PhD student in the Fluid
Interfaces Group at the MIT Media Lab.
• SixthSense bridges the gap by bringing intangible, digital
information out into the tangible world, and allowing us to interact
with this information via natural hand
• SixthSense comprises a pocket projector, a mirror and a camera.
The hardware components are coupled in a pendant like mobile
wearable device

8. COMPONENTS
The hardware components
are coupled in a pendant
like mobile wearable
device.
Camera
Projector
Mirror
Mobile Component
Colored Markers

10. 1.CAMERA
Captures an object in
view and tracks the
user’s hand gestures.
It sends the data to
smart phone.
It acts as a digital eye,
connecting you to the
world of digital
information.

11. 2.PROJECTOR
 The projector projects visual
information enabling surfaces and
physical objects to be used as
interfaces.
 The project itself contains a battery
inside, with 3 hours of battery life.
 A tiny LED projector displays data
sent from the smart phone on any
surface in view–object, wall, or
person.

12. 3.MIRROR
 The usage of the mirror is
significant as the projector
dangles pointing downwards
from the neck.
4.Smart Phone.
 A Web-enabled smart phone in
the user’s pocket processes the
video data.
 Other software searches the
Web and interprets the hand
gestures

13. 5.COLOR MARKERS5.COLOR MARKERS
o It is at the tip of the user’sIt is at the tip of the user’s
fingers .fingers .
o Marking the user’s fingers withMarking the user’s fingers with
red, yellow, green, and blue tapered, yellow, green, and blue tape
helps the webcam recognizehelps the webcam recognize
gestures.gestures.
o The movements andThe movements and
arrangements of these makersarrangements of these makers
are interpreted into gestures thatare interpreted into gestures that
act as interaction instructions foract as interaction instructions for
the projected applicationthe projected application
interfaces.interfaces.

17. 1.MAKE A CALL
You can use the Sixth Sense to
project a keypad onto your hand,
then use that virtual keypad to
make a call.
2.CALL UP A MAP
With the map application we can call
up the map of our choice and then use
thumbs and index fingers to navigate
the map.

18. 3.CHECK THE TIME
Draw a circle on your wrist to get a
virtual watch that gives you the
correct time.
4.CREATE MULTIMEDIA READING
EXPERIENCE Sixth Sense can be
programmed to project
related videos onto
newspaper articles you are
reading.

19. The user can zoom in or zoomThe user can zoom in or zoom
out using intuitive handout using intuitive hand
movements.movements.
5.DRAWING
APLICATIONThe drawing application
lets the user draw on any
surface by tracking the
fingertip movements of the
user’s index finger.
6.ZOOMING
FEATURES

20. The system can projectThe system can project
Amazon ratings on thatAmazon ratings on that
book, as well as reviews andbook, as well as reviews and
other relevant information.other relevant information.
7.GET PRODUCT
INFORMATIONSixth Sense uses image
recognition or marker technology
to recognize products we pick up,
then feeds us information on those
products.
8.GET BOOK
INFORMATION

21. The system will project
relevant information
about a person such as
what they do, where
they work, and so on.
9.GET FLIGHT
UPDATESThe system will recognize
your boarding pass and
let you know whether your
flight is on time and if the
gate has changed.
10.FEED INFORMATION ON
PEAOPLE

22. If you fashion your index fingers
and thumbs into a square
("framing" gesture), the
system will snap a photo.
After taking the desired number
of photos, we can project
them onto a surface, and use
gestures to sort through the
photos, and organize and
resize them
11.TAKE PICTURES

23. Drawing a magnifying glass symbol
takes the userto the map
application.
Drawing an ‘@’ symbol lets the
usercheckhis mail.

25. ADVANTAGES
 Portable.
 Supports multi-touch and
multi-use interaction.
 Connectedness between
world and information
 Cost effective.(around $
350).
 Data access directly from
machine in real time.
 Mind map the idea
anywhere.

26. DISADVANTAGES
 The product is not yet released into the market .
 Privacy concerns.
 Health issues regarding SixthSense’s projection
technology.
 It is still being modified and tested .
 Concerns about the pricing .
 Mistry announced that the device is costing about $350
for each, on his website (Mistry, 2010). This information
was updated in 2009, but ever since then there is not
news about this device.

27. Pranav Mistry said, “This
prototype needs some serious
engineering and programming.”
Everyone is waiting hoping that
this will be available in market
once all the modifications are
done.

28. LATEST APPLICATIONS
OF SIXTH SENSE
TECHNOLOGY

30. CONCLUSION
Sixth Sense recognizes the
objects around us,
displaying information
automatically and letting
us to access it in any way
we need allowing us to
interact with this
information via natural
hand gestures.

33. NOW, A GLIMPSE AHEADOF
THE FUTURE OF SIXTH
SENSE TECHNOLOGY…..