This document describes the Sixth Sense technology, which allows users to interact with digital information through natural hand gestures. The Sixth Sense consists of a camera, projector, mirror, and mobile device coupled together. The camera tracks hand gestures while the projector displays interfaces on surfaces. This enables applications like accessing information about objects, taking photos, and making calls. The system has advantages such as being portable and supporting multi-touch interaction. Future enhancements could eliminate color markers and incorporate the camera and projector directly into a mobile device.

1. SIXTH SENSE TECHNOLOGY
presented by :
D.JHANSI
(18D21A1209)

2.  INTRODUCTION
 COMPONENTS
 WORKING
 APPLICATIONS
ADVANTAGES
DISADVANTAGES
CONCLUSION
FUTURE ENHANCEMENTS
CONTENTS

3. INTRODUCTION
• Sixth sense is a wearable gesture interface that
augments the physical world around us with the
digital world.
• It lets us use natural hand gestures to interact
with the
digital world.
• It comprises a pocket projector , a mirror and a
camera. The hardware components are coupled in
pendent like mobile wearable device.

4. COMPONENTS
 CAMERA
 PROJECTOR
 MIRROR
 MOBILE COMPONENT
 COLOUR MARKERS
THESE COMPONENTS ARE COUPLED IN A PENDENT LIKE MOBILE
WEARABLE DEVICE.

5. CAMERA
 Captures an object in view and tracks the users hand gestures.
 Can recognize individuals, pictures, books etc.
 Acts as an digital eye, connecting you to the world of digital information.
 Sends data to the mobile device for processing.

6. PROJECTOR
 The projector projects visual information enabling surfaces and physical
objects used as interfaces.
 A tiny LED projector displays data sent from smart phone on any surface.
 The projector itself contains a battery inside, with 3 hours of battery life.

7. MIRROR MOBILE
 The downward facing projector projects
the output image on the mirror.
 The mirror reflects image on the desired
surface.
 The web enabled smart phone in the user’s
pocket is used to process data.

8. COLOUR MARKERS
 It is at the tip of the user’s
fingers.
 Marking the user’s fingers with
red, yellow, green, blue tape help
the web cam recognize the
gestures
 The movement and
arrangement of these makers are
interpreted into gestures that act
as interaction instructions for the
projected application interfaces

9. HOW IT WORKS?
IMAGES
PICTURES
GESTURE
S
INFO ON
SURFACE
Send Info
Project image Reflect on
desired surface
Send for processing capture

10. WORKING
oThe hardware that makes sixth sense work is a pendant like mobile wearable
device.
o It has a camera, a projector, a mirror and is connected wirelessly to Bluetooth
smart phone that can slip comfortably into one’s pocket.
oThe camera recognizes individuals, images, pictures, gestures one makes with
their hands.
oInformation is sent to the Smartphone for processing.
oThe downward-facing projector projects the output image on to the mirror.
oMirror reflects image on to the desired surface.
oThus digital information is freed from its confines and placed in the physical
work.

11. APPLICATIONS
TAKE PICTURES
If you fashion your index fingers and
thumbs into a square ( “framing”
gesture) we can take a snap.
After taking the photos, we can
project them onto a surface, and use
gestures to sort through the photos,
and organize and resize them.

12. ZOOMING FEATURES
We can arrange those pictures. The user can
zoom in or zoom out by just using hand
movements
GETS BOOK INFORMATION
The system can project Amazon ratings on
that book, as well as reviews and all other
relevant information

13. FEED INFORMATION ON PEOPLE
The system will project some relevant
information about a person such what he/she
does, where they work, and so on.
GET FLIGHT UPDATES
The system will recognize your boarding
pass and you know whether your flight is on
time and if the gate has changed

14. MAKE A CALL
You can use sixth sense to project a
keypad onto your hand, then use the
that key pad to make a call.
CREATES MULTIMEDIA
READING EXPERIENCES
 Sixth sense can be programmed to
project related videos onto news
paper articles you are reading.

15. DRAWING APPLICATION
The drawing application lets the user draw on
any surface by tracking the fingertip movements
of the user’s index finger
CHECK THE TIME
 Draw a circle on your wrist to get virtual
watch that gives you the correct time

16. GETS PRODUCT INFORMATION
Sixth sense uses image recognition or marker
technology to recognize products we pick up
and feed us information on those products
CALL UP A MAP
 With the map application we can call
up the map of our choice and then
use thumps and index fingers to
navigate the map

17. Portable
Support Multi touch and Multi user interaction
Cost Effective(300$)
Data access directly from the machines in real time
Mind map the idea anywhere
Open Source Software
ADVANTAGES

18.  Hardware limitations of the devices, that we currently carry
around with us.
 For example many phones will not allow the external
camera feed to be manipulated in real time
 Post processing can occur however.
DISADVANTAGES

19.  Sixth Sense recognizes the objects around us, displaying
information automatically and letting us to access it in any way
we need.
 The Sixth Sense prototype implements several applications
that demonstrate the usefulness, viability and flexibility of the
system.
 The potential of becoming the ultimate “transparent” user
interface for accessing information about everything around us.
 Allowing us to interact with this information via natural hand
gestures
CONCLUSION

20.  To gets rids of color markers.
 To incorporate camera and projector inside mobile computing
device.
 To have 3D gestures tracking.
 To make Sixth Sense work as fifth Sense for disabled person
FUTURE ENHANCEMENTS

21. THANK YOU