The document describes the Sixth Sense technology, a wearable gestural interface developed by Pranav Mistry in 2009. It allows users to access digital information about the physical world by projecting it onto surfaces and interacting through natural hand gestures. The system uses a camera, projector, and mirror connected to a smartphone to recognize objects, gestures, and surfaces and display related data seamlessly overlaid on the physical world. Some applications mentioned include using gestures to draw, access maps and photos, and interact with projected interfaces on surfaces like palms or walls. Educational and other potential uses are also discussed.

1. Submitted To Submitted By
Prof. Narinder Singh Jagdeep Singh Sidhu
MCA -3 rd Year

2. Introduction
 About Sense
 SO WHY SIXTH SENSE??
 Basic Points About Sixth Sense
 What is Six Sense Technology
 History
 That Things it can Do
Components
Software
 How it works
 Applications
 Educational Use
 Advantage
2

3. Issues and Disadvantages
Other Related Technologies
Future Development
Conclusion

4.  About Sense
Senses are physiological capacities of organism
that provide data for perception . Human beings
have
 Sight
 Hearing
 Taste
 Smell
 Touch
are the five traditionally recognized.

6. • Hereby Physical world is painted with the
digital information.
• You can carry your digital world with you
wherever you go.
• You can start with any wall or any surface as
an interface even your palm.

7.  Sixth Sense allows people to use the internet without a
screen or a keyboard
 It can turn any surface into a touch screen
 “The software program processes the video stream data
captured by the camera and tracks the locations of the
colored markers using simple computer-vision
techniques.”

8. Sixth Sense Technology is a wearable gestural
interface that augments the physical world around
us with digital information and lets use natural
hand gestures to interact with that information.

9. Steve Mann is the father of Sixth Sense who
made a wearable computer in 1990.
KARMA: Knowledge-based Augmented Reality
for Maintenance Assistance

10. Mouseless
The firstly
mouseless
technology was
deve. By Pranav
Mistry .The
Mouse less is an
invisible computer
mouse that provides
the familiarity of
interaction of a
physical mouse
without actually
needing a real
hardware mouse.

11. The Sixth Sense technology
is a wearable wireless
device developed by
researcher Pranav Mistry
from the Media Lab at
Massachusetts Institute of
Technology in 2009. Mistry
is part of the Fluid
Interfaces Group at MIT
where he developed this
technology to create a link
between the physical world
and digital devices.

12.  “The device recognizes items in stores, and then gathers
and projects information about products to the user. It
also is able to provide quick signals to let users know
what the best products are based on their needs.”
 “Another amazing feature is the device’s ability to look
at an airplane ticket and let the user know whether the
flight is delayed or on time. It is also able to recognize
books (based on an image ) in a book store and then
project reader reviews or author information from the
Internet onto blank pages.”
 “The device can also recognize articles in newspapers,
retrieve the latest related stories or video from the
Internet and then display them on pages for the user.
Say goodbye to your dictionary and encyclopedia.”

13.  Camera
 Projector
 Mirror
 Mobile component
 Colored markers

14.  Captures an object in
view and tracks the
user’s hand gestures
 It sends the data to
smart phone
 It acts as a digital eye,
connecting you to the
world of digital
information

15.  The projector projects visual
information enabling surfaces
and physical objects to be
used as interfaces
 The projecter itself contains a
battery inside, with 3 hours of
battery life
 A tiny LED projector displays
data sent from the smart
phone on any surface in view-
object, wall, or person

16.  he usage of the mirror
is significant as the
projector dangles
pointing downwards
from the neck.
 A Web –enabled smart
phone in the user’s
pocket processes the
video data
 Other software
searches the Web and
interprets the hand
gestures

17.  It is at the tip of the user’s
fingers
 Marking the user’s fingers
with red, yellow, green, and
blue tape helps the webcam
recognize gestures
 The movements and
arrangements of these
markers are interpreted into
gestures that act as
interaction instructions for
the projected application
interfaces

18. Pranav Mistry says the Sixth Sense software will
be open source. As far as this seems to be a little
set of items, there will not be user interfaces or
much advanced programs for the users. There
will be much harder and secured coding inside
the device to make sure the security of the
software. It will be interesting to know the new
language for coding for a sixth sense device.

19.  The hardware that makes Sixth Sense work is a pendant
like mobile wearable interface.
 It has a camera, a mirror and a projector and is
connected wire Lesley to a Bluetooth smart phone that
can slip comfortably into one’s pocket.
 The camera recognizes individuals, images, pictures,
gestures one makes with their hands.
 Information is sent to the Smartphone for processing.
 The downward-facing projector projects the output
image on to the mirror.
 Mirror reflects image on to the desired surface.
 Thus, digital information is freed from its confines and
placed in the physical world.

21. APPLICATIONS

22.  The drawing application lets the user draw
on any surface by tracking the fingertip
movements of the user’s index finger

23.  Sixth Sense can be programmed to project related
videos onto newspaper articles you are reading

24.  Draw a circle on your wrist to get a virtual watch that
gives you the correct time

25.  You can use the Sixth Sense to project a keypad
onto your hand, then use that virtual keypad to
make a call.

27.  With the map application we can call up
the map of our choice and then use thumbs
and index fingers to navigate the map

28.  If you fashion your index
fingers
and thumbs into a square
("framing" gesture), the
system
will snap a photo
 After taking the desired
number of
photos, we can project them
onto a
surface, and use gestures to sort
through the photos, and
organize
and resize them.

30.  Research
 Collaboration
 Cost - effectiveness

31.  Sixth Sense will give new meaning to “looking
something up.”
 Since we are essentially talking about the internet,
students will be given the opportunity to portably
research the world.
 They can all go on a virtual field trip and project the
images on their own desks, for example.

32.  Students will be given an opportunity through this
technology to feel more connected to others.
 Although there does seem to be the sense that
individuals could walk through life wired and
lonely, I like to think the classroom would serve as
the environment in which students and teachers
using Sixth Sense would want to share.
 Not only could the sharing take place in the
classroom, I suppose since the users are connected
online, sharing could take place around the world.

33.  This product currently costs only $350 (approx.
Rs.17000) . From an educator’s stand point, this is
minimum given the amount of money spent on
textbooks, computer labs and LCD projectors.
 For educator’s, Sixth Sense would be a way to put
technology (literally) into each student’s hands,
because of its size and its cost.

34.  Portable
 Support smulti-touch
 Connectedness between world and information
 Cost effective
 Data access directly from machine in real time
 Mind map the idea anywhere

35.  The product is not yet released into the market.
 There are some security concerns about this product.
New inventions in information technology have some
kind of security concerns. For example when a person
is taking a picture using the Sixth Sense, he just snaps
with his fingers which have little marker caps on
them. People don’t want to be captured on a camera
of a random person.
 One can never tell when Sixth Sense is taking a
picture, because it is not a big object and nothing is
being help in your hand in order to take a picture like
a camera or a phone.
 This is invading other’s privacy which can be a huge
problem.

36.  Kinect (Project Natal )is a motion sensing input
device by Microsoft for the Xbox 360 video game
console and Windows PCs. Based around a
webcam-style add-on peripheral for the Xbox 360
console, it enables users to control and interact
with the Xbox 360 without the need to touch a
game controller, through a natural user interface
using gestures and spoken commands.
 Kinect was launched in North America on
November 4, 2010

38.  It seems to be that there can be a good future for
SixthSense technology applications. There are
several things that designers must pay their
attention. The digital cameras came into the
market. But it did not provide the real quality for
the photographers at a reasonable price. Therefore
most of the professional photographers still use
the analog cameras.
 Nano technology came into the world, but the
general consumers do not use that technology so
far. The reason is the extremely high price.

39.  SixthSense devices are very much different from the
computers, this will be a new topic for the hackers and the
other people also. First thing is to provide the security for
the SixthSense applications and devices. Lot of good
technologies came and died due to the security threats. It
allows the user to dial a number of the phone using the
keypad available on the palm.

41.  Sixth Sense recognizes the objects around us,
displaying information automatically and
letting us to access it in any way we need.
 The Sixth Sense prototype implements several
applications that demonstrate the usefulness,
viability and flexibility of the system.
 Allowing us to interact with this information
via natural hand gestures.
 Bye -Bye Keyboards and Mouse.

42. 1. www.pranavmistry.com/projects/sixthsense/
2. en.wikipedia.org/wiki/SixthSense

44. 44