Steve Mann is father of sixth sense who made a
wearable computer in 1990. The Sixth Sense
Technology was first implemented as the neck worn
projector + camera system. He was a media lab student
at that time. There after it was used and implemented
by an Indian who is the man has become very famous
in the recent Pranav Mistry. There will be a long future
rather than the short period of history for the Sixth
Sixth Sense is a wearable gestural interface that
argument the physical world around us with digital
information and lets us use natural hand gestures to
interact with that information.
It was developed by Pranav Mistry, a PhD student on
the fluid interfaces group at the MIT Media Lab.
Sixth sense comprises a projector pockets, a mirror and
a camera. The hardware component like a mobile
Sixth sense technology was developed at media labs in
MIT and coined as Wear Ur World (WUW).
Six sense device
Radio Frequency Identification
It is a term for a live direct or indirect view of a physical
real world environment whose elements are
augmented by virtual Computer generated imagery.
It is related to a more general concept called mediated
reality, in which a view of reality is modified (possibly
even diminished rather than augmented) by a
It is a topic in Computer science and language
technology with the goal of interpreting human
gesture via mathematical algorithms.
Gestures can originate from any bodily motion or state
but commonly originate from the face or hand.
Gesture recognition can be seen as a way for computers
to begin to understand human body language, thus
building a richer bridge between machines and
humans than primitive text user interfaces or even
GUIs (graphical user interfaces), which still limit the
majority of input to keyboard and mouse.
It is the science and technology of machines that see.
It is concerned with the theory behind artificial
systems that exact information from images.
Tasks of computer vision:
2. Motion analysis
3. Scene Reconstruction
4. Image restoration
It is basically an electronic tagging technology that
allows the detection, tracking of tags and consequently
the objects that they are affix to.
The tag contains electronically stored information
which may be read from up to several meters away.
Tracking of goods
Tracking of persons and animals
Hardware component are coupled in a pendent like
mobile wearable devices.
Capturing an object in view and tracks the users hand
Sends the data to the smart phone.
It acts as a digital eye, connecting you to world of
The projector projects visual information enabling
surfaces and physical objects to be used as interfaces.
Projector has a battery inside with 3 hours of battery
A tiny LED projector displays data sent from the smart
phone on any surfaces in view object, wall or person.
The usage of the mirror is significant as a
projector dangles pointing downwards from
• A web enabled smart phone in the user’s
pocket process the video data.
• Other software reaches the web & interprets
the hand gesture.
It is at the tip of the user’s fingers.
Marking the user’s fingers with red, yellow, green, blue
tapes helps the webcam recognizes gesture.
The movement and arrangements of these markers are
interpreted into gestures that act as interaction for the
projected application interfaces.
Send information Project
Into a surface
A Google map that can interact with physical world.
Make a call (keypad on your hand virtual keypad to
Call up a map (navigate maps).
Take a picture (index fingers & thumbs into a square
system snap a photo).
Zoom edit email (after taking the pics you can project
them onto the surface zoom in or zoom out by hand
3D Drawing application: simply using the index finger
you can draw.
Get product information: marker technology to
recognize product we pick up then feeds us
information on those product.
Get books information: You can get the book
information via just hold books.
Check the time: Draw a circle in your wrist to get a
virtual watch that gives you the correct time.
Get flight updates: Recognize your boarding pass and
let you know whether your flight is on time and if gate
has changed feed information on people.
The system will project relevant information about a
person what they do, where they work and so on..
Creating multimedia reading experience: programmed
to project related videos onto newspaper articles you
Weather information: Get the weather information
directly to the newspaper.
Tablet pc by paper:
Playing motion sensing game
Supports multi touch and multi user interaction
Connection between world and information.
Data access directly from machine in real time.
It is and open source(make own hardware and
This technology can be used as a replacement of the
5th senses for handicapped peoples.
Sixth sense recognizes the objects around us,
displaying information automatically and letting us to
access it in any way we need. The sixth sense prototype
implements several application that demonstrate the
usefulness, viability, and flexibility of system. Allowing
us to interact with this information via natural hand
gesture. This can provide easy control over
machineries in industry. This will enable individuals to
make their own application depending upon needs
Sixth Sense devices are very much different from the
computers; this will be a new topic for the hackers and
the other people also. First thing is to provide the
security for the Sixth Sense applications and devices.
Lot of good technologies came and died due to the
security threats. There are some weaknesses that can
reduce the accuracy of the data. Some of them were
the on palm phone keypad. It allows the user to dial a
number of the phone using the keypad available on
the palm. There will be a significant market
competitor to the Sixth Sense technology since it still
required some hardware involvement with the user.