The document discusses the Sixth Sense technology, a wearable gestural interface developed by Pranav Mistry at the MIT Media Lab. It consists of a camera, projector, and mirror worn on a pendant around the neck. The camera tracks hand gestures which are used to interact with information projected onto physical surfaces using the projector. Sixth Sense allows users to access digital information in a natural way through gestures, overlaying virtual content onto the real world. It has applications in areas like augmented reality, mobile devices, and helping disabled individuals. The technology provides an easy to use, portable interface but security and accuracy need further improvement before widespread adoption.

1. Presented by- GAURAV SINGH RAWAT
SYSTEMS ENGINEERING

2. Introduction
Components
Working
Application

3.  Steve Mann is father of sixth sense who made a
wearable computer in 1990. The Sixth Sense
Technology was first implemented as the neck worn
projector + camera system. He was a media lab student
at that time. There after it was used and implemented
by an Indian who is the man has become very famous
in the recent Pranav Mistry. There will be a long future
rather than the short period of history for the Sixth
Sense technology.

4.  Sixth Sense is a wearable gestural interface that
argument the physical world around us with digital
information and lets us use natural hand gestures to
interact with that information.
 It was developed by Pranav Mistry, a PhD student on
the fluid interfaces group at the MIT Media Lab.
 Sixth sense comprises a projector pockets, a mirror and
a camera. The hardware component like a mobile
wearable device.
 Sixth sense technology was developed at media labs in
MIT and coined as Wear Ur World (WUW).

5.  Seen
 Taste
 Smell
 Touch
 Hear
 Six sense device

6.  Augmented Reality
 Gesture Recognition
 Computer Vision
 Radio Frequency Identification

7.  It is a term for a live direct or indirect view of a physical
real world environment whose elements are
augmented by virtual Computer generated imagery.
 It is related to a more general concept called mediated
reality, in which a view of reality is modified (possibly
even diminished rather than augmented) by a
computer.

8.  It is a topic in Computer science and language
technology with the goal of interpreting human
gesture via mathematical algorithms.
 Gestures can originate from any bodily motion or state
but commonly originate from the face or hand.
 Gesture recognition can be seen as a way for computers
to begin to understand human body language, thus
building a richer bridge between machines and
humans than primitive text user interfaces or even
GUIs (graphical user interfaces), which still limit the
majority of input to keyboard and mouse.

9.  It is the science and technology of machines that see.
It is concerned with the theory behind artificial
systems that exact information from images.
 Tasks of computer vision:
1. Recognition
2. Motion analysis
3. Scene Reconstruction
4. Image restoration

10.  It is basically an electronic tagging technology that





allows the detection, tracking of tags and consequently
the objects that they are affix to.
The tag contains electronically stored information
which may be read from up to several meters away.
Access management
Tracking of goods
Tracking of persons and animals
Toll collection.

11. Hardware component are coupled in a pendent like
mobile wearable devices.
 Camera
 Projector
 Mirror
 Mobile component
 color markers

12.  Capturing an object in view and tracks the users hand
gestures.
 Sends the data to the smart phone.
 It acts as a digital eye, connecting you to world of
digital information.

13.  The projector projects visual information enabling
surfaces and physical objects to be used as interfaces.
 Projector has a battery inside with 3 hours of battery
life.
 A tiny LED projector displays data sent from the smart
phone on any surfaces in view object, wall or person.

14.  The usage of the mirror is significant as a
projector dangles pointing downwards from
the neck.
Smart phone
• A web enabled smart phone in the user’s
pocket process the video data.
• Other software reaches the web & interprets
the hand gesture.

15.  It is at the tip of the user’s fingers.
 Marking the user’s fingers with red, yellow, green, blue
tapes helps the webcam recognizes gesture.
 The movement and arrangements of these markers are
interpreted into gestures that act as interaction for the
projected application interfaces.

16. send for
processing
Capture
Camera
Images
Pictures
gesture
Mobile(smart
phone)
Send information Project
image
Projector
Reflect desired
surfaces
Mirrors
Into a surface

17. 1.
Ball mouse.

18.  A pen that can draw in 3 dimension

19.  A Google map that can interact with physical world.

20.  Make a call (keypad on your hand virtual keypad to
call.)
 Call up a map (navigate maps).

21.  Take a picture (index fingers & thumbs into a square
system snap a photo).

22.  Zoom edit email (after taking the pics you can project
them onto the surface zoom in or zoom out by hand
movement).

23.  3D Drawing application: simply using the index finger





you can draw.
Get product information: marker technology to
recognize product we pick up then feeds us
information on those product.
Get books information: You can get the book
information via just hold books.
Check the time: Draw a circle in your wrist to get a
virtual watch that gives you the correct time.
Get flight updates: Recognize your boarding pass and
let you know whether your flight is on time and if gate
has changed feed information on people.
The system will project relevant information about a
person what they do, where they work and so on..

24.  Creating multimedia reading experience: programmed
to project related videos onto newspaper articles you
are reading.
 Weather information: Get the weather information
directly to the newspaper.
 Tablet pc by paper:
 Using microphone
 Surfing internet
 Watching movie
 Playing motion sensing game

25.  KNOW ABOUT PERSON

27.  Portability
 Supports multi touch and multi user interaction
 Connection between world and information.
 Data access directly from machine in real time.
 It is and open source(make own hardware and
application)
 Cost effective.
 This technology can be used as a replacement of the
5th senses for handicapped peoples.

28.  Sixth sense recognizes the objects around us,
displaying information automatically and letting us to
access it in any way we need. The sixth sense prototype
implements several application that demonstrate the
usefulness, viability, and flexibility of system. Allowing
us to interact with this information via natural hand
gesture. This can provide easy control over
machineries in industry. This will enable individuals to
make their own application depending upon needs
and imagination.

29.  Sixth Sense devices are very much different from the
computers; this will be a new topic for the hackers and
the other people also. First thing is to provide the
security for the Sixth Sense applications and devices.
Lot of good technologies came and died due to the
security threats. There are some weaknesses that can
reduce the accuracy of the data. Some of them were
the on palm phone keypad. It allows the user to dial a
number of the phone using the keypad available on
the palm. There will be a significant market
competitor to the Sixth Sense technology since it still
required some hardware involvement with the user.

30.  http://boingboing.net/2009/11/12/sixth-sensetechnolo.html
 http://gizmodo.com/5167790/sixth-sensetechnology




maychange-how-welook-at-the-world-forever
http://www.ted.com/talks/pattie-mass-demosthesixthsense.html
http://theviewspaper.net/sixthsense-technologywillrevolutinizetheworld
http://www.freshcreation.com/entry/sixth-sense-technology/
http://www.vsrdjournals.com/CSIT/Issue/2012_08_August/Web
/3_Monika_Arora_893_Research_Communication_CSIT_August
_2012.pdf
http://www.pranavmistry.com/projects/sixthsense/