Sixth Sense is a wearable technology developed by Pranav Mistry that allows users to access digital information using hand gestures. It consists of a camera, projector, and mobile device. The camera tracks colored markers on the user's fingers to recognize gestures and access information from the internet. This information can then be projected onto physical surfaces using the projector. Some applications include accessing maps, taking photos, drawing, making calls, getting product information, and checking the weather. Whirlpool has also integrated Sixth Sense technology into washing machines to optimize water and energy usage during cycles based on load size.

1. Sixth Sense Technology
Submitted to:
Mrs. Anu Chawla
Submitted by:
Shruti Bansal
MSC IT 3rd sem
8522

2. Introduction
• We've evolved over millions of years to sense the world around us. When we
encounter something, someone or some place, we use our five natural senses to
perceive information about it.
• This information helps us make decisions and chose the right actions to take.
But arguably the most useful information that can help us make the right decision
is not naturally perceivable with our five senses, namely the data, information
and knowledge that mankind has accumulated about everything and which is
increasingly all available online.
• Although the miniaturization of computing devices allows us to carry
computers in our pockets, keeping us continually connected to the digital
world, there is no link between our digital devices and our interactions with the
physical world. Information is confined traditionally on paper or digitally on a
screen.
• Sixth Sense bridges this gap, bringing intangible, digital information out into
the tangible world, and allowing us to interact with this information via natural
hand gestures.

3. W h a t i s S i x t h S e n s e Te c h n o l o g y … ?
Sixth Sense in scientific (or non-scientific) terms is defined as Extra Sensory
Perception or in short ESP.
It involves the reception of information not gained through any of the five
senses. Nor is it taken from any experiences from the past or known.
 Sixth Sense is a wearable ―gesture based‖ device that augments the
physical world with digital information and let people use natural hand
gestures to interact with that information.
Sixth Sense will allow us to interact with our world like never before. We
can get information on anything we want from anywhere within a few
moments!
We will not only be able to interact with things on a whole new level but
also with people. One great part of the device is its ability to scan objects or
even people and project out information regarding what you are looking at.

4. Who invented it.. ?

Pranav Mistry, 28 year old, of Indian
origin is the mastermind behind the „Sixth
Sense / WUW ( Wear UR World)„
technology.

He is a research assistant and a PhD
candidate at MIT Media Lab.

Pranav holds a Master in Media Arts
and Sciences from MIT and Master of
Design from IIT Bombay besides his
Bachelor degree in Computer Engineering
from
Nirma
Institute
Of
Technology, Ahmedabad.
 Sixth Sense has been awarded 2009
Invention Award by Popular Science.
 Pranav also won Young Innovator
Award by Technology Review.

5. History behind Sixth Sense Technology
 It all started with the mouse, not
the optical one but the one with the
balls.
 This technology was developed
by the ball of mouse and placed
them in a line attaching them by
some strings, pulleys and springs
into a motion sensing device. The
axial rollers found in the ball mouse
were used to replicate the gestures
made with hand on the computer.

9. Sixth Sense Prototype
Portable device that is worn around neck.

10. Earlier Prototype
Recent Prototype

11. Components :
 Camera
 Colored Markers
 Projector
 Mobile Component
Mirror

12. Camera:
It captures the image of the object in view
and tracks the user‟s hand gesture. The
camera
recognizes
individuals, images, pictures, gestures that
user makes with his hand. The camera then
sends this data to a smart phone for
processing. Basically the camera forms a
digital eye which connects to the world of
digital information.
Colored Markers:
There are colour markers placed at the tip
of users fingers. Marking the user‟s fingers
with red, yellow, green and blue coloured
tape helps the webcam to recognize the
hand gestures. The movements and
arrangement of these markers are
interpreted into gestures that act as an
interaction instruction for the projected
application interfaces.

13. Projector:
The information that is interpreted through the
smartphone can be projected into any surface.
The projector projects the visual information
enabling surfaces and physical objects to be
used as interfaces. The projector itself consists
of batteries which have 3 hours of battery life.
A Tiny LED projector displays the data sent
from the smartphone on any surface in viewobject, wall or person. The downward facing
projector projects the image on to a mirror.
Mobile Component:
The Sixth Sense device consists of a web
enabled smartphone which process the data
send by the camera. The smartphone
searches the web and interprets the hand
gestures with the help of the coloured
markers placed at the finger tips.

14. Mirror:
The usage of a mirror is important as the
projector dangles pointing downward
from the neck. The mirror reflects the
image on to a desire surface. Thus finally
the digital image is freed from its
confines and placed in the physical
world.

16. Description:
1.It captures the image of the object in view and track the user‟s hand
gestures.
2. There are colour markers placed at the tip of users finger. Marking
the user‟s fingers with red, yellow, green and blue coloured tape
helps the webcam to recognize the hand gestures. The movements
and arrrangement of these markers are interpreted into gestures that
act as a interaction instruction for the projected application
interfaces.
3. The smartphone searches the web and interprets the hand gestures
with the help of the coloured markers placed at the finger tips.
4. The information that is interpreted through the smartphone can be
projected into any surface.
5. The mirror reflects the image on to a desired surface.

17. Kinds of Gestures Recognised:
1.Multi-Touch Gestures:
Like the ones we see in the iphone-where we touch the screen and
make the map move by pinching and dragging.
2. Freehand Gestures:
Like when you take a picture or Namaste gesture to start the
projection on the wall.
3. Iconic Gestures:
Drawing an icon in the air. Like, whenever we draw a star, shows us
the weather details. When we draw a magnifying glass, shows us the
map.

18. Applications:

19. Viewing Map: With the help of a map
application the user can call upon any map of
his/her choice and navigate through them by
projecting the map on to any surface. By using
the thumb and index fingers movements the user
can zoom in, zoom out or pan the selected map.
Taking Pictures: Another application of
Sixth Sense devices is the implementation of a
gestural camera. This camera takes the photo of
the location user is looking at by detecting the
framing gesture. After taking the desired
number of photos we can project them onto any
surfaces and then use gestures to sort through
those photos and organize and resize them .

20. Drawing
Application:
The drawing
application allows the user you to draw on any
surface by tracking the fingertip movements of
the user‟s index finger. The pictures that are
drawn by the user can be stored and replaced on
any other surface. The user can also shuffle
through various pictures and drawing by using
the hand gesture movements.
Making Calls: We can make calls with the
help of Sixth Sense device. The Sixth Sense
device is used to protect the keyboard into
your palm and using that virtual keypad we
can make calls to anyone.

21. Interacting with physical objects:
The Sixth Sense system also helps to interact
with physical objects we use in a better way.
It augments physical objects by projecting
more information about these objects
projected on them. For example, a newspaper
can show live video news or dynamic
information can be provided on a regular
piece of paper.
Check the Time: Just by making a circle
on your wrist you will be able to see watch
on your wrist and easily see the time.

22. Getting Information:
Sixth Sense devices can be used for getting
various information relating to our everyday life
by getting in contact with objects.
(a)Product information:
Sixth Sense Technology uses marker technology
or image recognition techniques to recognize the
objects we pick in our hand and then provide
information relating to the product.
(b) Book Information:
By holding and shuffling through the book
pages, the Sixth Sense provides Amazon ratings
on that book, other reviews and other relevant
things related to the book.
(c) Flight Updates:
With the help of the Sixth Sense Technology it is
no longer required to log into any sites for
checking the status of the flights. The system will
recognize your boarding pass and let you know
whether the flight is on time or not.

23. Symbol Interaction: Sixth Sense also lets
the user draw icons or symbols in the air
using the movement of the index finger and
recognizes those symbols as interaction
instructions.
Internet Access: On a flat surface or on
a paper, you can access internet services
making it an interface for accessing the
services.
Weather
Information:
This
technology also provides us with a
review of weather details in visual form
by just looking at its map.

24. Washing Machines with Sixth Sense Technology
Whirlpool's 6th Sense technology uses
sensors built in to the washing machine to
continually monitor and control your
washing cycle to give you perfect results in
the most efficient way possible.
6th Sense adjusts water, temperature and
time levels to save energy and natural
resources
Whirlpool‟s 2009 range of washing
machines AWOE 8758 comes integrated
with enhanced 6th sense technology that
gives more optimisation of resources and
also increased saving in terms of
energy, water and time.

25. Working:
All Whirlpool appliances with intelligent 6th Sense technology work on
three key principles; Sense, Adaption and Control, to ensure that they achieve
optimal performance .
Senses: sensors measure the load size - the amount of washing you have
put in your washing machine before starting the cycle.
Adapts: It will then fill the washing machine with just the right amount of
water to get the job done - no more, no less.
This step by step rise in temperature optimises the working power of each
individual active agent within the stain solver, giving you the best results on
stain removal in a highly energy-efficient manner.
In Whirlpool washing machines the intelligent sixth sense technology
sensors firstly measure the load size. Secondly, they will adjust the water, the
temperature and the time in order to save energy and natural resources.

26. Refrigerators with Sixth Sense Technology

27. Working:
Once set, the unique Sixth Sense system memorises, monitors and maintains
your cooling levels automatically.
When you open the door, Sixth Sense detects a rise in temperature and the
sensitive system automatically boosts cooling to recover the optimum storage
conditions fast.
Humidity settings lets you control the whole climate at the touch of a button.
On holiday’ mode: The Whirlpool holiday or vacation mode controls your
fridge freezer while you‟re away. Controlled from the digital panel it ensures
that the freezer temperature is maintained while the fridge operates at a minimal
energy setting. Saving you money when you‟re not at home
Also in the sixth sense cooling products you have the benefit of the multi
flow ventilation system. This is a "total no frost" system which circulates chilled
air around the freezer's storage areas, reducing humidity and preventing the
formation of ice. This system blows chilled air around the interior of the fridge
to ensure perfect conditions throughout.

28. Automobiles with Sixth Sense Technology
Preventing accidents by warning
drivers about potential danger from
other vehicles was a major goal during
the development of the new General
Motors V2V (vehicle-to-vehicle)
communication systems. Vehicles
equipped with this technology can
communicate with each other and
exchange information such as location
and speed. Drivers can then be warned
in advance if another car is travelling
in their blind spot, stopped in an area
that is difficult or impossible to see, or
about to enter the same intersection as
they are.

29. Advantages:
1.Portable:
One of the main advantages of the Sixth Sense devices is its small size and
portability. It can be easily carried around without any difficulty. The
prototype of the Sixth Sense is designed in such a way that it gives more
importance to the portability factor. All the devices are light in weight and the
smartphone can easily fit into the user‟s pocket.
2. Support Multi touch and Multi user interaction:
Multi touch and Multi user interaction is another added feature of the Sixth
Sense devices. Multi sensing technique allows the user to interact with system
with more than one finger at a time. Sixth Sense devices also incorporates
Multi user functionality. This is typically useful for large interaction scenarios
such as interactive table tops and walls.
3. Cost Effective:
The cost incurred for the construction of the Sixth Sense prototype is quite
low. It was made from parts collected together from common devices. And a
typical Sixth Sense device costs up to $300. The Sixth Sense devices have not
been made in large scale for commercial purpose. Once that happens it‟s
almost certain that the device will cost much lower than the current price.

30. 4. Data access directly from the machines in real time:
With the help of a Sixth Sense device the user can easily access data from any
machine at real time speed. The user doesn‟t require any machine-human
interface to access the data. The data access through recognition of hand
gestures is much easier and user friendlier compared to the text user interface or
graphical user interface which requires keyboard or mouse.
5. Mind map the idea anywhere:
With the advent of the Sixth Sense device, requirement of a platform or a screen
to analyze and interpret the data has become obsolete. We can project the
information onto any surface and can work and manage the data as per our
convenience.
6. Open Source Software:
The software that is used to interpret and analysis the data collected by the
device is going to be made open source as said by its inventor. This will enable
other developers to contribute to the development of the system.

31. Cost
 It costs 350$ without the mobile
device.
 In Indian currency Rs.17000.

32. Future Enhancements
 To get rid of colour markers.
 To incorporate camera and projector inside mobile Computing device.
 Whenever we place pendant- style wearable device on table, it should allow
us to use the table as multi touch user interface.
 Applying this technology in various interest like gaming, education systems
etc.
 To have 3D gesture tracking.
 To make sixth sense work as fifth sense for disabled person.

33. Conclusion
Information is often confined to paper or computer screens. Sixth Sense frees
data from these confines and seamlessly integrate information and reality. With
the miniaturization of computing devices, we are always connected to the
digital world, but there is no link between our interactions with these digital
devices and our interactions with the physical world. Sixth Sense bridges this
gap by augmenting the physical world with digital information, bringing
intangible information into tangible world.
Sixth Sense recognizes the objects around us, displaying information
automatically and letting us access it in any way we need. The Sixth Sense
prototype implements several applications that demonstrate the usefulness,
viability and flexibility of the system. The potential of becoming the ultimate
“transparent” user interface for accessing information about everything around
us is present in this technology. Using this technology “Finally one gets a taste
of the world of Harry Potter.” Sixth Sense Technology is the science of
tomorrow with the aim of connecting the physical world seamlessly,
eliminating hardware devices.

34. References
https://www.google.co.in/search?hl=en&site=imghp&tbm=isch&source=hp
&biw=1280&bih=828&q=sixth+sense+technology&oq=sixth+sense+technol
ogy&gs_l=img.3..0l10.2570.8396.0.9883.22.12.0.10.10.0.263.2127.3j2j7.12.0
....0...1ac.1.27.img..2.20.1708.GAgu3_mWl8A
http://www.pranavmistry.com/projects/sixthsense/
http://en.wikipedia.org/wiki/SixthSense
http://www.engineersgarage.com/articles/sixth-sense-technology
http://ijritcc.org/IJRITCC%20Vol_1%20Issue_4/IJRITCC_1354.pdf
http://www.bvicam.ac.in/news/INDIACom%202011/89.pdf
http://123seminarsonly.com/Seminar-Reports/025/82559741-The-SixthSense-Technology.pdf

35. Video References
http://video.ted.com/talk/podcast/2009I/None/PranavMistry_2009I.mp4
https://www.youtube.com/watch?v=Fez4huQWxkg
https://www.youtube.com/watch?v=ig2RSID-kn8

36. Any Questions