The Sixth Sense technology developed by Pranav Mistry allows users to interact with digital information in the physical world using natural hand gestures. The prototype consists of a camera, projector, and colored markers that the camera uses to interpret gestures. It projects information onto surfaces based on gestures made near objects. Applications include using hand gestures to make calls, access maps, and check the time without touching a device. The technology aims to seamlessly integrate digital and physical worlds.

1. “SIXTH SENSE TECHNOLOGY”
Under the guidance of: Presented by:
PURNIMA DEVI.G (ME) JAI RABINDRA UPADHYAY
Asst.Professor 1MJ08EE020
1

2. CONTENTS
INTRODUCTION
SIXTH SENSE PROTOTYPE
COMPONENTS
HOW IT WORKS
APPLICATIONS
ADVANCEMENT
CONCLUSION
2

3. INTRODUCTION
 Sixth Sense is a wearable gestural
interface that augments the physical
world around us with digital
information.
 Technology that plays with Human
gestures to make the world more
interactive and workflow much
easier.
 Pranav Mistry , of Indian origin, a
PhD student in the Fluid Interfaces
Group at the MIT Media Lab is the
mastermind behind the sixth sense Pranav Mistry
technology 3

4. WHAT IS SIXTH SENSE TECHNOLOGY
'Sixth Sense' is a wearable gestural interface that
augments the physical world around us with digital
information and lets us use natural hand gestures to
interact with that information.
It augments the physical world around us with digital
information and lets us use natural hand gestures to
interact with that information.
4

5. PHYSICAL WORLD
Objects ~ Gestures
Gestures ~ Interaction
5

6. WHAT DOES IT DO?
 “Sixth Sense brings intangible, digital information into the
tangible world, and allows us to interact with this
information via natural hand gestures.
 6thfrees information from its confines, seamlessly
integrating it with reality, thus making the entire world
your computer.”
6

7. SIXTH SENSE OVERVIEW
 Developed by Pranav Mistry
 Research assistant/PhD candidate MIT
 Portable device that is worn around neck
 Consists of:
 Camera
 Colored Markers
 Projector
 A smart phone
7

8. SIXTH SENSE PROTOTYPE
A Pocket Projector
Projects visual
information to
interfaces like wall,
physical objects.
A Camera Tracks user
hand gestures.
Colored Markers
Movements of fiducials
are interpreted into
gestures.
Mirror
Mobile phone
8

9. COLOR MARKERS
 It is at the tip of the user’s fingers .
 Marking the user’s fingers with red, yellow, green, and
blue tape helps the webcam recognize gestures
 The movements and arrangements of these makers are
interpreted into gestures that act as interaction
instructions for the projected application interfaces
9

10. SMART PHONE
 A Web-enabled smart phone in the user’s pocket
processes the video data
 Other software searches the Web and interprets the hand
gestures
10

11. MIRROR
 The usage of the mirror is significant as the projector
dangles pointing downwards from the neck.
MIRROR
11

12. PROJECTOR
 The projector projects visual information enabling surfaces
and physical objects to be used as interfaces
 The projector itself contains a battery inside, with 3 hours of
battery life.
 A tiny LED projector displays data sent from the smart phone
on any surface in view–object, wall, or person.
12

13. HOW IT WORKS ?
BLOCK DIAGRAM
capture • Images
Send for • Pictures
processing
• Gesture
Send Info
Reflect on
Project image desired Info on
surface surface
13

14. DESCRIPTION
 The hardware that makes Sixth Sense work is a pendant like
mobile wearable interface
 It has a camera, a mirror and a projector and is connected
wirelessly to a Bluetooth smart phone that can slip
comfortably into one’s pocket
 The camera recognizes
individuals, images, pictures, gestures one makes with their
hands
 Information is sent to the Smartphone for processing
 The downward-facing projector projects the output image
on to the mirror
 Mirror reflects image on to the desired surface
 Thus, digital information is freed from its confines and
placed in the physical world. 14

15. WASHING MACHINES WITH 6TH SENSE
TECHNOLOGY
Whirlpool's 6th Sense technology uses
sensors built in to the washing machine
to continually monitor and control your
washing cycle to give you perfect results
in the most efficient way possible.
6th Sense adjusts water, temperature
and time levels to save energy and
natural resources
Whirlpool’s 2009 range of washing machines AWOE 8758 comes
integrated with enhanced 6th sense technology that gives more
optimisation of resources and also increased saving in terms of
energy, water and time.
15

16. WORKING
All Whirlpool appliances with intelligent 6th Sense technology work on
three key principles; Sense, Adaption and Control, to ensure that they
achieve optimal performance
Senses: sensors measure the load size - the amount of washing you
have put in your washing machine before starting the cycle.
Adapts: It will then fill the washing machine with just the right amount
of water to get the job done - no more, no less.
This step by step rise in temperature optimises the working power of
each individual active agent within the stain solver, giving you the best
results on stain removal in a highly energy-efficient manner.
In Whirlpool washing machines the intelligent sixth sense technology
sensors firstly measure the load size. Secondly, they will adjust the
water, the temperature and the time in order to save energy and
natural resources. 16

17. REFRIGERATORS
17

18. WORKING
 Once set, the unique Sixth Sense system memorises, monitors and
maintains your cooling levels automatically.
 When you open the door, Sixth Sense detects a rise in temperature
and the sensitive system automatically boosts cooling to recover the
optimum storage conditions fast.
 Humidity settings lets you control the whole climate at the touch of a
button.
 On holiday’ mode: The Whirlpool holiday or vacation mode controls
your fridge freezer while you’re away. Controlled from the digital
panel it ensures that the freezer temperature is maintained while the
fridge operates at a minimal energy setting. Saving you money when
you’re not at home
 Also in the sixth sense cooling products you have the benefit of the
multi flow ventilation system. This is a "total no frost" system which
circulates chilled air around the freezer's storage areas, reducing
humidity and preventing the formation of ice. This system blows
chilled air around the interior of the fridge to ensure perfect
conditions throughout.
18

19. AUTOMOBILES APPLICATION
Preventing accidents by warning drivers about potential danger from
other vehicles was a major goal during the development of the new
General Motors V2V (vehicle-to-vehicle) communication systems.
Vehicles equipped with this technology can communicate with each
other and exchange information such as location and speed. Drivers can
then be warned in advance if another car is travelling in their blind
spot, stopped in an area that is difficult or impossible to see, or about to
enter the same intersection as they are. 19

20. ADVANCEMENTS
 MAKE A Call-You can use the
Sixth Sense to project a keypad
onto your hand, then use that
virtual keypad to make a all
 CALL UP A MAP- With the map
application we can call up the
map of our choice and then use
thumbs and index fingers to
navigate the map
 CHECK THE Time-draw a circle
on your wrist to get a virtual
watch that gives you the correct
time
20

21. ‹#›

22. ADVANTAGES
 Connectedness between world and information.
 Data access directly from machine in real time.
 Mind map the data anywhere.
 Portable.
 Inexpensive
 Microsoft Surface does currently exist (which is similar in
theory). But Microsoft’s product is not portable like Sixth
SenseIn addition to that Microsoft is developing a
controlling environment whore the user doesn’t even have to
touch the controller device named ‘Project Natal’. This will be
a significant market competitor to the SixthSense technology
since it still required some hardware involvement with the
user.
 OPEN SOURCE
22

23. CONCLUSION
 Sixth Sense recognizes the objects
around us, displaying information
automatically and letting us to access it
in any way we need
 The Sixth Sense prototype implements
several applications that demonstrate
the usefulness, viability and flexibility
of the system
 Allowing us to interact with this
information via natural hand gestures
 The potential of becoming the
ultimate "transparent" user interface
for accessing information about
everything around us 23

24. ‹#›

25. REFERENCE
 http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.html
 http://www.pranavmistry.com
 P. Mistry, P. Maes. Sixth Sense – A Wearable Gestural Interface. To be
appeared in SIGGRAPH Asia 2009, Emerging Technologies.
Yokohama, Japan. 2009
 P. Mistry. The thrilling potential of Sixth Sense technology TED India
2009. Mysore, India
 http://ieeexplore.ieee.org Rao, S.S.;
Electron. & Commun. Eng., Anna Univ. of Technol., Coimbatore, India
This paper appears in: Communication and Computational Intelligence
(INCOCCI), 2010 International Conference on
Issue Date: 27-29 Dec. 2010
On page(s): 336 - 339
Location: Erode
E-ISBN: 978-81-8371-369-6
References Cited: 11
INSPEC Accession Number: 11887446
Date of Current Version: 24 March 2011
25

26. 26