1. SHANKERSINH VAGHELA BAPU
INSTITUTE OF TECHNOLOGY
THE SIXTH SENSE TECHNOLOGY
By,
- Ronak M. Dumasia
10IT049 1
2. 2
SIXTH SENSE
CONTENTS
• INTRODUCTION
• COMPONENTS
• WORKING
• APPLICATIONS
• ADVANTAGES
• CONCLUSION
3. INTRODUCTION
•Sixth Sense is a wearable gestural interface that augments the
physical world around us with digital information and lets us use
natural hand gestures to interact with that information.
• It was developed by ”Pranav Mistry”, a PhD student in the Fluid
Interfaces Group at the MIT Media Lab.
• Technology that plays with Human gestures to make the world
more interactive and workflow much easier.
• SixthSense comprises a pocket projector, a mirror and a camera.
The hardware components are coupled in a pendant like mobile
wearable device.
3
• The cost of Sixth Sense Technology is estimated $350.
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
4. 4
COMPONENTS
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
• Camera
• Projector
• Mirror
• Mobile component
• Coloured markers
5. 5
CAMERA
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
• Captures an object in view and tracks the
user’s hand gestures.
• It sends the data to smart phone.
• It acts as a digital eye, connecting you to the
world of digital information.
6. 6
PROJECTOR
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
• The projector projects visual information enabling
surfaces and physical objects to be used as interfaces.
• The project itself contains a battery inside, with 3
hours of battery life.
• A tiny LED projector displays data sent from the smart
phone on any surface in view-object, wall, or person
7. 7
Smart Phone & Mirror
INTRODUCTION
COMPONENTS
TECHNOLOGY
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
• The usage of the mirror is significant as the
projector dangles pointing downwards from the
neck.
• A Web –enabled smart phone in the user’s
pocket processes the video data.
• Other software searches the Web and
interprets the hand gestures.
8. 8
COLOUR MARKERS
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
• It is at the tip of the user’s fingers.
• Marking the user’s fingers with red, yellow, green, and
blue tape helps the webcam recognize gestures.
• The movements and arrangements of these makers are
interpreted into gestures that act as interaction
instructions for the projected application interfaces.
9. 9
How Does It Works?
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
10. 10
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
•The hardware that makes Sixth Sense work is a pendant like
mobile wearable interface.
•It has a camera, a mirror and a projector and is connected
wirelessly to a bluetooth smart phone that can slip comfortably
into one’s pocket.
•The camera recognizes individuals, images, pictures, gestures
one makes with their hands.
•Information is sent to the Smartphone for processing.
•The downward-facing projector projects the output image on to
the mirror.
•Mirror reflects image on to the desired surface.
•Thus, digital information is freed from its confines and placed in
the physical world.
11. 11
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
APPLICATIONS
• CHECK TIME
Check the time just by
drawing a circle on the
wrist.
• WATCH VIDEOS
Watch related videos
on the news-paper
articles you are reading.
12. 12
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
APPLICATIONS
• MAKE A CALL
To make a call, virtual
keypad is shown on your
palm.
• GET PRODUCT
INFORMATION
Get product
information by using
image recognition
technology.
13. 13
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
APPLICATIONS
•BOOK
INFORMATION
Get book reviews,
ratings & other relevant
information.
• GET UPDATES
Get flight, train,
bus updates
regarding timing of
the same.
14. 14
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
APPLICATIONS
• TAKE PICTURES
If you fashion your index
fingers and thumbs into
framing gesture, the
system will snap a photo.
• ORGANIZE PHOTOS
After taking the photos,
we can project them onto
a surface, and use
gestures to sort through
the photos, & organize
and resize them.
15. 15
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
APPLICATIONS
• DRAWING
The drawing application
lets the user draw on any
surface by tracking the
fingertip movements.
• CALL UP A MAP
With the map application
we can call up the map of
our choice and then use
thumbs and index fingers to
navigate the map
16. 16
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
ADVANTAGES
• Connectedness between world and information.
• Data access directly from machine in real time.
• Mind map the data anywhere.
• Portable.
• Inexpensive.
• Open Source.
• Very helpful in Emergency situations.
•Mind map the idea anywhere.
17. 17
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
CONCLUSION
The key here is that Sixth Sense recognizes the objects around
you, displaying information automatically and letting you access
it in any way you want, in the simplest way possible.
Clearly, this has the potential of becoming the ultimate
"transparent" user interface for accessing information about
everything around us.
It may change the way we interact with the real world and truly
give everyone complete awareness of the environment around
us.
18. 18
INTRODUCTION
COMPONENTS
WORKING
APPLICATIONS
ADVANTAGES
CONCLUSION
REFERENCES
REFERENCES
http://boingboing.net/2009/11/12/sixth-sense-technolo.
html
http://gizmodo.com/5167790/sixth-sense-technology-may-
change-how-we-look-at-the-world-forever
http://www.ted.com/talks/pattie_maes_demos_the_sixth_
sense.html
http://theviewspaper.net/sixth-sense-technology-will-revolutionize-
the-world/
http://www.pranavmistry.com
http://www.slideshare.net