-Integrating information with real world. -The s/w program processes the video stream data captured by the camera and tracks the location of colored markers using simple computer vision techniques.

2.  Introduction
 Components
 Working
 Related Technologies
 Applications
 Advantages
 Future Scope
 Conclusion

3. INTRODUCTION

4. The hardware components are coupled in a pendant
like mobile wearable device.
Camera
Projector
Mirror
Mobile Component
Colored Markers

5. CAMERA

6. PROJECTOR

7. SMART PHONE

8. MIRROR

9. Color Markers
 It is at the tip of the user’s fingers .
 Marking the user’s fingers with red, yellow, green, and
blue tape helps the webcam recognize gestures.
 The movements and arrangements of these makers are
interpreted into gestures that act as interaction
instructions for the projected application interfaces.

10. IMAGES, PICTURES,
GESTURES
Random
Surface
Capture
Digital Camera
Send for
Processing
Smartphone
Send Processed Info.
Projector
Project Image
Mirror
Reflect on
desired surface
HOW IT WORKS?

11. Sixth Sense software
 The main algorithm behind the Sixth Sense software is
the “ COMPUTER VISION ALGORITHMS .”
 Its an algorithm which is implemented using OPENCV
library.
 This is the heart of the hand gesture recognition
implemented in the Sixth Sense software.

12. Gesture Recognition
Sixth Sense software recognizes three kinds of
gestures:
 Multi touch gestures
 Freehand gestures
 Iconic gestures

14. APPLICATIONS

15. Make a call
You can use the Sixth Sense to
project a keypad onto your hand,
then use that virtual keypad to
make a call.
Call up a map
With the map application we can
call up the map of our choice
and then use thumbs and index
fingers to navigate the map

16. Check the time
Draw a circle on your
wrist to get a virtual watch
that gives you the correct
time
Create multimedia
reading experiences
Sixth Sense can be
programmed to project related
videos onto newspaper articles
you are reading

17. Drawing application
The drawing application lets the
user draw on any surface by
tracking the fingertip movements
of the user’s index finger
Zooming features
The user can zoom in or
zoom out using intuitive hand
movements

18. Get flight updates
The system will recognize your
boarding pass and let you know
whether your flight is on time
and if the gate has changed.
Feed information on people
The system will project relevant
information about a person such
as what they do, where they work,
and so on.

19. Take pictures
If you fashion your index
fingers and thumbs into a
square ("framing" gesture), the
system will snap a photo.
After taking the desired
number of photos, we can
project them onto a surface,
and use gestures to sort
through the photos, and
organize and resize them.

20. ADVANTAGES
Supports multi-touch and multi-user interaction
Portable
Connectedness between world and information
Cost effective
Data access directly from machine in real time
Mind map the idea anywhere
It is an open source

21. Page 21
DISADVANTAGES
 Hardware limitations of the devices we carry around
with us.
 Continuous power supply cannot be provided.
 It is expensive in nature as the current cost is around
350 $ or approximately 15000 rupees.
 The main cost is due to use of the micro projector.

22. Page 22
Future Scope
 3d visualizations.
 Solar batteries could be used in near future.
 This could act as a third eye for a blind person.
 After ten years we may be carrying an ultimate Sixth
Sense brain implant.
 Our Ex-president Dr Abdul Kalam is going to get it
incorporated in the Bhabha Atomic Research centre.

23. Page 23
CONCLUSION
 Sixth Sense recognizes the objects around us, displaying
information automatically and letting us to access it.
 The Sixth Sense prototype implements several applications
that demonstrate the usefulness, viability and flexibility of
the system
 Allow us to interact with the information via natural hand
gestures.

24. Page 24
CONCLUSION(cont..)
 Helps us to get rid of the divide between physical and
digital world.
 To be more connected to our physical world.
 Not be machines sitting in front of another machine.

25. Page 25
http://boingboing.net/2009/11/12/sixth-sense-technolo.html
http://gizmodo.com/5167790/sixth-sense-technology-may-change-how-
we-look-at-the-world-forever
http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.html
http://theviewspaper.net/sixth-sense-technology-will-revolutionize-the-
world/
http://www.freshcreation.com/entry/sixth_sense_technology/
REFERENCES

26. Page 26
THANK YOU