Sixth Sense Technology


Published on

-Integrating information with real world.
-The s/w program processes the video stream data captured by the camera and tracks the location of colored markers using simple computer vision techniques.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Sixth Sense Technology

  1. 1.  Introduction  Components  Working  Related Technologies  Applications  Advantages  Future Scope  Conclusion
  3. 3. The hardware components are coupled in a pendant like mobile wearable device. Camera Projector Mirror Mobile Component Colored Markers
  4. 4. CAMERA
  7. 7. MIRROR
  8. 8. Color Markers  It is at the tip of the user’s fingers .  Marking the user’s fingers with red, yellow, green, and blue tape helps the webcam recognize gestures.  The movements and arrangements of these makers are interpreted into gestures that act as interaction instructions for the projected application interfaces.
  9. 9. IMAGES, PICTURES, GESTURES Random Surface Capture Digital Camera Send for Processing Smartphone Send Processed Info. Projector Project Image Mirror Reflect on desired surface HOW IT WORKS?
  10. 10. Sixth Sense software  The main algorithm behind the Sixth Sense software is the “ COMPUTER VISION ALGORITHMS .”  Its an algorithm which is implemented using OPENCV library.  This is the heart of the hand gesture recognition implemented in the Sixth Sense software.
  11. 11. Gesture Recognition Sixth Sense software recognizes three kinds of gestures:  Multi touch gestures  Freehand gestures  Iconic gestures
  13. 13. Make a call You can use the Sixth Sense to project a keypad onto your hand, then use that virtual keypad to make a call. Call up a map With the map application we can call up the map of our choice and then use thumbs and index fingers to navigate the map
  14. 14. Check the time Draw a circle on your wrist to get a virtual watch that gives you the correct time Create multimedia reading experiences Sixth Sense can be programmed to project related videos onto newspaper articles you are reading
  15. 15. Drawing application The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger Zooming features The user can zoom in or zoom out using intuitive hand movements
  16. 16. Get flight updates The system will recognize your boarding pass and let you know whether your flight is on time and if the gate has changed. Feed information on people The system will project relevant information about a person such as what they do, where they work, and so on.
  17. 17. Take pictures If you fashion your index fingers and thumbs into a square ("framing" gesture), the system will snap a photo. After taking the desired number of photos, we can project them onto a surface, and use gestures to sort through the photos, and organize and resize them.
  18. 18. ADVANTAGES Supports multi-touch and multi-user interaction Portable Connectedness between world and information Cost effective Data access directly from machine in real time Mind map the idea anywhere It is an open source
  19. 19. Page 21 DISADVANTAGES  Hardware limitations of the devices we carry around with us.  Continuous power supply cannot be provided.  It is expensive in nature as the current cost is around 350 $ or approximately 15000 rupees.  The main cost is due to use of the micro projector.
  20. 20. Page 22 Future Scope  3d visualizations.  Solar batteries could be used in near future.  This could act as a third eye for a blind person.  After ten years we may be carrying an ultimate Sixth Sense brain implant.  Our Ex-president Dr Abdul Kalam is going to get it incorporated in the Bhabha Atomic Research centre.
  21. 21. Page 23 CONCLUSION  Sixth Sense recognizes the objects around us, displaying information automatically and letting us to access it.  The Sixth Sense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system  Allow us to interact with the information via natural hand gestures.
  22. 22. Page 24 CONCLUSION(cont..)  Helps us to get rid of the divide between physical and digital world.  To be more connected to our physical world.  Not be machines sitting in front of another machine.
  23. 23. Page 25   we-look-at-the-world-forever   world/  REFERENCES
  24. 24. Page 26 THANK YOU