The document discusses sixth sense technology, which allows users to interact with digital information using natural hand gestures through a wearable device. It originated from Steve Mann's prototype in the 1990s and was further developed by Pranav Mistry. The technology works by using a camera to capture gestures and project visual information onto surfaces using a projector. Some applications mentioned include using it to check flight statuses, search maps, make calls, and take photos. While portable, issues include difficulty wearing the interface and errors in gesture recognition. The future scope discusses improving processing speed, connectivity, and implementing the technology in more areas like education and gaming.

1. sixth sense technology
T H E F U T U R E I S H E R E
GOPIKA GOPAN
S2 MCA
2022-2024
20
23
M I I T A Y O O R
6 T H S E N S E
PRESENTED BY

2. 1
2
3
4
Table Of Content
5
6
7
8
Introduction
History
Components
Working
Applications
Pros and Cons
Future Scope
Conclusion

3. Sixth Sense technology refers to a wearable device that allows users to interact
with digital information using natural hand gestures.
A sixth sense is an ESP(Extra Sensory Perception) that aims at a more developed
future with both the physical and digital world connected without the help of
hardware devices.
The Sixth Sense device enables us to interact with the world more efficiently. It
provides instant information about anything and anyone you scan, enhancing the way
we interact with the environment and people around us.
INTRODUCTION

4. History of
History of
6th sense
6th sense
technology
technology
Steve Mann
(father of 6th Sense
technology)

5. It composed of a pocket projector, a mirror and a
camera. The hardware components are coupled in a
pendant-like mobile wearable device.
Both the projector and the camera are connected to the
mobile computing device in the user’s pocket.
The initial approach was with the projector attached to
the helmet but there are various drawbacks of this
process,
Thus with a smaller projector, created the pendant
prototype to be shabby around the neck.
INITIAL PROTOTYPE
CURRENT PROTOTYPE
- Steve Mann
- Pranav Mistry

6. Microphone
COMPONENTS
Camera
Camera behaves as a digital
eye of the system.
Camera is used to capture
images or videos
It is only required when using
paper as an interactive surface
by capturing sound across the
paper medium
t

7. Mirror
Projector
COMPONENTS
Projector is the main output
device
It projects the visual information
on any surface. and physical
object
The mirror helps to reflect the
image on to a desired surface
t
It allows to choose the size and
place of projecting the result

8. Color Marker
Mobile computing device
COMPONENTS
It is the main processing
device of the system.
It may be any portable device
with internet access.
. Users’ fingers are marked with
red, yellow, green and blue
colored tape
It helps the camera to recognize
the hand gestures
t

9. components of Sixth sense technology

10. WORKING
Sixth sense device analyses what user sees and visually augments the surfaces
and physical objects user is interacting with.
The key here is that Sixth Sense recognizes the objects around you,
displaying information automatically and letting you access it in any way
you want, in the simplest way possible.
The object in view in captured by the camera and sends it to webcam for
processing. With the help of the markers, the gestures are identified.
The software program analyses the video data caught by the camera and also
tracks down the locations of the colored markers by utilizing single
computer vision techniques.

11. WORKING
The software recognizes 3 kinds of gestures:
Multitouch gestures
Freehand gestures
Iconic gestures
Then the processed information is projected by the projector onto the mirror
which in turn reflects it on the desired surface.
To develop an application based on sixth sense technology one can use
1) Language: Java, C #, C++, OpenCV, JavaCV.
2) Image processing Software: MatLab, Mathematica, Cylab
3) Powerful Electronic Gazette: WUW v0.1 beta, Hand Gloves

13. applications

14. applications
Virtual Newspapers Check your Flight Status
It Searches the most appropriate video
from the web by seeing the headlines
of the News report.
Just place the ticket in front of the
projector and it checks its status from
the internet.

15. applications
Recognize people scan & project on any surface
Recognize people by their appearances
and project related information
retrieved from the internet
Scan any image at real time and
project it into any surface easily

16. applications
Search the map Project on any surface
It can be used to navigate, to find places,
to find the shortest path etc
project on any surfacen, zoom in and out ,
retrieve info from internet directly

17. applications
Make calls Capture photos
Anybody Can project the keypad on his
palms and make calls just by touching
the digital keys(acting as virtual keys and
press the keys
It captures the photo, when you make a
square with your fingers, highlighting
which one you want to frame.

18. Portable : One of the main advantages of the
Sixth Sense devices portability. It can be
easily carried around without any difficulty
Integration : The digital information and its
objects are integrated into the physical world
by using the Sixth sense interface.
Multi sensing technique : allows the user to
interact with system with more than one
finger at a time .
Data access directly from the machines in
real time : the user can easily access data
from any machine at real time speed .
DISADVANTAGES
DISADVANTAGES
ADVANTAGES
ADVANTAGES
It is difficult to wear the interface
every time
To find appropriate vision based
gesture recognition algorithm is very
difficult task in the sixth sense
technology.
Failure of any components makes
functioning difficult.
There will be errors in interpretation
of gestures.
There are limitations on the
equipment used and image noise for
image-based gesture recognition

19. Future Scope
HIGH SPEED
PROCESSOR
CONNECTED TO
DEVICE
HD PROJECTION OF
PHOTOS AND VIDEO
ON ANY SURFACE
CONNECT THE
DEVICE TO CLOUD
FOR STORING
INFORMATION
IMPLEMENT THIS
TECHNOLOGY IN VARIOUS
AREAS LIKE GAMMING,
EDUCATION SYSTEM
.

20. The Sixth sense technology is near future technology. If its security threats
are handle efficiently then it will be the most popular technology amongst
all.
The key here is that Sixth Sense recognizes the objects around you,
displaying information automatically and letting you access it in any way
you want, in the simplest way possible.
It is the real example of how we can greatly communicate with the
technology to make our life easy and as the name suggests it is definitely
an extra sense to disable people.
CONCLUSION