The document summarizes the development of Sixth Sense technology, a wearable gestural interface system developed in 1997-1998. It consists of a pocket projector, camera, and mobile device. The projector projects interfaces onto surfaces while the camera tracks hand gestures to interact with projected interfaces. Several demo applications are described to showcase its capabilities, such as projecting maps, clocks, and internet content. While the technology received media attention in 2009, commercialization has been delayed due to technical challenges.

2. In 1997 the first
headworn
Sixth sense technology
device was developed.
This was the origin of
the sixth sense
technology. Later
in 1998 a neckworn
sixth sense device was
developed.

3. The SixthSense prototype
is comprised of a pocket
projector, a mirror and a
camera. The hardware
components are coupled
in a pendant like mobile
wearable device. Both the
projector and the camera
are connected to the mobile
computing device in the user’s pocket.

4. The projector projects visual information enabling
surfaces, walls and physical objects around us to be
used as interfaces.

5. • While the camera recognizes and tracks user's hand
gestures and physical objects using computer-vision
based techniques.

6. • The software program processes the video stream data captured by
the camera and tracks the locations of the colored markers (visual
tracking fiducials) at the tip of the user’s fingers using simple
computer-vision techniques. The movements and arrangements of
these fiducials are interpreted into gestures that act as interaction
instructions for the projected application interfaces. The maximum
number of tracked fingers is only constrained by the number of
unique fiducials, thus SixthSense also supports multi-touch and multi-
user interaction.

7. The SixthSense prototype implements several applications
that demonstrate the usefulness, viability and flexibility of
the system.
1. The projector displays a map on the wall, and the user can control the
map using zoom and pan gestures.

8. 2. A number pad is projected onto the user's palm, and the user can
dial a phone number by touching his palm with a finger. t was hinted
that the system is able to pin point the location of the palm.

9. 3. The user can pick up a product in supermarket and the system could
display related information (e.g. the amount of bleach used) back on
the product itself.

10. 4. The user can draw a circle on his wrist, and the system will project a
clock on it. Note this demo hinted at the ability to accurately detect the
location of the wrist.

11. 5.The prjector can project the entire news paper infront of the user. It
can project it wither on a white paper or even on a hand.

12. 6.It is also used to display contents from internet and project them on
any piece of paper.

13. • Although the SixthSense technology achieved wide press
coverage in 2009, no commercial product had been released at
that time. As of September 2013, the open source code
published has not been updated since October 2012,and the
Java development branch of the project was similarly stalled.
With many users encountering difficulties compiling and
running the source code, the technology itself has not spread as
widely as its media coverage. Pranav Mistry hinted at several
reasons for not being able to deliver the technology so far.

14. • The price for developer’s preview is around $350.
• It is hinted that the device needs to incorporate newer
hardwares and there is also need to remove dependencies
on proprietary Microsoft code libraries before the
commercial release.