The document discusses Sixth Sense technology, which is a wearable gestural interface that augments the physical world with digital information. It consists of a camera, projector, mirror, colored markers, and smartphone. The camera tracks hand gestures tagged with colored markers while the projector displays augmented information onto surfaces. The smartphone processes input and provides output. Some applications include making calls, accessing maps, taking pictures. Advantages include accessibility of information and usability. Future enhancements could include removing markers and incorporating more components into a mobile device.

1. Sixth Sense Technology
WEARABLE GESTURAL INTERFACE
1

2. CONTENT OVERVIEW
2
1
• Introduction
2
• History
3
• Components
4
• installation
5
• Working
6
• Applications
7
• Advantages
8
• Disadvantages
9
• Uses
10
• Future Enhancements

3. DEFINITION
3
‘Sixth Sense' is a
wearable gestural
interface that augments
the physical world
around us with digital
information and lets us
use natural hand
gestures to interact with
that information.’

4. What is
SIXTH
SENSE?
 It is a technology based on
the concept of augmented
reality
 It is an integration of the
real world object with the
digital world
 It is an ESP(extra sensory
perception) thus the name.
4

5. HISTORY
 Proposed by Steve Mann
 Developed in MIT Labs
 1994-1997 as head worn
device
 1998 as neck worn device
5

6.  The work was furthered by
Pranav Mistry
 They initially produced a
wristband that would read
an Radio Frequency
Identification tag.
 They started with a larger
projector that was mounted
on a helmet.
6

7. Initial Prototype
7

8. Hardware
Components
 Camera
 Projector
 Microphone
 Mirror
 Smartphone
 Coloured markers
8

9. 9
CAMERA
MICROPHONE
PROJECTOR
MIRROR
COLOR MARKERS
MOBILE COMPUTING DEVICE

10. CAMERA
 Capture an object in view and tracks the
user’s hand gestures
 It sends the data to smart phone
 It acts as a digital eye , connecting you to
the world to digital information
10

11. PROJECTOR
 Projects graphical user interface of the
selected application onto surfaces or walls in
front.
 Prototype contains a rechargeable battery
 The mobile computing device provides the
projector with the content to be projected
11

12. MIRROR
 The usages of the mirror is significant as the
projector dangles pointing downwards from
the neck.
 The user can manually change the tilt of the
mirror to change the location of the
projection
12

13. SMART PHONES
 A Web-enabled smart phone in
the user’s pocket processes the
video data.
 Other Software searches the Web
and interprets the hand gesture.
13

14. COLOR MARKERS
 It is at the tip of the user’s fingers .
 Marking the user’s fingers with red,
yellow, green, and blue tape helps the
webcam recognize gestures.
 The movements and arrangements of
these markers are interpreted into
gestures that act as interaction instruction
for the projected application interfaces.
14

15.  Optional component of SixthSense
 Required when a paper is used as a
computing device
 Clipped microphone captures the
sound signals of user touching the
paper
15
MICROPHONE

16. 16
GESTURE
RECOG-
NITION
COMPUTER
VISION
AUGMENT-
ED
REALITY
RADIO
FREQUEN-
CY
ID

17.  Language: c++, c#
 Software: WUW v0.1
 Operating System:
windows
 Visual Studio
 DirectX
17
Software
Components

18. 18
Download v0.1from
https://code.google.com/archive/p/sixthsen
se/wikis/Software.wiki
Extract and copy the files from
wuw_v0.1.zip
Open WUW01.sln (which is present in the
folder "CODE") then click on F5 to debug
it
Configure camera settings select color
markers and then launch any application
available in menu

19. WORKING
19
Images
Pictures
Gestures
Camera
for image
capture
Process
Informa-
tion
Project
informa-
tion

20. 20

21. Applications
 Call your contacts
 Refer a map
 Check the time
 Easily available multimedia content
 Drawing application
 Product details
 Play games
 Get book details
 Book and check flights
 Get details of people
 Take pictures
21

22. 22MAKE A CALL
AUGMENTED
NEWSPAPER
CLICK
PICTURES
PLAY
GAMES
DRAW
ANYWHERE
REFER A
MAP
CHECK THE
TIME
PROJECT DETAILS

23. Advantages
23
 Makes the whole world our computer
 Adapts to our needs
 Brings intangible information to tangible world
 Supports multi-touch and multi-user interaction
 Real time direct data access
 Open source and cost effective
 Useful, viable and flexible system
 Portable

24. Disadvantages
24
 Security
 Projection efficiency
 Cost
 Impractical

25. 25USEFULNES
S
USABILITY
EFFICIENCYFLEXIBILITY
COST

26.  Engaging Lectures
 Research Purpose
 Collaborative Projects
26
USES

27.  To get rid of colour markers
 To incorporate camera and
projector inside mobile computing
device.
 Broadening the scope of
technology
 To have 3D gesture tracking.
 To make sixth sense work as fifth
sense for specially abled people.
27
FUTURE
ENHANCEMENT

28. CURRENT
STATUS
 No commercial product
released.
 Open source code has not
been updated since 2012
28

29. Thank You
-MISHIKA BHARADWAJ