The document discusses the Sixth Sense technology, a wearable gestural interface that augments the physical world with digital information. It can project information onto surfaces using a camera, projector and mirror. The technology recognizes hand gestures to allow interactions like getting maps, photos and product information without devices. It offers advantages like connectivity and accessibility but faces issues like privacy, health effects and lack of durability. The technology may transform fields like education, e-commerce and assistance for disabled people.

1. SEMINAR PRESENTATION
ON
SIXTH SENSE TECHNOLOGY: A VARIANT
FOR UPCOMING TECHNOLOGIES

2.  Introduction
 Evolution
 Software
 Hardware Components
 Working
 Related Technologies
 Applications
 Advantages and Disadvantages
 Conclusion
 References

3. Sixth sense is a wearable
gestural device that augments
the physical world around us
with the digital information.
Technology that plays with
human gestures to make the
world more interactive and
workflow easier.
It is portable device that is worn
around neck.

5. Steve Mann is considered the
father of sixth sense
technology.
He invented a wearable
computer device in 1990s.
His work was carried forward
by Pranav Mistry, of Indian
origin, a PhD student in the
Fluid Interfaces Group at the
MIT Media Lab.

6.  The Sixth Sense prototype runs on windows
operating system.
 Major part of the software is coded in C# and C++

7.  Camera
 Color markers
 Projector
 Mirror
 Mobile component
 Microphone

8. • The camera captures an object in view and tracks
the user’s hand gestures.
• It sends the data to smart phone which runs sixth
sense software.

9.  The user has to wear marker caps (red, blue, green, yellow)
known as visual tracking fiducials on the tip of his finger.
 It helps the camera to track the movements of the users
finger.

10.  The projector is the key output device.
 The projector projects visual information enabling
surfaces and physical objects to be used as interface.

11.  Mirror reflects the projection coming out from projector
and thus helps in projecting out onto the desired location
on walls or surfaces.
Mirror

12.  The smartphone runs the sixth
sense software to process the
video stream data captured
through the camera.
 It is used for computation and
communication purpose.

13.  The microphone is an
optional component. It is
required only when
paper is used as an
computing interface.
 The microphone
captures the sound
signals and sends it to
the smart phone for
processing.

15. 1. Augmented Reality
• The Augmented Reality is a visualization
technology that allows the user to experience the
virtual world added over real world in real time.
• Sixth sense technology uses this concept to super
impose digital information on the real world.

16. 2. Gesture recognition
• It is a technology which is aimed at interpreting
human gestures with the help of mathematical
algorithms.
• Gestures can originate from any bodily motion or
state but commonly originate from the face or
hand.

17. The sixth sense software recognizes the following
three types of gestures:
1. Multi-touch gestures
Eg: pinching and dragging
2. FreeHand gestures
Eg: clicking a picture
3. Iconic gestures
Eg: drawing a star for weather

18. 3. Computer vision techniques
• Computer Vision is the technology in which
machines are able to interpret or extract necessary
information from an image.
• This technology includes various fields like image
processing, image analysis, pattern recognition.

20. Make a call
You can use the Sixth Sense to project a
keypad onto your hand, then use that
virtual keypad to make a call.
The map application
With the map application we can call
up the map of our choice and then use
thumbs and index fingers to navigate
the map

21. Check the time
Draw a circle on your wrist to
get a virtual watch that gives you
the correct time
Create multimedia
reading experiences
Sixth Sense can be programmed to
project related videos onto newspaper
articles you are reading

22. Drawing application
The drawing application lets the user draw on
any surface by tracking the fingertip
movements of the user’s index finger
Zooming features
The user can zoom in or zoom out
using intuitive hand movements

23. Get product information
Sixth Sense uses image recognition or
marker technology to recognize products we
pick up, then feeds us information on those
products
Get book information
The system can project Amazon ratings
on that book, as well as reviews and
other relevant information

24. Get flight updates
The device can also tell the user whether
your flight is delayed or on time and by
looking at the ticket.
Feed information on
people
The system will project relevant information
about a person such as what they do, where
they work, and so on.

25. Take pictures
If you fashion your index fingers and
thumbs into a square ("framing"
gesture), the system will snap a photo.
After taking the desired number of
photos, we can project them onto a
surface, and use gestures to sort through
the photos, and organize and resize
them.

26.  Connectedness between the world and information.
 Portable
 Multi-touch interactions.
 Data access directly from machine in real time.
 Open source
 Cost effective
No privacy
Intelligence opening doors for criminals
Health issues
There is no easy way to fix if device breaks
The device doesn't project on hard surfaces

27. •Use of papers and pens will decrease.
•Online shopping may become easy if,
Virtual changing room, where one can
give his body measurements and try
clothes on a virtual copy of his image, is
created by web developers.
•It can become a fifth sense for
handicapped people.
•New way of teaching in Education
System.
•Videos can be widely annotated by
physical events side by side

28. [1] Sixth Sense Technology by Abhinav Sharma, Mukesh Agarwal,
Anima Sharma, Sachin Gupta, International Journal IJRITCC
Volume 1, Issue 4, 277-282.
[2] Gesture Based Interface Using Motion and Image Comparison by
Shany Jophin, Sheethal M.S, Priya Philip, T M Bhruguram, IJAIT Vol.
2, No.3, June 2012.
[4] Real Time Hand Gesture Interface for Computing Environment
by Shitalkumar Pawar and M.A. Sayyad, International Journal of
Computer Applications (0975 – 8887)(ICRTET'2013).
[5] WUW - Wear Ur World - A Wearable Gestural Interface by
Pranav Mistry, Pattie Maes and Liyan Chang , MIT Media Lab, ACM
978-1-60558-246-7/09/04.