DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
6th Sense: The Technology Ahead
1. Submitted To : Submitted By :
ICAI Jodhpur Saurabh Vaid Mehta
The Institute of Chartered Accountants of India
2. Introduction
• 'SixthSense' is a wearable gestural interface that augments
the physical world around us with digital information and lets
us use natural hand gestures to interact with that
information.
• It was developed by Pranav Mistry, a PhD candidate in the
Fluid Interfaces Group at the MIT Media Lab
• SixthSense brings intangible, digital information out into the
tangible world, and allowing us to interact with this
information via natural hand gestures, and thus making the
entire world your computer.
3. COMPONENTS
•• Usage of is at mirror of the user’s
It the the tip is
The•projector projects visual
• significantan object in view
Captures as enabling surfaces
fingers
information the projector
•pointing user’s fingers
andtracksCamera green, and
danglesMarking user’s hand used
and •physical objects to be
the the
with red, yellow,
gestures Projector
downwards tape helps neck.
blue from the the webcam
•
as interfaces
•
•• AThe project datagestures a
It Web –enabled smart
sends the itselfto smart
recognize contains
• Coloured markers
phone the user’s pocket
phone ininside, with 3 hours of
battery
• • digital & Mobile
• TheMirroreye,
battery movements and
processesathe video data
It acts aslife
arrangements of these
•• component
connecting projector displaysinto
A tiny LED you tointerpreted
makers are the world
Other software searches
thedigital and interpretsas phone
gestures that act
of Web information the
data sent from the smart for
interaction instructions
hand gestures in view-object,
on anythe projected application
surface
interfaces
wall, or person
4. How It Works?
Send for Capture
Images
Processing Pictures
Gestures
Send Info
Projects Reflects Info on
on
Image Desired
Surface
Surface
6. DRAWING APPLICATION
The drawing application lets the user draw
on any surface by tracking the fingertip
movements of the user’s index finger
7. Create multimedia reading
experiences
Sixth Sense can be programmed to project
related videos onto newspaper articles you are
reading
8. CHECK THE TIME
Draw a circle on your wrist to get a virtual watch that
gives you the correct time
9. MAKE A CALL
You can use the Sixth Sense to project a keypad onto
your hand, then use that virtual keypad to make a call.
10. Call up a map
With the map application we can call up
the map of our choice and then use thumbs
and index fingers to navigate the map
11. Take pictures
If you fashion your index fingers
and thumbs into a square
("framing" gesture), the system
will snap a photo After taking the
desired number of
photos, we can project them onto
a surface, and use gestures to
sort
through the photos, and organize
and resize them.
12. Advantages Disadvantages
• Portable • Product is not yet released
• Supports multi-touch and into the market
multi-use interaction • Concerns about the pricing
• Connectedness between of this device
world and information • World doesn’t know
• Cost effective VS whether the work on this
• Data access directly from device is stopped
machine in real time • Projection is better in the
• Mind map the idea night time and dark areas
anywhere rather than mornings and
• It is an open source bright areas