All six senses of Human BeingTouch Taste Body MouthSight Smell Eyes NoseHear Calculation Ear Mind
Sixth Sense is a wearable gestural interface that connects the physical worldaround us with digital information and lets us use natural hand gestures to interactwith that information.It was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group atthe MIT Media Lab.Sixth Sense bridges the gap by bringing intangible, digital information out intothe tangible world, and allowing us to interact with this information via naturalhand.Sixth Sense comprises a pocket projector, a mirror and a camera.The hardware components are coupled in a pendant like mobile wearable device.
Pranav MistryInstitutions:Research assistant and PhD candidate at MIT Media LabKnown for:Inventor of SixthSense Technology,Mouseless and TeleTouchNotable awards:2009 Invention Award By Popular ScienceTR35 2009 by Technology Review
Mouseless is an invisible computer mouse that provides thefamiliarity of interaction of a physical mouse without actuallyneeding a real hardware mouse.TeleTouch lets you touch and control from far. See thru yourSmartphones camera and control EVERYTHING you see on the screen bytouching it. Now you can interact with your appliances from far, in a funway. Here it goes. You looks any scence thru the camera of yourSmartphone and control what you see - home appliances (TV, alarm,music player, … ), Open the door; or turn on that light… Just by touchingit on screen. It’s simple. TeleTouch lets you interact with your world withtouch, but now from far.
The hardware components are coupled in a pendant like mobilewearable device. Camera Mobile Component Projector Mirror Colored Markers
Captures an object in view and tracks the user’s hand gestures It sends the data to smart phone It acts as a digital eye, connecting you to the world of digitalinformation
A web-enabled smart phone in the user’s pocket processesthe video dataOther software searches the Web and interprets the handgestures
The projector projects visual information enabling surfaces and physicalobjects to be used as interfacesThe project itself contains a battery inside, with 3 Hours of battery life.A tiny LED projector displays data sent from the smart phone on any surfacein view–object, wall, or person.
MIRRORThe usage of the mirror is significant as the projector danglespointing downwards from the neck.
It is at the tip of the user’s fingers . Marking the user’s fingers with red, yellow, green, and blue tapehelps the webcam to recognize gesturesThe movements and arrangements of these makers areinterpreted into gestures that act as interaction instructions for theprojected application interfaces.
Send for processing capture Images Pictures GesturesSend Info Reflect on desired Project surface Info on image surface
The hardware that makes Sixth Sense work is a pendant like mobilewearable interfaceIt has a camera, a mirror and a projector and is connected wirelessly to aBluetooth smart phone that can slip comfortably into one’s pocketThe camera recognizes individuals, images, pictures, gestures one makeswith their handsInformation is sent to the Smartphone for processingThe downward-facing projector projects the output image on to the mirrorMirror reflects image on to the desired surfaceThus, digital information is freed from its confines and placed in thephysical world
Gesture recognition is a topic in computer science and language technologywith the goal of interpreting human gestures via mathematical algorithms.Augmented reality is a term for a live direct or indirect view of a physical realworld environment whose elements are augmented by virtual computer generatedimagery.Computer vision is the science and technology of machines that see. It isconcerned with the theory behind artificial systems that extract information fromimages.Radio Frequency Identification is basically an electronic tagging technologythat allows the detection, tracking of objects through a supply chain.
Make a call You can use the Sixth Sense to project a keypad onto your hand, then use that virtual keypad to make a call. Call up a map With the map application we can callup the map of our choice and then usethumbs and index fingers to navigatethe map
Drawing application The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger Zooming featuresThe user can zoom in or zoom outusing intuitive hand movements
Get product information Sixth Sense uses image recognition or marker technology to recognize products we pick up, then feeds us information on those products Get book informationThe system can project Amazonratings on that book, as well asreviews and other relevantinformation
Get flight updates The system will recognize your boarding pass and let you know whether your flight is on time and if the gate has changed. Feed information on people The system will project relevantinformation about a person such as whatthey do, where they work, and so on.
Take pictures If you fashion your index fingers and thumbs into a square ("framing" gesture), the system will snap a photo.After taking the desired number ofphotos, we can project them onto asurface, and use gestures to sort athrough the photos, and organize andresize them.
PortableSupport Multi Touch and Multi Touch InteractionsA bridge between physical world and digital sourcesCost effectiveAnother interesting thing is the inventor of sixth sense, Mr. PranavMistry has declared to make it open source.
Not good configurationIf You made a bad gesture then it will not as u want.We have to make gesture near to perfect.Low Battery BackupNot Yet Released in the marketSecurityPrivacy
This is a universal fact that there is no any perfect technologyevery technology comes with advantages some disadvantagestogether.Sixth Sense recognizes the objects around us, displayinginformation automatically and letting us to access it in anyway we need.The sixth sense prototype implements several applicationsthat demonstrate the usefulness, viability and flexibility ofthe system.Allowing us to interact with the information via natural handgestures.Bye-Bye Keyboards and mouse.