SIXTH SENSE TECHNOLOGY Under the guidance of Prof.Hemant jogi Lecturer, Dept of computers MR.Naresh harale (h.o.d,computers dept.) Submitted by: Monali patil Akshata kamble Deepak pandey Hitesh pandey
Contents introduction components working applications
introduction Sixth Sense Technology is a wearable gestural interface that arguments the physical world around us with digital information and let us use natural hand gestures to interact with that information. It was developed by PRANAV MISTRY, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. Sixth Sense bridges the gap by bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hands. Sixth Sense comprises of packet projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device.
CAMERA Captures an object in view and tracks the user’s hand gestures. It sends the data to the smart phone and then it gets processed. It acts as a digital eyes, connecting you to the world of digital information.
PROJECTOR The projector projects visual information enabling surfaces andphysical objects to be used as interfaces. The projector itself contains a battery inside, with 3 hours ofbattery life. A tiny LED project displays data sent from a smart phone deviceon any surface in view-object , wall, or person.
MIRROR The usage of mirrors are significant as the projector danglespointing downwards from the neck. SMART PHONES A Well-Enabled smart phone in user’s pocket processes the video data. Other software searches the Web and interprets the hand gestures.
COLOUR MARKERS As we can see from the fig., it is always at the tip of the finger. Marking the user’s finger with red, yellow, green and blue tapeshelps the Web-cam recognize the hand gestures. The movements and arrangements of these markers areinterpreted into gestures that act as interaction instructions for theprojected application interfaces.
HOW IT ACTUALLY WORKS??? Sends for processing capture Images Gestures Pictures capture ImagesSends for Gesturesprocessing Pictures Send info Information Send on the info surfaces Project images Reflect on the desired surface Reflect on the Project images desired surface Information on the surfaces
DESCRIPTION The hardware that makes Sixth Sense work is a pendent like mobilewearable interface. It has a camera, a mirror and a projector and is connected wirelesslyto a Bluetooth smart phone that can slip comfortably into one’s pocket. The camera recognizes individuals, images, pictures, gestures onemakes with their hands. Information is sent to the Smart Phone for processing. The downward-facing projector projects the output image on to themirror.Mirror reflects the image on the desired surface. Thus, a digitalinformation is freed and placed in the physical world.
RELATED TECHNOLOGIES Augmented reality is the term for a live direct or indirect view of aphysical real world environment whose elements are augmented byvirtual computer generated imagery.Gesture recognition is a topic in computer science and languagetechnology with the goal of interpreting human gestures viamathematical algorithms. Computer version is the science and technology of machines that see.It is concerned with the theory behind artificial systems that extractinformation from images. Radio Frequency Identification is basically an electronic taggingtechnology that allows the detection, tracking of tags and consequentlythe objects that are affixed to.
MAKE A CALL You can use the Sixth Sense to project a keypad onto your hand, then use the virtual keypad to make a call. CALL UP A MAPWith the map application we can call upthe map of our choice and then usethumbs and index fingers to navigate themap.
CHECK THE TIME Draw a circle on your wrist to get avirtual watch that gives you the correcttime. CREATE MULTIMEDIAREADING EXPERIENCESixth Sense can be programmed toproject related videos onto newspaperarticles you are reading.
DRAWING APPLICATIONSThe drawing application lets the users draw onany surface by tracking the fingertip movementsof the user’s index finger.ZOOMING FEATURES The user can zoom in or zoom out usingintuitive hand movements.
GET PRODUCT INFORMATIONSixth Sense uses the image recognition ormarker technology to recognize productswe pick up ,then feeds the informationon those products. GET THE BOOKS INFORMATIONThe system can project Amazon ratingson that book ,as well as reviews andother relevant information.
GET AN UPDATEABOUT FLIGHTSThe system will recognize your boardingpass and lets you know whether yourflight is on time and if the gate haschanged. FEED PEOPLE INFORMATION The system will project the relevant information about the person such as what they do, where they work, and so on.
TAKE A PICTUREIf you fashion your index fingers andthumbs into a square (“FRAMING” )gesture, the system will snap a photo.After taking the desired number of photos,we can project them onto a surface, anduse gestures to sort through the photos,and organize and reside them.
ADVANTAGES Portable. Supports multi-touch and multi-user interaction. Connectedness between world and information. Cost effective. Data access directly from machine in real time. Mind map the idea anywhere. It is an Open Source.
CONCLUSIONSixth Sense recognizes the objects around us, displays informationautomatically and letting us to access it in anyway we need. The Sixth Sense prototype implements several applications thatdemonstrate the usefulness, viability and flexibility of the system.Allows us to interact with this information via natural getsures. The potential of becoming the ultimate “transparent” userinterface for accessing information about everything around us.