A PAPER PRESENTATIONONSIXTH SENSE TECHNOLOGYPRESENTED BY: J.G.M.Jagagdeesh KumarDepartment of C.S.E. (IV year)Affiliated to JNTU KDJR College of Engineering and Technology,Gudavalli, VijayawadaKrishna (dt.), Andhra Pradesh, India.
ABSTRACTSixth Sense is a wearable gesturalinterface device developed by PranavMistry, a PhD student in the FluidInterfaces Group at the MIT Media Lab. Itis similar to Telepointer. The Sixth Senseprototype comprises a pocket projector, amirror and a camera contained in apendant like, wearable device. Both theprojector and the camera are connectedto a mobile computing device in the user’spocket. The projector projects visualinformation enabling surfaces, walls andphysical objects around us to be used asinterfaces; while the camera recognizesand tracks users hand gestures andphysical objects using computer- visionbased techniques. The software programprocesses the video stream data capturedby the camera and tracks the locations ofthe colored markers (visual trackingfiducially) at the tip of the user’s fingers.The movements and arrangements ofthese fiducially are interpreted intogestures that act as interactioninstructions for the projected applicationinterfaces. Sixth Sense supports multi-touch and multi-user interaction.INTRODUCTIONSixth Sense is a wearablegestural interface that augmentsthe physical world around us with digitalinformation and lets us use natural handgestures to interact with that information.It was developed by Pranav Mistry, a PhDstudent in the Fluid Interfaces Group at theMIT Media Lab.Sixth Sense bridges the gap by bringingintangible, digital information out into thetangible world, and allowing us tointeract with this information via naturalhand Sixth Sense comprises a pocketprojector, a mirror and a camera. Thehardware components are coupled in apendant like mobile wearable device SixthSense is a mini-projector coupled with acamera and a cell phone—which acts asthe computer and your connection to theCloud, all the information stored on theweb. Sixth Sense can also obey handgestures, like in the infamous MinorityReport. The camera recognizes objectsaround you instantly, with the micro-projector overlaying the information on anysurface, including the object itself or yourhand. Then, you can access or manipulatethe information using your fingers. Need tomake a call? Extend your hand on front ofthe projector and numbers will appear foryou to click. Need to know the time? Drawa circle on your wrist and a watch willappear. Want to take a photo? Just make asquare with your fingers, highlighting whatyou want to frame and the system willmake the photo—which you can laterorganize with the others using your ownhands over the air. The true power of Sixth
Sense lies on its potential to connect thereal world with the Internet, and overlayingthe information on the world itself.WHY SIXTH SENSE?COMPONENTThe hardware components are coupled in apendant like mobile wearable device. Camera Projector Mirror Mobile Component Colored MarkersCAMERA Captures an object in view andtracks the user’s hand gestures It sends the data to smartphone It acts as a digital eye,connecting you to the worldof digital information
PROJECTOR The projector projects visualinformation enabling surfacesand physical objects to beused as interfaces. The project itself contains abattery inside, with 3 hours ofbattery life. A tiny LED projector displaysdata sent from the smart phone onany surface inView–object, wall, or personMIRRORThe usage of the mirror is significantas the projector dangles pointingdownwards from the neck.SMART PHONEA Web-enabled smart phone in theuser’s pocket processes the video data Othersoftware searches the Web and interpretsthe hand gesturesCOLOR MARKERSIt is at the tip of the user’s fingers. Markingthe user’s fingers with red, yellow, green,and blue tape helps the webcam recognizegesturesThe movements and arrangements of thesemakers are interpreted into gestures thatact as interaction instructions for theprojected application interfaces.HOW IT WORKS?The hardware that makes Sixth Sense workis a pendant like mobile wearable interfaceIt has a camera, a mirror and a projectorand is connected wirelessly to aBluetooth smart phone that can slipcomfortably into one’s pocketThe camera recognizes individuals,images, pictures, gestures one makes withtheir handsInformation is sent to the Smartphonefor processing The downward-facingprojector projects the output image onto the mirrorMirror reflects image on to the desiredsurfaceThus, digital information is freed from itsconfines and placed in the physical worldRELATED TECHNOLOGIES• Augmented reality is a term for a live
direct or indirect view of a physicalreal world environment whoseelements are augmented by virtualcomputer generated imagery.• Gesture recognition is a topic incomputer science andlanguage technology with the goalof interpreting human gestures viamathematical algorithms.• Computer vision is the science andtechnology of machines that see. Itis concerned with the theorybehind artificial systems that extractinformation from images.• Radio Frequency Identification isbasically an electronic taggingtechnology that allows the detection,tracking of tags and consequentlythe objects that they are affixed to.APPLICATIONSMake a callYou can use the Sixth Sense to project akeypad onto your hand, then use that virtualkeypad to make a call.Call up a mapWith the map application we can call upthe map of our choice and then usethumbs and index fingers to navigate themapCheck the timeDraw a circle on your wrist to get a virtualwatch that gives you the correct timeCreate multimedia reading experiencesSixth Sense can be programmed to projectrelated videos onto newspaper articles youare reading
Drawing applicationThe drawing application lets the userdraw on any surface by tracking thefingertip movements of the user’s indexfingerZooming featuresThe user can zoom in or zoom out usingintuitive hand movementsGet product informationSixth Sense uses image recognition ormarker technology to recognize productswe pick up, and then feeds us informationon those productsGet book informationThe system can project Amazon ratings onthat book, as well as reviews and otherrelevant informationGet flight updatesThe system will recognize your boardingpass and let you know whether yourflight is on time and if the gate haschanged.Feed information on peopleThe system will project relevantinformation about a person such as whatthey do, where they work, and so on.Take picturesIf you fashion your index fingers andthumbs into a square ("framing" gesture),the system will snap a photo.After taking the desired number of photos,we can project them onto a surface, anduse gestures to sort through the photos, andorganize and resize them.Educational UseEngagement• Teachers may find that Sixth Sense,because of its unique ability to workwith many of Gardner’s multipleintelligences, will be a catalyst forstudents who might otherwiseremain unengaged in learning.• Sixth Sense uses the visual,kinesthetic, intrapersonal andinterpersonal among others.• If this technology does nothing else,the idea that students can simplyuse their hands to draw images on
walls and take pictures with theirhands will be (at least initially)quite motivatingResearch Sixth Sense will give new meaningto “looking something up.” Since we are essentially talkingabout the internet, students will begiven the opportunity to portablyresearch the world. They can all go on a virtual fieldtrip and project the images on theirown desks, for example.Collaboration Students will be given anopportunity through this technologyto feel more connected to others. Although there does seem to be thesense that individuals could walkthrough life wired and lonely, I liketo think the classroom would serveas the environment in whichstudents and teachers using SixthSense would want to share. Not only could the sharing takeplace in the classroom, I supposesince the users are connectedonline, sharing could take placearound the world.Cost-Effectiveness This product currently costs only$350 (approx. Rs.17000) . From aneducator’s stand point, this isminimum given the amount of moneyspent on textbooks, computer labs andLCD projectors. For educator’s, Sixth Sense would bea way to put technology (literally)into each student’s hands, because ofits size and its cost.ADVANTAGESPortableInexpensiveCoolMulti-SensorySupports multi-touch and multi- userinteractionConnectedness between world andinformationCost effectiveData access directly from machine inreal timeMind map the idea anywhereIt is an open sourceCritical thinking would be somewhat vitalhere….allowing teachers a fantasticopportunity for interdisciplinarystudy with critical thinking componentsCONCLUSIONSixth Sense recognizes the objects aroundus, displaying information automaticallyand letting us to access it in any way we
needThe Sixth Sense prototype implementsseveral applications that demonstrate theusefulness, viability and flexibility of thesystemAllowing us to interact with thisinformation via natural hand gesturesThe potential of becoming the ultimate"transparent" user interface for accessinginformation about everything around usREFERENCEShttp://www.pranavmistry.com/projects/sixthsense/https://www.google.co.in/search?q=sixth+sense+pranav+mistry&sa=X&tbm=isch&tbo=u&source=univ&ei=lGbAUZLTJc3jrAeahYCgBA&ved=0CDYQsAQ&biw=1241&bih=640&sei=p2bAUdraCYnVkQXerYHoAghttp://en.wikipedia.org/wiki/SixthSensehttp://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.html