Sixth sense tecnology.
Upcoming SlideShare
Loading in...5
×
 

Sixth sense tecnology.

on

  • 7,225 views

 

Statistics

Views

Total Views
7,225
Views on SlideShare
7,225
Embed Views
0

Actions

Likes
6
Downloads
690
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft Word

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Sixth sense tecnology. Sixth sense tecnology. Document Transcript

  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR SIXTH SENSE TECHNOLOGYNAME : A.SUSHMAROLL NO : 08U51A1256BRANCH : IT(B) DRK COLLEGE OF ENGINEERING & TECHNOLOGY 1
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR ACKNOWLEDGEMENT I would like to take this opportunity to place it on record thatthis Technical Seminar would never have taken shape but for thecooperation extended to us by certain individuals. Sincerely I acknowledge my deep sense of gratitude to Miss.T.M.R.RAJESWARI (Assistant professor) for her constantencouragement, help and valuable suggestions. I would like to express our deep gratitude to the Mr. C.PRAVEEN KUMAR Head of Department of INFORMATIONTECHNOLOGY, for his timely cooperation while carrying theTechnical Seminar. It is his friendliness that made me learn more. A.SUSHMA (08U51A1256) DRK COLLEGE OF ENGINEERING & TECHNOLOGY 2
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR SIXTH SENSE TECHNOLOGY ABSTRACT DRK COLLEGE OF ENGINEERING & TECHNOLOGY 3
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR SIXTH SENSE TECHNOLOGY ABSTRACTObjective: Sixth Sense is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.Introduction: It is a sense that would give seamless and easy access to Meta information or information that may exist somewhere. The Sixth Sense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces. ‘Sixth Sense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer. Initially the device started with a helmet consisting of the camera, projector and colour markers. Later it was converted into a form so that it is easy to use it by wearing around the neck.Needs of ‘SIXTH SNSE TECHNOLOGY’: When we encounter something, someone or some place, we use our five natural senses to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that DRK COLLEGE OF ENGINEERING & TECHNOLOGY 4
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world.Why the name ‘SIXTH SENSE’: From thousands of years mankind used the five senses to gain information. But now as this device is completely portable and it can provide information about anything, it is named as ‘SIXTH SENSE DEVICE’.Benefits of ‘SIXTH SENSE TECHNOLOGY’: You can call to your friend by typing the numbers on your hand. It displays the keypad of the phone over your palm and the keys appear on the four fingers &use another hands finger to press the keys. We can see moving pictures on a Newspaper. It Searches the most appropriate video from the web by seeing the headlines or the caption of the News report. Using this technology we can capture images without a camera, when we make a square with fingers, highlighting which one we want to frame. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 5
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR CONTENTS DRK COLLEGE OF ENGINEERING & TECHNOLOGY 6
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR CONTENTS1 ABSTRACT 32 INTRODUCTION 83 DEVICES 104 TECHNOLOGIES 125 ADVANTAGES 166 APPLICATIONS 197 WAY FORWARD 238 CONCLUSION 269 REFERENCES 28 DRK COLLEGE OF ENGINEERING & TECHNOLOGY 7
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR INTRODUCTION DRK COLLEGE OF ENGINEERING & TECHNOLOGY 8
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR 2.IntroductionAlthough miniaturized versions of computers help us to connect tothe digital world even while we are travelling there aren’t any deviceas of now which gives a direct link between the digital world and ourphysical interaction with the real world. Usually the information’s arestored traditionally on a paper or a digital storage device. Sixth sensetechnology helps to bridge this gap between tangible and non-tangible world. Sixth Sense device is basically a wearable gesturalinterface that connects the physical world around us with digitalinformation and lets us use natural hand gestures to interact with thisinformation .The sixth sense technology was developed by PranavMistry, a PhD student in the Fluid Interfaces Group at the MIT MediaLab. The sixth sense technology has a Web 4.0 view of human andmachine interactions. SixthSense integrates digital information intothe physical world and its objects, making the entire world yourcomputer. It can turn any surface into a touch-screen for computing,controlled by simple hand gestures. It is not a technology which isaimed at changing human habits but causing computers and othermachines to adapt to human needs .It also supports multi user andmulti touch provisions. Sixth Sense device is a mini-projector coupledwith a camera and a cell phone—which acts as the computer and yourconnection to the Cloud, all the information stored on the web. Thecurrent prototype costs around $350. The Sixth Sense prototype isused to implement several applications that have shown theusefulness, viability and flexibility of the system.SIXTH SENSESixthSense is a wearable gestural interface that augments thephysical world around us with digital information and lets us usenatural hand gestures to interact with that information The hardwarecomponents are coupled in a pendant like mobile wearable device.The SixthSense prototype is comprised of a pocket projector, amirror, colord marker and a camera. The camera, mirror andprojector is connected wirelessly to a blue tooth smart phone devicethat can easily fit into the user’s pocket. A software then processesthe data that is collected by the capturing device and producesanalysis. The software that is used in sixth sense device is opensource type. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 9
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR DEVICES DRK COLLEGE OF ENGINEERING & TECHNOLOGY 10
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR 3.DEVICESCamera:It captures the image of the object in view and track the user’s handgesture. The camera recognizes individuals, images, pictures,gestures that user makes with his hand. The camera then sends thisdata to a smart phone for processing. Basically the camera forms adigital eye which connects to the world of digital information.Coloured Marker:There are colour markers placed at the tip of users finger. Markingthe user’s fingers with red, yellow green and blue coloured tape helpsthe webcam to recognize the hand gestures .The movements andarrangement of these markers are interpreted into gestures that actas a interaction instruction for the projected application interfaces.Mobile Component:The Sixth Sense device consists of a web enabled smart phone whichprocess the data send by the camera. The smart phone searches theweb and interprets the hand gestures with help of the colouredmarkers placed at the finger tips.Projector:The information that is interpreted through the smart phone can beprojected into any surface. The projector projects the visualinformation enabling surfaces and physical objects to be used asinterfaces. The projector itself consists of a battery which have 3hours of battery life .A tiny LED projector displays the data sent fromthe smart phone on any surface in view- object, wall or person. Thedownward facing projector projects the image on to a mirror. Usingpalm for dialing a number.Mirror:The usage of a mirror is important as the projector dangles pointingdownwards from the neck. The mirror reflects the image on to adesire surface. Thus finally the digital image is freed from its confinesand placed in the physical world. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 11
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR TECNOLOGIES DRK COLLEGE OF ENGINEERING & TECHNOLOGY 12
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR4.Technologies that are related to Sixth SenseDevicesAugmented Reality:The augmented Reality is a visualization technology that allows theuser to experience the virtual experience added over real world inreal time. With the help of advanced AR technology the informationabout the surrounding real world of the user becomes interactive anddigitally usable. Artificial information about the environment and theobjects in it can be stored and retrieved as an information layer ontop of the real world view. When we compare the spectrum betweenvirtual reality, which creates immersive, computer-generatedenvironments, and the real world, augmented reality is closer to thereal world. Augmented reality adds graphics, sounds, haptic feedbackand smell to the natural world as it exists. Both video games and cellphones are driving the development of augmented reality. Theaugmented systems will also superimpose graphics for everyperspective available and try adjust to every movement of the usershead and eyes. The three basic components of an augmented realitysystem are the head-mounted display, tracking system and mobilecomputer for the hardware. The main goal of this new technology isto merge these three components into a highly portable unit muchlike a combination of a high tech Walkman and an ordinary pair oreyeglasses. The head-mounted display used in augmented realitysystems will enable the user to view superimposed graphics and textcreated by the system. Another component of an augmented realitysystem is its tracking and orientation system. This system pinpointsthe users location in reference to his surroundings and additionallytracks the users eye and head movements. Augmented realitysystems will need highly mobile computers. As of now manycomputers aren’t there to satisfy to provide this option.Gesture Recognition:It is a technology which is aimed at interpreting human gestures withthe help of mathematical algorithms. Gesture recognition techniquebasically focuses on the emotion recognition from the face and handgesture recognition. Gender recognition technique enables humans tointeract with computers in a more direct way without using any DRK COLLEGE OF ENGINEERING & TECHNOLOGY 13
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. Interfaces which solely depends on the gestures requires precise hand pose tracking. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. In the Sixth Sense devices coloured bands are used for this purpose. Once hand pose has been captured the gestures can be recognized using different techniques. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. This technique has a high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures. Computer Vision: Computer vision is the technology in which machines are able to interpret/extract necessary information from an image. Computer vision technology includes various fields like image processing, image analysis and machine vision. It includes certain aspect of artificial intelligence techniques like pattern recognition. The machines which implement computer vision techniques require image sensors which detect electromagnetic radiation which are usually in the form of ultraviolet rays or light rays. The computer vision find itself applicable in varies field of interest. One such field is bio medical image processing. It’s also used in autonomous vehicle like SUV’s. The computer vision technique basically includes four processes.o Recognition: One of the main task of computer vision technique is to determine whether the particular object contain the useful data or not.o Motion Analysis: Motion analysis includes several tasks related to estimation of motion where an image sequence is processed continuously to detect the velocity at each point of the image or in the 3D scene.o Scene Reconstruction: Computer vision technique employs several methods to recreate a 3D image from the available images of a scene. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 14
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINARo Image Restoration: The main of aim of this step is to remove noise from an given image. The simplest method involves using simple filters like low pass or median filters. In order to get better quality images more complex methods like Inpainting are used. Radio Frequency Identification: Radio frequency identification systems transmit the identity of an object wirelessly, using radio magnetic waves. The main purpose of a radio frequency identification system is to enable the transfer of a data via a portable device. The portable device is commonly known as tag. The data send by the tag is received and processed by a reader according to the needs of the application. The data send by the tag contains various information’s identification or location of the information, or specifics about the product that has been tagged, for example price, colour, date of purchase, etc. This technology gained importance because of its ability to track moving object. A typical radio frequency tag consists of a microchip attached to a radio antenna which is mounted on a substrate. To retrieve the data from the tag a reader is needed. A typical radio frequency reader consists of two antennas that emit radio waves and at the same are capable of accepting the signals from the tag. The reader then passes the information that it has received to a computer device in digital form. The computer then interprets this digital data and processes it. Radio frequency identification techniques are widely used in the fields like asset tracking, supply chain management, manufacturing, payment systems etc. One of the major advantages of devices using radio frequency technology over other similar devices is that RFID devices need not be positioned precisely relative to the scanner. But till then there are certain areas of concern for this technology. Some problem related to this technology is tag collision and reader collision. Usually the reader collision occurs when the signals from two or more readers overlap, while tag collision occurs when many tags are present in a small area. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 15
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR ADVANTAGES DRK COLLEGE OF ENGINEERING & TECHNOLOGY 16
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR5.ADVANTAGES OF SIXTH SENSE DEVICESPortable:One of the main advantages of the sixth sense devices is its smallsize and portability. It can be easily carried around without anydifficulty. The prototype of the sixth sense is designed in such a waythat it gives more importance to the portability factor. All the devicesare light in weight and the smart phone can easily fit into the users’pocket.Support multi touch and multi user interaction:Multi touch and multi user interaction is another added feature of thesixth sense devices. Multi sensing technique allows the user tointeract with system with more than one than one finger at a time..Sixth sense devices also in-cooperates multi user functionality. This istypically useful for large interaction scenarios such as interactivetable tops and walls.Cost effective:The cost incurred for the construction of the sixth sense proto type isquiet low. It was made from parts collected together from commondevices. And a typical sixth sense device cost up to $300. The sixthsense devices have not been made in large scale for commercialpurpose. Once that happens it’s almost certain that the device willcost much lower than the current price.Connectedness between real world and digital world:Forming a connection between the real world and the digital worldwas the main aim of the sixth sense technology.Data access directly from the machines in real time:With help of a sixth sense device the user can easily access data fromany machine at real time speed. The user doesn’t require anymachine-human interface to access the data. The data access DRK COLLEGE OF ENGINEERING & TECHNOLOGY 17
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINARthrough recognition of hand gestures is much easier and userfriendlier compared to the text user interface or graphical userinterface which requires keyboard or mouse.Mind map the idea anywhere:With the advent of the sixth sense device, requirement of a platformor a screen to analyse and interpret the data has become obsolete.We can project the information into any surface and can work andmanage the data as per our convenience.Open source software:The software that is used to interpret and analysis the data collectedby the device is made open source. This enables other developers tocontribute to the development of the system. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 18
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR APPLICATIONS DRK COLLEGE OF ENGINEERING & TECHNOLOGY 19
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR 6.APPLICATIONSThe sixth sense technology finds a lot of application in the modernworld. The sixth sense devices bridge the gap by bringing the digitalworld into the real world and in that process allowing the users tointeract with the information without the help of any machineinterfaces. Prototypes of the sixth sense device have demonstratedviability, usefulness and flexibility of this new technology. Accordingto the words of its developers the extend of use of this new device isonly limited by the imagination of human beings. Some practicalapplications of the sixth sense technology is given below.Map Application:With the help of a map application the user can call upon any map ofhis/her choice and navigate through them by projecting the map onto any surface .By using the thumb and index fingers movements theuser can zoom in, zoom out or pan the selected map.Taking Pictures:Another application of sixth sense devices is the implementation of agestural camera. This camera takes the photo of the location user islooking at by detecting the framing gesture. After taking the desirednumber of photos we can project them onto any surfaces and thenuse gestures to sort through those photos and organize and resizethem. The user taking making a pose gesture The camera takes thephoto of the location.Drawing Application:The drawing application allows the user you to draw on any surfaceby tracking the fingertip movements of the user’s index finger. Thepictures that are drawn by the user can be stored and replaced onany other surface. The user can also shuffle through various picturesand drawing by using the hand gesture movements. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 20
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINARMaking Calls:We can make calls with help of sixth sense device .The sixth sensedevice is used to project the keypad into your palm and the usingthat virtual keypad we can make calls to anyone.Interacting with physical objects:The Sixth Sense system also helps to interact with physical objectswe use in a better way. It augments physical objects by projectingmore information about these objects projected on them. Forexample, a gesture of drawing a circle on the user’s wrist projects ananalog watch on the users hand. Similarly a newspaper can show livevideo news or dynamic information can be provided on a regularpiece of paper. Newspaper showing live feeds an analog watchprojected into the wrist.Getting Information:Sixth sense devices can be used for getting various informationrelating to our everyday life by getting in contact with objects.Product Information:Sixth sense technology uses marker technology or image recognitiontechniques to recognize the objects we pick in our hand and thenprovide information relating to that product.Book Information:By holding and shuffling through the book pages, the sixth senseprovides Amazon ratings on that book, other reviews and otherrelevant things related to the book.Flight Updates:With the help of the sixth sense technology it is no longer required tolog into any sites for checking the status of the flights. The systemwill recognize your boarding pass and let you know whether the flightis on time or not. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 21
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINARInformation About People:With help of face recognition techniques the sixth sense devices areable to provide information about the people when we meet them.The sensor detects the face and checks the data base for the relevantinformation. The system will then project the relevant informationabout a person like what they do, where they work, Boarding passshowing current status the information about a person beingprojected. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 22
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR WAY FORWARD DRK COLLEGE OF ENGINEERING & TECHNOLOGY 23
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR 7.WAY FORWARDUpcoming Projects Making Use of the Sixth Sense TechnologyMouse less:Mouse less is a concept which is developed in order to avoid theusage of mouse in computers. It helps to provide a familiarity of thephysical mouse without actually requiring a physical mouse. Eventhough the computer hardware technology has been developed to agreater extent, still there has been no proper substitute for a physicalmouse. This new invention aims to remove the requirement of havinga physical mouse altogether but still it provides the feeling of aphysical mouse that users are familiar with. It basically consists of anInfrared laser beam and an Infrared camera. Both laser and cameraare embedded together with the computer. The laser beam module ismodified with a line cap and placed such that it creates a plane of IRlaser just above the surface the computer sits on. The user cups theirhand, as if a physical mouse was present underneath, and the laserbeam lights up the hand which is in contact with the surface. The IRcamera detects those bright IR blobs using computer vision. Thechange in the position and arrangements of these blobs areinterpreted as mouse cursor movement and mouse clicks.Third Eye:Third Eye is a new technique that enables multiple viewers to seedifferent things on a same display screen at the same time. With thirdEye, We can have a public sign board where a Japanese tourist seesall the instructions in Japanese and an American in English. - Wedont need to have the split screen in games now. Each player cansee his/her personal view of the game on the TV screen. - Two peoplewatching TV can watch their favorite channel on a single TV screen. Apublic display can show secret messages or patterns. - In the samemovie theater, people can see different end of a suspense movie. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 24
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINARInktuitive:Even though there has been a tremendous development of computeraided designing tools, still paper and pencil is the preferred by mostof the designers, especially in the earlier stages of designing .Theproject ‘inktuitive’ is aimed to combine the process of creation that isinherent in paper and pencil with the power of computing that thedigital design tools provide. It also extends the natural work-practiceof using physical paper by giving the pen the ability to control thedesign in physical three-dimensional space, freeing it from its tie tothe paper. There always remains an intuition of pen and paper ,butthe lines that have been drawn are be captured and translated intoshapes in the digital world. The physical paper is augmented withoverlaid digital strokes. The platform provides a novel interactionmechanism for drawing and designing using above the surface penmovements. In other words ‘inktuitive’ can be considered as anintuitive physical design workspace that aims to bridge the gap andbring together the conventional design tools such as paper and pencilwith the power and convenience of the digital tools for design.TaPuma:TaPuma is the short form of Tangible Public Map. It is anotherattempt to bring the digital world nearer to the real world byexploring the techniques of sixth sense technology. Key word basedsearch mechanism has vastly influenced and modified the ways inwhich we search information’s. The keyword based search allows theuser to filter out the required data from the vast data that areavailable on search engines such as yahoo and Google. TaPuMaallows people to use their own belongings, the objects they usuallycarry with them to access relevant and just-in-time information andlocations of places from a public map. The project also explores andanalyzes the advantages and challenges of this novel interactionmechanism, where real life objects serve as the interface forinformation acquirement. The broad concept behind the projectTaPuMa is Object Amelioration, where the functions of everydayobjects can be expanded by using their affordances or functionalitiesin a variety of different contexts. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 25
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR CONCLUSION DRK COLLEGE OF ENGINEERING & TECHNOLOGY 26
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR 8.CONCLUSIONThe sixth sense technology and devices are definitely the wayforward. The sixth sense recognizes the objects around us anddisplays the information relating to those objects in a real timeenvironment. The sixth sense technology allows the user to interactthe information through hand gestures. This is a quiet efficient waycompared to the text and graphic based user interface. It has thepotential to form the transparent user interface for accessing theinformation around us. . Even though the sixth sense devices arecurrently in development stages and have not been used in largenow, it’s quiet predictable that this technology have the potentialrevolutionize the way in which we interacts with the digital world. DRK COLLEGE OF ENGINEERING & TECHNOLOGY 27
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR REFERENCES DRK COLLEGE OF ENGINEERING & TECHNOLOGY 28
  • SIXTH SENSE TECHNOLOGY TECHNICAL SEMINAR 9.REFERNCES 1. http://www.ted.com/talks/pranav mystery the thrilling potential of sixthsense technology.html/ 2. http://www.commoncraft.com/augmented-realityvideo/ 3. http://www.arcane-technologies.com/en/ 4. http://en.wikipedia.org/wiki/Augmented_reality/ 5. http://www.rfidjournal.com/ 6. http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.ht ml / 7. http://timesofindia.indiatimes.com/Health__Science/Sixth_sense_giz mo_a_sci-fi_reality/articleshow/4083978.cms / 8. http://www.gesturetek.com/ 9 http://www.slideshare.net/renjithravi/sixth-sense-technology DRK COLLEGE OF ENGINEERING & TECHNOLOGY 29