Sixth Sense (The Future of Technology)
•Download as PPTX, PDF•
5 likes•1,018 views
'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital Information and lets us use natural hand gestures to interact with that information. All of us are aware of the five basic senses - seeing, feeling, smelling, tasting and hearing. But there is also another sense called the sixth sense. Sixth Sense Technology is the science of tomorrow with the aim of connecting the digital world with the physical world seamlessly, eliminating hardware devices.This combination of devices and software together create a reality in which the digital world is merged with the physical world.
More Related Content
What's hot
What's hot (20)
Similar to Sixth Sense (The Future of Technology)
Similar to Sixth Sense (The Future of Technology) (20)
Recently uploaded
Recently uploaded (20)
Sixth Sense (The Future of Technology)
- 1. Sixth Sense Technology Presented By Faheema Fairuj Monica （莫妮卡） Student Id- S20141501 Information and Communication Engineering University of Science & Technology, Beijing
- 2. What is Sixth Sense? • 'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital Information and lets us use natural hand gestures to interact with that information. • All of us are aware of the five basic senses - seeing, feeling, smelling, tasting and hearing. But there is also another sense called the sixth sense. It is basically a connection to something greater than what their physical senses are able to perceive. To a layman, it would be something supernatural. Some might just consider it to be a superstition or something psychological. But the invention of sixth sense technology has completely shocked the world. Although it is not widely known as of now but the time is not far when this technology will change our perception of the world.
- 3. Evolution of Sixth Sense Technology Steve Mann is considered as the pioneer of Sixth Sense Technology who made wearable computer in 1990. He implemented the Sixth Sense Technology as the neck projector with a camera system which he referred to as “Synthetic Synesthesia of the Sixth Sense”. Self-portraits of Mann with "Digital Eye Glass" (wearable computer and Augmediated Reality systems) from 1980s to 2000s
- 4. Sixth Sense-The Future of Technology And then his work was carried forward by Pranav Mistry, 28 year old, of Indian origin who is a Ph.D. student in the Fluid Interfaces Group at the Massachusetts Institute of Technology (MIT) Media Lab. He came up with exciting new applications from this technology. Sixth sense technology was later coined as Wear Ur World (WUW). The inventors have filed patent under the name Wear Ur World (WUW) in February 2010.
- 5. Related Technologies Sixth sense technology has integrated the real world objects with digital world. It’s a blend of many exquisite technologies. The thing which makes it magnificent is the marvelous integration of all those technologies and presents it into a single portable and economical product. It associates technologies like- 1. Augmented reality- It is a term for a live direct or indirect view of a physical real world environment whose elements are augmented by virtual computer generated imagery. 2. Gesture recognition-It’s a topic in computer science and language technology with the goal of interpreting human gestures via mathematical algorithms. 3. Computer vision-It is the science and technology of machines that see. It is concerned with the theory behind artificial systems that extract information from images. 4. Radio frequency identification/RFD-It is basically an electronic tagging technology that allows the detection, tracking of tags and consequently the objects that they are affixed to.
- 6. Sixth Sense Device At present the commercial product isn’t launched but the prototype is prepared. The current prototype system costs approximate $350 to build. The sixth sense prototype is composed of- 1. Camera 2. Projector 3. Mirror 4. Mobile component 5. Colored markers Pranav Mistry with sixth sense prototype
- 7. The Components of 6th Sense Prototype Captures an object in view and tracks the user’s hand gestures. It sends the data to smart phone. It acts as a digital eye, connecting you to the world of digital information 1. Camera It is at the tip of the user’s fingers . Marking the user’s fingers with red, yellow, green, and blue tape helps the webcam recognize gestures. The movements and arrangements of these makers are interpreted into gestures that act as interaction instructions for the projected application interfaces. 2. Color Markers
- 8. The Components of 6th Sense Prototype 3. Mirror The usage of the mirror is significant as the projector dangles pointing downwards from the neck. 4. Smart Phone A Web-enabled smart phone in the user’s pocket processes the video data Other software searches the Web and interprets the hand gestures
- 9. The Components of 6th Sense Prototype The projector projects visual information enabling surfaces and physical objects to be used as interfaces The project itself contains a battery inside, with 3 hours of battery life. A tiny LED projector displays data sent from the smart phone on any surface in view–object, wall, or person 5. Projector
- 10. Application of 6th Sense Technology Viewing Map Taking Pictures Drawing Application Making Calls Interacting with physical objects Getting Information •Product information •Book Information •Flight Updates
- 11. Applications of 6th Sense Technology Make a call You can use the Sixth Sense to project a keypad onto your hand, then use that virtual keypad to make a call. Palm is the new dialer!
- 12. Applications of 6th Sense Technology Call up a map With the map application we can call up the map of our choice and then use thumbs and index fingers to navigate the map. Using any surfaces as an interface.
- 13. Applications of 6th Sense Technology Take pictures • If you fashion your index fingers and thumbs into a square ("framing" gesture), the system will snap a photo. • After taking the desired number of photos, we can project them onto a surface, and use gestures to sort through the photos, and organize and resize them. Capture photos with fingers!
- 14. Applications of 6th Sense Technology Check the time Draw a circle on your wrist to get a virtual watch that gives you the correct time. Create multimedia reading experiences Sixth Sense can be programmed to project related videos onto newspaper articles you are reading. Newspaper showing live video news!
- 15. Applications of 6th Sense Check your Flight Status: •Just place the ticket in front of the projector and it checks its status from the internet. Get book information • Sixth Sense uses image recognition or marker technology to recognize products we pick up, then feeds us information on those products. • The system can project Amazon ratings on that book, as well as reviews and other relevant information
- 16. Advantages & Disadvantages Portable Support Multi touch and Multi user interaction Cost Effective(300$) Data access directly from the machines in real time Mind map the idea anywhere Open Source Software Hardware limitations of the devices, that we currently carry around with us. For example many phones will not allow the external camera feed to be manipulated in real time. Post processing can occur however. ADVANTAGES DISADVANTAGES
- 17. Future Enhancement To get rid of color markers. To incorporate camera and projector inside mobile computing device. To have 3D gesture tracking. To make Sixth Sense work as fifth Sense for disabled person.
- 18. Leap Motion Controller $79.99 Microsoft Kinect XBOX 360 $249.99 Think by Texting Samsung Galaxy Gear Smartwatch $299 MYO Electric Arm Band $149 Google Glass $1500
- 19. Conclusion It’s the beginning of a new era of technology where engineering will reach new milestones. Just like in the science fiction movies where display of computer screen appears on walls, commands are given by gestures, the smart digital environment which talks to us to do our work and so on, these all will be possible very soon. You imagine it and Sixth Sense Technology will make it possible. “Minority Report” (Steven Spielberg, 2002)
- 21. Sources: 1.http://wearcam.org/6ense.pdf 2.http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.html 3.http://www.pranavmistry.com/projects/sixthsense 4.https://github.com/sixthsense/sixthsen 5.http://www.engineersgarage.com/articles/sixth-sense-technology?page=2 6."WUW - wear Ur world: a wearable gestural interface", Proceedings of CHI EA '09 Extended Abstracts on Human Factors in Computing Systems Pages 4111- 4116, ACM New York, NY, USA 7.MIT Media Lab Technical Report 260, December 1994 8.Pattie Maes + Pranav Mistry: Meet the Sixth Sense interaction. Video on. Ted.com. Retrieved on 2013-12-09.
Editor's Notes
- Telepointer, a wearable computer based on a pendant that contains a webcam and laser-based infinite depth-of-focus projector, and related technologies in the Sixth Sense gesture-based wearable computing system.
- The projector projects visual images on a surface. This surface can be wall, table, book or even your hand. Thus, the entire world is available on your screen now. When user moves their hands to form different movements with colored markers on the finger tips, the camera captures these movements. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. Recognition is made using computer vision technique. These markers act as visual tracking fiducials. The software program processes this video stream data and interprets the movements into gestures. The gestures are different from one another and are assigned some commands. These gestures can act as input to application which is projected by the projector. Since, the projector is aligned downwards for compactness; therefore images would be formed at the user’s feet if mirror wasn’t used. The mirror reflects the image formed by the projector to front. The entire hardware is fabricated in the form of a pendent. The entire product cost around $ 350 and that also because of projector. It works very similar like a touch screen phone with entire world as the screen.
- The product is not yet released into the market. There are no legal obligations as of now, because there are some modifications still being made on the product itself. However, there are some security concerns about this product. New inventions in information technology have some kind of security concerns. For example when a person is taking a picture using the Sixth Sense, he just snaps with his fingers which have little marker caps on them. People don’t want to be captured on a camera of a random person. One can never tell when Sixth Sense is taking a picture, because it is not a big object and nothing is being help in your hand in order to take a picture like a camera or a phone. This is invading other’s privacy which can be a huge problem. Some of the health issues are regarding Sixth Sense’s projection technology. When the device is projecting on a hard surface, it is not private enough for just the user. People around him can see the projection since it is very detailed. Projection is better in the night time and dark areas rather than mornings and bright areas. This is an issue because the vision of the user can be damaged when using this instrument. Sixth Sense should be able to shift its projection techniques during different times of the day. That way it won’t be an issue for the vision of the user. Since the device is still being modified and tested, Mistry can try to overcome issues with projection.
- These are the devices which were inspired by the sixth sense technology. 1.Myoelectric armband or MYO armband is a gadget that allows you to control your other Bluetooth enabled devices using your finger or your hands. How it works is that, when put on, the armband will detect movements in in your muscle and translate that into gestures that interact with your computer. By moving your hands up/down it will scroll the page you are browsing in. By waving it, it will slide through pictures in a photo album or switch between applications running in your system. What would this be good for? At the very least, it will be very good for action games. MYO armband is out for pre-order at the price of $149. 2. Kinect XBOX- Speaking of gaming, Microsoft Kinect is takes gaming with the Xbox to the next stage. It detects and recognizes a user’s body movement and reproduces it within the video game that is being played. It also recognizes the user’s face and voice. With the update Kinect can now read small gesture controls such as pinch to zoom, opening and closing of hands, so you can actually use Microsoft Kinect for other purposes apart from gaming. 3.Leap Motion is a motion sensor device that recognizes the user’s fingers with its infrared LEDs and cameras. As it works by recognizing only your fingers, when you hover over it to type on the keyboard, nothing registers. But when you hover your fingers above it, you can navigate your desktop like you would your smartphone or tablet: flick to browse pages or pinch to zoom, etc. It’s a small USB device that works the moment you connect it to your computer. You don’t need to charge it and it works even with non-touch sensitive screens. Leap Motion works well with gaming and 3D-related sofwares. You can pre-order Leap Motion for $79.99. 4.Texting by thinking: In addition to 5G, phones are now available with the option of texting by thought power alone. This is achieved by a combination of eye-tracking technology and a sensor-mounted headset worn by the user. The headset contains a brain-machine interface which detects electrical brain waves and converts them into digital signals, then displays the resulting letters on-screen. Some high-end models can be used with glasses or visors featuring displays built into their lenses. This enables completely hands-free texting, creating a form of virtual telepathy. The process is rather slow at this stage, requiring a high degree of mental concentration. It is more of a novelty for now. However, advances in the coming years will enable smooth and fast interactions, revolutionizing the world of communication. 5. Smart Gear: The Samsung Galaxy Gear will have model number “SM-V700″ and is said to sport a 1.67-inch AMOLED display with a resolution of 320 x 320 pixels. The smartwatch is said to be powered by an Exynos 4212 chipset with a dual-core processor clocked at 1.5 GHz, Mali-400 MP4 GPU and 1 GB of RAM. The list of features continues with 2 megapixel camera, Bluetooth and NFC connectivity.
- In terms of the applications for this type of technology, the possibilities are limitless. The fact that a mouse is no longer needed to control movements on a screen, and all that is needed are hands to tell your computer what you want to do, speaks to how engaging the technology is now. It almost reminds me of the movie Minority Report where Tom Cruise does all this cool movements on a tele screen with a special glove that he wears. In my opinion, it looks like we’re heading in that direction. I will not be surprised if in 20 years, if not sooner, these gestural type sensors will replace all mice and keyboards for computers.