Interactive Technology

Five by Five presentsINTERACTIVETECHNOLOGY

The multi-touch screen of theiPhone introduced in 2007,revolutionized the handsetscreen, and triggered a majormomentum towards touchscreen for all sizes of display.

As a result, Apple ushered in a dramatic change inbehaviour. We as consumers now come to expect tointeract with screens.However, this user interaction with technology isalready going above the glass.

With the ability of technology, like the MicrosoftKinect to see users’ movements in space, touch lessinteractivity such as gestures, are being added totraditional methods in new layers of interaction. Youno longer need an explicit tool or even directmanipulation to drive a user interface.

Beyond gestures, a new pattern of computing isemerging where interactions with technology willbe conversational.Voice recognition technology has ﬁnally hit itstipping point of capability and the stage is beingset for a generation of users to start assumingvoice control - just as touch control is nowassumed for any screen.

Looking forward, ubiquity of connections & connectivity will result ineverything becoming interactive or ‘pervasive’. Our interactions withphysical and digital will therefore become fluid and frictionless.

The following presentation will provide an analysis of Interactive Technology.We will explore present and future trends as they pertain to business, culture andsociety. Where available we have used current examples to bring to life each trend.By identifying change we hope to provide stimulus for readers to contemplate howpresent and future innovation may affect our business and clients.The key trends for Interactive Technology:• Touch• Objects• Augmented Reality• Gestures• Facial Recognition• Eye Tracking• Sound• Thought• Smell

Five by Five presentsINTERACTIVE TECHNOLOGYTOUCH

Five by Five presents INTERACTIVE TECHNOLOGY TOUCHTouch Screen Smart WindowIn 2011 Samsung introduced the transparent smart window; a large, transparent one-way mirror touch screen that has a digitaloverlay of touch controlled widgets.Short term the smart window will disrupt traditional retail displays adding a layer of digital to the display. OLED technologieswith digital overlay are being already in use as vending machines and refrigerators in Japan. In the long-term OLED touch screentechnology will be used for multiple surfaces in the home and in retail environments.

Five by Five presents INTERACTIVE TECHNOLOGY TOUCHMulti-Touch Smart WindowMoving beyond the poking action of a smart window touch screen, multi-touch tech enables a user to interact with a systemwith more than one finger at a time. Extending the Samsung smart window, high-spec multi-touch displays are already beingresearched as GM have displayed with their in-car window allowing for pinching and sweeping interactivity.

Five by Five presents INTERACTIVE TECHNOLOGY TOUCHMulti-Touch Tables and WallsMulti-touch sensing devices such as Flatfrog’s interactive table and Adidas interactive wall can accommodate multiple users atone time, allowing for simultaneous interactive displays within retail environments, museums, tradeshows and exhibitions.

Five by Five presents INTERACTIVE TECHNOLOGY TOUCHEnhancing Interaction on Touch SurfacesFurther developments in multi-touch are around the anatomical detection of a human finger allowing different parts to berecognized such as the tip, knuckle, nail and pad - researchers TapSense, amongst others are experimenting in this area.

Five by Five presents INTERACTIVE TECHNOLOGY TOUCHEnhancing Interaction on Touch Surfaces - HapticsExtending touch, Disney Research have been looking at new haptics technology for enhancing touch interfaces with tactilefeedback, allowing the user to feel virtual elements through touch. Leading innovator Senseg at CES 2012 demoed their hapticuser experience for touch screens. Samsung Nexus One and HTC Sense include Haptic feedback. Watch out for more haptictechnology in tablets and smart phones.

Five by Five presents INTERACTIVE TECHNOLOGY TOUCHEvery Surface Can Become A Touch Screen – User Defined InterfaceOmniType is a virtual projection wearable system that enables graphical, interactive, multi-touch input on arbitrary, everydaysurfaces. Celluon have manufactured the ‘magic cube’ a virtual projected keyboard and multi-touch mouse.

Five by Five presentsINTERACTIVE TECHNOLOGYOBJECTS

Five by Five presents INTERACTIVE TECHNOLOGY OBJECTSMicrosoft Enhance Object Recognition TablesMulti-touch screens allow for object recognition and object based play.For a few years now, multi touch tables such as Microsoft ‘Surface’ have provided a platform for developers to link interactiveobjects with the screen. With Amnesia Connect users can literally see-through their device and share content as easy and tactileas it can get. It is perfectly suited for sharing visual data like images and video, but works for any other type of content as well.

Five by Five presents INTERACTIVE TECHNOLOGY OBJECTSDisney Turns iPad Into Interactive TrackAs multi-touch screen devices such as smart phones and tablets become ubiquitous, the opportunities to link physical objectswith a smart device with an application have opened up business opportunities. In 2011 Disney released Appmates ‘Cars’ toys,transforming the iPad screen into a game board when the cars come into contact with the touch screen interface.

Five by Five presents INTERACTIVE TECHNOLOGY OBJECTSHasbro Developing zAppedTablet GamesToy company Hasbro is currently producing interactive tablet ‘zAPPed’ games such as the Game of Life, Monopoly andBattleships due to for release in June 2012.

Five by Five presents INTERACTIVE TECHNOLOGY OBJECTSExtended the TouchScreen via Interactive ObjectsMichael Knepful a researcher at NYU has looked at the opportunity to extend touch screens via physical, mechanical andelectrical devices in a number of ways that can be incorporated by many products, and opens up creative possibilities for brandsthat want to develop applications linked to physical objects.

Five by Five presentsINTERACTIVE TECHNOLOGYAUGMENTED REALITY

Five by Five presents INTERACTIVE TECHNOLOGY AUGMENTED REALITYAR MarkersThe Majority of AR experiences to date are achieved using devices with a camera and touch screen. There are many applicationsand that incorporate AR tech allowing users to lock onto a marker and experience virtual content. Five by Five used this tech andapproach for Dynamo Magician Impossible in 2011.

Five by FIve presents INTERACTIVE TECHNOLOGY AUGMENTED REALITYMarkerless ARAurasma is just one company pushing the boundaries of AR. They have developed a visual browser whereby virtual content canbe served up without markers, making the experience frictionless.Markerless AR has been incorporated within virtual demo apps by Bandai for its toy packaging. Sony Music developed an ARexperience for their Tings Tings album cover and Starbucks created ‘Magic Cups’ app for its coffee cups for Christmas andValentine’s. The London Eye has produced an experiential education AR app incorporating Aurasma, providing tourists with avirtual and real-world experience.

Five by Five presents INTERACTIVE TECHNOLOGY AUGMENTED REALITYLive Broadcast ARBrands such as National Geographic, Lynx and Green Giant have incorporated AR as part of their public experiential digital out ofhome campaigns within shopping centres and train stations.

Five by Five presents INTERACTIVE TECHNOLOGY AUGMENTED REALITYAR GamesAs smart phone ownership increases, pervasive entertainment in the form of AR games are becoming ever more popular. Onesuch example is Vodaphone’s Buffer Monster game. The Sony Playstation Vita has also developed a number of AR titles for thisdevice.

Five by Five presents INTERACTIVE TECHNOLOGY AUGMENTED REALITYAR GlassesBy the end of 2012, Google will launch a pair of Android powered, augmented reality, heads up display glasses (Project Glass). Itsfeatures will primarily be locative content served up via Google Maps and Search.IDEO designer Michaël Harboun has already experimented with AR glasses. As an alternative to glasses that tell you where thenearest bar is, his ‘Transcendenz’ project allows the wearer to experience the metaphysical environment asking intelligentquestions rather than receiving the answers.

Five by Five presentsINTERACTIVE TECHNOLOGYGESTURES

Five by Five presents INTERACTIVE TECHNOLOGY GESTURESMotion Control Interactive DisplaysWith regard to digital out of home, the majority of gesture based interactions is focussed on motion control.It can be used for browsing through product videos outside a shop for example Cartier’s Timepiece Explorer.Raiffensenbank in Kosova have experimented with gesture controlled interactive windows where navigation enables users tobrowse products and interact with content at any time of the day.

Five by Five presents INTERACTIVE TECHNOLOGY GESTURESMotion Control Interactive InstallationsDesign I/O created an interactive installation that allows children to use their arms to puppeteer larger than life creaturesprojected on the wall in front of them.

Five by Five presents INTERACTIVE TECHNOLOGY GESTURESMicrosoft Kinect HackingGesture control allows for touch free interactivity.Since the introduction of Microsoft Kinect in 2010, the technology has not just transformed gaming but has inspired creativityamongst many industries. As a result Kinect hacking has become very popular such as Kinect controlled skateboards, shoppingtrolleys and displays. Microsoft’s response to hacking was to open up their device with a dedicated SDK for Windows 7 andKinect for PC released in March 2012.

Five by Five presents INTERACTIVE TECHNOLOGY GESTURESMicrosoft Kinect LaptopsPrototype Kinect enables laptops from ASUS which are powered by the Windows 8 operating system, boast Kinect sensors thatare located at the top of the display, while a set of LEDs will run along the bottom.

Five by Five presents INTERACTIVE TECHNOLOGY GESTURESMotion Control Tablet ApplicationBitGym have incorporated head tracking to produce a game for your tablet that can be used in the gym.

Five by Five presents INTERACTIVE TECHNOLOGY GESTURESMotion Control Desktop GamesOmnimotec have developed browser based games for webcams that do not require Kinect or motion sensing tech. For the filmAlvin & The Chipmunks 2, Omnimotec produced ‘Munkdance’ a motion controlled dance game.

Five by Five presents INTERACTIVE TECHNOLOGY GESTURESMotion Control In-CarCar manufacturer Mercedes unveiled its Dynamic & Intuitive Control Experience (DICE) at CES 2012 featuring gesture-basedcontrols that allows the driver to scroll, select and control a variety of functions with basic hand motions.

Five by Five presentsINTERACTIVE TECHNOLOGYFACE RECOGNITION

Five by Five presents INTERACTIVE TECHNOLOGY FACE DETECTIONFace Tracking and SubstitutionOne of the biggest areas for development with gestures is facial tracking and recognition. Developer Arturo Castro hasexperimented with face hack. His Faces demo allows for real-time face substitution via projection, overlaying the features ofyour desired clone over your own countenance. The freakiest part is that it’s even capable of moving along with your facialexpressions

Five by Five presents INTERACTIVE TECHNOLOGY FACE DETECTIONFace Recognition AdvertisingImmersive labs have developed adaptive advertising technology to serve up ads dynamically tailored to the target audience usingfacial recognition. Plan UK used this technology to serve up ads on their billboards for women only. With televisionmanufacturers integrating face recognition technology into their devices we will soon experience targeted TV ads.

Five by Five presents INTERACTIVE TECHNOLOGY FACE DETECTIONFace Recognition Vending MachinesUnilever Ice Cream vending machine used facial recognition technology; to determine age, gender, and emotion. The machineuses an interactive "smile-o-meter" to rate smiles; those with a big enough smile were rewarded with free ice cream.The Happiness Machine from CocaCola used facial recognition to dispense coke based on two couples kissing.

Five by Five presents INTERACTIVE TECHNOLOGY FACE DETECTIONFace Recognition Smart Phone AppsThe RecognizeMe App for iOS5 uses facial recognition for phone authentication. The creative possibility to extend smart phoneapps to incorporate face recognition is an area for further exploration.

Five by Five presentsINTERACTIVE TECHNOLOGYEYE TRACKING & CONTROL

Five by Five presents INTERACTIVE TECHNOLOGY EYE TRACKING & CONTROLEye Controlled GamesEye tracking & eye control technology make it possible for interfaces to know exactly where a user is looking.This technology has revolutionized communications for those with special needs. But more recently the technology has beenused for interactive games. Innovation company Tobii produced EyeAsteroids in which players can use their eyes as a controller.

Five by Five presents INTERACTIVE TECHNOLOGY EYE TRACKING & CONTROLEye Control For Mobile DevicesSenseye has developed technology that tracks the movement of your eyes using the front-facing camera on mobile phones. Thefirst version requires"EyeDock", an add-on with an inexpensive webcam and an infrared LED. The company is currently workingwith handset manufacturers to bring this technology to mass market in 2013.

Five by Five presents INTERACTIVE TECHNOLOGY EYE TRACKING & CONTROLEye Tracking Smart Phone AppsBreathalEyes iPhone app is an example of tech developed to track the movements in your eyes to determine the state ofintoxication.

Five by Five presents INTERACTIVE TECHNOLOGY EYE TRACKING & CONTROLEye Control Interface for Windows 8Interactivity via gaze, adds an entirely new dimension to interactive media. Tobii has developed eye tracking software forWindows 8 including a photo gallery that allowed a user to navigate through pictures by shifting glance and then enlarging achosen photo by focusing on it.

Five by Five presents INTERACTIVE TECHNOLOGY EYE TRACKING & CONTROLApple To Bring 3D Gaming And Eye Tracking to iPad & iPhone?Apple in 2012 filed for an eye-tracking patent for gaming, photography and video as well as a feature for its iOS. CurrentlyNascent.

Five by Five presentsINTERACTIVE TECHNOLOGYSOUND

Five by Five presents INTERACTIVE TECHNOLOGY SOUNDVoice Control For GamesThe Kinect device features voice commands alongside motion sensing. As a result we are now experiencing voice control withingames such as Mass Effect 3 allowing the player to control the squad via voice. The Nintendo Wii U console due for release inlate 2012 is rumoured to feature voice control.

Five by Five presents INTERACTIVE TECHNOLOGY SOUNDVoice Control For Mobile DevicesVoice recognition and voice commands have been available as applications for Android phones for some time.When Apple announced their voice recognition app ‘Siri’, a number of hacks appeared. As a result we are now seeing appsintegrating voice control for example the Hello Kitty voice control cookbook to control page turns, and location-aware app Wazewhich provides hands free traffic information.

Five by Five presents INTERACTIVE TECHNOLOGY SOUNDAudio Content RecognitionAudio Content Recognition can be used to interact with television programmes, in-game content and advertisements.Automotive company Honda was one of the first brands to release a mobile app for their ‘This Unpredictable Life’ TV campaign.The app allowed viewers to interact with the TV spot on their handset, catching the animated characters as they appear onscreen.Fox International produced a free companion app for Series 2 of The Walking Dead incorporating, Civolution audio recognitiontechnology serving up exclusive content available for both live and time-shifted programming.20th Century Fox partnered with Shazam technology for TV allowing users to access exclusive content from their Alvin and theChipmunks movie ‘Chipwrecked’, simply by tagging the film or TV spot using the application.

Five by Five presents INTERACTIVE TECHNOLOGY SOUNDVoice Control For Smart TV’sSamsung are integrating voice commands within its smart TV’s as demonstrated at CES in 2012. The all new Apple Smart TV isrumoured to feature Siri voice control.

Five by Five presents INTERACTIVE TECHNOLOGY SOUNDVoice Control For CarsMercedes will feature Siri for hands free voice commands within their A-Class cars, whilst the Ford SYNC in-car communicationssystem uses Windows technology that incorporates instant voice recognition and voice activation. Among the many Siri hacks toemerge is one that will start your car via voice command.

Five by Five presentsINTERACTIVE TECHNOLOGYTHOUGHT

Five by Five presents INTERACTIVE TECHNOLOGY THOUGHTMind Control Devices For GamesControlling both physical and virtual objects using the power of your mind is now a reality.Electronics company Emotiv manufacture a brain-computer interface system, allowing people to interact with computerapplications including games via mind control. It works by picking up brain signals via electrodes mounted on the head.

Five by Five presentsINTERACTIVE TECHNOLOGYSMELL

Five by Five presents INTERACTIVE TECHNOLOGY SMELLSmell-o-VisionSmelling your movies via a clever concept called SMELLIT, from Portuguese designer Nuno Teixeira, brings contextual smells tothe viewers schnoz via 118 aroma cartridges, each triggered by reading "smell information" embedded in a DVD.Samsung R&D in collaboration with the University of California in San Diego are currently experimenting with a small device thatcould be easily fitted to the back of your television that would serve to deliver the essence of odour appropriate to the picturebeing displayed on the screen. The smell is produced via aqueous solution of ammonia. This solution is held in a compartmentmade of non-toxic, non-flammable silicone elastomer, which releases odours through a small hole when heat and odour pressurebuild up.This technology is also being tried to be implemented in smart phones!

Five by Five presents INTERACTIVE TECHNOLOGY SMELLSmell-vertisingIn the UK McCain has cooked up a novel marketing technique with a campaign that produced the smell of hot jacket potatoeswafting through bus shelters in cities across the UK. A hidden heating element warms the 3D poster of a jacket potato at thepress of a button, slowly releasing the aroma of a hot baked potato.The smell was developed over three months in collaboration with a specialist scent lab to match that of the real thing.

THANKS

Interactive Technology

by fivebyfive

Accessibility

Categories

Upload Details

Usage Rights

1 Embed 106

Statistics