Your SlideShare is downloading. ×
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Innovative (Mobile) Interactivity (Augmented Reality and more…)
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Innovative (Mobile) Interactivity (Augmented Reality and more…)

12,206

Published on

Here's the background information (lots of text and links) for my Barcamp London 7 session on 25th October 2009 (http://www.slideshare.net/secret/89s2DDmWvf8TYt), with inspirational snippets of …

Here's the background information (lots of text and links) for my Barcamp London 7 session on 25th October 2009 (http://www.slideshare.net/secret/89s2DDmWvf8TYt), with inspirational snippets of information about AR and other technologies, applications, concepts and ideas.

Find your subject on the 2-page index, to jump to its info and links...!

Have fun!

1 Comment
2 Likes
Statistics
Notes
No Downloads
Views
Total Views
12,206
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
204
Comments
1
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Barcamp London 7 25.10.2009 Innovative (Mobile) Interactivity (Augmented Reality and more…) Inspirational snippets of information, gathered from the web by Carin Campanario (updated from Barcamp London 6, 09.03.2009) 1
  • 2. Index 1 INTRODUCTION 4 2 AUGMENTED AND VIRTUAL REALITY - INFO 5 2.1 VIRTUAL REALITY (VR) ............................................................................................................5 2.2 AUGMENTED REALITY (AR) ......................................................................................................6 2.3 AR - TRAINING .........................................................................................................................7 2.4 AR – GAME WORKSHOP ..........................................................................................................7 2.5 MAGICSYMBOL ........................................................................................................................7 2.6 HOLOTRONICA .........................................................................................................................7 2.7 ARTOOLKIT.............................................................................................................................8 2.8 FLARTOOLKIT .........................................................................................................................8 2.9 PAPERVISION (3D AND X).........................................................................................................9 2.10 PURE DATA (PD) ....................................................................................................................9 2.11 OPENFRAMEWORKS ..............................................................................................................9 2.12 STEREOVISION.....................................................................................................................10 2.13 VIDEO GLASSES ...................................................................................................................11 2.14 3D WITHOUT GLASSES .........................................................................................................13 2.15 VR GLOVES .........................................................................................................................14 2.16 ARDUINO .............................................................................................................................14 3 NEW MOBILE INTERACTIONS - INFO 16 3.1 TOUCH ..................................................................................................................................16 3.2 SPEECH ................................................................................................................................16 3.3 MOBILE TV ............................................................................................................................16 3.4 LIVE VIDEO STREAMING FROM MOBILE TO MOBILE ....................................................................17 3.5 CAMERA VALUES ...................................................................................................................17 3.6 CAMERA MOTION TRACKING ...................................................................................................17 3.7 CAMERA CAPTURE RECOGNITION ...........................................................................................17 3.8 DEVICE MOTION .....................................................................................................................18 4 AR - GAME CONSOLE APPLICATIONS 19 4.1 NINTENDO - WII .....................................................................................................................19 4.2 MICROSOF XBOX - PROJECT NATAL .......................................................................................19 4.3 SONY PLAYSTATION 3 - EYE PET ............................................................................................20 4.4 SONY PLAYSTATION 3 - MOTION CONTROLLER + EYE CAMERA ................................................22 5 AR - MOBILE APPLICATIONS & IDEAS 23 5.1 INTRO ABOUT MOBILE AR APPLICATIONS .................................................................................23 5.2 MOBILIZY - WIKITUDE .............................................................................................................23 5.3 HP - MEDIASCAPES ...............................................................................................................24 5.4 NOKIA - AR WITH IMAGE COMPARISSON ..................................................................................24 5.5 LAYAR – AR BROWSER APP....................................................................................................25 5.6 NOKIA - AR CONCEPT ............................................................................................................26 5.7 ACROSSAIR - NEAREST TUBE .................................................................................................26 5.8 WORKSNUG ...........................................................................................................................26 5.9 IKEA - AR APPS......................................................................................................................26 2
  • 3. 5.10 GOOGLE - SKY MAP .............................................................................................................27 5.11 TAT - ID MAPPING................................................................................................................27 5.12 CONNECTED - SECOND SIGHT .............................................................................................27 5.13 METAIO - CEREAL BOX AR INTERACTION...............................................................................27 5.14 GE - INTERACTIVE 3D MAGAZINE COVER...............................................................................28 5.15 TOTAL IMMERSION - COMMERCIAL AR APPS..........................................................................28 5.16 ARTHUR - ARCHITECTURE TOOL .........................................................................................29 5.17 WHITEAPP - CUSTOMISEABLE AR IPHONE APPS ....................................................................29 5.18 ACROSSAIR - BESPOKE AR IPHONE APPS .............................................................................30 5.19 MEHMET (AKA MEMO) AKTEN - GOLD DUST – INSTALLATION & IPHONE VERSIONS .................30 5.20 MEHMET (AKA MEMO) AKTEN - REINCARNATION - INSTALLATION VERSION .............................30 5.21 TREEHUGGER - AR IDEAS FOR SUSTAINABLY LIVING ..............................................................31 5.22 RACHEL CLARKE - HISTORY AR IDEA ....................................................................................31 6 MOBILE PHONE AS REMOTE CONTROL 32 6.1 UNIQUE AUTOMATION - BATH-O-MATIC ..................................................................................32 7 DATA TRANSFER AND CONNECTION 33 7.1 CONTENT TRANSFER - FROM WEB/LOCATION TO MOBILE (EASY & FREE) ...................................33 7.2 TELEMETRY ...........................................................................................................................33 7.3 BLUETOOTH...........................................................................................................................33 7.4 WIFI & 3G .............................................................................................................................33 7.5 INFRARED ..............................................................................................................................33 7.6 CAMERA ................................................................................................................................33 7.7 RADIO-FREQUENCY IDENTIFICATION (RFID) ............................................................................34 8 EXAMPLES OF GADGETS 35 8.1 EREADER ..............................................................................................................................35 8.2 ECHATTER.............................................................................................................................35 8.3 SCRIBBLER FRIDGE MAGNET..................................................................................................36 8.4 BAMBOOTABLET ....................................................................................................................36 8.5 NABAZTAG.............................................................................................................................37 8.6 LINUX PINGUIN ......................................................................................................................37 8.7 AIBO .....................................................................................................................................37 8.8 PRADA WATCH ......................................................................................................................37 9 MOBILE FLASH (LITE) WIDGETS 38 9.1 WIDGET ADVANTAGE (COMPARED TO NATIVE APPS) ................................................................38 9.2 FLASH(LITE) ADVANTAGE (MULTI-PLATFORM & HIGH PERFORMANCE IN RICH MEDIA) .................38 9.3 DEVICE SERVICES IN FLASHLITE WIDGETS ..............................................................................38 9.4 WIDGET LAUNCH BUTTONS ON N97 HOMESCREEN ..................................................................39 3
  • 4. 1 Introduction This document lists all the information I gathered during 2 intensive web surfing sessions in March and October 2009, when I was trying to find answers to e.g. following questions: Will Gadgets (small smart devices) and Widgets (small single-purpose web-based programs) invade our daily lives? Will we expect our widgets to be scattered across all kinds of device platforms? Will we expect all our devices to connect continuously, globally, silently, wireless and free of (extra) charge via Wi-Fi, RFID, Bluetooth, Infrared, USB, etc. to the internet, GPS, and to all kinds of other devices, like mobile phones, watches, video glasses, earphones, PDAs, laptops, desktop computers, billboards, shop displays, pay machines, club entrances, restaurant menus, loud speakers, lighting systems, projectors (of screens, keyboards, avatars, etc.), TVs, fridges, Nabastacs, etc.? Will we expect them to interact with us via touch (soft keys, hard keys, touch screens, device housing haptics), sound (speech and noise), motion (of the device itself), camera tracking (target motion, gesture, shape or colour; or recognition of camera content via data comparison), received values (GPS position, RFID identity, light intensity, etc.), according to our (manually set up and automatically expanded) user profile? What role will virtual and augmented reality play on these gadgets and widgets? Will they become an integral part of our reality? Will different gadgets replace our mobile phones, or will our mobile phones be(come) our main (integral) gadget? What kind of gadgets, widgets, applications, services, platforms, technologies and interactions are there around in 2009, and what could the future bring? This document is not meant to be exhaustive or 100% accurate, but merely holds together little snippets of the information I was able to find and compile within a very short time, with the links to the sites where I found that information. During my web-surf I also saved many images and screenshots. They are not included in this doc, but I could point you to them... Have fun! Carin Campanario 4
  • 5. 2 Augmented and Virtual Reality - Info 2.1 Virtual Reality (VR) Jonathan Strickland wrote “How Virtual Reality Works” (http://electronics.howstuffworks.com/gadgets/other-gadgets/virtual-reality.htm/printable) Kevin Bonsor mentions following in “How Augmented Reality Will Work” (http://www.howstuffworks.com/augmented-reality.htm): << On the spectrum between virtual reality, which creates immersible, computer-generated environments, and the real world, augmented reality is closer to the real world. Augmented reality adds graphics, sounds, haptics and smell to the natural world as it exists. >> Virtual Reality (http://dictionary.zdnet.com/definition/virtual+reality.html ) is an artificial reality that projects the user into a 3D space generated by the computer. A virtual reality system uses stereoscopic goggles that provide the 3D imagery and some sort of tracking device, which may be the goggles themselves for tracking head and body movement, or a "data glove" that tracks hand movements. The glove lets you point to and manipulate computer-generated objects displayed on tiny monitors inside the goggles. Serious Work or Entertainment Virtual reality (VR) can be used to create an illusion of reality or imagined reality and is used both for amusement as well as serious training. Flight simulators for training airplane pilots and astronauts were the first form of this technology, which provided a very realistic and very expensive simulation. Spatially Immersive Environments Virtual reality has other variants. Spatially immersive displays use multi-sided rooms that you walk into, and an "immersive theatre" or "immersive wall" uses a large flat or curved screen (8-24' long) that completely fills your peripheral vision. Desktop virtual reality (desktop VR) uses a computer to play games and view environments that you move around in, although they lack the 3D reality of true VR systems. See head mounted display, 6DOF, cyberspace, VRML, mixed reality, virtual world and Second Life. Virtual Reality at the Dentist In this application, the child is looking through the goggles and manipulating the scenes that he sees with a game controller. (Image courtesy of I-O Display Systems, www.i-glasses.com) Fakespace Systems' CAVE products simulate a VR environment for various purposes, such as testing the design of a new building (train station above) or learning how to operate a Caterpillar bulldozer (below). In the latter, the steering wheel on the left meets the real steering wheel on the right in virtual space. CAVE was developed by the Electronic Visualization Laboratory at the University of Illinois in the early 1990s. (Images courtesy of Fakespace Systems Inc., a subsidiary of Mechdyne Corporation, www.mechdyne.com) 5
  • 6. The 6 Degrees of Freedom or 6DOF (http://dictionary.zdnet.com/definition/6DOF.html ) are the amount of motion supported in a robotics or virtual reality system. Six degrees provides X, Y and Z (horizontal, vertical and depth) and pitch, yaw and roll. Three degrees of freedom (3DOF) provides X, Y and Z only. See pitch-yaw-roll. Virtual Reality Modelling Language or VRML (http://dictionary.zdnet.com/definition/VRML.html) is a 3D graphics language used on the Web. After downloading a VRML page, its contents can be viewed, rotated and manipulated. Simulated rooms can be "walked into." The VRML viewer is launched from within the Web browser. The first VRML viewer was WebSpace from SGI, whose Open Inventor graphics library was the basis for developing VRML. Cosmo Player, WorldView and Cortona are other popular Windows viewers, and SimVRML and Virtus Voyager are well known Mac viewers. See also: http://en.wikipedia.org/wiki/Virtual_reality VR products: http://www.vrealities.com/ Head mounted displays: http://www.vrealities.com/hmd.html Displays: http://www.vrealities.com/stereoscopicdisplays.html Gloves: http://www.vrealities.com/5dtglove14.html 2.2 Augmented Reality (AR) Kevin Bonsor mentions following in “How Augmented Reality Will Work”: << Augmented-reality displays overlay computer-generated graphics onto the real world and adds graphics, sounds, haptics and smell to the natural world as it exists. >> Article: http://www.howstuffworks.com/augmented-reality.htm Other links: http://computer.howstuffworks.com/augmented-reality6.htm Printable: http://www.howstuffworks.com/augmented-reality.htm/printable Mixed Reality (http://dictionary.zdnet.com/definition/mixed+reality.html ) is a type of virtual reality that combines real and imagined images. In "augmented reality," most of the images are real. For example, using transparent headsets, you could see how that new sofa would look in your own living room, or view the 3D schematic of a jet engine while you work on the engine itself. With "augmented virtuality," most of the imagery is computer-generated. For example, you might see something real, perhaps even yourself, projected into an imaginary environment. See virtual reality. Game idea: Augmented reality software could allow a group of mobile users to film each other, while each of them manipulates a specific 2D graphic. This could be just fun or educational as well. If only the others can see (on their mobile screens) what your card represents in the application, then they could explain what the object is (for) and you could guess its name, so that each person in the group trains his knowledge on the related subject (e.g. medieval times). The films (with the users and their interactive 3D video objects) could be shared, reviewed and commented afterwards. 6
  • 7. 2.3 AR - Training The Virtual Reality Lab (VRlab), EPFL in Lausanne (http://vrlab.epfl.ch/About/about_index.html ) was founded in July 1988 by its director, Professor Daniel Thalmann. The laboratory is mainly involved in the modelling and animation of Three-Dimensional Inhabited Virtual Worlds. VRlab is a world leader laboratory in real-time Virtual Humans and a key player in the area of multi-modal interaction, immersive Virtual Environments, and Augmented Reality. One of Vrlab’s Project European project is STAR (http://vrlab.epfl.ch/Projects/projects_index.html), which covers various aspects of augmented reality applied to enhance animations concerning virtual actors manipulating objects for the purpose of training operability of industrial equipments. 2.4 AR – Game Workshop Mediamatic (http://www.mediamatic.net/ ) organizes exhibitions, presentations, workshops and much more (related to New Media, Art and Society). Its site freely mixes news, theory and people: http://www.mediamatic.net/index.php?lang=en Mediamatic organizes workshops in Amsterdam (http://www.mediamatic.net/page/9832) on new developments in interactive (media) technologies, with a cultural approach. The courses offer effective hands-on training along with sharp conceptual exploration and are about experimenting, playing, testing and having fun! Recent courses included focus on hybridity, the integration of digital components in material objects, workshops around the Fablab machinery, the (Lilypad) Arduino, game based technologies & Machinima, PureData, RFID & the Internet of Things, location based media, mobtagging, radio experiences, Interactive film & Korsakow and anyMedia documentaries. In workshop “Augmented Reality Games” in 2, 3 and 4 June 2008 (http://www.mediamatic.net/page/36632 and http://www.mediamatic.net/page/37778/en) participants conceptualise and construct a prototype of their own Augmented Reality Game in 3 days. 2.5 MagicSymbol MagicSymbol™ (demo: http://www.magicsymbol.com/) is the next generation of 'reveal' technology, providing a unique experience. On filming themselves with a (2D) card, participants will see themselves on screen and on their cards will appear a (3D) video animation (with sound and interaction). Move and spin the card around, and the (3D) video clip stays magically glued to the surface. You can create such augmented reality (also) with (F)LARToolkit and Papervision. Demos: Smart Grid: http://ge.ecomagination.com/smartgrid/?c_id=Huff#/augmented_reality John Lindquist: http://pv3d.org/2009/03/12/augmented-reality-flartoolkit-demo-reel/ Seb Lee-Delisle: http://www.sebleedelisle.com/?p=383 2.6 Holotronica Holotronica (from holographic and electronica) describes all artistic holotronic works. 7
  • 8. 2.7 ARToolKit ARToolKit (http://artoolkit.sourceforge.net/ and http://www.hitl.washington.edu/artoolkit/) is a software library for building Augmented Reality (AR) applications. These are applications that involve the overlay of virtual imagery on the real world. For example, in the image to the right a three-dimensional virtual character appears standing on a real card. It can be seen by the user in the head set display they are wearing. When the user moves the card, the virtual character moves with it and appears attached to the real object. One of the key difficulties in developing Augmented Reality applications is the problem of tracking the users viewpoint. In order to know from what viewpoint to draw the virtual imagery, the application needs to know where the user is looking in the real world. ARToolKit uses computer vision algorithms to solve this problem. The ARToolKit video tracking libraries calculate the real camera position and orientation relative to physical markers in real time. This enables the easy development of a wide range of Augmented Reality applications. Some of the features of ARToolKit include: * Single camera position/orientation tracking. * Tracking code that uses simple black squares. * The ability to use any square marker patterns. * Easy camera calibration code. * Fast enough for real time AR applications. * SGI IRIX, Linux, MacOS and Windows OS distributions. * Distributed with complete source code. ARToolKit was originally developed by Dr. Hirokazu Kato, and its ongoing development is being supported by the Human Interface Technology Laboratory (HIT Lab) at the University of Washington, HIT Lab NZ at the University of Canterbury, New Zealand, and ARToolworks, Inc, Seattle. ARToolKit is made available freely for non-commercial use under the GNU General Public License. Commercial licenses to a professional implementation of ARToolKit are available for users for whom the GPL is not suitable, or who require a higher level of support, or who require customisation or other specialist modifications. Commercial licenses are administered by ARToolworks, Inc., Seattle, WA, USA. 2.8 FLARToolkit FLARToolkit (http://www.libspark.org/wiki/saqoosha/FLARToolKit/en) detects the marker from an input image and calculates the camera position in the three-dimension space. libspark (FLARToolKit) site: http://www.libspark.org/wiki/WikiStart/en 8
  • 9. 2.9 Papervision (3D and X) PapervisionX (http://blog.papervision3d.org/ ) is the next version of Papervision3D, based on Flash10’s new 3D API. Papervision3D (http://code.google.com/p/papervision3d/ ) is an open source 3D engine for the Flash platform. Flash allows animation and interaction in the 3D augmented reality. The user could e.g. blow or speak into the microphone to trigger actions (blow out candles, blow on wind turbines, speak- command objects, etc.). 2.10 Pure Data (Pd) Pure Data or Pd (http://en.wikipedia.org/wiki/Pure_Data ) is a graphical programming language developed for the creation of interactive computer music and multimedia works. Pd is an open source project and has a large developer base working on new extensions to the program. Pure Data or Pd (http://puredata.info/) is a real-time graphical programming environment for audio, video, and graphical processing, which is easy to extend by writing object classes ("externals") or patches ("abstractions"). The work of many developers is already available as part of the standard Pd packages and the Pd developer community is growing rapidly. Recent developments include a system of abstractions for building performance environments; a library of objects for physical modelling; and a library of objects for generating and processing video in real-time. Pd is free software and can be downloaded either as an OS-specific package, source package, or directly from CVS. Pd was written to be multi-platform and therefore is quite portable; versions exist for Win32, IRIX, GNU/Linux, BSD, and MacOS X running on anything from a PocketPC to an old Mac to a brand new PC. It is possible to write externals and patches that work with Max/MSP and Pd using flext and cyclone. Example: http://doboxrecordings.com/db/index.php/2007/05/10/maker-faire-2007-pd-osc-processing- quartz-composer/ 2.11 OpenFrameworks OpenFrameworks is an open source C++ toolkit for creative coding, and includes e.g. motion tracking code. OpenFrameworks: http://www.openframeworks.cc/ iPhone Development with openFrameworks and ofxiPhone: http://www.memo.tv/ofxiphone 9
  • 10. 2.12 Stereovision Stereovision is actually the normal way almost everyone sees in the real world. We all have two eyes and perceive depth by a mental interpretation of the world we view through those two eyes. Each eye gives a slightly different perspective on the objects viewed and this slight difference provides depth cues to our brain. Objects which are relatively close will shift a larger distance horizontally when viewed from one eye and then switching eyes. Objects which are relatively far away shift a smaller amount. Hold your finger up about 6 inches in front of your nose. Close one eye, then switch back and forth quickly. See the image shift? That left and right slightly shifted perspective is what creates the depth perception that your brain interprets. That's why you have 2 eyes! The E-D software and drivers automatically convert the images on your monitor into a left and right perspective. Each image flickers back and forth so fast on your monitor that it is not noticeable to the human eye. Working synergistically with our advanced active glasses, the flickering of each image is precisely timed with flickering of the left and right lens of the glasses, again faster than can be perceived. Thus, stereovision as it pertains to viewing a virtual world means that you have the capability to produce two separate images and that each eye sees only one of the two images. If this is done correctly, your mind will combine the two images in such a way that you actually have the perception of being "in" the virtual world rather than just viewing a picture of the virtual world. This adds a level of realism and immersion to games and other images that is otherwise unattainable. In addition to perceiving depth "into" the monitor it is also possible to make objects appear to come "out of" the monitor. Almost all fairly recent computers and games come pre-equipped with the necessary tools for proper viewing. It's important to note that eDimensional 3D images are in full colour and do not use the old fashioned red/blue effect. The colours below are just to emphasize the difference in perspective. Info: http://www.edimensional.com/category_info.php?cPath=21 Products: http://www.edimensional.com/index.php?cPath=21&osCsid=bc3398d46fd89e2313262f316ade7b3d&ref=7 3&gclid=COD62Zadw5kCFRCdnAod7W-Dtg E-D Wireless 3D Glasses for the PC $99.95 Set yourself free of wires and view amazing 3D gaming action through our wireless 3D glasses. * Works on virtually all PC games * Supports virtually any PC * Supports both CRT and LCD monitors * Comfortable and adjustable E-D Wired 3D Glasses for the PC $69.95 10
  • 11. Works just like our critically acclaimed wireless glasses and comes with everything you need to play all of your favourite games in stunning 3D. Sleek and stylish -- you won't believe your eyes! Vuzix - VR920 Head Mounted Display $399.95 If you're looking for a head mounted display with built-in screens, we now offer the Vuzix VR920. Features 3D, head tracking, audio, mic and more in a compact and portable display device. 3D Combine 2D to 3D Photo Software $39.95 Convert your own pictures into real 3D instantly. 3DCombine gives you a new and fun way to take your digital photos and images and view them in amazing 3D with our wired or wireless 3D glasses. 3D Glasses for Samsung and Mitsubishi Televisions $149.95 Did you know that the latest DLP and Plasma TVs from Samsung and Mitsubishi now offer high resolution 3D as a standard option? If you've got one of these televisions, you'll need our new viewing systems to unleash the full 3D potential. Long Range Viewing Equipment for Stereo Projection $295.00 Specially designed stereoscopic viewing equipment for use in conjunction with stereoscopic projection, our powerful custom emitter and shutter glasses view 3D images up to 20' away. Laboratory tested for exceptional performance at a fraction of the price. 2.13 Video glasses Head Mounted Display (http://dictionary.zdnet.com/definition/head+mounted+display.html ) is a display system built and worn like goggles that gives the illusion of a floating monitor in front of the user's face. The head mounted display (HMD) is a critical component of a body-worn computer (wearable computer). Single-eye units are used to display hands-free instructional material, and dual-eye, stereoscopic units are used for virtual reality applications. See heads-up display, body-worn computer and CAVE. EEYE (http://www.eeye.hk/product.asp) has 3 types of video glasses: - TV viewing - Film viewing - Film viewing & capturing Vuzix (http://www.vuzix.co.uk/) has many types of video glasses: Vuzix Wrap 920AV (January 2009: http://www.vuzix.com/UKSITE/iwear/reviews.html ) The Wrap 920AV is the world’s “first in class” Video Eyewear that takes the form of a standard pair of fashionable sunglasses with revolutionary ‘see-thru’ Quantum optics technology that doesn’t block out the world around you. Its unique ‘see-thru’ lens design allows you to stay grounded in the real world while watching your private video display or experiencing augmented or mixed reality on mobile devices such as the iPhone. A revolutionary patent pending electronic IPD system enables adjustment for virtually all facial structures and optional prescription lens inserts provide the ultimate solution for eyeglass wearers. 11
  • 12. The Wrap 920AV provides a 60-inch monitor as seen from 9 feet and has available expansion options – all in a lightweight package that is less than 3 ounces. Coming Autumn of 2009 Vuzix AV230 XL The AV230 XL is a wearable display that transforms your small portable video player screen into a personal home cinema with a virtual 44-inch screen as viewed from nine feet. Dual displays provide crisp images and vivid colours through optics aligned to military specifications. Worn like regular glasses, the AV230 XL includes separate focus adjustments for each eye and removable high-quality stereo earphones. A single removable AA battery affords up to 17 hours of viewing enjoyment. Price: £149.99 / €169.99 (Including VAT at 15%) Vuzix iWear VR920 Step inside with the Vuzix iWear VR920, the world’s most popular virtual reality and gaming solution that incorporates immersive big-screen 3D video, head tracking, microphone and audio. You can move, look around, listen, and communicate with others - almost like being in the ‘real’ world. The iWear VR920 opens amazing new doors to the World Wide Web. Price: £299.99 / €349.99 (Including VAT at 15%) YouTube videos: Vuzix mobile TV: http://www.youtube.com/watch?v=907Z__2ohKw Vuzix augmented reality: Lego - http://www.youtube.com/watch?v=SYbUJJDpcs8 Virtual Reality Fishing - http://www.youtube.com/watch?v=k3l5YD_FOfQ&feature=related Vuzix widescreen video glasses: http://www.youtube.com/watch?v=jyjOG39jsDc http://www.youtube.com/watch?v=-uxqO2AkfAc Vuzix full review (mentioning 3D stereoscopic option, pros + cons): http://www.youtube.com/watch?v=4MR3AxwpZsI&feature=related 12
  • 13. 2.14 3D without glasses Wazabee (http://wazabee.net/) is a registered brand of Spatial View Inc. 3DeeShell Wazabee 3DeeShell is the world’s first protective case designed for viewing glasses-free 3D content on the Apple iPhone and iPod Touch. Create and share relevant stereo 3D images with friends, family or anyone using an iPhone. Enjoy the visual excitement of truly vibrant 3D content and access content from online sources or upload your own 3D imagery. Watch clips and play games in 3D in the palm of your hand without the need for special glasses or an external display. Easily removable for enjoying both regular 2D and vivid 3D content. 49.99 EUR / 49.99 USD Excluding VAT and shipping,. 3DeeCamera 3DeeCamera enables you to create 3D images using your built-in iPhone camera. Take two side-by-side photographs or choose two stereo-pairs from storage to easily generate stunning 3D images by shifting, rotating and scaling the image pairs. Immediately create and share 3D images with friends, family or anyone using an iPhone. 3DeeVUsion The ultimate 3D viewing application for the iPod Touch. 3DeeVUsion allows you to select a pair of images from the Photo Library for 3D viewing. Experience and view any stereo 3D content including images generated with your iPhone or any other stereo 3D Camera. 3Dee!oadr An easy and simple way to connect with your Yahoo Flickr account. The 3Dee!oadr is available to search and view over 500,000 pre-existing stereoscopic 3D images. Furthermore, it allows you to upload your own content to a Flickr! Account. 3DeeFlector (Available Spring 2009) Introducing the Wazabee 3DeeFlector - A removable overlay screen designed for viewing glasses-free 3D content on all 13.3 inch notebooks! Enjoy the excitement of truly vibrant content by turning your notebook into 3D. Watch clips, play games in 3D and experience a perfect 3D impression without loss of image quality. Build your professional 3D business presentation without the need for special glasses or an external display. Create and share relevant stereo 3D images with friends, family or anyone using a 13.3 inch notebook. 13
  • 14. 2.15 VR Gloves The 5DT Data Glove 14 Ultra (http://www.vrealities.com/5dtglove14.html ) has been designed to satisfy the stringent requirements of modern Motion Capture and Animation Professionals. It offers comfort, ease of use, a small form factor and multiple application drivers. The high data quality, low cross-correlation and high data rate make it ideal for realistic real-time animation. The 5DT Data Glove 14 Ultra measures finger flexure (2 sensors per finger) as well as the abduction between fingers. The system interfaces with the computer via a cable to the USB Port (Platform Independent). It features an auto-calibration function, 8-bit flexure and abduction resolution, extreme comfort, low drift and an open architecture. The optional Wireless Kit interfaces with the computer via Bluetooth technology (up to 20m distance) for high speed connectivity for up to 8 hours on a single battery. Right- and left-handed models are available. One size fits many (stretch lycra). SPECIFICATIONS Bend Sensing Method: Fully enclosed fibre optic bend sensors Number of Sensors: (two per finger) as well as abduction between fingers Resolution: 8-bits (256 positions/finger) Output Interface: USB 1.1, Minimum 75hz sampling rate, 200hz per finger Tracking, Integrated pitch and roll sensor Glove fitting: RH & LH versions; "One size fits many" Calibration Routine: Open & close hand; each user 5DT Data Glove 5 Ultra (NOT 14 Ultra): 5DT Data Glove 5 Ultra, Right Handed - $895.00 5DT Data Glove 5 Ultra, Left Handed - $895.00 Wireless Glove Kit - $1495.00 2.16 Arduino The LilyPad Arduino (http://www.arduino.cc/en/Main/ArduinoBoardLilyPad) is a micro-controller board designed for wearables and e-textiles. It can be sewn to fabric and similarly mounted power supplies, sensors and actuators with conductive thread. Tutorials, etc: http://www.arduino.cc/playground/ Pguino is e.g. a real world application based on the Arduino, which measures the MPG (miles/gal) of a driver to provide feedback to the driver so they may change their driving habits and conserve on gas. This application encompasses the use of an LCD, button menu, and data input and manipulation. The CyberEmotions consortium (http://www.cyberemotions.eu/ ) began in February 2009 for a period of four years. The project focuses on the role of collective emotions in creating, forming and breaking-up e- communities. The project involves nine partners in six different countries in Europe, including experts in the psychology of emotions, complexity, web data collection, artificial intelligence and virtual reality. 14
  • 15. The main aims of the project are: To understand the role of collective emotions in creating, forming and breaking-up ICT mediated communities as a spontaneous emergent behaviour occurring in complex techno-social networks To understand the relationship between emotions of individuals as revealed by subjective experience, behaviour, physiological responses, and expressions with online emotional behaviours of ICT mediated dyads and groups in an integrative multi-level approach To create decentralized adaptive tools which allow the amplification of positive or the suppression of negative collective emotions in e-societies and will take into account the heterogeneity of interacting humans To prepare the theoretical background for the development of the next generation emotionally-intelligent ICT services using models of self-organized active agents and sociophysics methods. Understanding these phenomena is important in view of the growing role of ICT-mediated social interactions and some specific features of e-communities. The challenge of this interdisciplinary project is to combine psychological models of emotional interactions and algorithmic methods for detection and classification of human emotions in the Internet with probabilistic models of complex systems and data driven simulations based on heterogeneous emotionally-reacting agents. The theoretical foundations will be mainly based on statistical physics applied to the study of the emergent properties of many-object systems interacting in self-organized evolving networks. Empirically, we concentrate on the issue of how to support and maintain the emotional climates of security, trust, hope, and freedom in future techno-social communities and how to prevent or resolve conflicts within them. Data on human emotions and their influence on the structure of sustainable cooperative communities will be collected from the Blogosphere, newsgroups and Internet discussion forums and compared to computer simulations based on active agent models. Finally, we plan to develop artificial agents that can help to assess the emotional states of the members of e-communities and can act as cyberadvisers in e-communities. The results of the project will build the foundations for the next generation of socially- and emotionally-intelligent ICT services. Partners (http://www.cyberemotions.eu/partners.html) : Poland: Warsaw University of Technology (WUT), Centre of Excellence for Complex Systems Research [Project leader] Poland: Gemius SA, online research agency Switzerland: EPFL, Virtual Reality Lab UK: University of Wolverhampton, School of Computing and IT, Statistical Cybermetrics Research Group Austria: Österreichische Studiengesellschaft für Kybernetik (The Austrian Research Institute for Artificial Intelligence - OFAI) Switzerland: ETH Zurich, Chair of Systems Design Slovenia: Jozef Stefan Institute (JSI) Ljubljana, Department of Theoretical Physics Germany: Jacobs University, Bremen, TU Berlin, Faculty of Computer Science, IKM Research Group 15
  • 16. 3 New Mobile Interactions - Info 3.1 Touch Interesting exchange on MOMOLO mailing list (February/March 2009): Touchscreens - a herd mentality? (http://tech.groups.yahoo.com/group/momolondon/msearch?query=Touchscreens+- +a+herd+mentality%3F&submit=Search&charset=UTF-8 ) HAPI (haptic interaction for mobile devices): Haptic research: http://www.hapi-project.com/ Blog: http://www.partly-cloudy.com/ When digital objects can be manipulated directly by hand, the interaction principles of conventional mouse-keyboard-interfaces are not valid any longer. In order to be able to develop applications for sensitive surfaces, it’s therefore necessary to first create adequate interaction principles for these novel computer interfaces. Tangent (http://www.hapi-project.com/posts/view/21), an interactive multitouch surface, enables us to transfer interactions with physical objects known from everyday life to the digital medium. Multitouch Jazzmutant Instruments: Video: http://www.jazzmutant.com/videos/lemurlight.mov Site: http://www.jazzmutant.com/ Scribbler mobile application (http://www.mobiletipstricks.com/scrible-on-your-windows-mobile-with- scribbler/ ) is designed specially for Symbian UIQ (user interface quartz) 3 phones. What good about UIQ series phones is the inherent support for touch screen functionality and Scribbler makes full use of this technology by enabling you to create or write what ever you want to on the screen of your mobile phone. From: Scrible On Your Windows Mobile with Scribbler (Nov 28, 2008). 3.2 Speech Spinvox (http://www.spinvox.com/) captures spoken messages, converts them into written text and delivers these to destinations of choice (e.g. inbox, blog, wall, space…). SpinVox will be opening up access to its Voice Message Conversion System (VMCS™) via SpinVox Create (https://www.spinvox.com/developer), a simple interface to quickly build and monetise server based or mobile speech applications. 3.3 Mobile TV Gadget show video (Korean mobile TV after 50 sec): http://www.youtube.com/watch?v=cIcFUKL9r- g&feature=PlayList&p=D49A28DCA1CFC60F&playnext=1&playnext_from=PL&index=3 16
  • 17. 3.4 Live video streaming from mobile to mobile LTE (http://www.dailynet.de/Fusion-Akquisation-Uebernahmen/12122.php) is a next generation wireless technology that delivers seamless mobile broadband connectivity making applications like streaming HD Video, interactive gaming, and video conferencing as accessible on mobile devices as they are at home or the office. Floobs (http://www.floobs.com) is a Finish startup, which develops a live streaming platform that enables live streaming from mobile phones, web cams, and dv-cams to other mobile phones and web. Live video from mobile to mobile could enable great use experiences, e.g.: - one user could see where the other is going and guide him in the right direction - one user could give a virtual tour to another mobile user at home (and check out what the second one requests) 3.5 Camera values Camera software values for distance, light, shake, etc. could be used as interaction inputs in mobile applications. The user could e.g. zoom in/out on elements on his screen by raising/lowering his mobile, using the distance measure feature of his phone’s camera. 3.6 Camera motion tracking Emma Persky (www.travellerwithatale.com), Grant Skinner and others developed applications that allow a web cam to focus on (‘grab’) one or several targets, trace their movements, and use these movements as interaction inputs. Microsoft and Sony have integrated this technology for their video game console systems, with Project Natal and Eye Pet. Such software could allow the user to point his phone camera to specific targets (e.g. on billboards, in shops, at events, or throughout the city), interact with these targets (by moving the targets or the camera), and trigger specific reactions on his phone’s screen in real time. 3.7 Camera capture recognition Nestor - Ar live recognition system Nestor is a real-time shape recognition and pose estimation system for natural shapes. The system runs on an N95 mobile phone and tracks solid blobs and curves. Nestor was developed by the Human Interface Technology Laboratory New Zealand (HIT Lab NZ) is developing and commercialising technology that improves human computer interaction and by doing so unlocks the power of human intelligence. 17
  • 18. The HIT Lab NZ conducts research with new emerging technologies such as Augmented Reality, Next Generation Video Conferencing, Immersive Visualization and Perceptual User Interfaces. Interaction Design techniques are used to adapt these technologies to the needs of end users and solve real world problems. The end goal is to improve the user experience with technology. Video - Augmented Reality on Natural Shapes (live recognition): http://www.youtube.com/watch?v=je8SihypYA4 Hitlabnz Site: http://www.hitlabnz.org/wiki/Home Microsoft and Sony have integrated this technology for their video game console systems, with Project Natal and Eye Pet. 3.8 Device motion Nokia’s accelerometer sensor values for e.g. shake (double tapping) and x, y and z axis and rotation can be used as interaction inputs in mobile applications. Such inputs demand much less precision, concentration and dexterity than conventional mobile interaction with soft and hard keys (buttons). The Flash Lite Developer's Library 1.3 on forum.nokia now supports Service APIs (like the Sensor Service API) which allow Flash Lite 3.0 applications to use the S60 5th Edition device sensor values: http://library.forum.nokia.com/index.jsp?topic=/Flash_Lite_Developers_Library/GUID-46EABDC1-37CB- 412A-ACAD-1A1A9466BB68.html The user could e.g. - lift the right/left side of the device upwards for the next/previous screen - lift the top/bottom side of a device upwards for a view-mode toggle (e.g. text/image) - rotate the device clockwise/anti-clockwise to steer a screen object, pull a virtual lever (switch), move a slider up/down, etc. - shake the device to reset the application or return to the home screen Reuters Slideshow widget (in progress):http://clients.tui.co.uk/reuters_slideshow iPhone demo with sensor apps: http://www.apple.com/uk/ipodtouch/gallery/ads/index.html 18
  • 19. 4 AR - Game Console Applications 4.1 Nintendo - Wii Wii is Nintendo's home video game console that targets a broader demographic than Microsoft's Xbox 360 and Sony's PlayStation 3 (and sold more than them worldwide, in December 31, 2008). It shows the player’s customized avatar on the screen, which moves exactly as the player in real-time. - Wii Remote is a wireless motion-sensing handheld remote controller, for 3D motion detection and pointing. - Wii MotionPlus is a controller that tracks players' movements in finer detail and with greater accuracy, replicating the slightest twist of the wrist or turn of the body exactly on the TV screen, allowing users to become even more immersed in Wii game play. - Wii Balance Board is a flat board with multiple pressure sensors that measure the user's weigh and centre of balance (the location of the intersection between an imaginary line drawn vertically through the centre of mass and the surface of the Balance Board), which it transmits to the Wii through Bluetooth. - WiiConnect24 enables Wii to receive messages and updates over the Internet while in standby mode. Wiki: http://en.wikipedia.org/wiki/Wii http://en.wikipedia.org/wiki/Wii_MotionPlus http://en.wikipedia.org/wiki/Wii_Balance_Board Amazon: http://www.amazon.co.uk/Wii-Motion-Plus-Accessory/dp/B001TOQ8NO 4.2 Microsof Xbox - Project Natal Microsoft announced ‘Project Natal’, the controller-free interaction experience for their Xbox 360 video game platform at E3 2009 (the annual gathering for interactive entertainment), on June 1, 2009. Project Natal enables users to control and interact with the Xbox 360 by using gestures, spoken commands, or presented objects and images, without the need for a game controller. See a ball? Kick it, hit it, trap it or catch it. If you know how to move your hands, shake your hips or speak, you and your friends can jump into the fun - the only experience needed is life experience. Project Natal’s sensor features an RGB camera, depth sensor, multi-array microphone, and custom processor running proprietary software, which provides full-body (skeleton) 3D motion capture, facial recognition, and voice recognition capabilities, for up to 4 people at the time. The microphone enables the Xbox 360 to conduct acoustic source localization and ambient noise suppression, allowing for things such as headset-free party chat over Xbox Live. 19
  • 20. The depth sensor consists of an infrared projector combined with a monochrome CMOS sensor, and allows to see in 3D under any ambient light conditions. The sensing range of the depth sensor is adjustable, and will be automatically calibrated based on gameplay and the player's physical environment, such as the presence of chairs. The skeletal mapping technology shown at E3 2009 was capable of simultaneously tracking up to four users for motion analysis, with a feature extraction of 48 skeletal points on a human body at a frame rate of 30 hertz. Depending on the person's distance from the sensor, Project Natal is capable of tracking models that can identify individual fingers. Wikipedia: http://en.wikipedia.org/wiki/Project_Natal Site: http://www.xbox.com/en-US/live/projectnatal/ Project Natal Video: http://www.youtube.com/watch?v=p2qlHoxPioM Meet Milo video: http://www.youtube.com/watch?v=HluWsMlfj68 4.3 Sony Playstation 3 - Eye Pet Eye Pet is a new game for Sony’s Playstation 3 (PS3) game console, featuring a virtual pet monkey ‘EyePet’, with which the player has to interact in certain ways (e.g. feeding and bathing it) to score points and gain rewards (new pet objects and outfits for new interactions), and with which the player can just have fun in mini games (e.g. balloon popping, or driving cars that EyePet has drawn). The player can: - Interact with EyePet by moving his hand, body or a printed card - The card is included with the game and has a unique printing that is identified by the PS3 Eye webcam, so that virtual, animated and interactive objects can be mapped onto the card in real-time, such as shower heads, soap bottles and hair dryers to shower EyePet with. - Customize EyePet - Modify fur length, color and pattern and choose from over 250 unique outfits. - Draw New Toys for Your EyePet - Watch as they transform into 3D toys in-game. - Create and Share With Friends - Record your favourite EyePet moments and creations, and then share them online. EyePet reacts to every movement and command: - it leaps towards your fingers as you waggle them in the air 20
  • 21. - it pounces across the ground when you move your arm down - it purrs when you pet it - it laughs when you tickle it - it chases a ball when you roll it - etc. Through the game’s ‘Pet Programme’ challenges you can earn gold medals by completing increasingly difficult challenges over a 14 day period. The game always feels fresh and constantly rewards, because every time you do something well you’ll win a new EyePet costume, and every time you complete Pet Programme section you’ll earn a new object, so that you’ll have a host of objects, toys and costumes to play with, extending the experience even further while you try everything out. Besides the ‘Pet Programme’ you can also play ‘Mini games’, like popping balloons, teaching him songs, sending him for check-ups, or driving cars that he has drawn (you can draw objects for EyePet with a thick pen, scan them into the Playstation Eye, see EyePet re-draw them, see the objects become 3D, and then interact with them!) It would be around 5-8 hours before you’ve seen everything. You interact via the Playstation Eye camera, which is pointed towards the ground, giving EyePet an area to move. The game is constantly storing the footage of yourself interacting with EyePet , and shows you this footage when EyePet sleeps and dreams about previous events. Pushsquare review: http://www.pushsquare.com/7466/eye-pet-on-playstation-3-review/ Sony article: http://uk.playstation.com/games-media/news/articles/detail/item227474/Love-your-EyePet/ Videos: Trailer: http://www.youtube.com/watch?v=_ZQpqfzDgOk Pushsquare: http://www.youtube.com/watch?v=Pa8KKSH1ZE0&feature=player_embedded With children: http://www.eurogamer.net/videos/eye-pet-in-the-wild Amazon: Eye Pet: http://www.amazon.com/EyePet-Playstation- 3/dp/B002OOVJUA/ref=sr_1_1?ie=UTF8&s=videogames&qid=1256229166&sr=1-1 Eye Pet Bundle: http://www.amazon.com/EyePet-Bundle-Playstation- 3/dp/B002Q7KWAI/ref=sr_1_2?ie=UTF8&s=videogames&qid=1256229166&sr=1-2 PS3: http://www.amazon.com/PlayStation-3-120-GB/dp/B002I0J4VQ/ref=dp_ob_title_vg PS3 Eye: http://www.amazon.com/PlayStation-3- Eye/dp/B000VTQ3LU/ref=sr_1_3?ie=UTF8&s=videogames&qid=1256229166&sr=1-3 21
  • 22. 4.4 Sony Playstation 3 - Motion Controller + Eye camera Sony announced their new motion controller for the PS3 (Playstation 3) at E3 (the annual gathering for interactive entertainment) on June 2, 2009. The prototype looks like a wand with a colour-changing ball on top, which can be tracked by the PlayStation Eye (camera), to overlay on-screen objects (e.g. weapons, tools, characters, hands, etc.), for actions like: - Sport (mapping rackets, bats, etc, and calculating trigger force, distance and direction) - Fighting (mapping characters, hands, weapons) - Drawing (pencil, spray, object drawing) - Building (manipulating objects) The player can - define the force, distance and direction of his actions, and the moment of triggering (when only pointing, and when actually drawing/shooting) - change the screen’s viewpoint (to his or his object’s/wand’s viewpoint) - change the wand’s purpose (by changing its colour -> which drawing mode/sport tool/weapon/etc.) - hold up to 4 controllers (with different colours), but realistically 1 or 2 controllers (e.g. 1 for the bow and 1 for the arrow) The Motion Controller features an orb at the end which can glow in any of a full range of colours. The uniform spherical shape and known size of the light allows the system to simply determine the wand's distance from the PlayStation Eye, through the light's image size, thus enabling the wand's position to be tracked in three dimensions with high precision and accuracy. The PlayStation Eye is Sony's webcam device for its PlayStation 3 video game console. Its microphone enables multi-directional voice location tracking, echo cancellation, and background noise suppression, which allows speech recognition and audio chat in noisy environments without the use of a headset. Wiki: http://en.wikipedia.org/wiki/PlayStation_Motion_Controller http://en.wikipedia.org/wiki/PlayStation_Eye Article: http://www.engadget.com/2009/06/02/sony-announces-new-ps3-motion-controller/ Video: http://www.youtube.com/watch?v=cnuyaIIOyz8 22
  • 23. 5 AR - Mobile Applications & Ideas 5.1 Intro about mobile AR applications While it may be some time before these types of applications become mainstream on mobile phones, the current prediction for smartphone sales suggests this will be sooner than you think. Smartphone sales that support AR apps account for less than 20% of the overall global market (in October 2009) but are growing fast and are predicted to reach 50% of the mobile market within the next five years. Article: http://mobverge.blogspot.com/2009/10/ikea-augmented-reality-concept-coming.html Many AR articles and apps: http://www.engadget.com/tag/augmented+reality/ 5.2 Mobilizy - Wikitude Wikitude is a mobile travel guide for the Android platform based on location-based Wikipedia, Qype and Lonely PLanet content. It is a handy application for planning a trip or to find out about landmarks in your surroundings. Search 350,000 world-wide points of interests based on your current GPS location and address and display them in a list view, map view or cam view. To get started as easily as possible, two search options have been provided: - Simple Search allows users to initiate a search just by pressing "Start Search" - Advanced Search offers users additional search options (category, distance, and search term) Search results are displayed on a map (normal or satellite mode) as orange dots. There is a text bubble containing a short description next to the selected point of interest. The truly compelling feature is the augmented reality cam view, users may hold the phone’s camera against a spectacular mountain range and see the names and heights displayed as overlay mapped with the mountains in the camera. Users may look out of an airplane window to see what is down there. Users may walk through a city like Seville, Spain, holding the phone’s camera against a building and Wikitude tells what it is. WIKITUDE World Browser presents the user with data about their surroundings, nearby landmarks, and other points of interest by overlaying information on the real-time camera view of a smart-phone. WIKITUDE.me is a community of mobile augmented reality users and shapers, empowered with a powerful tool to embed unique points of interest (POI) and location-specific, hyperlinked media content which can be viewed on the WIKITUDE World Browser. WIKITUDE DRIVE is a fully-functional, light weight navigational system which overlays point-to-point directions on a camera-view, without the need for maps. 23
  • 24. WIKITUDE API is a powerful application programming interface which allows for the open development of markerless AR experiences, providing developers with the tools to either create their own android augmented reality applications, or enhance their existing Android applications with an AR camera-view engine. Site: http://www.wikitude.org/ (http://www.mobilizy.com/wikitude.php ) Wikitude Videos: http://www.youtube.com/watch?v=8EA8xlicmT8 http://www.youtube.com/watch?v=tpaJBu4BEuA&feature=related WikiDrive Video: http://www.youtube.com/watch?v=PdmSVCDmJGA 5.3 HP - Mediascapes The free Mscape Suite enables the creation of Mediascapes, which are applications with mobile, location– based interactive media (video, audio, images and text) that can be games, stories, experiences, tours, guides, tools, and more. With more than 436 million mobile phones with GPS capabilities, Mscape has a vast potential audience. While most of today’s mediascapes work with GPS (on specific Windows devices: http://wiki.mscapers.com/bin/view/Main/SupportedDevices), the Mscape plug-in architecture allows for expansion to other sensors such as infrared, Bluetooth™ wireless technology, and bio sensors, which enable even more user options (http://www.mscapers.com/about-mscapers/). Site: http://www.mscapers.com Mediascapes: http://www.mscapers.com/browse Demos: http://www.youtube.com/watch?v=BUOHfVXkUaI http://www.mscapers.com/what-is-a-mediascape Mscape demo (after 5:48 min): http://h30418.www3.hp.com/?rf=sitemap&fr_story=9bab5d9298338617c81e7b85fc0491de0826a439&jum pid=reg_R1002_USEN 5.4 Nokia - AR with image comparisson Nokia had a similar research project with augmented reality: http://www.youtube.com/watch?v=0HOO80RitVI&feature=related 24
  • 25. When the user takes a mobile picture in the Nokia AR project, it is compared against the pictures in a database, so that its point of interest will be recognized, so that the POI name and details (like active telephone link) can be displayed on the mobile screen. 5.5 Layar – AR browser app Layar is an AR browser developed by Layar. It is a free Android application on your mobile phone which shows what is around you by displaying real time digital information on top of reality through the camera of your mobile phone. By holding the phone in front of you like a camera, information is displayed on top of the camera display view. For all points of interest which are displayed on the screen, information is shown at the bottom of the screen. On top of the camera image (displaying reality) Layar adds content layers. Layers are the equivalent of webpages in normal browsers. Just like there are thousands of websites there will be thousands of layers. One can easily switch between layers by selecting another via the menu button, pressing the logobar or by swiping your finger across the screen. Layar Reality Browser 2.0 features: * Unique layer specific icons/markers * Featured and Popular section * Search function * Add layer to favorites * Map view and list view * Enhanced AR view * Accuracy information * “Take me There” function * “Share layer” and “screen shot” function in layar 2.1 update Site:http://layar.com/ List of 163 layers:http://layar.com/layers/#health Layer video:http://www.youtube.com/watch?v=b64_16K2e08&NR=1 Article:http://www.svennerberg.com/2009/06/mobile-first-person-user-interfaces/ Layer Images: Qype: http://de.hoppala.eu/artikel/wp-content/uploads/2009/08/layar_meets_qype.png BrightKite: http://blog.brightkite.com/wp-content/uploads/2009/08/layar-screenshot.jpg Architecture:http://layar.com/wp-content/uploads/2009/07/layar-service-archtecture-blog-and- pressrelease.png Large Layar images in Amsterdam: http://layar.com/wp-content/uploads/2009/07/layar_dreamcatcher_keynote09_template003.png http://media.svennerberg.com/2009/06/layar-app.jpg 25
  • 26. 5.6 Nokia - AR concept Nokia’s AR concept involves a new user experience with e.g.wireless: - Earphones - See-through AR goggles - Eye tracking, to select elements on the goggle display - Bracelet with accelerometer, to confirm selected elements on the goggle display, and trigger actions Video: http://www.youtube.com/watch?v=CGwvZWyLiBU 5.7 Acrossair - Nearest Tube One of the first augmented reality apps to go live in the iPhone AppStore. When you load the app, holding it flat, all 13 lines of the London underground are displayed in coloured arrows. By tilting the phone upwards, you will see the nearest stations: what direction they are in relation to your location, how many kilometres and miles away they are and what tube lines they are on. If you continue to tilt the phone upwards, you will see stations further away, as stacked icons. Site: http://www.acrossair.com/apps_nearesttube.htm Video: http://www.youtube.com/watch?v=5fZk0HaIs4s&feature=player_embedded 5.8 Worksnug WorkSnug uses Augmented Reality to connect mobile workers to the nearest and best places to get some work done in the city. Users simply hold up and point their iPhone, and the potential connection spots float alongside the real-life, real-time image of the users’ environment. To help users find the best workspace for their needs, the WorkSnug team has discovered and reviewed hundreds of places to work – from family-run cafés to formal co-working spaces – and offers personal observations, including a guide to power provision, atmosphere, noise levels, and even the quality of the coffee. In addition, WorkSnug users can suggest new places, review their favourite workspaces and will soon be able to connect with other local users and create ad-hoc co-working communities. Best of all, the application and all of these services are completely free of charge. Presentation: http://www.mashupevent.com/event/augmented-reality Website: www.worksnug.com Video: http://www.worksnug.com/ Library: http://connectedpr.eu/worksnug/worksnug-media-library/ Contact: Richard Leyland 5.9 Ikea - AR apps Try out Ikea furniture within your own space by vmapping it nto what you see through yout phone camera in your space. Blog Article: http://mobverge.blogspot.com/2009/10/ikea-augmented-reality-concept-coming.html 26
  • 27. Video of concept - manual in 3D: http://www.youtube.com/watch?v=V4b4ArHZupM Video of concept - Catalogue & My.ikea site: http://www.youtube.com/watch?v=OjavjTvzIMw 5.10 Google - Sky Map Sky Map is Google's stargazer Android application which allows a user to identify constellations by simply pointing their phone at the night sky. Site (with download option): http://www.google.com/sky/skymap.html 5.11 TAT - ID mapping Map your social network contact details around your face so that people can click and use them when they look at you through their mobile camera. UI product & design company TAT Blog with innovative UX experiments: http://mobileuserinterfaces.blogspot.com/ Site: http://tat.se/ Video about AR ID mapping: http://mobileuserinterfaces.blogspot.com/ 5.12 ConnectED - Second Sight The camera is aimed at a symbol, to identify the subject. The student can then download the given information in video/audio/image/text and upload its own information in video/audio/image/text. All content is stored on a server and can be shared and discussed in a group later on. Second Sight enables teachers to blend the use of their established text books, display materials and audio visual content in a way that has not been easy to deploy in the classroom before. Second Sight comprises a PC based content creation suite and a Second Sight viewer application for the SONY PSP. “Interactive multimedia content is very important. Students are used to playing and reviewing rich media files in audio, video and in gaming, anytime and anywhere. They expect a richer experience. PSP™ helps fulfil that need. It is easy to use, extremely robust and portable, and most importantly PSP™ is very engaging and interesting to the students”. Andy Goff, Education Director, ConnectED. Site: http://www.connectededucation.com/index.php?option=com_content&view=article&id=153 Image: http://www.flickr.com/photos/dlivingstone/3947127965/ 5.13 Metaio - Cereal box AR interaction Interact and play with packaging... Developped by AR agency Metaio. Pioneer in the area of augmented reality technology, metaio develops software products for systems driven by visual interaction in both real and virtual worlds. 27
  • 28. As a pioneer in the area of Augmented Reality technology, metaio develops software products for visual interactive solutions between the real and virtual world. Based on the software platform Unifeye SDK, 3D- animations can be integrated seamlessly into live-video streams respectively into pictures of the real- user’s environment. Founded in February 2003, metaio currently employs 50 people at three different locations. The head office of the company is based in Munich. The subsidiaries metaio Inc. located in San Francisco, CA and metaio Asia respectively in Seoul. At the moment metaio has over 140 renowned customers out of different branches and areas. Among them are: BMW, Daimler, Siemens, Toyota, Peugeot, EADS, Bertelsmann, KUKA, LEGO, MINI, Universal Home Entertainment and Volkswagen. Site: http://www.metaio.com/ Video: http://www.youtube.com/watch?v=b1naY762FHc Presentation: http://www.mashupevent.com/event/augmented-reality Contact: Jan Schlink 5.14 GE - Interactive 3D magazine cover Point your webcam to the magazine cover to see an interactive 3D object mapped onto it in the webcam capture on your screen. Site: http://ge.ecomagination.com/smartgrid/popsci/ Cover: http://ge.ecomagination.com/smartgrid/popsci/res/cover.pdf Video: http://www.youtube.com/watch?v=broaO24jkJg 5.15 Total Immersion - Commercial AR apps Myles Peyton is UK Sales Director for Total Immersion. Total Immersion is the global leader in augmented reality. Through its patented D’Fusion® technology, Total Immersion blurs the line between the virtual world and the real world by integrating real time interactive 3D graphics into a live video stream. Leading the augmented reality category since 1999, the company maintains offices in Europe (France and UK), Asia and in the U.S., and supports a network of more than 50 partners worldwide. Find the latest news concerning Total Immersion projects at: http://augmented-reality-news.com. Site: www.t-immersion.com Videos: http://www.t-immersion.com/en,video-gallery,36.html Presentation: http://www.mashupevent.com/event/augmented-reality Contact: Myles Peyton 28
  • 29. 5.16 ARTHUR - Architecture tool The ARTHUR (Augmented Round Table for Architecture and Urban Planning) project has developed an augmented reality interface for round table design meetings. Using see through augmented reality glasses developed by Ericsson Saab Avionics the ARTHUR round table generates virtual models of the design scheme being discussed. Twin cameras fitted to the glasses and computer vision techniques provide head tracking for the users, as well as tracking real world placeholder objects on the table that allow the users to interact with the virtual model. The virtual model is manipulated by moving the placeholders. This manipulation may entail movement of components or building blocks tied to the placeholders, or the placeholders may be linked to control points in a more complex parametric building object. In this way moving placeholders can alter the complex curves of a three dimensional surface or adjust the series of parametric construction components that would make that surface constructible. The see through glasses and the real world placeholders mean that all members of the round table have equal access to the design user interface. ARTHUR will also develop a series of simulations and visualisations of aspects of building performance, so that the consequences of design changes can be evaluated while the design is being manipulated. In this way, the effects of moving building blocks relative to each other on patterns of pedestrian movement could be visualised through a real time simulation of pedestrians flows on the ARTHUR tabletop. Dates: 2001-2004 Value: £405,000 (total value £2.23m) Principal Investigator: Professor AR Penn Other Investigators: Recognised Researchers: Chiron Mottram, Ava Fatah gen. Schieck, Stefan Kueppers Project Partners: Fraunhofer-FIT, Foster and Partners, Ericsson Saab Avionics, Linie 4, Aalborg University Department: Bartlett Organisation: University College London Site: http://www.vr.ucl.ac.uk/projects/arthur/ 5.17 whiteapp - Customiseable AR iPhone apps Whiteapp is a directory of mobile applications that serve as building blocks for yours. Starting from an existing application saves a lot of creative and production cost. It has an AR iPhone app, which is an augmented reality engine that can function as a stand-alone app or as part of a larger proposition. Display any location-based information over a live video feed from the user's iPhone camera. Data can be from a local source stored in the app or from the cloud. Site: http://www.whiteapp.com/directory/apps/augmented_reality.php 29
  • 30. 5.18 Acrossair - Bespoke AR iPhone apps Acrossair is an iPhone development company specialising in Augmented Reality. Ravi Damani is the co- founder of Acrossair and is a constant innovator and entrepreneur with involvement in digital publishing to ecommerce. Site: http://www.acrossair.com/ Presentation: http://www.mashupevent.com/event/augmented-reality Contact: Ravi Damani 5.19 Mehmet (aka Memo) Akten - Gold Dust – Installation & iPhone Versions Tent London - installation version: Shiny gold particles on a large screen move according to motion tracking. Without motion, the gold dust falls still on all the outlines it can trace of the people standing in front of the screen, defining their faces, hands, bodies, etc. in shiny gold outlines. “Gold” is an interactive installation which explores our obsession with super-stardom, and the extravagance that accompanies it. Through a ‘magic mirror’, revel in a world of excess where you are the super-star. Shower in glittery gold, experience almost omnipotent powers as you materialize, morph and dematerialize into pure sparkling gold dust. Immortalize yourself as a shimmering golden statue, before you collapse and fade away. iPhone app: Shiny gold particles move according to your finger swipes, and according to the device angle (they fall downwards). It was written with a custom version of openFrameworks (pre-006) and an early version of the ofxiPhone addon. Tent London version - Info + Videos: http://www.vimeo.com/2281077 and http://www.msavisuals.com/gold PDF: http://www.msavisuals.com/sites/default/files/Gold%20by%20Mehmet%20Akten%20print.pdf Made with openFrameworks: http://www.openframeworks.cc/ iPhone version - Info + Video: http://memo.tv/iphone/gold_dust Developed for iPhone using openFrameworks and ofxiPhone: http://www.memo.tv/ofxiphone 5.20 Mehmet (aka Memo) Akten - Reincarnation - Installation Version A large screen shows abstract visual layers (flames), containing subtle hints of human forms and motion, following the movement of dancers on stage. Site + Video: http://memo.tv/reincarnation Made with openFrameworks: http://www.openframeworks.cc/ 30
  • 31. 5.21 Treehugger - AR ideas for sustainably living From the Treehugger site: << Imagine walking down the street and seeing emissions data for the companies/businesses simply by pointing your phone at them. Or pointing at machinery and seeing schematics, lifecycle emissions data, or… the options are limitless! - What if you could aim the mobile at a row of restaurants and see their food sustainability practices before making a decision on where to eat? - How about scanning a shelf of products and seeing the carbon footprint data of each option so you can make a low impact purchasing decision despite the tricky labels and packaging the manufacturers use? - How might you want to see this kind of software used to make living sustainably an easier part of our daily lives? >> Site: http://www.treehugger.com/files/2009/07/using-augmented-reality-to-change-the-way-we-see-our- green-world.php 5.22 Rachel Clarke - History AR idea From Rachel Clarke's Blog : << I want a history tool. I want to be able to walk around London and know that Marble Arch used to be Tyburn. That this is the path of the Fleet. That Trafalgar Square used to be the Royal Mews. Point my phone at something and it would offer me the chance to move back and forward in time, giving me information about what it was. In some places, where the images are there, I want to see what it looked like. A perfect example is the paintings on the walls of one of the Tube tunnels at Charing Cross, which gives you street plans and drawings of buildings of the area. Let’s put that on the phone. This isn’t a simple mash-up, it’s not pulling ready-made data together, because as far as I know, it’s not there. We’ll have to build the database, turn into historians to pull it together. I think that Layer is a possibility, with the ability to create data sets. This is what I want, but I have no idea how to build it..anyone out there doing it already? Update: I went along to Mobile Monday London yesterday and ended up chatting about this app. A few more ideas got developed: * The database element and app itself appears to be fairly simple. It needs to use the location and retrieve the data for that location, and then be able to move through the different time layers. * Collecting content is more difficult. There could be ways of partnering with museums, ie Museum of London, or other local museums. A great source would be local history groups, that often have specialised archives. It should be possible to allow users to develop the content, around a specific location. >> Rachel Clarke's Blog entree - Augmented Reality – the History application, 10. October 2009: http://blog.bibrik.com/ 31
  • 32. 6 Mobile phone as Remote Control 6.1 Unique Automation - Bath-o-matic Bathomatic from Unique Automation, can lower your bathtub's motorized plug, and fill the tub to the exact temperature, depth, aromas and bubbles that you have chosen through your wall, PC, laptop or (free) iPhone app interface. It can save 9 favourite combinations (of temperature, depth and aromas) and store a preset for each member of the family. It is suitable for new and retro installations, including whirlpools, without drilling or other invasive alterations. The only visible parts are a drain and overflow/filler available in variety of 9 finishes from chrome to gold. Article: http://www.pocket-lint.com/news/25003/iphone-bathomatic-bathovision-remote-control Website: http://www.bath-o-matic.com/ Images: http://www.bath-o-matic.com/html/EN/press/images_01.html Flash Demo: http://www.bath-o-matic.com/flash/BOM_Demo_Popup.swf App store: http://www.appstorehq.com/bathomatic-iphone-36373/app 32
  • 33. 7 Data Transfer and Connection 7.1 Content transfer - from web/location to mobile (easy & free) FuturLink (http://www.futurlink.com/) establishes communication from specific locations (Wilico Access Points) or websites (with content published in the Wimob Suite) to the mobile (through Bluetooth, Infrared, USB or Wi-Fi, depending on the case), enabling the mobile to receive content for free, or to send information to Wilico APs (with or without special client applications, depending on the case). Wimob -> web to mobile: http://www.wimob.com/overview.html The glossy and customizable Wimob web button invites the user to click and explore it. A friendly interface then opens, allowing him to receive the web content on his mobile phone easily and for free. This is a great way to promote content and brand, to familiarize users with (the download of) mobile content and mobile applications (from the web), and to establish a multi platform reach. Wilico -> location to mobile: http://www.futurlink.com/en/location_to_mobile.php To promote the new BBC America series “Robin Hood”, a 15 second video was sent via Bluetooth from 2 outdoor billboards in LA and NYC to customers and bystanders mobile phones during 4 weeks. The ones that had their Bluetooth device switched on could receive the video spot in a matter of seconds, after accepting an invitation on their mobile phones via Bluetooth. Results: Huge success for BBC America, with over 6,100 downloads and a 39.7% acceptance rate with a positive engagement rate of 87.3%. 7.2 Telemetry Telemetry (according to Wikipedia) typically refers to wireless communications (i.e. using a radio system to implement the data link), but can also refer to data transferred over other media, such as a telephone or computer network or via an optical link or when making a robot it can be over a wire. 7.3 Bluetooth Ian Volans wrote an interesting article: Bluetooth - accentuating the generation gap (http://vodafone.com/flash/receiver/05/articles/index08.html ) 7.4 WiFi & 3G Wifi establisheds fast internet connection. Will 3G replace Wifi, because it doesn’t requiere a hotspot? 7.5 Infrared Wii and Xbox are using infrared for their video game consoles. 7.6 Camera Microsoft and Sony use their smart video game console camera to capture data for Project Natal and Eye Pet. 33
  • 34. 7.7 Radio-frequency identification (RFID) Radio-frequency identification (according to Wikipedia) is the use of an object (typically referred to as an RFID tag) applied to or incorporated into a product, animal, or person for the purpose of identification and tracking using radio waves. Some tags can be read from several meters away and beyond the line of sight of the reader. Most RFID tags contain at least two parts. One is an integrated circuit for storing and processing information, modulating and demodulating a radio-frequency (RF) signal, and other specialized functions. The second is an antenna for receiving and transmitting the signal. There are generally two types of RFID tags: active RFID tags, which contain a battery and thus can transmit its signal autonomously, and passive RFID tags, which have no battery and require an external source to initiate signal transmission. Current uses: Race Timing, Passports, Transportation payments, RFID and asset management, Product tracking, Transportation and logistics, Lap scoring, Animal identification,Inventory systems, Human implants, Libraries, Schools and universities, Museums, Social retailing,Miscellaneous Potential uses: Replacing barcodes, Telemetry, Identification of patients and hospital staff, etc. The two main privacy concerns regarding RFID are: 1. Since the owner of an item will not necessarily be aware of the presence of an RFID tag and the tag can be read at a distance without the knowledge of the individual, it becomes possible to gather sensitive data about an individual without consent. 2. If a tagged item is paid for by credit card or in conjunction with use of a loyalty card, then it would be possible to indirectly deduce the identity of the purchaser by reading the globally unique ID of that item (contained in the RFID tag). Most concerns revolve around the fact that RFID tags affixed to products remain functional even after the products have been purchased and taken home and thus can be used for surveillance and other purposes unrelated to their supply chain inventory functions. The concerns raised by the above may be addressed in part by use of the Clipped Tag. The Clipped Tag is an RFID tag designed to increase consumer privacy. The Clipped Tag has been suggested by IBM researchers Paul Moskowitz and Guenter Karjoth. After the point of sale, a consumer may tear off a portion of the tag. This allows the transformation of a long-range tag into a proximity tag that still may be read, but only at short range – less than a few inches or centimeters. The modification of the tag may be confirmed visually. The tag may still be used later for returns, recalls, or recycling. 34
  • 35. 8 Examples of Gadgets 8.1 eReader The Home E-Reader for Windows Vista (Prototype stage) : http://www.ricavision.com The Home E-Reader is a small handheld portable Windows SideShow device that connects wirelessly to a Windows Vista PC. It combines the convenience of electronic documents with wireless access to Windows Vista. It has a reflective eInk type display that is optimized for reading documents so that reading with the Home E-Reader is as comfortable as it is on paper. It can cache a large number of pages on the device so that it can also be used offline. It also includes stylus capability. As small and lightweight as a single book, the Home E-Reader allows users to download and take along newspapers, books, and documents, or upload them to share with family, friends, or co-workers. In addition, the stylus capability enables the user to make notes that can be easily transferred to a PC. As electronics become more integrated into our contemporary lifestyle, a device like the Home E-Reader may become essential to access the computers with the ease of ordinary pen and paper. For personal or professional use, the Home E-Reader can add significant value to Windows Vista experience. The Home E-Reader uses the SideShow as the primary GUI and Windows Vista as the means by which pages are actually rendered for display on the device. Kindle and Sony have widely distributed eBooks.. 8.2 eChatter The MK140 eChatter for Windows Vista (Prototype stage) : http://www.ricavision.com The MK140 eChatter is a small handheld portable Windows SideShow device that connects wirelessly to a Windows Vista PC. With the MK140 eChatter, a user can compose emails and instant messages on the 5.0" WQVGA LCD display with a QWERTY-layout thumb keyboard. The device can also be used as an audio headset for voice communication. The MK140 eChatter comes with an internal battery with a 16-hour minimum lifetime in normal use as well as an external AC adapter/charger through a mini-USB. Small and lightweight, sleek and handsome, the MK140 eChatter is designed to provide Windows Vista users with enhanced wireless email/chatting experience and significant value. 35
  • 36. 8.3 Scribbler Fridge Magnet Windows Vista SideShow Fridge Magnet (Wednesday, 16 May 2007) http://www.automatedhome.co.uk/New-Products/Windows-Vista-SideShow-Fridge-Magnet.html The Home Scribbler Fridge Magnet from Ricavision is a small handheld portable device wirelessly connected to a PC running Windows Vista that functions as a normal enhanced device for Windows SideShow. The scribbler enables the user to create handwritten notes on the device’s 3.5” QVGA LCD display using a stylus, and these notes may then be retained on the device or sent to the Windows Vista- based PC for further processing. The MK 140 FM Fridge Magnet/Scribbler Device for Windows Vista (Prototype stage): http://www.ricavision.com The MK140 FM Magnet/Scribbler is a portable device that functions like an electronic note pad with Windows SideShow capability. It combines the convenience of sticky notes with wireless access to Windows Vista. It can be easily attached to a refrigerator or wherever it is needed for maximum convenience. The MK140 FM Fridge Magnet/Scribbler is a portable enhanced Windows SideShow device wirelessly connected to a Windows Vista PC. It enables a user to create handwritten notes on the 3.5" QVGA LCD display using a stylus, which may be retained on the device or sent to a Windows Vista PC for further processing. The MK140 FM Fridge Magnet/Scribbler is powered by an internal battery with a 16-hour minimum lifetime in normal use and an external AC adapter and charger. With close coordination with Microsoft, the MK140 FM Fridge Magnet/Scribbler can provide users with a convenient wireless communication capability to Windows Vista and significant value. 8.4 BambooTablet The BambooTablet (http://www.wacom.com/BambooTablet/bamboo.php) works with any software. Many software applications have special features and tools that are designed to be used with a pen. Touch the pen tip to the tablet to handwrite notes and emails (to enter text by hand anywhere typed text is accepted), to mark up digital documents, sign your name, navigate your desktop with a flick of the pen, and make quick sketches in a simple, easy, and more natural way than with a mouse or keyboard. Alternating among input devices such as a mouse, a keyboard, and a pen is an effective way to reduce strain on delicate muscles, tendons, and nerves. The pressure sensitivity of such a pen would be nice to have on mobile screens. 36
  • 37. 8.5 Nabaztag Nabaztag (Armenian for "rabbit") is a Wi-Fi enabled ambient electronic device in the shape of a rabbit. It is an internet connected RSS reader in cute bunny shape, with customizable feeds (email, weather, news, etc.), voices, timings, etc. Website: http://www.nabaztag.com/en/index.html Wiki: http://en.wikipedia.org/wiki/Nabaztag 8.6 Linux Pinguin Wireless internet connected RSS reader in cute pinguin shape, with customizeable feeds (email, wheateer, news, etc.), voices, timings, etc. 8.7 Aibo Smart and cute robot dog that reacts to voice and gestures, and learns specific behaviours from its owner. Website: http://support.sony-europe.com/aibo/ Wiki: http://en.wikipedia.org/wiki/AIBO 8.8 Prada Watch Watch that can be connected to the mobile phone by Bluetooth, to pass on information about incoming emails, calls, etc. Info + Video: http://www.phonesreview.co.uk/2009/02/21/video-lg-prada-2-and-lg-prada-watch-at-mwc-2009/ Info + Images: http://www.cellphones.ca/news/post004974/ http://www.newlaunches.com/archives/lg_kf900_prada_ii_phone_is_boxed_with_bluetooth_prada_watch. php 37
  • 38. 9 Mobile Flash (Lite) widgets 9.1 Widget advantage (compared to native apps) Widgets are mostly light weight wrapper applications for up-to-date internet content, which are easy to: - build (with standard web development tools and languages) - install (to be retrieved among the other mobile applications) - use (since they are mostly single-purpose) - monetise (ads, banners, sponsors, click-through to paid content or websites, etc.) - track (where, when, how long and how it’s used) - update (new versions can be detected and installed automatically, with user’s consent). 9.2 Flash(Lite) advantage (multi-platform & high performance in rich media) Widgets can contain Flash(Lite) applications, which can embed, load, manipulate and/or animate interactive and optimized video, audio, bitmaps and vector graphics very well on mobile devices. A SWF file can be used in many ways, e.g.: - embedded in an S60 widget, with Miniview enabled on the N97 - embedded in a SIS package, to become a native Symbian file - embedded in an AIR package, to become a desktop application that resembles a customized widget or (Vista) gadget - embedded in a web page, on the Internet, Extranet, Intranet - embedded in web pages for digital TV (depends on set top box) - as standalone or embedded applications and presentations on PC, CD-Rom and DVD (http://www.flash- on-tv.com/flash-to-dvd.html, http://www.armchair-travel.com/first/index.htm) This allows giving the users a similar (familiar) and good experience on different platforms. The application(s) should be optimized for each platform use. 9.3 Device services in FlashLite widgets The Flash Lite Developer's Library 1.3 on forum.nokia now supports Service APIs which allow Flash Lite 3.0 applications to use powerful platform services on S60 5th Edition devices: - Access and launch applications on a device using the AppManager Service API - Access and manage calendar information using the Calendar Service API - Access and manage information about contacts using the Contacts Service API - Access and manage information about landmarks using the Landmarks Service API - Access device logging events using the Logging Service API - Access device location information and perform location-based calculations using the Location Service API - Access information about media files stored on a device using the Media Management Service API - Send, retrieve, and manage messages such as SMS and MMS using the Messaging Service API - Access data from the physical sensors of a device using the Sensor Service API - Access and modify system information on a device using the SystemInfo Service API 38
  • 39. Forum.nokia: http://library.forum.nokia.com/index.jsp?topic=/Flash_Lite_Developers_Library/GUID- 46EABDC1-37CB-412A-ACAD-1A1A9466BB68.html 9.4 Widget launch buttons on N97 homescreen The N97 allows the user to add Miniview buttons for widgets on the device’s home screen, which offer widget previews (from the internet or static) and shortcuts (1 click to launch it), making widget use more appealing. Flash Lite applications can also be wrapped in SIS files (native Symbian applications), but considerable time and money is then needed for SIS licensing for new each application version. 39

×