Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Visual Interactivity


Published on

Wide ranging talk on visually interactive things for mobile given at Over The Air 2009. The related video clips are linked from:

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Visual Interactivity

  1. 1. Mobile<br />… or mobile interactive services for normal people<br />Geoff Ballinger<br /><br /><br />
  2. 2. Overview<br />what is the problem?<br />some real world motivation<br />some fun examples<br />where does AR fit in?<br />visual search ...<br />how do developers engage?<br />
  3. 3. Survey …<br />how many people here:<br />use a mobile phone for voice calls?<br />have sent a message from their phone?<br />have a camera on their phone?<br />have used the camera on their phone?<br />have visited a website from their phone?<br />have downloaded an app or a game?<br />what do you think the answers would be for the typical “normob” on the street?<br />x<br />x<br />x<br />x<br />x<br />x<br />x<br />
  4. 4. Brand Marketing<br />mobile becoming a serious option<br />often combined with traditional media<br />needs to be inclusive<br />mustn’t be off-putting<br />actually all of this can be said in general about good mobile services …<br />x<br />
  5. 5. The Camera<br />… has now arrived:<br />
  6. 6. Some dull stats<br />in 2008, 166.6m handsets (Western Europe) are registered as MMS-enabled. That is a 95% penetration!<br />over 90% of all handsets currently being sold have a cameraphone.<br />in the 11-19 demographic 53% regularly use picture messaging, with 85% having used it at least once.*<br />in the 16-34 demographic 78% have used picture messaging with 48% using it regularly.<br />* Source TGI Youth Q2 2008<br />x<br />x<br />x<br />x<br />
  7. 7. 2D bar codes<br />Patent No. 6,999,573 31st Jan 2006<br />x<br />x<br />
  8. 8. Recognition<br />the simplest form of interactivity<br />replaces SMS and keywords etc.<br />but have to ask why bother …<br />… large number of media which can’t necessarily be adapted?<br />x<br />x<br />x<br />x<br />x<br />
  9. 9. Who’s who<br />PixTo<br />
  10. 10. Image Zoning<br />activation of Vodafone’s Champions League sponsorship<br />take penalties by taking a picture of where you want to aim the ball<br />send in by MMS to see whether you score or not<br />true user interaction<br />
  11. 11. Aim with your camera phone<br />See the outcome in your web browser<br />x<br />
  12. 12. Colour<br />Nike PhotoiD by AKQA is a great example<br />
  13. 13. Videos<br />Shoot and Score<br />Darts<br />Nike PhotoID<br />
  14. 14. Blue-screen<br />run as part of the Vodafone Live! Music Awards<br />think blackpool beach – users stick their heads through the display<br />picture sent in by MMS, heads cut out, and incorporated into a music video<br />
  15. 15. Snap your mates on a camera phone<br />See them in a personalised video<br />x<br />
  16. 16. Facefinder<br />think bluescreen without the screen<br />automatic detection and extraction of the faces in any image<br />much more suitable for viral apps<br />currently all face-likefeatures:<br />in future will distinguishbetween these and real faces<br />x<br />
  17. 17. Videos<br />You Rockstar!<br />Facefinder<br />
  18. 18. AR<br />What actually is Augmented Reality?<br />Extra digital information overlaid on the real world.<br />AR Toolkit – 3D shapes triggered by 2D codes in the environment.<br />Recently GPS and compass based apps such as , Wikitude, and Bionic Eye.<br />
  19. 19. AR Mobile Gaming<br />Also “magic monstervision” game mentioned by Paul Coulton earlier!<br />
  20. 20. Layar<br />
  21. 21. Visual AR<br />Specific and accurate placement of digital info into the video stream.<br />
  22. 22. Videos<br />Arf video<br />snap2Win Live<br />
  23. 23. Visual Search<br />General Visual Search?<br />Recognise “all” images?<br />Make the world clickable?<br />Science Fiction?<br />Product Search is happening now!<br />
  24. 24. Product Search<br />Snaptell Explorer for Amazon<br />Barnes and Noble store app<br />Mobile Acuity Visual Shopper<br />
  25. 25. Visual Shopper<br />
  26. 26. Web Services<br />How does the developer get involved with this?<br />Some related code out there – Haar classifiers and AR Toolkit etc<br />Web service API prototypes from Kooaba and Mobile Acuity.<br />Build into your apps.<br />
  27. 27. Summary<br />