Visual Interactivity


Published on

Wide ranging talk on visually interactive things for mobile given at Over The Air 2009. The related video clips are linked from:

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Visual Interactivity

  1. 1. Mobile<br />… or mobile interactive services for normal people<br />Geoff Ballinger<br /><br /><br />
  2. 2. Overview<br />what is the problem?<br />some real world motivation<br />some fun examples<br />where does AR fit in?<br />visual search ...<br />how do developers engage?<br />
  3. 3. Survey …<br />how many people here:<br />use a mobile phone for voice calls?<br />have sent a message from their phone?<br />have a camera on their phone?<br />have used the camera on their phone?<br />have visited a website from their phone?<br />have downloaded an app or a game?<br />what do you think the answers would be for the typical “normob” on the street?<br />x<br />x<br />x<br />x<br />x<br />x<br />x<br />
  4. 4. Brand Marketing<br />mobile becoming a serious option<br />often combined with traditional media<br />needs to be inclusive<br />mustn’t be off-putting<br />actually all of this can be said in general about good mobile services …<br />x<br />
  5. 5. The Camera<br />… has now arrived:<br />
  6. 6. Some dull stats<br />in 2008, 166.6m handsets (Western Europe) are registered as MMS-enabled. That is a 95% penetration!<br />over 90% of all handsets currently being sold have a cameraphone.<br />in the 11-19 demographic 53% regularly use picture messaging, with 85% having used it at least once.*<br />in the 16-34 demographic 78% have used picture messaging with 48% using it regularly.<br />* Source TGI Youth Q2 2008<br />x<br />x<br />x<br />x<br />
  7. 7. 2D bar codes<br />Patent No. 6,999,573 31st Jan 2006<br />x<br />x<br />
  8. 8. Recognition<br />the simplest form of interactivity<br />replaces SMS and keywords etc.<br />but have to ask why bother …<br />… large number of media which can’t necessarily be adapted?<br />x<br />x<br />x<br />x<br />x<br />
  9. 9. Who’s who<br />PixTo<br />
  10. 10. Image Zoning<br />activation of Vodafone’s Champions League sponsorship<br />take penalties by taking a picture of where you want to aim the ball<br />send in by MMS to see whether you score or not<br />true user interaction<br />
  11. 11. Aim with your camera phone<br />See the outcome in your web browser<br />x<br />
  12. 12. Colour<br />Nike PhotoiD by AKQA is a great example<br />
  13. 13. Videos<br />Shoot and Score<br />Darts<br />Nike PhotoID<br />
  14. 14. Blue-screen<br />run as part of the Vodafone Live! Music Awards<br />think blackpool beach – users stick their heads through the display<br />picture sent in by MMS, heads cut out, and incorporated into a music video<br />
  15. 15. Snap your mates on a camera phone<br />See them in a personalised video<br />x<br />
  16. 16. Facefinder<br />think bluescreen without the screen<br />automatic detection and extraction of the faces in any image<br />much more suitable for viral apps<br />currently all face-likefeatures:<br />in future will distinguishbetween these and real faces<br />x<br />
  17. 17. Videos<br />You Rockstar!<br />Facefinder<br />
  18. 18. AR<br />What actually is Augmented Reality?<br />Extra digital information overlaid on the real world.<br />AR Toolkit – 3D shapes triggered by 2D codes in the environment.<br />Recently GPS and compass based apps such as , Wikitude, and Bionic Eye.<br />
  19. 19. AR Mobile Gaming<br />Also “magic monstervision” game mentioned by Paul Coulton earlier!<br />
  20. 20. Layar<br />
  21. 21. Visual AR<br />Specific and accurate placement of digital info into the video stream.<br />
  22. 22. Videos<br />Arf video<br />snap2Win Live<br />
  23. 23. Visual Search<br />General Visual Search?<br />Recognise “all” images?<br />Make the world clickable?<br />Science Fiction?<br />Product Search is happening now!<br />
  24. 24. Product Search<br />Snaptell Explorer for Amazon<br />Barnes and Noble store app<br />Mobile Acuity Visual Shopper<br />
  25. 25. Visual Shopper<br />
  26. 26. Web Services<br />How does the developer get involved with this?<br />Some related code out there – Haar classifiers and AR Toolkit etc<br />Web service API prototypes from Kooaba and Mobile Acuity.<br />Build into your apps.<br />
  27. 27. Summary<br />