Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Multimodal Interaction in Distributed and Ubiquitous Computing - ICIW 2010

1,698 views

Published on

Multimodal Interaction in Distributed
and Ubiquitous Computing presentation

Published in: Technology
  • Be the first to comment

Multimodal Interaction in Distributed and Ubiquitous Computing - ICIW 2010

  1. 1. ICIW 2010 - The Fifth International Conference on Internet and Web Applications and Services<br />May 9 - 15, 2010 - Barcelona, Spain <br />Titol de la presentació<br />Multimodal Interaction in Distributed <br />and Ubiquitous Computing<br />Marc Pous and Luigi Ceccaroni<br />bdigital<br />Cognom Nom, CàrrecNom de la jornada, lloc<br />
  2. 2. SUMMARY<br />Why multimodality?<br />Multimodal distributed services deployment<br />User tests and conclusions<br />
  3. 3. In our cities, urban services practically have not changed in a century<br />
  4. 4. MOTIVATIONS<br />1: Location-based services<br />
  5. 5. http://www.flickr.com/photos/nnova/4512346900/<br />
  6. 6. http://picasaweb.google.com/marc.pous/Xina2007#5102695479944027890<br />
  7. 7. http://picasaweb.google.com/marcpous.nyc2009/NYC2009#5415374502175450370<br />
  8. 8. http://picasaweb.google.com/marcpous.nyc2009/NYC2009#5415371534810675298<br />
  9. 9. http://www.flickr.com/photos/loquat73/3385335980/<br />
  10. 10. MOTIVATIONS<br />2: Interactions and multimodality<br />
  11. 11. http://www.flickr.com/photos/nnova/4423756547/in/set-72157623598200316/<br />
  12. 12. http://www.flickr.com/photos/nnova/4424521014/in/set-72157623598200316/<br />
  13. 13. MOTIVATIONS<br />3: Accessibility<br />
  14. 14.
  15. 15.
  16. 16. http://www.dynamiclanguageblog.com/2009/12/technology-grows-for-hard-of-hearing.html<br />
  17. 17. MOTIVATIONS<br />Whatisan ICD?<br />(InteractiveCommunityDisplay)<br />
  18. 18.
  19. 19. INREDIS<br />3G = ACCESSIBILITY + UBIQUITY + INTEROPERABILITY<br />http://www.inredis.es<br />
  20. 20. INREDIS ICD<br />
  21. 21. Management of distributed services that offer the capability of processing and synthesizing multiple modalities of interaction<br />
  22. 22. DISTRIBUTED INTERACTION SERVICES<br />Voice services<br />Voice recognition<br />Via microphone, real-time streaming  converting the voice signal into text<br />Voice synthesis<br />Sign language service<br />Spanish sign language recognition<br />Via webcam, real-time streaming  converting the image into text<br />Emotion service<br />Emotion recognition (voice + image)<br />Via webcam and microphone, real-time streaming<br />Avatar service<br />Emotional avatar<br />Sign-language speaker avatar<br />
  23. 23. DISTRIBUTED SERVICES<br />SIGN LANGUAGE SERVICES<br />
  24. 24. DISTRIBUTED SERVICES<br />VOICE SERVICES<br />
  25. 25. How to consume multimodal distributed services offered by an ICD?<br />
  26. 26. W3C MMI Architecture<br />W3C MMI Architecture<br />http://www.w3.org/TR/mmi-arch/<br />
  27. 27. W3C MMI Framework<br />http://www.w3.org/TR/mmi-framework/<br />
  28. 28. Proposed multimodal interactionframework<br />
  29. 29. ICD ARCHITECTURE<br />ICD Architecture<br />
  30. 30. ICD DESIGN and INTERFACES<br />(1) Interactionidentification<br />(2) Main page<br />- Mapor avatar<br />- Commandbuttons<br />- Content<br /> - Scenariooptions<br />(3) Contextualizedmapwithservices<br />(4) Avatar withmap and Street View service<br />
  31. 31. USER–CENTERED DESIGN<br />User profiles (Personas)<br />Blind users<br />Deaf users<br />Unable to read<br />People living or visiting a city<br />Scenarios<br />Context-aware informative scenario<br />Emergency scenario<br />
  32. 32. IMPLEMENTATION<br />
  33. 33. USABILITY TESTING<br />PLI (PeopleLedInnovation) methodology<br />Preliminar usabilitytestswith a limitednumber of users<br />Butthe ICD implementationreceivedgoodfeedback!<br />
  34. 34. CONCLUSIONS and FUTURE WORK<br />Implementation based on the W3C MMI Architecture idea<br />Platform able to integrate multimodal interactive distributed services and offer interaction in real-time<br />Web-based applications and device-independent implementation<br />Improvement of the user experience and accessibility of people with special needs<br />What are we working on now?<br />Real-time interaction: delay reduction between interactions<br />Browser-based apps not being able to easily access device hardware<br />Synchronous interaction vs. Asynchronous technologies<br />Improvement of the distributed services orchestration<br />Enhancement of the mobile usability<br />
  35. 35. MOBILE PHONES?<br />http://www.slideshare.net/nokiaconversations/younghee-jung-and-jan-chipchase-presentation-for-nokia-design-london-studio-event-london-29th-april-2008<br />
  36. 36. Thankyou!<br />Moltesgràcies!<br />¡Muchas gracias!<br />Marc Pous and Luigi Ceccaroni<br />mpous@bdigital.org and lceccaroni@bdigital.org<br />Titol de la presentació<br />Cognom Nom, CàrrecNom de la jornada, lloc<br />

×