ICIW 2010 - The Fifth International Conference on Internet and Web Applications and Services<br />May 9 - 15, 2010 - Barce...
SUMMARY<br />Why multimodality?<br />Multimodal distributed services deployment<br />User tests and conclusions<br />
In our cities, urban services practically have not changed in a century<br />
MOTIVATIONS<br />1: Location-based services<br />
http://www.flickr.com/photos/nnova/4512346900/<br />
http://picasaweb.google.com/marc.pous/Xina2007#5102695479944027890<br />
http://picasaweb.google.com/marcpous.nyc2009/NYC2009#5415374502175450370<br />
http://picasaweb.google.com/marcpous.nyc2009/NYC2009#5415371534810675298<br />
http://www.flickr.com/photos/loquat73/3385335980/<br />
MOTIVATIONS<br />2: Interactions and multimodality<br />
http://www.flickr.com/photos/nnova/4423756547/in/set-72157623598200316/<br />
http://www.flickr.com/photos/nnova/4424521014/in/set-72157623598200316/<br />
MOTIVATIONS<br />3: Accessibility<br />
http://www.dynamiclanguageblog.com/2009/12/technology-grows-for-hard-of-hearing.html<br />
MOTIVATIONS<br />Whatisan ICD?<br />(InteractiveCommunityDisplay)<br />
INREDIS<br />3G = ACCESSIBILITY + UBIQUITY + INTEROPERABILITY<br />http://www.inredis.es<br />
INREDIS ICD<br />
Management of distributed services that offer the capability of processing and synthesizing multiple modalities of interac...
DISTRIBUTED INTERACTION SERVICES<br />Voice services<br />Voice recognition<br />Via microphone, real-time streaming  con...
DISTRIBUTED SERVICES<br />SIGN LANGUAGE SERVICES<br />
DISTRIBUTED SERVICES<br />VOICE SERVICES<br />
How to consume multimodal distributed services offered by an ICD?<br />
W3C MMI Architecture<br />W3C MMI Architecture<br />http://www.w3.org/TR/mmi-arch/<br />
W3C MMI Framework<br />http://www.w3.org/TR/mmi-framework/<br />
Proposed multimodal interactionframework<br />
ICD ARCHITECTURE<br />ICD Architecture<br />
ICD DESIGN and INTERFACES<br />(1) Interactionidentification<br />(2) Main page<br />- Mapor avatar<br />- Commandbuttons<...
USER–CENTERED DESIGN<br />User profiles (Personas)<br />Blind users<br />Deaf users<br />Unable to read<br />People living...
IMPLEMENTATION<br />
USABILITY TESTING<br />PLI (PeopleLedInnovation) methodology<br />Preliminar usabilitytestswith a limitednumber of users<b...
CONCLUSIONS and FUTURE WORK<br />Implementation based on the W3C MMI Architecture idea<br />Platform able to integrate mul...
MOBILE PHONES?<br />http://www.slideshare.net/nokiaconversations/younghee-jung-and-jan-chipchase-presentation-for-nokia-de...
Thankyou!<br />Moltesgràcies!<br />¡Muchas gracias!<br />Marc Pous and Luigi Ceccaroni<br />mpous@bdigital.org and lceccar...
Upcoming SlideShare
Loading in …5
×

Multimodal Interaction in Distributed and Ubiquitous Computing - ICIW 2010

1,612 views

Published on

Multimodal Interaction in Distributed
and Ubiquitous Computing presentation

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,612
On SlideShare
0
From Embeds
0
Number of Embeds
138
Actions
Shares
0
Downloads
26
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Multimodal Interaction in Distributed and Ubiquitous Computing - ICIW 2010

  1. 1. ICIW 2010 - The Fifth International Conference on Internet and Web Applications and Services<br />May 9 - 15, 2010 - Barcelona, Spain <br />Titol de la presentació<br />Multimodal Interaction in Distributed <br />and Ubiquitous Computing<br />Marc Pous and Luigi Ceccaroni<br />bdigital<br />Cognom Nom, CàrrecNom de la jornada, lloc<br />
  2. 2. SUMMARY<br />Why multimodality?<br />Multimodal distributed services deployment<br />User tests and conclusions<br />
  3. 3. In our cities, urban services practically have not changed in a century<br />
  4. 4. MOTIVATIONS<br />1: Location-based services<br />
  5. 5. http://www.flickr.com/photos/nnova/4512346900/<br />
  6. 6. http://picasaweb.google.com/marc.pous/Xina2007#5102695479944027890<br />
  7. 7. http://picasaweb.google.com/marcpous.nyc2009/NYC2009#5415374502175450370<br />
  8. 8. http://picasaweb.google.com/marcpous.nyc2009/NYC2009#5415371534810675298<br />
  9. 9. http://www.flickr.com/photos/loquat73/3385335980/<br />
  10. 10. MOTIVATIONS<br />2: Interactions and multimodality<br />
  11. 11. http://www.flickr.com/photos/nnova/4423756547/in/set-72157623598200316/<br />
  12. 12. http://www.flickr.com/photos/nnova/4424521014/in/set-72157623598200316/<br />
  13. 13. MOTIVATIONS<br />3: Accessibility<br />
  14. 14.
  15. 15.
  16. 16. http://www.dynamiclanguageblog.com/2009/12/technology-grows-for-hard-of-hearing.html<br />
  17. 17. MOTIVATIONS<br />Whatisan ICD?<br />(InteractiveCommunityDisplay)<br />
  18. 18.
  19. 19. INREDIS<br />3G = ACCESSIBILITY + UBIQUITY + INTEROPERABILITY<br />http://www.inredis.es<br />
  20. 20. INREDIS ICD<br />
  21. 21. Management of distributed services that offer the capability of processing and synthesizing multiple modalities of interaction<br />
  22. 22. DISTRIBUTED INTERACTION SERVICES<br />Voice services<br />Voice recognition<br />Via microphone, real-time streaming  converting the voice signal into text<br />Voice synthesis<br />Sign language service<br />Spanish sign language recognition<br />Via webcam, real-time streaming  converting the image into text<br />Emotion service<br />Emotion recognition (voice + image)<br />Via webcam and microphone, real-time streaming<br />Avatar service<br />Emotional avatar<br />Sign-language speaker avatar<br />
  23. 23. DISTRIBUTED SERVICES<br />SIGN LANGUAGE SERVICES<br />
  24. 24. DISTRIBUTED SERVICES<br />VOICE SERVICES<br />
  25. 25. How to consume multimodal distributed services offered by an ICD?<br />
  26. 26. W3C MMI Architecture<br />W3C MMI Architecture<br />http://www.w3.org/TR/mmi-arch/<br />
  27. 27. W3C MMI Framework<br />http://www.w3.org/TR/mmi-framework/<br />
  28. 28. Proposed multimodal interactionframework<br />
  29. 29. ICD ARCHITECTURE<br />ICD Architecture<br />
  30. 30. ICD DESIGN and INTERFACES<br />(1) Interactionidentification<br />(2) Main page<br />- Mapor avatar<br />- Commandbuttons<br />- Content<br /> - Scenariooptions<br />(3) Contextualizedmapwithservices<br />(4) Avatar withmap and Street View service<br />
  31. 31. USER–CENTERED DESIGN<br />User profiles (Personas)<br />Blind users<br />Deaf users<br />Unable to read<br />People living or visiting a city<br />Scenarios<br />Context-aware informative scenario<br />Emergency scenario<br />
  32. 32. IMPLEMENTATION<br />
  33. 33. USABILITY TESTING<br />PLI (PeopleLedInnovation) methodology<br />Preliminar usabilitytestswith a limitednumber of users<br />Butthe ICD implementationreceivedgoodfeedback!<br />
  34. 34. CONCLUSIONS and FUTURE WORK<br />Implementation based on the W3C MMI Architecture idea<br />Platform able to integrate multimodal interactive distributed services and offer interaction in real-time<br />Web-based applications and device-independent implementation<br />Improvement of the user experience and accessibility of people with special needs<br />What are we working on now?<br />Real-time interaction: delay reduction between interactions<br />Browser-based apps not being able to easily access device hardware<br />Synchronous interaction vs. Asynchronous technologies<br />Improvement of the distributed services orchestration<br />Enhancement of the mobile usability<br />
  35. 35. MOBILE PHONES?<br />http://www.slideshare.net/nokiaconversations/younghee-jung-and-jan-chipchase-presentation-for-nokia-design-london-studio-event-london-29th-april-2008<br />
  36. 36. Thankyou!<br />Moltesgràcies!<br />¡Muchas gracias!<br />Marc Pous and Luigi Ceccaroni<br />mpous@bdigital.org and lceccaroni@bdigital.org<br />Titol de la presentació<br />Cognom Nom, CàrrecNom de la jornada, lloc<br />

×