Downloaded 31 times
Uploaded byMarc Pous
Multimodal Interaction in Distributed and Ubiquitous Computing - ICIW 2010
This presentation discusses a research project that developed an Interactive Community Display (ICD) to provide multimodal interaction in distributed and ubiquitous computing environments. The ICD allows users to access distributed services like voice recognition, sign language recognition, and emotion recognition through a web interface. These services can be used to build context-aware and emergency scenarios. An implementation of the ICD architecture was tested with users and received positive feedback, and future work will focus on improving real-time interaction capabilities and mobile usability.
More Related Content
Similar to Multimodal Interaction in Distributed and Ubiquitous Computing - ICIW 2010
![Hci [5]paradigm](https://cdn.slidesharecdn.com/ss_thumbnails/hci-5paradigm-140116110615-phpapp01-thumbnail.jpg?width=640&height=640&fit=bounds)
Multimodal Interaction in Distributed and Ubiquitous Computing - ICIW 2010
- 1. ICIW 2010 -The Fifth International Conference on Internet and Web Applications and ServicesMay 9 - 15, 2010 - Barcelona, Spain Titol de la presentacióMultimodal Interaction in Distributed and Ubiquitous ComputingMarc Pous and Luigi CeccaronibdigitalCognom Nom, CàrrecNom de la jornada, lloc
- 2. SUMMARYWhy multimodality?Multimodal distributedservices deploymentUser tests and conclusions
- 3. In our cities,urban services practically have not changed in a century
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10. MOTIVATIONS2: Interactions andmultimodality
- 11.
- 12.
- 13.
- 16.
- 17.
- 19. INREDIS3G = ACCESSIBILITY+ UBIQUITY + INTEROPERABILITYhttp://www.inredis.es
- 20.
- 21. Management of distributedservices that offer the capability of processing and synthesizing multiple modalities of interaction
- 22. DISTRIBUTED INTERACTION SERVICESVoiceservicesVoice recognitionVia microphone, real-time streaming converting the voice signal into textVoice synthesisSign language serviceSpanish sign language recognitionVia webcam, real-time streaming converting the image into textEmotion serviceEmotion recognition (voice + image)Via webcam and microphone, real-time streamingAvatar serviceEmotional avatarSign-language speaker avatar
- 23.
- 24.
- 25. How to consumemultimodal distributed services offered by an ICD?
- 26. W3C MMI ArchitectureW3CMMI Architecturehttp://www.w3.org/TR/mmi-arch/
- 27.
- 28.
- 29.
- 30. ICD DESIGN andINTERFACES(1) Interactionidentification(2) Main page- Mapor avatar- Commandbuttons- Content - Scenariooptions(3) Contextualizedmapwithservices(4) Avatar withmap and Street View service
- 31. USER–CENTERED DESIGNUser profiles(Personas)Blind usersDeaf usersUnable to readPeople living or visiting a cityScenariosContext-aware informative scenarioEmergency scenario
- 32.
- 33. USABILITY TESTINGPLI (PeopleLedInnovation)methodologyPreliminar usabilitytestswith a limitednumber of usersButthe ICD implementationreceivedgoodfeedback!
- 34. CONCLUSIONS and FUTUREWORKImplementation based on the W3C MMI Architecture ideaPlatform able to integrate multimodal interactive distributed services and offer interaction in real-timeWeb-based applications and device-independent implementationImprovement of the user experience and accessibility of people with special needsWhat are we working on now?Real-time interaction: delay reduction between interactionsBrowser-based apps not being able to easily access device hardwareSynchronous interaction vs. Asynchronous technologiesImprovement of the distributed services orchestrationEnhancement of the mobile usability
- 35.
- 36. Thankyou!Moltesgràcies!¡Muchas gracias!Marc Pousand Luigi Ceccaronimpous@bdigital.org and lceccaroni@bdigital.orgTitol de la presentacióCognom Nom, CàrrecNom de la jornada, lloc