SlideShare a Scribd company logo
Designing and Executing Multimodal Interfaces for the Web based on State Chart XML Sebastian Feuerstack , Jessica H. Colnago and  César R. De Souza 18. November 2011 Dr.-Ing. Sebastian Feuerstack Universidade Federal de São Carlos Departamento de Computacão
Basic Challenge How to enable Multimodal Interfaces for the Web  ? 18. November 2011
Multi-Touch  Server-sided speech processing  Google Voice Search, SIRI, Nuance Speech API Sound API  Native API CSS3 Speech, Media Query, … Device Orientation 18. November 2011 What`s  the new Hype?
Distribution Migration Adaptation  (Ok, there is Content Selection & Device Discovery – but who uses more than the Browser UA?) Meta-UI => Natural Interaction 18. November 2011 What  is missing?
Developing Methods How do I design and implement complex Interactions ? (Native API…?) Free Tools What supports implementation and Debugging (Javascript Console?) Open Source Implementation Apache.org success Missing Standards  W3C Model-Based User Interfaces (MBUI) Working Group 18. November 2011 What`s  the barrier?
18. November 2011 Multimodal Interaction  Framework
Implemented  Use Cases  18. November 2011
Rapid model-based Design and Comparison of three variants    Published: HCII 2011, MoBe 2011, I-Com Journal The Augmented “Drag-and-Drop 18. November 2011 Use Case I: Test and Evaluation  Gesture-based Interface Navigation
Gesture-based Interface Navigation 18. November 2011
Furniture  Drag and Drop Published: SVR 2011 18. November 2011 Use Case II: Paradigm Design Augmented Drag and Drop Cam Cam Pointing Command Monitor Jessica
Gesture-based Drag and Drop Control  18. November 2011
Evaluation of controling a music sheet by using head movements 18. November 2011 Use Case III: Test and Evaluation  Head-based Interface Control
Two concepts Interactors Mappings 3 steps Widget Design Interacton Design Mapping 18. November 2011 SCXML-based  Interactor Design
1) Interactive Music Sheet Widget 18. November 2011 The Augmented “Drag-and-Drop
2) Interaction Design 18. November 2011
3) Mapping 18. November 2011
Thanks for you interest! On our website : All articles Videos Open Source Software MINT Framework Focus on: Fusion Paradigm Design Formalization Tools MINT Framework Design of Multimodal Interaction 18. November 2011 http://www.multi-access.de Visit our website!
18. November 2011

More Related Content

Viewers also liked

Engineering Device-spanning, Multimodal Web Applications using a Model-based ...
Engineering Device-spanning, Multimodal Web Applications using a Model-based ...Engineering Device-spanning, Multimodal Web Applications using a Model-based ...
Engineering Device-spanning, Multimodal Web Applications using a Model-based ...
Sebastian Feuerstack
 
Sanni Siltanen: Developing augmented reality solutions through user involveme...
Sanni Siltanen: Developing augmented reality solutions through user involveme...Sanni Siltanen: Developing augmented reality solutions through user involveme...
Sanni Siltanen: Developing augmented reality solutions through user involveme...
VTT Technical Research Centre of Finland Ltd
 
Hogyan kössünk app tartalmat termékeinkhez vonalkód segítségével
Hogyan kössünk app tartalmat termékeinkhez vonalkód segítségévelHogyan kössünk app tartalmat termékeinkhez vonalkód segítségével
Hogyan kössünk app tartalmat termékeinkhez vonalkód segítségével
szabolcs budahazy
 
Education: Disaggregated and Disrupted
Education: Disaggregated and DisruptedEducation: Disaggregated and Disrupted
Education: Disaggregated and Disrupted
LearningandTeaching
 
Ong Direct Pac4
Ong Direct Pac4Ong Direct Pac4
Ong Direct Pac4
ONGDirect
 
Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...
Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...
Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...
LearningandTeaching
 
Salud | Manual Del Fabricante - La Justicia de Cristo
Salud | Manual Del Fabricante - La Justicia de CristoSalud | Manual Del Fabricante - La Justicia de Cristo
Salud | Manual Del Fabricante - La Justicia de Cristo
Ministerio Palmoni
 
Why electronic instrument
Why electronic instrument Why electronic instrument
Why electronic instrument
ruikarsachin
 
Global Supply Simulation Presentation - Team 14
Global Supply Simulation Presentation - Team 14Global Supply Simulation Presentation - Team 14
Global Supply Simulation Presentation - Team 14
oenterprises
 
المحاضرة الأولى في العروض التقديمية
المحاضرة الأولى في العروض التقديميةالمحاضرة الأولى في العروض التقديمية
المحاضرة الأولى في العروض التقديمية
uqu
 
Green supply chain management
Green supply chain managementGreen supply chain management
Green supply chain management
Surabhi Kaushal
 
Distribución de frecuencias y representaciones graficas
Distribución de frecuencias y representaciones graficasDistribución de frecuencias y representaciones graficas
Distribución de frecuencias y representaciones graficas
innovalabcun
 
Apple life cycle
Apple life cycleApple life cycle
Apple life cycle
alexa_goff
 
Measurements and Instrumentation - Electrical and electronics instruments
Measurements and Instrumentation - Electrical and electronics instrumentsMeasurements and Instrumentation - Electrical and electronics instruments
Measurements and Instrumentation - Electrical and electronics instruments
JCT COLLEGE OF ENGINEERING AND TECHNOLOGY
 
Arte gótico.arquitectura
Arte gótico.arquitecturaArte gótico.arquitectura
Arte gótico.arquitectura
Alfredo Rivero Rodríguez
 
To Not Eat Your Heart Away Final
To Not Eat Your Heart Away FinalTo Not Eat Your Heart Away Final
To Not Eat Your Heart Away Final
Justin Price
 

Viewers also liked (17)

Engineering Device-spanning, Multimodal Web Applications using a Model-based ...
Engineering Device-spanning, Multimodal Web Applications using a Model-based ...Engineering Device-spanning, Multimodal Web Applications using a Model-based ...
Engineering Device-spanning, Multimodal Web Applications using a Model-based ...
 
Sanni Siltanen: Developing augmented reality solutions through user involveme...
Sanni Siltanen: Developing augmented reality solutions through user involveme...Sanni Siltanen: Developing augmented reality solutions through user involveme...
Sanni Siltanen: Developing augmented reality solutions through user involveme...
 
гаха2
гаха2гаха2
гаха2
 
Hogyan kössünk app tartalmat termékeinkhez vonalkód segítségével
Hogyan kössünk app tartalmat termékeinkhez vonalkód segítségévelHogyan kössünk app tartalmat termékeinkhez vonalkód segítségével
Hogyan kössünk app tartalmat termékeinkhez vonalkód segítségével
 
Education: Disaggregated and Disrupted
Education: Disaggregated and DisruptedEducation: Disaggregated and Disrupted
Education: Disaggregated and Disrupted
 
Ong Direct Pac4
Ong Direct Pac4Ong Direct Pac4
Ong Direct Pac4
 
Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...
Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...
Lemons, Catastrophic Climate Change, and e-Portfolios: Implementing sustainab...
 
Salud | Manual Del Fabricante - La Justicia de Cristo
Salud | Manual Del Fabricante - La Justicia de CristoSalud | Manual Del Fabricante - La Justicia de Cristo
Salud | Manual Del Fabricante - La Justicia de Cristo
 
Why electronic instrument
Why electronic instrument Why electronic instrument
Why electronic instrument
 
Global Supply Simulation Presentation - Team 14
Global Supply Simulation Presentation - Team 14Global Supply Simulation Presentation - Team 14
Global Supply Simulation Presentation - Team 14
 
المحاضرة الأولى في العروض التقديمية
المحاضرة الأولى في العروض التقديميةالمحاضرة الأولى في العروض التقديمية
المحاضرة الأولى في العروض التقديمية
 
Green supply chain management
Green supply chain managementGreen supply chain management
Green supply chain management
 
Distribución de frecuencias y representaciones graficas
Distribución de frecuencias y representaciones graficasDistribución de frecuencias y representaciones graficas
Distribución de frecuencias y representaciones graficas
 
Apple life cycle
Apple life cycleApple life cycle
Apple life cycle
 
Measurements and Instrumentation - Electrical and electronics instruments
Measurements and Instrumentation - Electrical and electronics instrumentsMeasurements and Instrumentation - Electrical and electronics instruments
Measurements and Instrumentation - Electrical and electronics instruments
 
Arte gótico.arquitectura
Arte gótico.arquitecturaArte gótico.arquitectura
Arte gótico.arquitectura
 
To Not Eat Your Heart Away Final
To Not Eat Your Heart Away FinalTo Not Eat Your Heart Away Final
To Not Eat Your Heart Away Final
 

Similar to Designing and Executing Multimodal Interfaces for the Web based on State Chart XML

The Augmented Drag-and-Drop
The Augmented Drag-and-DropThe Augmented Drag-and-Drop
The Augmented Drag-and-Drop
mintframework
 
Model-based Design of Interactions that can bridge Realities – The Augmented...
 Model-based Design of Interactions that can bridge Realities – The Augmented... Model-based Design of Interactions that can bridge Realities – The Augmented...
Model-based Design of Interactions that can bridge Realities – The Augmented...
Sebastian Feuerstack
 
Crick Presentation. Valencia 28_feb_2010
Crick Presentation. Valencia 28_feb_2010Crick Presentation. Valencia 28_feb_2010
Crick Presentation. Valencia 28_feb_2010
Luis Torres-Yepez
 
Web rtc+webaudio
Web rtc+webaudioWeb rtc+webaudio
Web rtc+webaudio
Seung Joon Choi
 
Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"
Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"
Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"
BBC News Labs
 
Vision in Vegas: WritersUA 2005 and the Next Big Thing
Vision in Vegas: WritersUA 2005 and the Next Big ThingVision in Vegas: WritersUA 2005 and the Next Big Thing
Vision in Vegas: WritersUA 2005 and the Next Big Thing
Bill Albing
 
OpenLayers Mobile Code Sprint, 2011
OpenLayers Mobile Code Sprint, 2011OpenLayers Mobile Code Sprint, 2011
OpenLayers Mobile Code Sprint, 2011
Moullet
 
IINSEMTIVES
IINSEMTIVESIINSEMTIVES
IINSEMTIVES
INSEMTIVES
 
Primers on mobile application development
Primers on mobile application developmentPrimers on mobile application development
Primers on mobile application development
Satta Nathan
 
Web2 0-SOA InterAct2008
Web2 0-SOA InterAct2008Web2 0-SOA InterAct2008
Web2 0-SOA InterAct2008
guest1fb6e4
 
Presentation of context: Web Annotations (& Pundit) during the StoM Project (...
Presentation of context: Web Annotations (& Pundit) during the StoM Project (...Presentation of context: Web Annotations (& Pundit) during the StoM Project (...
Presentation of context: Web Annotations (& Pundit) during the StoM Project (...
Net7
 
Open Source Trends to Change
Open Source Trends to ChangeOpen Source Trends to Change
Open Source Trends to Change
Software Park Thailand
 
Introduction to (web) APIs - definitions, examples, concepts and trends
Introduction to (web) APIs - definitions, examples, concepts and trendsIntroduction to (web) APIs - definitions, examples, concepts and trends
Introduction to (web) APIs - definitions, examples, concepts and trends
Olaf Janssen
 
SoundCloud Platform Do:s and Don't:s at How To Web 2011
SoundCloud Platform Do:s and Don't:s at How To Web 2011SoundCloud Platform Do:s and Don't:s at How To Web 2011
SoundCloud Platform Do:s and Don't:s at How To Web 2011
Eric Wahlforss
 
Open Data for Smart(er) Cities
Open Data for Smart(er) CitiesOpen Data for Smart(er) Cities
Open Data for Smart(er) Cities
Irene Celino
 
SWDC 2011: Mobile UI Design - Web or Native?
SWDC 2011: Mobile UI Design - Web or Native?SWDC 2011: Mobile UI Design - Web or Native?
SWDC 2011: Mobile UI Design - Web or Native?
Johannes Fahrenkrug
 
Open-source, how we survive with it?
Open-source, how we survive with it?Open-source, how we survive with it?
Open-source, how we survive with it?
Hermet Park
 
OpenChain Automation Case Study - September to December 2021
OpenChain Automation Case Study - September to December 2021OpenChain Automation Case Study - September to December 2021
OpenChain Automation Case Study - September to December 2021
Shane Coughlan
 
Basics of Android
Basics of Android Basics of Android
Basics of Android
sabi_123
 
Pestablogger2010+mozilla
Pestablogger2010+mozillaPestablogger2010+mozilla
Pestablogger2010+mozilla
Gen Kanai
 

Similar to Designing and Executing Multimodal Interfaces for the Web based on State Chart XML (20)

The Augmented Drag-and-Drop
The Augmented Drag-and-DropThe Augmented Drag-and-Drop
The Augmented Drag-and-Drop
 
Model-based Design of Interactions that can bridge Realities – The Augmented...
 Model-based Design of Interactions that can bridge Realities – The Augmented... Model-based Design of Interactions that can bridge Realities – The Augmented...
Model-based Design of Interactions that can bridge Realities – The Augmented...
 
Crick Presentation. Valencia 28_feb_2010
Crick Presentation. Valencia 28_feb_2010Crick Presentation. Valencia 28_feb_2010
Crick Presentation. Valencia 28_feb_2010
 
Web rtc+webaudio
Web rtc+webaudioWeb rtc+webaudio
Web rtc+webaudio
 
Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"
Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"
Dan Appelquist at BBC News Labs : "firefoxOS - the web, mobile, web apps"
 
Vision in Vegas: WritersUA 2005 and the Next Big Thing
Vision in Vegas: WritersUA 2005 and the Next Big ThingVision in Vegas: WritersUA 2005 and the Next Big Thing
Vision in Vegas: WritersUA 2005 and the Next Big Thing
 
OpenLayers Mobile Code Sprint, 2011
OpenLayers Mobile Code Sprint, 2011OpenLayers Mobile Code Sprint, 2011
OpenLayers Mobile Code Sprint, 2011
 
IINSEMTIVES
IINSEMTIVESIINSEMTIVES
IINSEMTIVES
 
Primers on mobile application development
Primers on mobile application developmentPrimers on mobile application development
Primers on mobile application development
 
Web2 0-SOA InterAct2008
Web2 0-SOA InterAct2008Web2 0-SOA InterAct2008
Web2 0-SOA InterAct2008
 
Presentation of context: Web Annotations (& Pundit) during the StoM Project (...
Presentation of context: Web Annotations (& Pundit) during the StoM Project (...Presentation of context: Web Annotations (& Pundit) during the StoM Project (...
Presentation of context: Web Annotations (& Pundit) during the StoM Project (...
 
Open Source Trends to Change
Open Source Trends to ChangeOpen Source Trends to Change
Open Source Trends to Change
 
Introduction to (web) APIs - definitions, examples, concepts and trends
Introduction to (web) APIs - definitions, examples, concepts and trendsIntroduction to (web) APIs - definitions, examples, concepts and trends
Introduction to (web) APIs - definitions, examples, concepts and trends
 
SoundCloud Platform Do:s and Don't:s at How To Web 2011
SoundCloud Platform Do:s and Don't:s at How To Web 2011SoundCloud Platform Do:s and Don't:s at How To Web 2011
SoundCloud Platform Do:s and Don't:s at How To Web 2011
 
Open Data for Smart(er) Cities
Open Data for Smart(er) CitiesOpen Data for Smart(er) Cities
Open Data for Smart(er) Cities
 
SWDC 2011: Mobile UI Design - Web or Native?
SWDC 2011: Mobile UI Design - Web or Native?SWDC 2011: Mobile UI Design - Web or Native?
SWDC 2011: Mobile UI Design - Web or Native?
 
Open-source, how we survive with it?
Open-source, how we survive with it?Open-source, how we survive with it?
Open-source, how we survive with it?
 
OpenChain Automation Case Study - September to December 2021
OpenChain Automation Case Study - September to December 2021OpenChain Automation Case Study - September to December 2021
OpenChain Automation Case Study - September to December 2021
 
Basics of Android
Basics of Android Basics of Android
Basics of Android
 
Pestablogger2010+mozilla
Pestablogger2010+mozillaPestablogger2010+mozilla
Pestablogger2010+mozilla
 

More from Sebastian Feuerstack

Revealing Differences in Designer‘s and Users‘Perspectives
Revealing Differences in Designer‘s and Users‘PerspectivesRevealing Differences in Designer‘s and Users‘Perspectives
Revealing Differences in Designer‘s and Users‘Perspectives
Sebastian Feuerstack
 
Comparing the Multimodal Interaction Technique Design of MINT with NiMMiT
Comparing the Multimodal Interaction Technique Design of MINT with NiMMiTComparing the Multimodal Interaction Technique Design of MINT with NiMMiT
Comparing the Multimodal Interaction Technique Design of MINT with NiMMiT
Sebastian Feuerstack
 
MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...
MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...
MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...
Sebastian Feuerstack
 
Model-based Design and Generation of a Gesture-based User Interface Navigatio...
Model-based Design and Generation of a Gesture-based User Interface Navigatio...Model-based Design and Generation of a Gesture-based User Interface Navigatio...
Model-based Design and Generation of a Gesture-based User Interface Navigatio...
Sebastian Feuerstack
 
Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...
Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...
Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...
Sebastian Feuerstack
 
Model Based Layouting
Model Based LayoutingModel Based Layouting
Model Based Layouting
Sebastian Feuerstack
 

More from Sebastian Feuerstack (6)

Revealing Differences in Designer‘s and Users‘Perspectives
Revealing Differences in Designer‘s and Users‘PerspectivesRevealing Differences in Designer‘s and Users‘Perspectives
Revealing Differences in Designer‘s and Users‘Perspectives
 
Comparing the Multimodal Interaction Technique Design of MINT with NiMMiT
Comparing the Multimodal Interaction Technique Design of MINT with NiMMiTComparing the Multimodal Interaction Technique Design of MINT with NiMMiT
Comparing the Multimodal Interaction Technique Design of MINT with NiMMiT
 
MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...
MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...
MINT-Composer – A Toolchain for the Model-based Specification of Post-WIMP In...
 
Model-based Design and Generation of a Gesture-based User Interface Navigatio...
Model-based Design and Generation of a Gesture-based User Interface Navigatio...Model-based Design and Generation of a Gesture-based User Interface Navigatio...
Model-based Design and Generation of a Gesture-based User Interface Navigatio...
 
Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...
Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...
Modelling of User Interfaces based on State- Charts to Ease the Test and Eval...
 
Model Based Layouting
Model Based LayoutingModel Based Layouting
Model Based Layouting
 

Recently uploaded

Keynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive SecurityKeynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive Security
Priyanka Aash
 
Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
DianaGray10
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
Google Developer Group - Harare
 
What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024
Stephanie Beckett
 
Retrieval Augmented Generation Evaluation with Ragas
Retrieval Augmented Generation Evaluation with RagasRetrieval Augmented Generation Evaluation with Ragas
Retrieval Augmented Generation Evaluation with Ragas
Zilliz
 
Intel Unveils Core Ultra 200V Lunar chip .pdf
Intel Unveils Core Ultra 200V Lunar chip .pdfIntel Unveils Core Ultra 200V Lunar chip .pdf
Intel Unveils Core Ultra 200V Lunar chip .pdf
Tech Guru
 
Camunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptxCamunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptx
ZachWylie3
 
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdfLeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
SelfMade bd
 
Zaitechno Handheld Raman Spectrometer.pdf
Zaitechno Handheld Raman Spectrometer.pdfZaitechno Handheld Raman Spectrometer.pdf
Zaitechno Handheld Raman Spectrometer.pdf
AmandaCheung15
 
Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17
Bhajan Mehta
 
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python CodebaseEuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
Jimmy Lai
 
Vulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive OverviewVulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive Overview
Steven Carlson
 
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Nicolás Lopéz
 
UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...
UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...
UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...
FIDO Alliance
 
It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...
Zilliz
 
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptxMAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
janagijoythi
 
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
sunilverma7884
 
UX Webinar Series: Aligning Authentication Experiences with Business Goals
UX Webinar Series: Aligning Authentication Experiences with Business GoalsUX Webinar Series: Aligning Authentication Experiences with Business Goals
UX Webinar Series: Aligning Authentication Experiences with Business Goals
FIDO Alliance
 
Integrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecaseIntegrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecase
shyamraj55
 
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
alexjohnson7307
 

Recently uploaded (20)

Keynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive SecurityKeynote : AI & Future Of Offensive Security
Keynote : AI & Future Of Offensive Security
 
Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
 
What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024What's New in Teams Calling, Meetings, Devices June 2024
What's New in Teams Calling, Meetings, Devices June 2024
 
Retrieval Augmented Generation Evaluation with Ragas
Retrieval Augmented Generation Evaluation with RagasRetrieval Augmented Generation Evaluation with Ragas
Retrieval Augmented Generation Evaluation with Ragas
 
Intel Unveils Core Ultra 200V Lunar chip .pdf
Intel Unveils Core Ultra 200V Lunar chip .pdfIntel Unveils Core Ultra 200V Lunar chip .pdf
Intel Unveils Core Ultra 200V Lunar chip .pdf
 
Camunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptxCamunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptx
 
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdfLeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
 
Zaitechno Handheld Raman Spectrometer.pdf
Zaitechno Handheld Raman Spectrometer.pdfZaitechno Handheld Raman Spectrometer.pdf
Zaitechno Handheld Raman Spectrometer.pdf
 
Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17
 
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python CodebaseEuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
 
Vulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive OverviewVulnerability Management: A Comprehensive Overview
Vulnerability Management: A Comprehensive Overview
 
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024
 
UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...
UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...
UX Webinar Series: Drive Revenue and Decrease Costs with Passkeys for Consume...
 
It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...It's your unstructured data: How to get your GenAI app to production (and spe...
It's your unstructured data: How to get your GenAI app to production (and spe...
 
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptxMAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
 
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
 
UX Webinar Series: Aligning Authentication Experiences with Business Goals
UX Webinar Series: Aligning Authentication Experiences with Business GoalsUX Webinar Series: Aligning Authentication Experiences with Business Goals
UX Webinar Series: Aligning Authentication Experiences with Business Goals
 
Integrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecaseIntegrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecase
 
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
leewayhertz.com-AI agents for healthcare Applications benefits and implementa...
 

Designing and Executing Multimodal Interfaces for the Web based on State Chart XML

  • 1. Designing and Executing Multimodal Interfaces for the Web based on State Chart XML Sebastian Feuerstack , Jessica H. Colnago and César R. De Souza 18. November 2011 Dr.-Ing. Sebastian Feuerstack Universidade Federal de São Carlos Departamento de Computacão
  • 2. Basic Challenge How to enable Multimodal Interfaces for the Web ? 18. November 2011
  • 3. Multi-Touch Server-sided speech processing Google Voice Search, SIRI, Nuance Speech API Sound API Native API CSS3 Speech, Media Query, … Device Orientation 18. November 2011 What`s the new Hype?
  • 4. Distribution Migration Adaptation (Ok, there is Content Selection & Device Discovery – but who uses more than the Browser UA?) Meta-UI => Natural Interaction 18. November 2011 What is missing?
  • 5. Developing Methods How do I design and implement complex Interactions ? (Native API…?) Free Tools What supports implementation and Debugging (Javascript Console?) Open Source Implementation Apache.org success Missing Standards W3C Model-Based User Interfaces (MBUI) Working Group 18. November 2011 What`s the barrier?
  • 6. 18. November 2011 Multimodal Interaction Framework
  • 7. Implemented Use Cases 18. November 2011
  • 8. Rapid model-based Design and Comparison of three variants Published: HCII 2011, MoBe 2011, I-Com Journal The Augmented “Drag-and-Drop 18. November 2011 Use Case I: Test and Evaluation Gesture-based Interface Navigation
  • 10. Furniture Drag and Drop Published: SVR 2011 18. November 2011 Use Case II: Paradigm Design Augmented Drag and Drop Cam Cam Pointing Command Monitor Jessica
  • 11. Gesture-based Drag and Drop Control 18. November 2011
  • 12. Evaluation of controling a music sheet by using head movements 18. November 2011 Use Case III: Test and Evaluation Head-based Interface Control
  • 13. Two concepts Interactors Mappings 3 steps Widget Design Interacton Design Mapping 18. November 2011 SCXML-based Interactor Design
  • 14. 1) Interactive Music Sheet Widget 18. November 2011 The Augmented “Drag-and-Drop
  • 15. 2) Interaction Design 18. November 2011
  • 16. 3) Mapping 18. November 2011
  • 17. Thanks for you interest! On our website : All articles Videos Open Source Software MINT Framework Focus on: Fusion Paradigm Design Formalization Tools MINT Framework Design of Multimodal Interaction 18. November 2011 http://www.multi-access.de Visit our website!