Our daily life is full of activities: working, cooking, cleaning, driving are just some of them. While performing these activities our communicating capabilities are limited since most of our senses are blocked by the main activity. Thus we cannot benefit from accessing the computer or using our hands and eyes for driving or our voice for talking to other people. In this paper we invest into enabling and designing human-computer interaction in situations where common modes of communication fail. Therefore we allow controlling an interface just by using head movements and propose a model-based interface design that enables to design and implement such interactions. As a proof of concept we explain our approach based on a natural interface for a musician that we have implemented. It enables to turn music sheets just by head movements.

1. Designing and Executing Multimodal Interfaces for the Web based on State Chart XML Sebastian Feuerstack , Jessica H. Colnago and César R. De Souza 18. November 2011 Dr.-Ing. Sebastian Feuerstack Universidade Federal de São Carlos Departamento de Computacão

6. 18. November 2011 Multimodal Interaction Framework

9. Gesture-based Interface Navigation 18. November 2011

11. Gesture-based Drag and Drop Control 18. November 2011

14. 1) Interactive Music Sheet Widget 18. November 2011 The Augmented “Drag-and-Drop

15. 2) Interaction Design 18. November 2011

16. 3) Mapping 18. November 2011

18. 18. November 2011