GUIDE – CONNECTED TV FOR THE ELDERLY
                                                           Developer tools for automatic user interface adaptation
                                                           and simulation-based user-centred design
                                                                                                                              The European project GUIDE (“Gentle user interfaces for elderly people”) creates a software
                                                                                                                              framework and design tools for Connected TV developers to support them in efficiently
                                                                                                                              integrating accessibility and personalisation features into their applications and services.
                                                                                                                                           GUIDE provides automatic multi-modal integration and adaptation of
                                                                                                                                             various legacy and next-generation user interface technologies, such as
                                                                                                                                                gesture interaction, voice control, avatars, second screen multi-touch
                                                                                                                                                devices and gyroscopic remote controls. A virtual user simulation
                                                                                                                                                software supports the developer at design-time, providing a view
                                                                                                                                                “through the eyes” of a user, by simulating vision-, hearing-, motor-,
                                                                                                                                                 and cognitive impairments as well as interaction scenarios. GUIDE-
                                                                                                                                                  enabled applications and services can automatically adapt their user
                                                                                                                                                  interface to the specific impairments and preferences of elderly users.
                                                                                                                                                   The project puts a dedicated focus on the emerging Connected TV
                                                                                                                                                    platforms and services (Internet-connected Digital TVs, Set-Top
                                                                                                                                                    Boxes). GUIDE develops a set of references applications (home
                                                                                                                                                     automation, video conferencing, tele-learning, media access) that
                                                                                                                                                     can help elderly citizens to simplify their daily life, stay connected in
                                                                                                                                                     their social network and enhance their understanding of the world.

                                                                                                                                             EXPECTED OUTCOMES
www.guide-project.eu
                                                                                                                                                                        Modal Input                                                                            Modal Output
                                                                                                                                                                      Transformation                                                                          Transformation

CONTACT:                                                                                                                                                                                                                                                                                       Video
                                                                                                                                                    Speech            Click!                                                                                  content                          Rendering,
Project coordination: Christoph Jung | Fraunhofer-Institut für Graphische Datenverarbeitung IGD | Fraunhoferstrasse 5,                           Commands                                                                                                                                      Adaptive GUI




                                                                                                                                                                                                                                  Multimodal Output Fission
                                                                                                                                                                               select!                                                                                                         Components
D-64283 Darmstadt | Tel: +49 6151 155-614 Fax: +49 6151 155-480 | E-mail: christoph.jung@igd.fraunhofer.de




                                                                                                                                                                                         Multimodal Input Fusion
                                                                                                                                             Remote Control:                                                                                                  content                          Audio
                                                                                                                                                  Buttons &                                                                                                                                    Rendering
                                                                                                                                                 Gyroscopic                    select!                                 ICT
BRIDGING THE GAPS                                                                                                                                                                                                   Application
                                                                                                                                                                                                                      Logic
                                                                                                                                                                                                                                                              content
                                                                                                                                                     Visual                                                                                                                                    Haptic
                                                                                                                                                   Gestures                 select!                                                                                                            Feedback
■
    Technical barriers: Connected TV services are not easy to use for elderly people. Many people
    still are not able to connect their device to the internet.                                                                                   Adaptive                                                                                                    content                          Speech
                                                                                                                                                Multi-Touch                                                                                                                                    Guidance/
■
    Awareness: There is still lack of awareness and acceptance of accessibility in the industry.                                                    Control                    select!                                                                                                         Avatars

■
    Cost: User-centred design is costly and time-consuming, due to user involvement.
    Development of user interfaces for heterogeneous user groups with individual preferences                                                                                                    Multimodal Adaptation

    and capabilities is not feasible.
                                                                                                                                                                          User
■
    Accessibility APIs: Software support and assistive technologies are there, but do not support                                                                      Simulation
                                                                                                                                                                                                                   User Model
                                                                                                                                                                                                                   and Profile                                           The GUIDE Principle
    automatic personalisation and adaptation.
■
    Design support: Existing design guidelines do not specifically address Connected TV scenarios                                        ■
                                                                                                                                             User Interface Adaptation Framework: This software framework supports applications at run-time.
    and multi-modal interaction design. User simulation is still widely unknown in the industry.                                             It integrates various types of user interface technologies, ranging from remote control, free-hands
                                                                                                                                             and gesture control and speech control to avatars and second screen devices. The framework
                                                                                                                                             performs automatic multi-modal adaptation (in terms of selection, configuration and “weighting”
                                                              Elderly society
                                                              organisations              Wider public
                                                                                          audience
                                                                                                                                             of individual modalities in concurrent use) of user interfaces to the impairments and preferences
                                     Public authorities                                                                                      of elderly users. The GUIDE Framework is being developed for multiple platforms and can be
                                                                                                              Connected                      installed on legacy and future Connected TV platforms, and integrates with legacy applications
                                                                                                               TV / STB
                   Assistive                                                                                 manufacturers                   by implementing a simple communication protocol through the GUIDE JavaScript API.
                 technology
                 developers                                                                                                              ■
                                                                                                                                             User Simulator: The GUIDE virtual user simulation software allows developers to perceive their
                                                                                                                                             develop UI and applications “through the eyes” of a virtual user. The software simulates vision,
                                                                                                                   Connected TV
                                                                                                                    application              hearing, cognition and motor functions of elderly users with ageing-related impairments. The
            Research                                                                                                developers
           community                                                                                                                         use of the simulator shall allow to identify design problems early, and thereby decrease the need
                                                                                                                                             of human resources in the user-centred design process, reducing cost and time.

          Connected TV /                                                                           TV service & content
                                                                                                                                         ■
                                                                                                                                             User Model Standards: GUIDE is developing a novel user model that reflects impairments and
          STB middleware                                                                                providers                            preferences of elderly people.The user model is an enabling technology for multi-modal adaptation
            developers
                                                                                                                                             in the GUIDE Framework and the GUIDE Simulator. In the European VUMS cluster (“Virtual User
                                                                                                                                             Modelling & Simulation”, http://www.vums-cluster.eu) GUIDE performs joint development
                    User interface                                              Standardisation
                     technology
                                                    Web browser                     bodies                                                   activities to derive a common inter-operable user model standard on an international level.
                     developers
                                                     developer                                                                           ■
                                                                                                                                             Developer Web Portal: The GUIDE “Handbook” will be a web portal dedicated to Connected
                                                                                                                                             TV developers. It shall support the industry in reaching the elderly society with their products
                                                                                                                                             and create awareness for e-Accessibility among European DTV developers. It provides access to
APPROACH                                                                                                                                     relevant user-centred design knowledge for application developers, service operators and device
                                                                                                                                             manufacturers, for example guidelines, regulation, events, as well documentation of the GUIDE
The GUIDE project will support the Connected TV industry with software tools and knowledge                                                   Framework.
to make their services better accessible by elderly users. To achieve this GUIDE follows a user-                                         ■
                                                                                                                                             User Interface Technologies: The GUIDE UI components (remote control, free-hands & gesture
centred design approach, which involves elderly users at all stages of the project development.
                                                                                                                                             control, speech recognition and synthesis, avatars, multi-touch tablet PC) being developed in the
Through user modelling GUIDE software can create individual profiles of users, representing
                                                                                                                                             project will be used in the user trials in the project and demonstrate the feasibility of the GUIDE
both preferences and capabilities. This knowledge can be used in a multi-modal adaptation
                                                                                                                                             multi-modal adaptation approach. Furthermore, some of the components will be distributed
process, where the user interface is automatically configured to meet the needs of the user,
                                                                                                                                             together with the GUIDE Framework as open source, to serve as development examples.
based on the profile and contextual information. In User Simulation the profiles are used to
render a UI for the developer, that reflects the effect of impairments and diseases of a possible
                                                                                                                                         ■
                                                                                                                                             Applications: The GUIDE applications (home automation, media access, video conferencing and
real end user.                                                                                                                               tele-learning) will be developed by strong end user involvement. They have been selected as valid
                                                                                                                                             use cases for improving social inclusion, assisted living and continuous learning of elderly users.
                                                                                                                                             The applications will validate the feasibility of GUIDE concepts for developers, and will partially
GUIDE is member of the European VUMS cluster (Virtual User Modelling & Simulation)
                                                                                                                                             be distributed with the GUIDE Framework as development examples.


The project has received funding from the
European Commission’s Seventh Framework
Programme (FP7/2007-2013) under Grant                                                                   Consortium:
Agreement no. 248893.

Poster Guide project poster-09-2011

  • 1.
    GUIDE – CONNECTEDTV FOR THE ELDERLY Developer tools for automatic user interface adaptation and simulation-based user-centred design The European project GUIDE (“Gentle user interfaces for elderly people”) creates a software framework and design tools for Connected TV developers to support them in efficiently integrating accessibility and personalisation features into their applications and services. GUIDE provides automatic multi-modal integration and adaptation of various legacy and next-generation user interface technologies, such as gesture interaction, voice control, avatars, second screen multi-touch devices and gyroscopic remote controls. A virtual user simulation software supports the developer at design-time, providing a view “through the eyes” of a user, by simulating vision-, hearing-, motor-, and cognitive impairments as well as interaction scenarios. GUIDE- enabled applications and services can automatically adapt their user interface to the specific impairments and preferences of elderly users. The project puts a dedicated focus on the emerging Connected TV platforms and services (Internet-connected Digital TVs, Set-Top Boxes). GUIDE develops a set of references applications (home automation, video conferencing, tele-learning, media access) that can help elderly citizens to simplify their daily life, stay connected in their social network and enhance their understanding of the world. EXPECTED OUTCOMES www.guide-project.eu Modal Input Modal Output Transformation Transformation CONTACT: Video Speech Click! content Rendering, Project coordination: Christoph Jung | Fraunhofer-Institut für Graphische Datenverarbeitung IGD | Fraunhoferstrasse 5, Commands Adaptive GUI Multimodal Output Fission select! Components D-64283 Darmstadt | Tel: +49 6151 155-614 Fax: +49 6151 155-480 | E-mail: christoph.jung@igd.fraunhofer.de Multimodal Input Fusion Remote Control: content Audio Buttons & Rendering Gyroscopic select! ICT BRIDGING THE GAPS Application Logic content Visual Haptic Gestures select! Feedback ■ Technical barriers: Connected TV services are not easy to use for elderly people. Many people still are not able to connect their device to the internet. Adaptive content Speech Multi-Touch Guidance/ ■ Awareness: There is still lack of awareness and acceptance of accessibility in the industry. Control select! Avatars ■ Cost: User-centred design is costly and time-consuming, due to user involvement. Development of user interfaces for heterogeneous user groups with individual preferences Multimodal Adaptation and capabilities is not feasible. User ■ Accessibility APIs: Software support and assistive technologies are there, but do not support Simulation User Model and Profile The GUIDE Principle automatic personalisation and adaptation. ■ Design support: Existing design guidelines do not specifically address Connected TV scenarios ■ User Interface Adaptation Framework: This software framework supports applications at run-time. and multi-modal interaction design. User simulation is still widely unknown in the industry. It integrates various types of user interface technologies, ranging from remote control, free-hands and gesture control and speech control to avatars and second screen devices. The framework performs automatic multi-modal adaptation (in terms of selection, configuration and “weighting” Elderly society organisations Wider public audience of individual modalities in concurrent use) of user interfaces to the impairments and preferences Public authorities of elderly users. The GUIDE Framework is being developed for multiple platforms and can be Connected installed on legacy and future Connected TV platforms, and integrates with legacy applications TV / STB Assistive manufacturers by implementing a simple communication protocol through the GUIDE JavaScript API. technology developers ■ User Simulator: The GUIDE virtual user simulation software allows developers to perceive their develop UI and applications “through the eyes” of a virtual user. The software simulates vision, Connected TV application hearing, cognition and motor functions of elderly users with ageing-related impairments. The Research developers community use of the simulator shall allow to identify design problems early, and thereby decrease the need of human resources in the user-centred design process, reducing cost and time. Connected TV / TV service & content ■ User Model Standards: GUIDE is developing a novel user model that reflects impairments and STB middleware providers preferences of elderly people.The user model is an enabling technology for multi-modal adaptation developers in the GUIDE Framework and the GUIDE Simulator. In the European VUMS cluster (“Virtual User Modelling & Simulation”, http://www.vums-cluster.eu) GUIDE performs joint development User interface Standardisation technology Web browser bodies activities to derive a common inter-operable user model standard on an international level. developers developer ■ Developer Web Portal: The GUIDE “Handbook” will be a web portal dedicated to Connected TV developers. It shall support the industry in reaching the elderly society with their products and create awareness for e-Accessibility among European DTV developers. It provides access to APPROACH relevant user-centred design knowledge for application developers, service operators and device manufacturers, for example guidelines, regulation, events, as well documentation of the GUIDE The GUIDE project will support the Connected TV industry with software tools and knowledge Framework. to make their services better accessible by elderly users. To achieve this GUIDE follows a user- ■ User Interface Technologies: The GUIDE UI components (remote control, free-hands & gesture centred design approach, which involves elderly users at all stages of the project development. control, speech recognition and synthesis, avatars, multi-touch tablet PC) being developed in the Through user modelling GUIDE software can create individual profiles of users, representing project will be used in the user trials in the project and demonstrate the feasibility of the GUIDE both preferences and capabilities. This knowledge can be used in a multi-modal adaptation multi-modal adaptation approach. Furthermore, some of the components will be distributed process, where the user interface is automatically configured to meet the needs of the user, together with the GUIDE Framework as open source, to serve as development examples. based on the profile and contextual information. In User Simulation the profiles are used to render a UI for the developer, that reflects the effect of impairments and diseases of a possible ■ Applications: The GUIDE applications (home automation, media access, video conferencing and real end user. tele-learning) will be developed by strong end user involvement. They have been selected as valid use cases for improving social inclusion, assisted living and continuous learning of elderly users. The applications will validate the feasibility of GUIDE concepts for developers, and will partially GUIDE is member of the European VUMS cluster (Virtual User Modelling & Simulation) be distributed with the GUIDE Framework as development examples. The project has received funding from the European Commission’s Seventh Framework Programme (FP7/2007-2013) under Grant Consortium: Agreement no. 248893.