Designing Graphical User Interfaces Integrating Gestures

on

  • 1,251 views

The world of today and its new technologies like smartphones, tablets, or any flat interaction surface has increasing the need for graphical user interfaces integrating gestural interaction in which ...

The world of today and its new technologies like smartphones, tablets, or any flat interaction surface has increasing the need for graphical user interfaces integrating gestural interaction in which 2D pen-based gestures are properly used. Integrating this interaction modality in streamlined software development represents a significant challenge for designers or developers: it requires important knowledge in gestures management, in deciding which gesture recognition algorithm should be used or refined for which types of gestures, or which usability knowledge should be used for supporting the development. These skills usually belong to experts for gesture interaction and not actors usually involved in user interface design process. In this paper, we present a structured method for facilitating the integration of gestures in graphical user interfaces by describing the roles of the gesture specialist and other stakeholders involved in the development life cycle, and the process of cooperation leading to the creation of a gesture-based user interface. The method consists of three pillars: a conceptual model for describing gestures on top of graphical user interfaces and its associated language, a step-wise approach for defining gestures depending on the end user’s task, and a software that supports this approach. This method is exemplified with a running example in the area of document navigation.

Statistics

Views

Total Views
1,251
Views on SlideShare
1,247
Embed Views
4

Actions

Likes
2
Downloads
7
Comments
0

2 Embeds 4

https://twitter.com 2
http://www.twylah.com 2

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Designing Graphical User Interfaces Integrating Gestures Designing Graphical User Interfaces Integrating Gestures Presentation Transcript

    • http://www.slideshare.net/jeanvdd/designing-graphical-user-interfaces-integrating-gestures François Beuvens and Jean Vanderdonckt francois.beuvens@uclouvain.be Researcher at LiLab, http://www.lilab.be Université catholique de Louvain (Belgium) ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 1
    • - Context- A method for designing graphical user interfaces integrating gestures- Underlying model- Supporting tool- Ongoing and future works ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 2
    • - Context- A method for designing graphical user interfaces integrating gestures- Underlying model- Supporting tool- Ongoing and future works ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 3
    • - Gestures are quick to learn and easy to reproduce- Stylus amplifies the hand movement and is comfortable to use- Offers high precision- Gives a direct output and visual feedback- Allows recording meta-data - Pressure - Inclination - Orientation - ... ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 4
    • - Many existing datasets and algorithms - Developers have little or no time to investigate all these different algorithms, datasets and variations- Some platforms for gesture recognition are helpful, yet hard for algorithm selection- Lack of availability- Lack of extensibility and flexibility ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 5
    • - Context- A method for designing graphical user interfaces integrating gestures- Underlying model- Supporting tool- Ongoing and future works ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 6
    • - 4 categories of contributors - Engineer/architect: requirements analyser - Designer: in charge of aesthetics - Gesture specialist: devoted to recognition mechanisms - Programmer: coder of the UI- Work together around a tool/system ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 7
    • - Interface Users (IU) - End users of the interface- System Users (SU) - Use the system to produce the user interface- System Feeders (SF) - Feed the system with knowledge ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 8
    • Interface Users define userinterface requirements. ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 9
    • Based on the UIrequirements, System Usersdefine system requirements. ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 10
    • If system requirements aremet, System Users use thesystem to produce the userinterface. ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 11
    • If system requirements arenot met, based on the systemrequirements, SystemFeeders feed the system. ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 12
    • If UI requirements can bemet, System Users canproduce the interface so thatInterface Users can use it. ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 13
    • If UI requirements cannot bemet, System Users refinesystem requirements, then goback to system feeding. ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 14
    • If Interface Users are notsatisfied, Interface Usersrefine their requirements, thengo back to system use.Otherwise, the process endsup ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 15
    • - Context- A method for designing graphical user interfaces integrating gestures- Underlying model- Supporting tool- Ongoing and future works ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 16
    • ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 17
    • ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 18
    • ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 19
    • ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 20
    • ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 21
    • ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 22
    • - Context- A method for designing graphical user interfaces integrating gestures- Underlying model- Supporting tool- Ongoing and future works ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 23
    • ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 24
    • - Theoretical - Conceptual modeling of 2D pen-based gestures for GUIs- Methodological - Integration into UsiXML, a XML User Interface Description Language (www.usixml.org) - Define the role of the System Users, etc.- Empirical - User study on user satisfaction with gesture integration - Development benefits estimation ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 25
    • - Empirical: with respect to - System Feeders: to what extent is it expensive to incorporate new knowledge in UsiGesture - A new algorithm (recognizer) - A calibration of an algorithm - A new variant of an existing algorithm - System Users: to what extent is it straightforward to design a GUI based on UsiGesture - Interface users: do they perceive a better recognition when the right algorithm is used ACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 26
    • Thank you very much for your attention! Any question? See more at: www.usixml.org, www.usixml.eu www.lilab.eu, www.lilab.beACM Int. Conf. on Design of Communication SIGDOC2012 (Seattle, October 3-5, 2012) 27