A General Gesture Recognition Framework
Beat Signer, Ueli Kurmann and Moira C. Norrie
Institute for Information Systems, E...
Interactive Paper




                                                             Digital Pen and Paper

ICDAR 2007, Sept...
Requirements
 Java API
 Different types of input devices
          digital pen and paper, mouse, etc.
 Support applica...
iGesture Components


                           Management                            Evaluation
                        ...
Management       Evaluation
                                                              Console           Tools

       ...
Management       Evaluation
                                                              Console           Tools

       ...
Management       Evaluation
                                                              Console           Tools

       ...
Management       Evaluation
                                                              Console           Tools

       ...
Management       Evaluation
                                                              Console           Tools

       ...
Management        Evaluation
                                                              Console            Tools

     ...
Management        Evaluation
                                                              Console            Tools

     ...
Management        Evaluation
                                                              Console            Tools

     ...
Management        Evaluation
                                                              Console            Tools

     ...
Current Status
 Algorithms
          Rubine, SiGeR, E-Rubine, SiGrid
 Gesture Sets
          Graffiti numbers, Graffit...
Conclusions
 Simple gesture recogniser Java API
 Experimental platform for implementing and
     testing new gesture rec...
References
                                           iGesture Framework,
                                               ...
Upcoming SlideShare
Loading in...5
×

iGesture: A General Gesture Recognition Framework

2,668
-1

Published on

Presentation given at ICDAR 2007, 9th International Conference on Document Analysis and Recognition, Curitiba, Brazil, September 2007

ABSTRACT: With the emergence of digital pen and paper interfaces, there is a need for gesture recognition tools for digital pen input. While there exists a variety of gesture recognition frameworks, none of them addresses the issues of supporting application developers as well as the designers of new recognition algorithms and, at the same time, can be integrated with new forms of input devices such as digital pens. We introduce iGesture, a Java-based gesture recognition framework focusing on extensibility and cross-application reusability by providing an integrated solution that includes tools for gesture recognition as well as the creation and management of gesture sets for the evaluation and optimisation of new or existing gesture recognition algorithms. In addition to traditional screen-based interaction, iGesture provides a digital pen and paper interface.

Published in: Technology, Education
2 Comments
1 Like
Statistics
Notes
No Downloads
Views
Total Views
2,668
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
66
Comments
2
Likes
1
Embeds 0
No embeds

No notes for slide

iGesture: A General Gesture Recognition Framework

  1. 1. A General Gesture Recognition Framework Beat Signer, Ueli Kurmann and Moira C. Norrie Institute for Information Systems, ETH Zurich 8092 Zurich, Switzerland http://vub.academia.edu/BeatSigner ICDAR 2007, September 26
  2. 2. Interactive Paper Digital Pen and Paper ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 2
  3. 3. Requirements  Java API  Different types of input devices  digital pen and paper, mouse, etc.  Support application and algorithm developers  Definition and evaluation of new gesture sets  Simple acquisition of gesture data ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 3
  4. 4. iGesture Components Management Evaluation Console Tools Recogniser Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 4
  5. 5. Management Evaluation Console Tools Recogniser iGesture Admin Tab Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 5
  6. 6. Management Evaluation Console Tools Recogniser Capture of Samples Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 6
  7. 7. Management Evaluation Console Tools Recogniser iGesture Test Bench Tab Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 7
  8. 8. Management Evaluation Console Tools Recogniser iGesture Test Data Tab Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 8
  9. 9. Management Evaluation Console Tools Recogniser Evaluation Tools Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 9
  10. 10. Management Evaluation Console Tools Recogniser Recogniser API Common Data Structures Configuration configuration = XMLTool.importConfiguration(new File(RUBINE)); GestureSet gestureSet = XMLTool.importGestureSet(new File(RUBINE_SET)); configuration.addGestureSet(gestureSet); recogniser = new Recogniser(configuration); ... ResultSet result = recogniser.recognise(note); ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 10
  11. 11. Management Evaluation Console Tools Recogniser Gesture Representation Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 11
  12. 12. Management Evaluation Console Tools Recogniser Recognition Algorithm Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 12
  13. 13. Management Evaluation Console Tools Recogniser Persistence Common Data Structures ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 13
  14. 14. Current Status  Algorithms  Rubine, SiGeR, E-Rubine, SiGrid  Gesture Sets  Graffiti numbers, Graffiti letters, MS application gestures, customised multi-stroke gestures  Input Devices  Anoto digital pen (e.g. Magicomm G303), mouse ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 14
  15. 15. Conclusions  Simple gesture recogniser Java API  Experimental platform for implementing and testing new gesture recognition algorithms  Definition and evaluation of new gesture sets  Extensibility in terms of  input devices  algorithms  gestures sets ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 15
  16. 16. References  iGesture Framework, Apache License, V2.0  http://www.igesture.org  B. Signer, M. C. Norrie and U. Kurmann. iGesture: A Java Framework for the Development and Deployment of Stroke-Based Online Gesture Recognition Algorithms. Technical Report ETH Zurich TR 561, September 2007 ICDAR 2007, September 26 Beat Signer, signer@inf.ethz.ch 16
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×