ICDAR 2007, September 26 A General Gesture Recognition Framework Beat Signer , Ueli Kurmann and Moira C. Norrie Institute for Information Systems, ETH Zurich 8092 Zurich, Switzerland http://vub.academia.edu/BeatSigner
iGesture: A General Gesture Recognition Framework
May 24, 2015
Presentation given at ICDAR 2007, 9th International Conference on Document Analysis and Recognition, Curitiba, Brazil, September 2007
ABSTRACT: With the emergence of digital pen and paper interfaces, there is a need for gesture recognition tools for digital pen input. While there exists a variety of gesture recognition frameworks, none of them addresses the issues of supporting application developers as well as the designers of new recognition algorithms and, at the same time, can be integrated with new forms of input devices such as digital pens. We introduce iGesture, a Java-based gesture recognition framework focusing on extensibility and cross-application reusability by providing an integrated solution that includes tools for gesture recognition as well as the creation and management of gesture sets for the evaluation and optimisation of new or existing gesture recognition algorithms. In addition to traditional screen-based interaction, iGesture provides a digital pen and paper interface.
ABSTRACT: With the emergence of digital pen and paper interfaces, there is a need for gesture recognition tools for digital pen input. While there exists a variety of gesture recognition frameworks, none of them addresses the issues of supporting application developers as well as the designers of new recognition algorithms and, at the same time, can be integrated with new forms of input devices such as digital pens. We introduce iGesture, a Java-based gesture recognition framework focusing on extensibility and cross-application reusability by providing an integrated solution that includes tools for gesture recognition as well as the creation and management of gesture sets for the evaluation and optimisation of new or existing gesture recognition algorithms. In addition to traditional screen-based interaction, iGesture provides a digital pen and paper interface.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
ICDAR 2007, September 26
A General Gesture Recognition Framework
Beat Signer, Ueli Kurmann and Moira C. Norrie
Institute for Information Systems, ETH Zurich
8092 Zurich, Switzerland
http://vub.academia.edu/BeatSigner
ICDAR 2007, September 26 Beat Signer, [email protected] 3
Requirements
Java API
Different types of input devices
digital pen and paper, mouse, etc.
Support application and algorithm developers
Definition and evaluation of new gesture sets
Simple acquisition of gesture data
ICDAR 2007, September 26 Beat Signer, [email protected] 4
iGesture Components
Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 5
iGesture Admin Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 6
Capture of Samples Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 7
iGesture Test Bench Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 8
iGesture Test Data Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 9
Evaluation Tools Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 10
Recogniser API
Configuration configuration =
XMLTool.importConfiguration(new File(RUBINE));
GestureSet gestureSet =
XMLTool.importGestureSet(new File(RUBINE_SET));
configuration.addGestureSet(gestureSet);
recogniser = new Recogniser(configuration);
...
ResultSet result = recogniser.recognise(note);
Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 11
Gesture Representation Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 12
Recognition Algorithm Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 13
Persistence Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
ICDAR 2007, September 26 Beat Signer, [email protected] 14
Current Status
Algorithms
Rubine, SiGeR, E-Rubine, SiGrid
Gesture Sets
Graffiti numbers, Graffiti letters, MS application
gestures, customised multi-stroke gestures
Input Devices
Anoto digital pen (e.g. Magicomm G303), mouse
ICDAR 2007, September 26 Beat Signer, [email protected] 15
Conclusions
Simple gesture recogniser Java API
Experimental platform for implementing and
testing new gesture recognition algorithms
Definition and evaluation of new gesture sets
Extensibility in terms of
input devices
algorithms
gestures sets
ICDAR 2007, September 26 Beat Signer, [email protected] 16
References
B. Signer, M. C. Norrie and U. Kurmann. iGesture: A
Java Framework for the Development and Deployment
of Stroke-Based Online Gesture Recognition Algorithms.
Technical Report ETH Zurich TR 561, September 2007
iGesture Framework,
Apache License, V2.0
http://www.igesture.org
Related Documents
