Hala Bezine IGS 2011 Cancun-Mexico 1
Presented by :Mme Hala Bezine
Republic of TunisiaMinistery of Higher Education and
Scientific Research
University of SfaxNational Engineering
School of Sfax Tunisia
Research Group on Intelligent Machines
Towards an Ink-Enabled handwriting editor
THE 15th INTERNATIONAL GRAPHONOMICS SOCIETY CONFERENCE (IGS2011)(IGS2011)
Live Aqua Cancun, MEXICO
2Hala Bezine IGS 2011 Cancun-Mexico 2
Outline 1- Introduction
2- Technical specifications of the On-line database “Mayastroun”
4- Conclusions
3- Architecture of the developed handwriting editor interface
3Hala Bezine IGS 2011 Cancun-Mexico 3
1- Introduction• The human being wants to communicate with the
computer in the simplest, fastest way in order to facilitate and accelerate the interaction and the exchange of information
• He seeks to make these machines, able to read, see, move, treat and quickly analyze the information received
• InkML provides cross-platforrm environement to support handwriting
Ink-enabled handwriting editor
• InkML offers a common format for the excahnging data between component (handwriting, gesture recognition, signature verification…
4Hala Bezine IGS 2011 Cancun-Mexico 4
2-Technical specifications of the On-line database “Mayastroun”
• The input of the handwriting editor are handwritten scripts drawn on digitizing tablet and stored in “Mayastroun”
• “Mayastroun” This dual handwriting database contains a variability of data : Arabic or Latin characters, digits, texts, signatures, mathematical expressions, etc....
• All samples are stored in XML (eXtensible Markup Language) files
• Each sample has two complementary Files : .out extension for the on-line handwritten database.bmp extension for the off-line handwritten database.
• A graphic user interface (GUI) was developed in .Net language
5Hala Bezine IGS 2011 Cancun-Mexico 5
MAYASTROUN database
XML file
Digital tablet
Scripter identification
2-Technical specifications of the On-line database “Mayastroun”General Schema of the “ Maystroroun ” database
6Hala Bezine IGS 2011 Cancun-Mexico 6
2-Technical specifications of the On-line database “Mayastroun”
Each writer:• has an identifier number ID which will be used when
acceding to the database• has a repertory is attributed to store all written samples• fills an electronic coordinate's form to collect personal
information such as first and last name, date of birth, country, sex and other informations
“Mayastroun” contains: • 5000 isolated digits• >13036 isolated lower and upper case letters• 35017 isolated words from a 500 word lexicon (English,
French and Arabic)
7Hala Bezine IGS 2011 Cancun-Mexico 7
2-Technical specifications of the On-line database “Mayastroun”
Example of XML file from the database “Mayastroun”
8Hala Bezine IGS 2011 Cancun-Mexico 8
3- Architecture of the developed handwriting editor interface
Based on the XML, XSLT is the language used for the conversion of files that have the same or other extensions
The original document is not changed, but a new document is created based on the content of the existing one
The new document will be arranged by the processor in standard XML syntax or in another format, such as HTML or
text (Microsoft Word, Latex,...)
9Hala Bezine IGS 2011 Cancun-Mexico 9
3- Architecture of the developed handwriting editor interface
The Interface designed for conversion of the samples from the database Mayastroun with .net language
10Hala Bezine IGS 2011 Cancun-Mexico 10
3- Architecture of the developed handwriting editor interface
• Handwriting recognition: the process by which software
analyzes ink words to convert them to typed text
• This recognition stage is based on natural handwriting that
is digitized by the system, then modified into digital writing
which is in turn analysed by a recognition engine
• This conversion is applied via the menu "conversion" of the
handwriting interface
11Hala Bezine IGS 2011 Cancun-Mexico 11
3- Architecture of the developed handwriting editor interface
The Handwriting editor interface
12Hala Bezine IGS 2011 Cancun-Mexico 12
3- Architecture of the developed handwriting editor interface
• This editor is well suited for a broad range of applications and platforms
• It is not restricted to handwriting samples from “Mayastroun” database, but we can exploit others databases such us Unipen,etc...
In practice and especially for pen-based mathematical interfaces, some improvements must be taken into account in order to recognize mathematical symbols and each component embedded in significant mathematical expression
Good recognition rate are obtained for major editable texts
13Hala Bezine IGS 2011 Cancun-Mexico 13
3- Architecture of the developed handwriting editor interface
An example of handwritten text edited by Microsoft Word
Good recognition rate of 98,27 (228 among 232 characters after recognition)
14Hala Bezine IGS 2011 Cancun-Mexico 14
A system for the real-time recognition of handwriting script
4- Conclusions
“ An ink Enabled Handwriting Editor ”
Recognition of every type of handwritten text expressed in Latin
“ Satisfied recognition rates”
Enhancement of the recognition performance of on-line Arabic script
15Hala Bezine IGS 2011 Cancun-Mexico 15
Contacts : {hala.bezine, sourour.njah, adel.alimi } @ieee.org
REGIM: REsearch Group on Intelligent Machines, University of Sfax, National Engineering School of Sfax (ENIS), Tunisia