Hala Bezine IGS 2011 Cancun-Mexico 1 Presented by :M me Hala Bezine Republic of Tunisia Ministery of Higher Education and Scientific Research University.

Hala Bezine IGS 2011 Cancun-Mexico 1

Presented by :Mme Hala Bezine

Republic of TunisiaMinistery of Higher Education and

Scientific Research

University of SfaxNational Engineering

School of Sfax Tunisia

Research Group on Intelligent Machines

Towards an Ink-Enabled handwriting editor

THE 15th INTERNATIONAL GRAPHONOMICS SOCIETY CONFERENCE (IGS2011)(IGS2011)

Live Aqua Cancun, MEXICO

2Hala Bezine IGS 2011 Cancun-Mexico 2

Outline 1- Introduction

2- Technical specifications of the On-line database “Mayastroun”

4- Conclusions

3- Architecture of the developed handwriting editor interface

3Hala Bezine IGS 2011 Cancun-Mexico 3

1- Introduction• The human being wants to communicate with the

computer in the simplest, fastest way in order to facilitate and accelerate the interaction and the exchange of information

• He seeks to make these machines, able to read, see, move, treat and quickly analyze the information received

• InkML provides cross-platforrm environement to support handwriting

Ink-enabled handwriting editor

• InkML offers a common format for the excahnging data between component (handwriting, gesture recognition, signature verification…

4Hala Bezine IGS 2011 Cancun-Mexico 4

2-Technical specifications of the On-line database “Mayastroun”

• The input of the handwriting editor are handwritten scripts drawn on digitizing tablet and stored in “Mayastroun”

• “Mayastroun” This dual handwriting database contains a variability of data : Arabic or Latin characters, digits, texts, signatures, mathematical expressions, etc....

• All samples are stored in XML (eXtensible Markup Language) files

• Each sample has two complementary Files : .out extension for the on-line handwritten database.bmp extension for the off-line handwritten database.

• A graphic user interface (GUI) was developed in .Net language

5Hala Bezine IGS 2011 Cancun-Mexico 5

MAYASTROUN database

XML file

Digital tablet

Scripter identification

2-Technical specifications of the On-line database “Mayastroun”General Schema of the “ Maystroroun ” database

6Hala Bezine IGS 2011 Cancun-Mexico 6

2-Technical specifications of the On-line database “Mayastroun”

Each writer:• has an identifier number ID which will be used when

acceding to the database• has a repertory is attributed to store all written samples• fills an electronic coordinate's form to collect personal

information such as first and last name, date of birth, country, sex and other informations

“Mayastroun” contains: • 5000 isolated digits• >13036 isolated lower and upper case letters• 35017 isolated words from a 500 word lexicon (English,

French and Arabic)

7Hala Bezine IGS 2011 Cancun-Mexico 7

2-Technical specifications of the On-line database “Mayastroun”

Example of XML file from the database “Mayastroun”

8Hala Bezine IGS 2011 Cancun-Mexico 8

3- Architecture of the developed handwriting editor interface

Based on the XML, XSLT is the language used for the conversion of files that have the same or other extensions

The original document is not changed, but a new document is created based on the content of the existing one

The new document will be arranged by the processor in standard XML syntax or in another format, such as HTML or

text (Microsoft Word, Latex,...)

9Hala Bezine IGS 2011 Cancun-Mexico 9

3- Architecture of the developed handwriting editor interface

The Interface designed for conversion of the samples from the database Mayastroun with .net language

10Hala Bezine IGS 2011 Cancun-Mexico 10

3- Architecture of the developed handwriting editor interface

• Handwriting recognition: the process by which software

analyzes ink words to convert them to typed text

• This recognition stage is based on natural handwriting that

is digitized by the system, then modified into digital writing

which is in turn analysed by a recognition engine

• This conversion is applied via the menu "conversion" of the

handwriting interface

11Hala Bezine IGS 2011 Cancun-Mexico 11

3- Architecture of the developed handwriting editor interface

The Handwriting editor interface

12Hala Bezine IGS 2011 Cancun-Mexico 12

3- Architecture of the developed handwriting editor interface

• This editor is well suited for a broad range of applications and platforms

• It is not restricted to handwriting samples from “Mayastroun” database, but we can exploit others databases such us Unipen,etc...

In practice and especially for pen-based mathematical interfaces, some improvements must be taken into account in order to recognize mathematical symbols and each component embedded in significant mathematical expression

Good recognition rate are obtained for major editable texts

13Hala Bezine IGS 2011 Cancun-Mexico 13

3- Architecture of the developed handwriting editor interface

An example of handwritten text edited by Microsoft Word

Good recognition rate of 98,27 (228 among 232 characters after recognition)

14Hala Bezine IGS 2011 Cancun-Mexico 14

A system for the real-time recognition of handwriting script

4- Conclusions

“ An ink Enabled Handwriting Editor ”

Recognition of every type of handwritten text expressed in Latin

“ Satisfied recognition rates”

Enhancement of the recognition performance of on-line Arabic script

15Hala Bezine IGS 2011 Cancun-Mexico 15

Contacts : {hala.bezine, sourour.njah, adel.alimi } @ieee.org

REGIM: REsearch Group on Intelligent Machines, University of Sfax, National Engineering School of Sfax (ENIS), Tunisia