Top Banner
Online Arabic Handwriting Recognition Fadi Biadsy Jihad El- Sana Nizar Habash Abdul-Rahman Daud Done by Presented by KFUPM Information & Computer Science department ICS 482 - Natural Language Processing
16

Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Jan 02, 2016

Download

Documents

Meghan Morris
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Online Arabic Handwriting Recognition

Fadi Biadsy

Jihad El-Sana

Nizar Habash

Abdul-Rahman Daud

Done by Presented by

KFUPMInformation & Computer Science department

ICS 482 - Natural Language Processing

Page 2: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Outline

Introduction 1. Characteristics of the Arabic Script ( problems) 2. Current Solutions 3. Better Solution (using HHM) 4. Hidden Markov Model Conclusion

Page 3: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Introduction

• Best means of human-computer interfacing.

• Forms smaller than the traditional

• computer use reaches a larger number

Page 4: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Introduction

• Speech– More People

• Handwriting– Performance– Privacy

• Handwriting Categories– Online– offline

Page 5: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Characteristics of the Arabic Script

• Cursive: – Arabic is written in a

cursive.

– style from right to left.

• Most letters are written in four

ـع ـعـ عـ ع

Page 6: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Characteristics of the Arabic Script

• Delayed strokes– creating new letters

• Dots

Page 7: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

• Most of them Offline Handwriting recognition– Strokes are ignored.

• Need for effective Online handwriting recognition

Current Solutions

Page 8: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Best Solution

• Based on HMM

• Hidden Markov model

• Regular expression (state machines)

• Our recognition framework uses discrete HMMs to represent each letter shape.

Page 9: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

HMM

• (HMM) is a statistical model in which the system being modeled is assumed to be a Markov process with unknown parameters, and the challenge is to determine the hidden parameters from the observable parameters.

• The extracted model parameters can then be used to perform further analysis

Page 10: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

HMM

Markov process

future states of the process, given the present state and all past states, depends only upon the present state and not on any past states, i.e. it is conditionally independent of the past states

HMM is used for many Patten recognition problems

Page 11: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

HMM

Page 12: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

HMM

• Given the parameters of the model, find the most likely sequence of hidden states that could have generated a given output sequence. This problem is solved by the Viterbi algorithm.

Page 13: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

HMM

• In this implementation, each observation yi in this observation sequence is an integer value

• Letters are joined to from word parts

Page 14: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

HMM

• To constrain the space of search, we utilize a dictionary of possible valid words. This ensures better recognition rates compared to systems that can recognize any arbitrary permutation of letters.

Page 15: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.

Conclusion

• This solution introduced an HMM based system with to provide solutions for most of the difficulties inherent in recognizing Arabic script: namely delayed strokes.

Page 16: Online Arabic Handwriting Recognition Fadi Biadsy Jihad El-Sana Nizar Habash Abdul-Rahman Daud Done byPresented by KFUPM Information & Computer Science.