Neural networks are a powerful technology forclassification of visual inputs arising from documents.However, there is a confusing plethora of different neuralnetwork methods that are used in the literature and inindustry. This paper describes a set of concrete bestpractices that document analysis researchers can use toget good results with neural networks. The mostimportant practice is getting a training set as large aspossible: we expand the training set by adding a newform of distorted data. The next most important practiceis that convolutional neural networks are better suited forvisual document tasks than fully connected networks. Wepropose that a simple "do-it-yourself" implementation ofconvolution with a flexible architecture is suitable formany visual document problems. This simpleconvolutional neural network does not require complexmethods, such as momentum, weight decay, structure-dependentlearning rates, averaging layers, tangent prop,or even finely-tuning the architecture. The end result is avery simple yet general architecture which can yieldstate-of-the-art performance for document analysis. Weillustrate our claims on the MNIST set of English digitimages.

/pdf/best-practices-for-convolutional-neural-networks-applied-to-1r5hlmtzmr.pdf

Best practices for convolutional neural networks applied to visual document analysis

The problem addressed in this study is the offline recognition of handwritten Arabic city names. The names are assumed to belong to a fixed lexicon of about 1,000 entries. A state-of-the-art classical right-left hidden Markov model (HMM)-based recognizer (reference system) using the sliding window approach is developed. The feature set includes both baseline-independent and baseline-dependent features. The analysis of the errors made by the recognizer shows that the inclination, overlap, and shifted positions of diacritical marks are major sources of errors. In this paper, we propose coping with these problems. Our approach relies on the combination of three homogeneous HMM-based classifiers. All classifiers have the same topology as the reference system and differ only in the orientation of the sliding window. We compare three combination schemes of these classifiers at the decision level. Our reported results on the benchmark IFN/ENIT database of Arabic Tunisian city names give a recognition rate higher than 90 percent accuracy and demonstrate the superiority of the neural network-based combination. Our results also show that the combination of classifiers performs better than a single classifier dealing with slant-corrected images and that the approach is robust for a wide range of orientation angles.

Combining Slanted-Frame Classifiers for Improved HMM-Based Arabic Handwriting Recognition

https://hal.archives-ouvertes.fr/hal-00668271/document

Off-line handwritten word recognition using multi-stream hidden Markov models

This paper introduces a script-independent methodology for multilingual offline handwriting recognition (OHR) based on the use of Hidden Markov Models (HMM). The OHR methodology extends our script-independent approach for OCR of machine-printed text images. The feature extraction, training, and recognition components of the system are all designed to be script independent. The HMM training and recognition components are based on our Byblos continuous speech recognition system. The HMM parameters are estimated automatically from the training data, without the need for laborious hand-written rules. The system does not require pre-segmentation of the data, neither at the word level nor at the character level. Thus, the system can handle languages with cursive handwritten scripts in a straightforward manner. The script independence of the system is demonstrated with experimental results in three scripts that exhibit significant differences in glyph characteristics: English, Chinese, and Arabic. Results from an initial set of experiments are presented to demonstrate the viability of the proposed methodology.

Multi-lingual offline handwriting recognition using hidden Markov models: a script-independent approach

Nowadays Hand written Character Recognition (HCR) is major remarkable and difficult research domain in the area of Image processing. Recognition of Handwritten English alphabets have been broadly studied in the previous years. Presently various recognition methodologies are in well-known utilized for recognition of handwritten English alphabets (character). Application domain of HCR is digital document processing such as mining information from data entry, cheque, applications for loans, credit cards, tax, health insurance forms etc. During this survey we present an outline of current research work conducted for recognition of handwritten English alphabets. In Handwritten manuscript there is no restriction on the writing technique. Handwritten alphabets are complicated to recognize because of miscellaneous human handwriting technique, difference in size and shape of letters, angle. A variety of recognition methodologies for handwritten English alphabets are conferred here alongside with their performance.

/pdf/a-survey-on-handwritten-character-recognition-hcr-techniques-tx9x8pkspj.pdf

A Survey on Handwritten Character Recognition (HCR) Techniques for English Alphabets

This paper describes an offline cursive handwritten word recognition system that combines hidden Markov models (HMM) and neural networks (NN). Using a fast left-right slicing method, we generate a segmentation graph that describes all possible ways to segment a word into letters. The NN computes the observation probabilities for each letter hypothesis in the segmentation graph. Then, the HMM compute the likelihood for each word in the lexicon by summing the probabilities over all possible paths through the graph. We present the preprocessing and the recognition process as well as the training procedure for the NN-HMM hybrid system. Another recognition system based on discrete HMM is also presented for performance comparison. The latter is also used for bootstrapping the NN-HMM hybrid system. Recognition performances of the two recognition systems using two image databases of French isolated words are presented. This paper is one of the first publications using the IRONOFF database, and thus can be used as a reference for future work on this database.

S. Kneer

Papers

An offline cursive handwritten word recognition system