Meter value recognition using locally connected hierarchical networks

Sven BehnkeESANN 2003 · OpenReview

Abstract

This paper introduces a robust two-stage neural network architecture for recognizing postage meter values from low-quality mail images. By employing a hierarchical "Neural Abstraction Pyramid" that classifies entire digit blocks without explicit segmentation, the system overcomes the traditional segmentation-recognition dilemma. The inclusion of contextual information regarding postal rates further enhances accuracy, achieving a 0.91% error rate on a dataset of Swedish postage marks.

Introduction

Automatic mail processing relies heavily on the ability to read postage meter stamps. However, these stamps often present significant challenges for computer vision systems due to low resolution, poor contrast, and high variance in printing quality. A fundamental hurdle is the segmentation-recognition dilemma: accurate digit recognition typically requires prior segmentation, yet in noisy or crowded images, successful segmentation often necessitates knowing the digits beforehand. Traditional OCR systems frequently fail when digits touch or overlap. This research proposes a holistic recognition approach that leverages contextual clues to resolve such ambiguities.

Methodology

The proposed system utilizes a two-stage architecture designed to bypass the pitfalls of traditional segmentation.

Stage 1: Block Classification

Instead of isolating individual digits, the system processes a $32 \times 16$ pixel window containing a block of digits. This window is fed into a five-layer feed-forward network known as the Neural Abstraction Pyramid. This architecture is locally connected with weight sharing, similar to modern Convolutional Neural Networks (CNNs). The network is initialized via unsupervised learning to identify sparse features and subsequently fine-tuned using supervised gradient descent to produce a simultaneous classification for the primary digits.

Example of a digit block used for holistic classification.

Stage 2: Digit Recognition with Context

When the block classifier's confidence is low, a second stage is activated. This stage analyzes individual digits while incorporating context units—inputs representing the predicted identity of neighboring digits. This design exploits the fact that postage values follow standard rates; for instance, if one digit is identified as a '4', the likelihood of the next being a '6' is significantly higher. This mimics human cognitive processes where prior knowledge of a domain helps resolve visual uncertainty.

Datasets

The system was evaluated using a database of 5,471 Swedish Post meter marks. The data is highly non-uniform, reflecting real-world postal usage where a small number of standard rates dominate the distribution.

Swedish postage meter marks and the distribution of postage values in the dataset.

As shown in the distribution table, the 16 most frequent postage values account for 99.2% of the dataset. This non-uniformity provides a strong prior that the context-aware stage of the network can exploit.

Key Results

The hierarchical approach demonstrated superior performance over standard "flat" neural network architectures:

  • Accuracy: The combined system achieved an error rate of just 0.91% at a zero-reject rate, compared to a 3.18% error rate for the best flat network.
  • Reliability: By rejecting the most ambiguous 3.55% of images, the error rate was further reduced to 0.18%.
  • Robustness: The system successfully recognized visually mangled or faint samples that were difficult even for human observers to interpret.

Conclusion

By shifting from isolated digit recognition to a holistic, context-aware block classification, this research provides a powerful solution to the segmentation-recognition dilemma in postal automation. Future work will focus on improving performance for rare postage values and enhancing the initial localization of the region of interest to further minimize recognition errors.

Summary updated

BibTeX
@inproceedings{behnke2003meter,
  author = {Sven Behnke},
  title = {{Meter value recognition using locally connected hierarchical networks}},
  booktitle = {ESANN},
  year = {2003},
  url = {https://openreview.net/forum?id=BEcuMIDtmBA},
}
Figure