MomentsNet: A simple learning-free method for binary image recognition

Jiasong Wu, Shijie Qiu, Youyong Kong, Yang Chen, Lotfi Senhadji, Huazhong Shu

Abstract

MomentsNet is a "learning-free" deep convolutional framework designed for binary image recognition. By replacing the data-driven filters of traditional CNNs with fixed mathematical moment kernels (e.g., Zernike or Legendre moments), it eliminates the need for backpropagation and PCA training. Experimental results demonstrate that MomentsNet achieves superior accuracy on binary image tasks, outperforming learning-based models like PCANet while maintaining computational efficiency.

Introduction

Deep learning, particularly Convolutional Neural Networks (CNNs), has revolutionized image recognition. However, the standard approach relies heavily on backpropagation, which is computationally expensive and requires massive amounts of labeled data. To simplify this, researchers previously developed PCANet, which uses Principal Component Analysis to learn filters without backpropagation. While lighter than a full CNN, PCANet still requires a training phase.

MomentsNet addresses this by asking: Can we skip the learning phase entirely? For binary images—such as silhouettes or logos—rotation invariance is crucial. The authors propose using classical mathematical "moments" as fixed, deterministic filters in a deep architecture.

Methodology

MomentsNet is a multi-stage architecture that mimics the structure of a CNN but replaces learned weights with predefined mathematical kernels.

  1. Convolution Layer (The "Moments" Stage): The network uses kernels from 12 different types of moments (e.g., Geometric, Zernike, Legendre, Tchebichef). These kernels capture specific geometric properties.
  2. Nonlinear Processing (Binary Hashing): The convolution output is binarized using a modified Heaviside function with a tunable threshold $t$.
  3. Pooling Layer (Block-wise Histogram): Binary strings are converted into decimal values, and the network computes histograms across local blocks to build a final feature vector.
  4. Classification: Features are fed into a standard Linear Support Vector Machine (SVM).
The multi-stage MomentsNet architecture, showing the cascading of moment-based feature extraction, binarization, and histogram pooling.

Experimental Setup

The model was evaluated on a Binary Image Database consisting of 9 classes (bird, camel, children, elephant, fork, hammer, key, ray, and turtle), totaling 1,296 images. To test rotation invariance, each image was rotated from 0° to 330° in 30° increments. All images were preprocessed to a 32×32 pixel scale.

Key Insights

The Power of Zernike Moments

Among the 12 moment types tested, ZernikeNet consistently performed the best. Zernike moments are defined on a unit disc and are mathematically robust against rotation, making them ideal for shape recognition.

Architecture vs. Raw Math

MomentsNet significantly outperformed raw moments used in isolation. For instance, raw Zernike moments achieved ~81.8% accuracy, but within the MomentsNet-2 architecture, accuracy jumped to 97.69%. This demonstrates that cascading, binarization, and histogram pooling add significant discriminative power to classical descriptors.

The "Density" Heuristic for Thresholding

A critical finding was the relationship between the binarization threshold $t$ and performance. The optimal threshold typically results in a feature map where roughly 40% to 50% of the pixels are "1"s. This provides a practical heuristic for tuning the model without exhaustive searching.

Impact of the binarization threshold on recognition accuracy (a) and the resulting density of binary features (b).

Results

  • Top Performance: ZernikeNet-2 achieved the highest accuracy at 97.69%, surpassing PCANet (94.60%).
  • Efficiency: Zero time is spent training the feature extractor, as filters are fixed mathematical functions.
  • Robustness: The model showed stability across different patch sizes and filter counts, peaking at specific configurations (e.g., 10 filters, 11×11 patch size for ZernikeNet).

Conclusion

While MomentsNet is highly effective for binary images, its scalability to complex, high-texture color images remains an open question. Future work could involve automated selection of moment kernels and testing on larger silhouette datasets like MPEG-7.

Summary updated

BibTeX
@inproceedings{wu2017momentsnet,
  author = {Jiasong Wu and Shijie Qiu and Youyong Kong and Yang Chen and Lotfi Senhadji and Huazhong Shu},
  title = {{MomentsNet: A simple learning-free method for binary image recognition}},
  booktitle = {ICIP},
  year = {2017},
  url = {https://openreview.net/forum?id=b9AWaR4RuGsh},
}
Figure