Abstract
Convolutional Neural Networks (ConvNets) are the standard for computer vision, yet their architectural priors—locality and stationarity—may impose significant limitations. This study demonstrates that ConvNets possess inherent "blindspots," remaining oblivious to simple, perfectly predictive signals that traditional, "weaker" models like Decision Trees or Shallow Perceptrons can easily exploit. We show that while a ResNet-56 maintains baseline performance, simpler models achieve 100% accuracy when presented with these injected signals.
Introduction
We often view ConvNets as universal function approximators that eventually converge on the most efficient solution given sufficient depth and data. However, ConvNets are not blank slates; they are built on specific inductive biases, primarily locality (pixels near each other are related) and stationarity (features like "eyes" look the same regardless of location). This research investigates whether these strengths are also fundamental weaknesses, identifying types of information that remain "invisible" to state-of-the-art deep learning architectures while being easily recognizable by simpler models.
Methods
The study employs a "competitive analysis" framework. Standard datasets, such as CIFAR-10 for vision and Yelp/Amazon reviews for text, are modified by injecting "truth-revealing signals"—subtle, perfectly predictive modifications that encode the class label. If a model can "see" the signal, it should achieve near-perfect accuracy.
The signals tested include:
- Low-dimensional signals: Encoding labels in a single pixel or a fixed pattern of pixels.
- Global signals: Adding class-specific orthogonal noise vectors or encoding labels in the image's mean value.
- Moving targets: Encoding labels in a pixel whose location varies randomly per image.
A ResNet-56 was compared against traditional models including Decision Trees, Random Forests, Naive Bayes, and Shallow Neural Networks.
Results and Analysis
The quantitative results reveal a massive gap between the "blind" ConvNet and "seeing" traditional models. While the ResNet-56 remained at its baseline accuracy of 84.9% across all injected signal types, simpler models reached near-perfection.
| Truth Signal (CIFAR-10) | ConvNet Accuracy | Best Traditional Model | Accuracy |
|---|---|---|---|
| Clean Data (Baseline) | 84.9% | - | - |
| One Pixel | 84.9% | Decision Tree | 100% |
| Pattern Pixels | 84.9% | Decision Tree | 100% |
| Noise Encoding | 84.9% | Perceptron | 100% |
| Mean Encoding | 84.9% | Shallow NN | 100% |
| Multiple Locations | 84.9% | QDA | 98.4% |
The Smoothing Trap and Locality Bias
The failure of ConvNets to utilize these signals stems from their core operations. Convolutions and pooling aggregate information, which effectively "washes out" low-dimensional data. A single "magic pixel" is treated as noise and averaged away by the network's layers. Furthermore, the focus on local spatial patches prevents the capture of global statistical properties, such as the mean of all pixels or distributed noise signals, unless the architecture is explicitly modified to account for them.
The Paradox of Complexity
In a striking reversal of the typical performance hierarchy, a 1-layer Perceptron outperformed a 56-layer ResNet. Simpler models, having fewer architectural priors about data structure, are free to latch onto mathematical "cheat codes." Conversely, the ResNet's invariance to shifts and scales—usually a benefit—becomes a hindrance when the critical information is encoded within those very properties.
Conclusion
While the signals used in this study are artificial, they represent extreme cases of real-world phenomena like sensor noise or global artifacts from photography equipment. This work highlights the need for architectural awareness; we must ensure that the inductive biases we bake into deep learning models do not inadvertently discard valuable information. Future work should explore architectural modifications, such as global skip connections or hybrid models, to mitigate these blindspots without losing the benefits of convolutions.
Summary updated