Overview
Crowd counting is a critical tool for urban management and public safety. However, environmental factors like heavy fog significantly degrade the performance of standard computer vision models. This paper introduces the Foggy Crowd Counting Network (FCCN), a novel framework that blends the laws of physics with cutting-edge neural architectures to maintain high accuracy in adverse weather. FCCN achieves a 12.2% to 27.5% reduction in Mean Absolute Error (MAE) compared to current state-of-the-art methods in dense fog scenarios.
The Challenge of Foggy Environments
Fog introduces three major hurdles for traditional crowd-counting systems:
- Non-uniform Attenuation: Fog does not blur an image evenly; it depends on the depth of field, meaning distant objects are more obscured than near ones.
- Feature Degradation: Standard convolutional neural networks (CNNs) struggle to extract meaningful patterns from low-contrast, blurry regions.
- Loss of Spatial Context: When fog hides the "connective tissue" of a scene, models lose the ability to understand how different parts of a crowd relate to one another.
Existing models often treat fog as simple noise, but FCCN argues for modeling the physical process of light scattering to effectively "see" through the haze.
Methodology
The FCCN framework consists of three synergistic modules designed to handle atmospheric degradation:
- Physics-Guided Module: Instead of simple pre-processing, this module uses a differentiable version of Koschmieder’s atmospheric scattering theory. It estimates transmittance and atmospheric light to restore a "dehazed" version of the scene, using a U-Net for refinement and guided filtering to preserve sharp edges.
- Multi-Scale Adaptive Kolmogorov-Arnold Network (MSA-KAN): Departing from standard CNNs, KANs use learnable activation functions (B-splines) on their edges rather than fixed functions on nodes. This three-layer progressive KAN is significantly better at fitting the complex, non-linear patterns found in degraded, foggy features.
- Weather-Aware Graph Convolutional Network (GCN): To handle spatial relationships, the model treats image regions as nodes in a graph. It dynamically builds an adjacency matrix that adjusts based on fog density, allowing the network to transfer information from high-visibility regions to low-visibility ones.
Experimental Setup and Datasets
The authors evaluated FCCN on four major public crowd-counting datasets: ShanghaiTech A, UCF-QNRF, JHU-Crowd++, and NWPU-CROWD. Because these datasets are typically clear, the authors constructed a hierarchical haze benchmark by systematically synthesizing four levels of fog (from "no haze" to "severe haze") using physical scattering equations.
Key Results and Insights
FCCN consistently outperformed eight other state-of-the-art methods (including SFCN, BL, and MAN) across all datasets and fog levels.
- Accuracy and Robustness: In moderate haze, FCCN achieved an MAE of 85.8, significantly lower than the next best model, AWCC-Net (96.3). While traditional models saw error rates surge by over 35% when fog density doubled, FCCN’s error only increased by 22%.
- KANs over CNNs: KAN layers reduced feature confusion in dense fog by 31% compared to traditional convolutional layers. Their ability to learn flexible mappings makes them uniquely suited for reconstructing details in blurry regions.
- Joint Optimization: By integrating physics into the training loop rather than using it as a pre-processor, FCCN prevents the dehazing process from accidentally smoothing out tiny, distant human heads that are crucial for an accurate count.
Conclusion and Future Work
FCCN demonstrates that combining physical priors with flexible neural architectures like KANs and GCNs provides a robust solution for crowd counting in challenging weather. While the results are impressive, future work may focus on adapting the model to real-world fog variations (like smog or steam) and optimizing the computational complexity of KANs for real-time deployment. The authors suggest this approach could be extended to other adverse conditions, such as heavy rain or nighttime glare.
Summary updated