Abstract
Crowd counting in congested scenes is a significant challenge due to extreme scale variations within and across images. While multi-scale feature fusion is a common approach, standard methods often fail to effectively combine features for highly congested environments. This paper introduces a novel architecture featuring Multi-Level Bottom-Top and Top-Bottom Fusion (MBTTBF) and Scale Complementary Feature Extraction Blocks (SCFB). By leveraging bidirectional information flow and cross-scale residual functions, the proposed network efficiently integrates spatial details and semantic context. Experimental results on ShanghaiTech, UCF_CC_50, and UCF-QNRF datasets demonstrate state-of-the-art performance.
Introduction
Estimating the number of people in congested scenes—such as marathons, protests, or festivals—is a critical task for public safety and urban planning. The primary difficulty lies in scale variation: a single image may contain individuals ranging from a few pixels to hundreds of pixels in size. Standard Convolutional Neural Networks (CNNs) struggle with this; shallow layers preserve spatial resolution but lack semantic context, while deeper layers capture high-level concepts but lose fine-grained detail. Previous attempts to bridge this gap via simple feature concatenation often fail to capture the complementary information necessary for precise counting in dense crowds.
Methodology
Multi-Level Bidirectional Fusion (MBTTBF)
The core innovation is the Multi-Level Bottom-Top and Top-Bottom Fusion (MBTTBF) scheme. Unlike traditional one-way fusion, this architecture employs a bidirectional hierarchy. The "bottom-top" path propagates fine-grained spatial details from shallower layers to deeper ones, while the "top-bottom" path sends semantic context back down to help shallower layers suppress background noise (e.g., trees or buildings that resemble heads).
Scale Complementary Feature Extraction Blocks (SCFB)
To make the fusion more effective, the authors introduce SCFB. These blocks utilize cross-scale residual functions to explicitly force the network to learn features that are missing or complementary between adjacent layers. This reduces redundancy and ensures that the fused features provide a more comprehensive representation of the crowd at various scales.
Scale-Aware Supervision
To improve training, the researchers developed a principled way to generate ground-truth density maps. Using a Markov Random Field (MRF) framework combined with superpixel segmentation, they estimate head sizes more accurately than standard nearest-neighbor heuristics. This provides a cleaner supervision signal, allowing the network to better learn scale-aware features.
Results and Discussion
The proposed MBTTBF-SCFB model was evaluated on several challenging benchmarks:
- UCF-QNRF: Achieved a Mean Absolute Error (MAE) of 97.5, significantly outperforming previous state-of-the-art methods like CAN (107.0).
- ShanghaiTech Part A: Reached an MAE of 60.2, surpassing established models such as CSRNet (68.2) and SANet (67.0).
- Qualitative Performance: Visualizations indicate that the model produces cleaner density maps with fewer false positives in background areas compared to traditional fusion methods.
Conclusion
By rethinking how multi-scale features are fused, this work establishes a new standard for crowd counting in congested scenes. The combination of bidirectional multi-level fusion and scale-complementary blocks allows the network to effectively handle the extreme scale variations inherent in dense crowds. Future research may focus on optimizing the computational efficiency of these complex fusion paths for real-time deployment.
Summary updated