TL;DR
ClusDet (Clustered Detection) is a novel framework designed to solve the "needle in a haystack" problem of aerial object detection. By first predicting where objects are likely to cluster and then adaptively normalizing the scale of those regions, it significantly improves detection accuracy for tiny objects while drastically reducing redundant computation compared to traditional uniform tiling methods.
Introduction: The Challenge of Aerial Imagery
Detecting objects in aerial imagery, such as those captured by drones or satellites, presents unique challenges that standard object detectors struggle to overcome. The primary hurdles are:
- Extreme Scale Variation: Objects like pedestrians or vehicles often occupy only a few pixels. Detectors trained on standard datasets like COCO are not optimized for such minute scales.
- Sparsity and Non-uniformity: High-resolution aerial shots often contain vast areas of irrelevant background (e.g., rooftops, fields). Objects typically congregate in specific clusters, such as parking lots or sidewalks.
Traditional "brute force" methods involve dividing the image into a uniform grid of "chips." This approach is inefficient, as it processes many empty regions and can truncate objects that span grid boundaries.
Methodology: The ClusDet Framework
The authors propose ClusDet, an end-to-end pipeline that unifies clustering and detection. The architecture consists of three specialized sub-networks:
- Cluster Proposal Sub-network (CPNet): Instead of immediate object detection, CPNet identifies "cluster regions." It functions as a modified Region Proposal Network (RPN) with an expanded receptive field to locate high-density areas.
- Scale Estimation Sub-network (ScaleNet): After identifying a cluster, ScaleNet predicts the optimal scale for objects within that chip. Rather than simple resizing, it estimates a "scale offset" to bring objects into a size range where the detector is most effective.
- Dedicated Detection Network (DetecNet): This stage performs fine-grained detection on scale-normalized chips. Because these chips are dense with objects, the detector can more effectively distinguish targets from the background.
To refine the output, ClusDet employs Iterative Cluster Merging (ICM) to manage overlapping proposals and a Local-Global Fusion strategy, combining high-resolution cluster detections with a low-resolution global pass.
Key Insights
- Clustering as a Computational Filter: Grid-based partitioning results in over 73% "sparse" chips. ClusDet increases the density of "clustered" chips by 7x, focusing computational resources on object-rich areas.
- Scale Normalization: Simply increasing resolution is insufficient. ScaleNet acts as an "adaptive zoom," standardizing object sizes to match the detector's learned anchors.
- Contextual Advantage: By focusing on clusters, the model implicitly leverages environmental context (e.g., cars on roads), reducing false positives in unlikely locations like tree canopies.
Results and Evaluation
ClusDet was evaluated on major aerial benchmarks, including VisDrone, UAVDT, and DOTA.
- Accuracy: On VisDrone, ClusDet achieved an Average Precision (AP) of 28.4%, outperforming standard Faster R-CNN (21.4%) and uniform tiling methods (24.4%).
- Efficiency: The framework required approximately 40% fewer image forwards than grid-based methods while achieving higher accuracy.
- Small Object Detection: The most significant gains were in the $AP_s$ metric, showing nearly a 2x improvement over baseline models.
Conclusion
ClusDet effectively addresses the inefficiencies of aerial object detection by prioritizing object clusters and adaptive scaling. While it excels at detecting grouped objects, future work may focus on better handling isolated objects and integrating temporal data from video streams to further enhance stability in dynamic environments.
Summary updated