YOLO-S: A Lightweight and Accurate YOLO-like Network for Small Target Detection in Aerial Imagery

Alessandro Betti, Mauro Tucci2023 · DOI

Detecting objects in aerial imagery—captured by drones, helicopters, or satellites—is a notoriously difficult computer vision task. While standard deep learning models excel at identifying large, centered objects, they often stumble when tasked with finding a car that occupies only a handful of pixels against a cluttered landscape.

In the paper "A lightweight and accurate YOLO-like network for small target detection in Aerial Imagery," Alessandro Betti introduces YOLO-S, a streamlined architecture designed specifically to bridge the gap between high-speed performance and the precision required for "tiny" target detection on edge devices.

The Challenge of Aerial Detection

Most state-of-the-art object detectors (like YOLOv3 or Faster R-CNN) are designed for "natural" images where objects are relatively large and centered. In aerial imagery, three major challenges arise:

  1. Extreme Scale: Targets like vehicles or people are tiny, often lacking distinctive features at low resolutions.
  2. Cluttered Backgrounds: Roads, buildings, and vegetation create "confusing" objects that lead to high false-alarm rates.
  3. Hardware Constraints: Aerial platforms (UAVs/drones) often lack the massive GPU power required to run heavy models in real-time.

Existing "Tiny" variants of popular models often sacrifice too much accuracy to achieve speed, failing to capture the fine-grained spatial information necessary to locate a small vehicle from high altitudes.

The YOLO-S Architecture

YOLO-S is a lightweight, single-scale detection network built on three primary pillars:

  • Darknet20 Backbone: Instead of the massive Darknet53 used in YOLOv3, YOLO-S uses a smaller feature extractor. This drastically reduces the computational load (BFLOPs) and memory footprint.
  • Reshape-Passthrough Layer: Standard downsampling (like pooling) loses spatial resolution. The passthrough layer instead reshapes the feature map to preserve low-level positional information and merge it with high-level semantic data.
  • Single Fine-Grained Output Scale: Unlike standard YOLO models that detect at three different scales, YOLO-S focuses on a single $52 \times 52$ grid. This specialization makes the network more efficient at finding small objects without wasting cycles on scales where those objects wouldn't be visible.

Dataset Analysis and Transitional Learning

The research utilizes a mix of established and brand-new benchmarks, including AIRES (cAr detectIon fRom hElicopter imageS), VEDAI, and SARD (Search and Rescue).

Distribution of object sizes across the AIRES (a), VEDAI (b), and SARD (c) datasets, highlighting the prevalence of small targets.

A key innovation is the "Transitional Learning" strategy. The author found that jumping straight from general COCO features to specific aerial targets creates a "domain gap." By introducing a transitional task—training on the large-scale DOTAv2 and VEDAI datasets first—the model learns the "language" of aerial views before fine-tuning on the final target dataset.

Performance and Results

Quantitative results position YOLO-S as a highly cost-effective model for industrial use. On the AIRES dataset, YOLO-S achieved a 46.7% mAP, significantly outperforming YOLOv3 (40.1%) and dwarfing Tiny-YOLOv3 (13.9%).

Visual detection results of YOLO-S across various aerial scenarios, demonstrating high precision in cluttered environments.

Beyond accuracy, the model excels in efficiency:

  • Speed: It runs at approximately 25.6 FPS, making it 25-50% faster than the full YOLOv3.
  • Size: It boasts an 87% reduction in parameters compared to YOLOv3 and occupies only about 32MB, making it ideal for edge hardware with limited RAM.
  • Generalization: In SARD tests, it proved robust at finding humans in complex terrains like high grass or forests, where standard models often failed.

Conclusion and Future Work

YOLO-S demonstrates that specializing a network for small-scale detection and utilizing efficient feature reuse allows it to outperform much larger models in specialized aerial domains. While its single-scale nature is optimized for high-altitude contexts, future work will explore data quantization—compressing the model's math from 32-bit floats to 8-bit integers—to allow these models to run on the most basic micro-controllers found on budget drones.

Summary updated

BibTeX
@misc{betti2023yolo,
  author = {Alessandro Betti and Mauro Tucci},
  title = {{YOLO-S: A Lightweight and Accurate YOLO-like Network for Small Target Detection in Aerial Imagery}},
  year = {2023},
  doi = {10.3390/s23041865},
}
Figure