I-YOLOv11n: A Lightweight and Efficient Small Target Detection Framework for UAV Aerial Images

Yukai Ma, Caiping Xi, Ting Ma, Han Xu Sun, Hongyu Lu, Xiang Xu, Xu ChenSensors 2025 · DOI

TL;DR

This paper introduces I-YOLOv11n, a novel lightweight object detection framework specifically designed for small targets in UAV aerial imagery. By enhancing feature representation, optimizing the detection head, and employing a multi-stage lightweighting strategy, it achieves superior accuracy and efficiency compared to existing methods, making it highly suitable for resource-constrained drone platforms.

What Problem Does This Paper Address?

Detecting small objects in aerial images captured by Unmanned Aerial Vehicles (UAVs) is a critical but challenging task. UAVs operate under constraints like limited computational power, varying illumination, and complex backgrounds, which can obscure small targets. Existing object detection algorithms often struggle with:

  • Weak small target representation: Subtle features of small objects get lost during downsampling and convolution.
  • High computational overhead: Many powerful models are too resource-intensive for real-time deployment on drones.
  • Poor adaptability: Fixed receptive fields and rigid structures limit their ability to handle the diverse scales and dynamic environments encountered in aerial imaging.

This paper aims to bridge this gap by developing a detection system that is both accurate for small targets and efficient enough for practical UAV deployment.

Methods

The I-YOLOv11n framework builds upon the YOLOv11n architecture and introduces several key innovations:

  • RFCBAMConv Module: This module enhances feature extraction by combining deformable convolution (to dynamically adjust receptive fields) with channel and spatial attention mechanisms. This helps in better capturing edge and texture details of small objects.
  • DFPC and STCMSP Modules: The DFPC (Dilated Feature Pyramid Convolution) module replaces the SPPF layer to expand the receptive field using dilated convolutions with varying expansion rates, improving multiscale context awareness. The STCMSP (Small Target Contextual Multiscale Pyramid) module further fuses features across different scales and levels, enhancing semantic understanding.
  • Transformer-DyHead Detection Head: A hybrid Transformer-DyHead detection head is designed. It integrates a three-dimensional attention mechanism (scale, spatial, and task awareness) with a lightweight Transformer submodule. This allows for more robust localization and classification, especially in complex scenes.
  • Three-Stage Lightweight Strategy:
    1. Hybrid Knowledge Distillation: A "teacher-student" approach where a larger, unpruned YOLOv11n model transfers its knowledge (response alignment, feature imitation, structure maintenance) to the lightweight student model.
  • LAMP-Taylor Pruning: A channel pruning mechanism that uses a mixed score of weight amplitude (LAMP) and gradient significance (Taylor) to selectively remove redundant channels while preserving critical ones for small target detection.
  • K-means++ Anchor Optimization: An anchor box clustering method based on IoU distance is used to generate anchor boxes that are better suited to the specific scale distribution of small targets in UAV imagery.

Datasets

The proposed I-YOLOv11n model was evaluated on three challenging public aerial image datasets:

  • VisDrone2019: Features dense small objects in urban environments with imbalanced category distribution.
  • AI-TOD: Focuses on microscopic object detection with a high proportion of extremely small targets (<16x16 pixels) and high-resolution imagery.
  • SODA-A: A large-scale dataset for remote sensing with multi-seasonal variations, multi-sensor sources, and frequent occlusions, designed to test cross-scenario transferability.

Key Insights and Ideas

  • Deformable convolution is key for small targets: Dynamically adjusting the receptive field allows the model to better focus on the subtle features of small objects, which are often lost with fixed convolutional kernels.
  • Multiscale fusion is crucial for context: Combining features from different scales and levels (via DFPC and STCMSP) helps in understanding the context around small targets, especially in cluttered backgrounds.
  • Attention mechanisms are powerful for localization: The three-dimensional attention in the DyHead module significantly improves the model's ability to pinpoint small targets accurately, even with scale variations and background noise.
  • A multi-pronged lightweighting approach is effective: Combining knowledge distillation, structured pruning, and anchor optimization is more effective than any single method for achieving both accuracy and efficiency.
  • Anchor box optimization matters for UAVs: Standard anchor boxes trained on general datasets don't perform well for UAVs; custom anchor boxes tailored to UAV data are essential for improved performance.

Key Results

  • Accuracy Improvement: I-YOLOv11n achieved a [email protected] of 40.1% and [email protected]:0.95 of 24.1% on the VisDrone dataset, outperforming the baseline YOLOv11n by 7.1% and 4.9% respectively. It also showed significant improvements on AI-TOD and SODA-A.
  • Efficiency Gains: The model is remarkably lightweight, with only 3.87M parameters and 14.7 GFLOPs. This is a significant reduction compared to many other state-of-the-art detectors.
  • Real-time Performance: The model achieves 92 FPS on a high-performance NVIDIA RTX 4090 GPU and 24 FPS on an embedded Jetson TX2 platform, meeting real-time requirements for UAV deployment.
  • Robustness: Demonstrated improved performance in challenging scenarios like high-density targets, low light, complex backgrounds, occlusion, and fog. It showed an 8.3% and 6.6% improvement in detecting targets smaller than 16x16 pixels compared to YOLOv5s and Swin-T, respectively.

Limitations and Future Work

  • Teacher Model Bottleneck: The performance of the hybrid knowledge distillation is still limited by the capabilities of the teacher model, particularly in handling occlusion and achieving extremely high real-time performance.
  • Pruning Granularity: The pruning strategy needs further optimization to strike a better balance between pruning rate and accuracy loss, especially for protecting key channels sensitive to small targets.
  • Future Work: The authors suggest focusing on enhancing model robustness in complex environments (low illumination, occlusion, multi-target interference) and providing efficient and reliable technical support for visual perception in resource-constrained unmanned systems.

Summary updated

Abstract

UAV small target detection in urban security, disaster monitoring, agricultural inspection, and other fields faces the challenge of increasing accuracy and real-time requirements. However, existing detection algorithms still have weak small target representation ability, extensive computational resource overhead, and poor deployment adaptability. Therefore, this paper proposes a lightweight algorithm, I-YOLOv11n, based on YOLOv11n, which is systematically improved in terms of both feature enhancement and structure compression. The RFCBAMConv module that combines deformable convolution and channel-spatial attention is designed to adjust the receptive field and strengthen the edge features dynamically. The multiscale pyramid of STCMSP context and the lightweight Transformer-DyHead hybrid detection head are designed by combining the multiscale hole feature pyramid (DFPC), which realizes the cross-scale semantic modeling and adaptive focusing of the target area. A collaborative lightweight strategy is proposed. Firstly, the semantic discrimination ability of the teacher model for small targets is transferred to guide and protect the subsequent compression process by integrating the mixed knowledge distillation of response alignment, feature imitation, and structure maintenance. Secondly, the LAMP-Taylor channel pruning mechanism is used to compress the model redundancy, mainly to protect the key channels sensitive to shallow small targets. Finally, K-means++ anchor frame optimization based on IoU distance is implemented to adapt the feature structure retained after pruning and the scale distribution of small targets of UAV. While significantly reducing the model size (parameter 3.87 M, calculation 14.7 GFLOPs), the detection accuracy of small targets is effectively maintained and improved. Experiments on VisDrone, AI-TOD, and SODA-A datasets show that the [email protected] and [email protected]:0.95 of I-YOLOv11n are 7.1% and 4.9% higher than the benchmark model YOLOv11 n, respectively, while maintaining real-time processing capabilities, verifying its comprehensive advantages in accuracy, light weight, and deployment.
BibTeX
@inproceedings{ma2025i,
  author = {Yukai Ma and Caiping Xi and Ting Ma and Han Xu Sun and Hongyu Lu and Xiang Xu and Xu Chen},
  title = {{I-YOLOv11n: A Lightweight and Efficient Small Target Detection Framework for UAV Aerial Images}},
  booktitle = {Sensors},
  year = {2025},
  doi = {10.3390/s25154857},
}
Figure