EFLNet: Enhancing Feature Learning for Infrared Small Target Detection

Bo Yang, Xinyu Zhang, Jiahao Zhu, Jian Zhang, Dongjian Tian, Jun Luo, Mingliang Zhou, Yangjun Pi

Abstract

Single-frame infrared small target detection (ISTD) is a critical yet challenging task characterized by extreme class imbalance, high sensitivity in bounding box regression, and the potential for target information loss in deep semantic layers. This paper presents the Enhancing Feature Learning Network (EFLNet), a framework specifically engineered to mitigate these issues. EFLNet introduces three primary innovations: an Adaptive Threshold Focal Loss (ATFL) to balance target-background attention, the Normalized Gaussian Wasserstein Distance (NWD) to stabilize regression for tiny objects, and a Dynamic Head mechanism for multi-scale feature integration. Experimental results across multiple benchmarks demonstrate that EFLNet outperforms existing state-of-the-art (SOTA) methods in detection accuracy and robustness.

Introduction

The detection of small targets in infrared (IR) imagery—such as distant aircraft or maritime vessels—is often described as finding a "needle in a haystack." These targets typically occupy a minuscule fraction of the total pixels and are frequently embedded in high-clutter environments involving clouds, sea-glint, or sensor noise.

Traditional approaches often treat ISTD as a semantic segmentation problem. However, segmentation-based methods can be computationally intensive and may not always provide the localization precision required for real-time tracking. EFLNet approaches ISTD as an object detection task, addressing the inherent mathematical instabilities that arise when applying standard detection frameworks to extremely small objects.

Core Challenges in Infrared Detection

The transition from segmentation to detection introduces three significant hurdles:

  1. Extreme Class Imbalance: Because targets are so small, the background dominates the feature space, causing standard models to neglect target-specific features.
  2. IoU Sensitivity: The standard Intersection over Union (IoU) metric is highly sensitive to small displacements. For a target only a few pixels wide, a minor prediction error can result in a zero IoU, providing no gradient for the model to learn from.
  3. Feature Dissipation: As data passes through successive downsampling layers in a deep neural network, the high-level semantic layers often lose the fine-grained spatial information necessary to identify a tiny target.

The EFLNet Framework

To overcome these obstacles, EFLNet incorporates three specialized components:

1. Adaptive Threshold Focal Loss (ATFL)

Standard Focal Loss treats all samples on a single continuum. ATFL improves upon this by "decoupling" the target and background. It utilizes a probability threshold (typically 0.5) to distinguish between easy background samples and difficult targets. An adaptive mechanism then adjusts the loss weights, forcing the network to allocate more attention to learning the features of dim or obscured targets that would otherwise be ignored.

2. Normalized Gaussian Wasserstein Distance (NWD)

To solve the "brittleness" of IoU, the authors replace it with NWD for bounding box regression. By modeling bounding boxes as 2D Gaussian distributions, the similarity between the predicted box and the ground truth is calculated via the Wasserstein distance. This approach creates a smooth, continuous gradient even when there is no physical overlap between boxes, significantly improving convergence during training for small targets.

3. Dynamic Head Mechanism

To prevent the loss of target information in deep layers, EFLNet employs a Dynamic Head. This component applies three levels of attention:

  • Scale-aware: Determines the relative importance of different feature pyramid layers.
  • Spatial-aware: Focuses the model on specific regions of interest within the frame.
  • Task-aware: Dynamically weights different feature channels to optimize for detection.

Experimental Evaluation

The researchers evaluated EFLNet on three benchmark datasets: NUAA-SIRST, NUDT-SIRST, and IRSTD-1k. To facilitate this research, the authors provided bounding box annotations for these datasets, which were previously limited to pixel-level masks.

EFLNet demonstrated superior performance compared to SOTA methods such as MDvsFA, ACMNet, and DNANet. On the NUDT-SIRST dataset, EFLNet achieved an F1-score of 0.947, a notable improvement over DNANet’s 0.901. On the IRSTD-1k dataset, the model maintained high precision (0.870) and recall (0.817), proving its robustness in cluttered environments like sea-sky lines and heavy cloud cover.

Conclusion

EFLNet represents a significant advancement in infrared small target detection by shifting the paradigm toward distribution-based regression and adaptive loss weighting. While the inclusion of the Dynamic Head and NWD increases computational complexity (approximately 38M parameters), the gains in detection reliability make it a compelling solution for high-stakes infrared monitoring systems.

The source code and annotated datasets are available at: https://github.com/YangBo0411/infrared-small-target

Summary updated

Abstract

Single-frame infrared small target detection is considered to be a challenging task, due to the extreme imbalance between target and background, bounding box regression is extremely sensitive to infrared small target, and target information is easy to lose in the high-level semantic layer. In this article, we propose an enhancing feature learning network (EFLNet) to address these problems. First, we notice that there is an extremely imbalance between the target and the background in the infrared image, which makes the model pay more attention to the background features rather than target features. To address this problem, we propose a new adaptive threshold focal loss (ATFL) function that decouples the target and the background, and utilizes the adaptive mechanism to adjust the loss weight to force the model to allocate more attention to target features. Second, we introduce the normalized Gaussian Wasserstein distance (NWD) to alleviate the difficulty of convergence caused by the extreme sensitivity of the bounding box regression to infrared small target. Finally, we incorporate a dynamic head mechanism into the network to enable adaptive learning of the relative importance of each semantic layer. Experimental results demonstrate our method can achieve better performance in the detection performance of infrared small target compared to the state-of-the-art (SOTA) deep-learning-based methods. The source codes and bounding box annotated datasets are available at https://github.com/YangBo0411/infrared-small-target.
BibTeX
@article{yang2024eflnet,
  author = {Bo Yang and Xinyu Zhang and Jiahao Zhu and Jian Zhang and Dongjian Tian and Jun Luo and Mingliang Zhou and Yangjun Pi},
  title = {{EFLNet: Enhancing Feature Learning for Infrared Small Target Detection}},
  journal = {IEEE Trans. Geosci. Remote. Sens.},
  year = {2024},
  url = {https://openreview.net/forum?id=tJHyWIxe6L},
}
Figure