IrisNet: Infrared Image Status Awareness Meta Decoder for Infrared Small Targets Detection

Xuelin Qian, Jiaming Lu, Zixuan Wang, Wenxuan Wang, Zhongling Huang, Dingwen Zhang, Junwei HanarXiv 2025 · DOI · arXiv

Introduction

Detecting small, dim targets in infrared (IR) imagery remains a significant challenge in computer vision. These targets often lack distinct textures and are frequently obscured by complex backgrounds or sensor noise. Traditional deep learning approaches typically employ static models with fixed weights, which often struggle to generalize across the diverse environmental "statuses" encountered in real-world IR applications.

The Challenge of Pattern Drift

A primary obstacle in infrared small target detection (IRSTD) is pattern drift. Infrared images vary significantly depending on the scene—for instance, a target against a clear sky presents a high-contrast signature, whereas the same target against a cluttered ground background may be nearly indistinguishable.

Research indicates that static models trained on mixed datasets often suffer an 8–12% drop in Intersection over Union (IoU) when tested on specific, challenging scenarios. This suggests that a single set of weights is insufficient to handle the varying statistical properties of different IR environments. IrisNet aims to solve this by making the detection strategy as dynamic as the environment itself.

Motivation for IrisNet: (a) Visual differences in IR backgrounds, (b) performance drop due to pattern drift, and (c) feature separation between ground and sky statuses.

Proposed Method: IrisNet

To address pattern drift, the researchers developed IrisNet, a framework that utilizes meta-learning to generate a custom detector for every input image. Unlike static networks, IrisNet adapts its decoding strategy on-the-fly based on the specific "status" of the scene.

Meta-Learned Decoding Paradigm

The core of IrisNet is its dynamic weight generation mechanism:

  1. Image-to-Decoder Transformer: This component acts as the system's "brain," mapping image features to learnable tokens via cross-attention. These tokens are then projected into the parameter space of the decoder.
  2. Structured 2D Parameter Tensor: To manage the computational complexity of predicting neural network weights, IrisNet represents decoder parameters as a structured 2D tensor, preserving hierarchical relationships while maintaining efficiency.
  3. Frequency-Assisted Encoder: The encoder incorporates a high-pass filter using Fast Fourier Transform (FFT) to highlight edges and point-like targets, enhancing the model's awareness of small objects.
  4. Multi-kernel Aggregation Block (MKAB): Parallel convolutional paths with varying kernel sizes allow the encoder to capture context across multiple scales.
The IrisNet architecture, featuring the Image-to-Decoder Transformer and the Meta Decoder for dynamic weight generation.

Experimental Results

IrisNet was evaluated on three major IRSTD benchmarks: NUDT-SIRST, NUAA-SIRST, and IRSTD-1K. The model consistently outperformed nearly 20 state-of-the-art methods, including both CNN and Transformer-based architectures.

  • Accuracy: IrisNet achieved an IoU of 72.08% on IRSTD-1K and 95.74% on NUDT-SIRST.
  • False Alarm Suppression: On the NUDT-SIRST dataset, the model reached a False Alarm Rate ($F_a$) of 0.367, significantly lower than competing models (often by a factor of 10).
  • Adaptability: Ablation studies confirmed that the meta-decoder alone provided a ~2% IoU boost over a static baseline, proving that dynamic adaptability is a crucial factor in detection performance.

Conclusion

IrisNet represents a shift toward "status-aware" computer vision. By treating the decoder as a dynamic function of the input image, the framework effectively mitigates the performance degradation caused by pattern drift. While the computational overhead of weight generation remains a consideration for real-time systems, the results demonstrate that adaptive filters are significantly better at suppressing background clutter and identifying elusive targets.

Summary updated

Abstract

Infrared Small Target Detection (IRSTD) faces significant challenges due to low signal-to-noise ratios, complex backgrounds, and the absence of discernible target features. While deep learning-based encoder-decoder frameworks have advanced the field, their static pattern learning suffers from pattern drift across diverse scenarios (\emph{e.g.}, day/night variations, sky/maritime/ground domains), limiting robustness. To address this, we propose IrisNet, a novel meta-learned framework that dynamically adapts detection strategies to the input infrared image status. Our approach establishes a dynamic mapping between infrared image features and entire decoder parameters via an image-to-decoder transformer. More concretely, we represent the parameterized decoder as a structured 2D tensor preserving hierarchical layer correlations and enable the transformer to model inter-layer dependencies through self-attention while generating adaptive decoding patterns via cross-attention. To further enhance the perception ability of infrared images, we integrate high-frequency components to supplement target-position and scene-edge information. Experiments on NUDT-SIRST, NUAA-SIRST, and IRSTD-1K datasets demonstrate the superiority of our IrisNet, achieving state-of-the-art performance.
BibTeX
@misc{qian2025irisnet,
  author = {Xuelin Qian and Jiaming Lu and Zixuan Wang and Wenxuan Wang and Zhongling Huang and Dingwen Zhang and Junwei Han},
  title = {{IrisNet: Infrared Image Status Awareness Meta Decoder for Infrared Small Targets Detection}},
  year = {2025},
  eprint = {2511.20319},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2511.20319},
}
Figure