Hybrid attention and bidirectional-gated network for hyperspectral image change detection

Xiangtan Li, Feng Gao, Yue Sun, Junyu DongJournal of Image and Graphics 2024 · DOI

Abstract

Hyperspectral images (HSIs) provide rich spectral and spatial information, yet their utility in change detection is often hampered by complex noise and the inherent trade-off between local detail and global context. To address these challenges, this paper introduces HBFormer, a novel Transformer-based architecture. HBFormer integrates a Hybrid Attention Module (HAM) and a Bidirectional-Gated Feed-Forward Network (BGFN). The HAM utilizes parallel CNN and gMLP branches to extract local and global features simultaneously, effectively suppressing noise. Meanwhile, the BGFN enhances feature fusion across spatial and channel dimensions. Experimental results on three benchmark datasets demonstrate that HBFormer significantly outperforms mainstream models like BiT and CBANet, achieving superior accuracy and robustness in complex environments.

Introduction

Change detection in hyperspectral remote sensing involves identifying transitions in land cover between two timestamps. While HSIs offer hundreds of narrow spectral bands, they are susceptible to Gaussian and striping noise. Traditional Convolutional Neural Networks (CNNs) excel at capturing local spatial details but struggle with global context. Conversely, standard Transformers capture long-range dependencies but are sensitive to noise and may overlook fine-grained details. HBFormer is designed to bridge this gap by processing local and global information in parallel, preventing noise from polluting the global feature extraction process.

The HBFormer Architecture

The HBFormer model is structured into two main stages, each containing specialized blocks designed to balance feature extraction. The core innovations are the Hybrid Attention Module (HAM) and the Bidirectional-Gated Feed-Forward Network (BGFN).

The overall architecture of HBFormer, illustrating the two-stage process and the internal components of the HBFormer block, including the parallel HAM branches and the gated BGFN.

Hybrid Attention Module (HAM)

Unlike standard self-attention, HAM employs a parallel structure:

  • CNN Branch: Utilizes a bottleneck structure with Squeeze-and-Excitation (SE) blocks to focus on local spatial details and suppress high-frequency noise.
  • gMLP Branch: Employs a gated Multi-Layer Perceptron to capture long-range dependencies and global context. By running these branches in parallel, the model ensures that local details do not compromise global relationships, and vice versa.

Bidirectional-Gated Feed-Forward Network (BGFN)

Replacing the standard FFN, the BGFN introduces two independent gating paths for spatial and channel dimensions. This allows the network to selectively emphasize informative spectral bands and spatial regions while filtering out irrelevant sensor noise.

Experimental Evaluation

The model was evaluated on three EO-1 Hyperion datasets: River, Farmland, and Hermiston. HBFormer consistently achieved the highest Percentage Correct Classification (PCC) and Kappa Coefficients (KC) across all tests.

Accuracy performance (PCC) of the HBFormer model across different patch sizes for the three benchmark datasets, showing stable and high performance.

Key Results

  • Farmland Dataset: HBFormer reached a 98.40% PCC, improving the Kappa coefficient by 2.02% over the BiT model. It proved particularly effective at identifying small, dense change areas like narrow farm paths.
  • Hermiston Dataset: The model achieved 96.48% PCC, significantly reducing false positives compared to CBANet by effectively managing the complex noise inherent in irrigated agricultural data.
  • River Dataset: Achieved a PCC of 97.86%, the highest among all tested mainstream methods.

Conclusion

HBFormer demonstrates that parallel integration of local and global features is a highly effective strategy for hyperspectral change detection. By utilizing the HAM and BGFN modules, the architecture suppresses noise while maintaining high sensitivity to actual land-cover changes. Future work will explore the migration of this architecture to multi-source data fusion and the integration of high-level semantic labels to further enhance detection intelligence.

Summary updated

Abstract

目的高光谱图像能提供丰富的光谱和空间信息,但常受到多种噪声的干扰,增加了其在变化检测领域应用的复杂性。为了解决上述问题,提出一种基于混合注意力和双向门控网络的高光谱图像变化检测方法,旨在提升变化检测的性能,从而在复杂环境和多变条件下实现更可靠的变化检测。方法通过整合局部和全局特征,改进了Transformer中的自注意力和前馈神经网络。具体而言,提出了混合注意力模块,采用卷积神经网络(convolutional neural network, CNN)和gMLP(gated multi-layer perceptron)的并行结构,分别提取图像的局部特征和全局上下文信息,有效平衡局部细节和全局上下文的特征提取,起到抑制噪声的作用。同时,构建了双向门控网络,强化通道和空间维度的特征提取,进一步增强全局与局部信息的融合,实现了多时相高光谱图像特征的深度融合。结果实验在3个数据集上与主流的6种方法进行了比较,在Framland数据集中,相比于BiT(bitemporal image Transformer)模型,准确率和Kappa系数分别提高0.34%和2.02%;在Hermiston数据集中,相比于CBANet(cross-band 2-D self-attention network)模型,准确率和Kappa系数分别提高1%和2.08%。同时消融实验结果证明,混合注意力模块和双向门控网络能有效地融合局部与全局信息,提升变化检测的精度。结论本文方法通过高效融合局部和全局特征,显著提升了变化检测的准确性,证明了其在实际应用中的潜力。在3个高光谱数据集的大量实验结果表明,本文方法在变化检测任务中性能优异,显著优于BiT、CBANet等主流方法。
BibTeX
@article{li2024hybrid,
  author = {Xiangtan Li and Feng Gao and Yue Sun and Junyu Dong},
  title = {{Hybrid attention and bidirectional-gated network for hyperspectral image change detection}},
  journal = {Journal of Image and Graphics},
  year = {2024},
  doi = {10.11834/jig.240360},
}
Figure