SAR Target Recognition via Random Sampling Combination in Open-World Environments

Xiaojing Geng, Ganggang Dong, Ziheng Xia, Hongwei Liu

TL;DR

This paper introduces a novel framework for Open Set Recognition (OSR) in Synthetic Aperture Radar (SAR) imagery, moving beyond the "closed-world" assumption where all test targets are known beforehand. By using a "random sampling combination" strategy to generate synthetic unknown targets from known data, the authors transform the open-world challenge into a manageable $(K+1)$ classification problem, significantly reducing the risk of misidentifying new, unseen targets.

What Problem Does This Paper Address?

In traditional SAR target recognition, researchers usually assume a closed-set environment: every object the AI sees during testing belongs to a category it saw during training (e.g., it only ever sees T-72 tanks and BMP-2 vehicles). In the real world, this is rarely true. An operational system will inevitably encounter "unknown" targets.

Standard deep learning models suffer from "open space risk"—they tend to classify these unknown objects into one of the known categories with high confidence. Existing solutions are often computationally heavy or rely on feature extractors that aren't optimized for the "openness" of the real world. This paper seeks a way to accurately reject unknown classes while maintaining high performance on known ones, all without massive computational overhead.

Methods

The authors propose a family of generative models called GvRSC (Generative models via Random Sampling Combination). The core idea is to simulate "indistinguishable" unknown targets by mixing parts or features of known targets. They propose two distinct technical routes:

  1. Spatial Clipping (SCG): This happens at the input layer. The system takes four different known targets, randomly crops them, and stitches them together into a single "Frankenstein" image. Because this image contains features from multiple classes but represents none of them perfectly, it serves as a proxy for an unknown target.
  2. Weighting (WG): This happens in the middle hidden layer. Instead of mixing pixels, the model performs a linear weighted combination of the high-dimensional feature representations of four different known targets. This creates a "synthetic feature" that lies in the gaps between known class clusters.

Both methods transform the problem into a $(K+1)$ classification task, where the $(K+1)$-th class is "Unknown." During inference, the model uses a two-stage thresholding process to identify unknowns: first rejecting targets that are "far" from all known clusters, and then using the $(K+1)$ output node to catch targets that look similar to known classes but don't quite fit.

Datasets

The study uses the MSTAR (Moving and Stationary Target Acquisition and Recognition) benchmark dataset, which is the standard for SAR research.

  • Known Classes: Typically 8 classes (like the BMP2, BTR70, T72, etc.) are used for training.
  • Unknown Classes: The remaining classes are held out to test the model's rejection capabilities.
  • Augmentation: To test robustness, the authors also used GANs to generate "MSTAR-noise" images, simulating more challenging, cluttered environments.

Key Insights and Ideas

  • Simulating the "Indistinguishable": The hardest unknowns to catch are those that look almost like known targets. By training the model on "synthetic unknowns" made from pieces of known data, the model learns exactly where the boundaries of the known classes should end, "pushing" the decision boundaries tighter.
  • Noise as a Feature: The authors found that the SCG (Spatial Clipping) method acts as a natural noise suppressor. Because the background noise is randomly sampled and spliced, the model learns to ignore it and focus on the inherent properties of the targets.
  • Algebraic Subspaces: The paper relies on the idea that each target class spans a specific linear subspace. By combining targets from different classes, you mathematically guarantee that the resulting "hybrid" target does not belong to any of the original subspaces.

Key Results

  • Superior Detection: On the MSTAR dataset, the proposed SCG and WG models achieved AUC (Area Under the Curve) scores exceeding 90%, outperforming standard baselines like Softmax (83%) and specialized OSR methods like ARPL.
  • High Accuracy: Unlike some OSR methods that sacrifice known-class accuracy to find unknowns, GvRSC maintained a closed-set accuracy of ~95%.
  • Robustness to Openness: As the "openness" of the environment increased (i.e., more unknown classes were introduced), the GvRSC models showed a much slower performance degradation compared to traditional Softmax-based classifiers.

Limitations and Future Work

While the model is excellent at saying "I don't know what this is," it cannot yet identify the attributes of the unknown target (e.g., "I don't know this specific tank, but I know it has treads").

The authors suggest that future work should focus on class-incremental learning. In a real-world scenario, once an unknown target is detected and identified by a human, the system should be able to learn that new class on the fly without retraining from scratch.

Summary updated

Abstract

Target recognition in SAR images was widely studied over the years. Most of these works were usually based on the assumption that the targets in the test set belong to a limited set of classes. In the practical scenarios, it is common to encounter various kinds of new targets. It is therefore more meaningful to study target recognition in open-world environments. In these scenes, it is needed to reject the unknown classes while maintain the classification performance on known classes. In the past years, few works were devoted to open set target recognition. Though the detection performance on unknown targets can be improved to a certain extent in the preceding works, most detection schemes are independent of a pretrained feature extractor, leading to potential open space risks. Besides, the model architectures are complicated, resulting in huge computational cost. To solve these problems, a family of new methods for open set target recognition is proposed. Targets indistinguishable from known classes are constructed by random sampling combination strategy. They are further sent into the classifier for feature learning. The original open-world environment is then transformed into a closed-world environment containing the unknown class. Moreover, the special implication of generated unknown targets is highlighted and used to realize unknown detection. Extensive experimental results on the MSTAR benchmark dataset illustrate the effectiveness of the proposed methods.
BibTeX
@article{geng2022sar,
  author = {Xiaojing Geng and Ganggang Dong and Ziheng Xia and Hongwei Liu},
  title = {{SAR Target Recognition via Random Sampling Combination in Open-World Environments}},
  journal = {IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing},
  year = {2022},
  doi = {10.1109/jstars.2022.3225882},
}
Figure