Deep Uncertainty-aware Tracking for Maneuvering Targets

Shuyang Zhang, Chang Gao, Qingfu Zhang, Tianyi Jia, Hongwei LiuarXiv 2024 · DOI · arXiv

TL;DR

This paper introduces MUPO-TTN, a deep learning framework that reimagines maneuvering target tracking by converting a difficult numerical regression problem into an image-based detection task. By projecting measurement uncertainty (noise distributions) into a "Target State Space" image, the model explicitly accounts for sensor confidence, allowing it to outperform traditional Kalman filters and standard recurrent neural networks during complex maneuvers.

What Problem Does This Paper Address?

Tracking a "maneuvering" target—one that suddenly changes speed or direction, like a fighter jet or a swerving vehicle—is a classic challenge in signal processing.

Traditional model-driven approaches, like the Interacting Multiple Model (IMM) filter, rely on predefined mathematical models of motion. When a target's behavior doesn't match these models (model mismatch), the tracker loses accuracy or fails entirely. On the other hand, recent data-driven (deep learning) methods often treat tracking as a sequence-to-sequence regression task. However, these models typically ignore the confidence of the measurements (e.g., signal-to-noise ratio).

The authors identify a specific "optimization conflict": in noisy environments, two different target states might produce nearly identical sensor measurements. A standard neural network trying to map these similar inputs to different outputs gets "confused," leading to inaccurate estimations.

Methods

The core innovation is the Measurement Uncertainty Projection Operator (MUPO). Instead of feeding raw coordinates into a network, the authors transform the data into a visual representation:

  1. State Space Projection: They take the measurement and its noise covariance matrix (derived from the sensor's SNR) and formulate a Probability Density Function (PDF).
  2. TSS Image Generation: This PDF is projected into a 2D grid called the Target State Space (TSS). Essentially, they create a "heat map" where each pixel's intensity represents the probability of the target being at that location.
  3. Multi-channel Input: To give the network more context, they use multiple "channels" (like RGB in a standard photo). One channel is the current measurement PDF, another is the output of a traditional IMM filter, and a third is a trajectory fitting (T-FoT) result.
  4. Detection via YOLO: Because the input is now an image, the authors use a modified YOLO (You Only Look Once) architecture. Instead of regressing a single coordinate, the network detects the target's location within the TSS image.
  5. Constraint Loss: They designed a specialized loss function that forces the network to focus on the area near the measurement, preventing it from getting distracted by "clutter" or background noise in the state space.

Datasets

The study relies on high-fidelity simulated radar datasets to evaluate performance under controlled maneuvering conditions.

  • Motion Models: Trajectories were generated using a mix of Constant Velocity (CV), Constant Acceleration (CA), Jerk, Singer, and Coordinated Turn (CT) models.
  • Noise Model: They used the Swerling 1 model to simulate realistic radar cross-section fluctuations and varying Signal-to-Noise Ratios (SNR).
  • Benchmarks: The model was tested against 10 "extra" complex trajectories to ensure it wasn't just memorizing the training data.

Key Insights and Ideas

  • Regression vs. Detection: The "Aha!" moment is realizing that neural networks are often better at finding a "blob" in an image (detection) than they are at predicting a precise floating-point coordinate from a list of numbers (regression).
  • Solving the Optimization Conflict: By including the noise distribution (the "shape" of the uncertainty) in the input, the network can distinguish between a high-confidence measurement and a low-confidence one, even if their center coordinates are the same.
  • Flexible-size Sampling: The authors found that "Flexible-size Sampling"—adjusting the resolution of the TSS image based on the target's potential maneuver range—significantly improved accuracy, though it increased training time.

Key Results

The proposed MUPO-TTN was compared against standard deep learning models (LSTM, Bi-LSTM, Transformer) and the gold-standard model-driven approach (IMM).

  • Accuracy: In Monte Carlo simulations, MUPO-TTN achieved a significantly lower Average Root-Mean-Square Error (ARMSE). For example, in one test case, MUPO-TTN reached an ARMSE of 106.62m, compared to 146.27m for the IMM filter and over 200m for the LSTM-based models.
  • Maneuver Recovery: When a target suddenly switched from a straight line to a sharp turn, MUPO-TTN converged on the new state much faster than traditional filters, which often "lag" during the transition.
  • Inference Speed: Despite the complexity of image processing, the model maintains an inference time of roughly 12-15ms, making it suitable for real-time radar applications.

Limitations and Future Work

  • Computational Overhead: The "Flexible-size Sampling" method, while accurate, increased training time by nearly 7.5x compared to fixed-size sampling (3500s vs 460s per epoch).
  • Uniform Observation Assumption: The current model assumes that sensor measurements arrive at perfectly even time intervals. In real-world "non-evenly" observed scenarios (like a radar being jammed or losing line-of-sight), the time-encoding logic would need a significant redesign.
  • Single Target Focus: The current paper focuses on tracking a single maneuvering target; extending this to multi-target environments with data association challenges is a logical next step.

Summary updated

Abstract

When tracking maneuvering targets, model-driven approaches encounter difficulties in comprehensively delineating complex real-world scenarios and are prone to model mismatch when the targets maneuver. Meanwhile, contemporary data-driven methods have overlooked measurements' confidence, markedly escalating the challenge of fitting a mapping from measurement sequences to target state sequences. To address these issues, this paper presents a deep maneuvering target tracking methodology based on target state space projection. The proposed methodology initially establishes a projection from the target measurement sequence to the target state space by formulating the probability density function of measurement error and samples the distribution information of measurement noise within the target state space as a measurement representation. Under this representation, the sequential regression task of target state estimation can be transmuted into a task of detecting the target location in the state space. Subsequently, a deep detection network is devised to accomplish target location detection in the target state space. Finally, a loss function is designed to facilitate the network's training for attaining the desired network performance. Simulation experiments suggest that the proposed method can maintain satisfactory tracking performance even when the target maneuvers, and can rapidly converge and achieve higher estimation accuracy compared with existing methods after the target maneuvers.
BibTeX
@misc{zhang2024deep,
  author = {Shuyang Zhang and Chang Gao and Qingfu Zhang and Tianyi Jia and Hongwei Liu},
  title = {{Deep Uncertainty-aware Tracking for Maneuvering Targets}},
  year = {2024},
  eprint = {2410.14422},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2410.14422},
}
Figure