Conditional Measurement Density Estimation in Sequential Monte Carlo via Normalizing Flow

Xiongjie Chen, Yunpeng Li

TL;DR

This paper introduces a more mathematically rigorous way to learn measurement models in Differentiable Particle Filters (DPFs) by using Conditional Normalizing Flows (CNFs). By ensuring the measurement model produces a valid probability density rather than just a heuristic "score," the authors achieve significantly better tracking accuracy and faster training convergence in complex visual environments.

What Problem Does This Paper Address?

Sequential Monte Carlo (SMC) methods, commonly known as Particle Filters, are the workhorses of state estimation—think of a robot trying to figure out its exact location based on noisy sensor data. Traditionally, the "measurement model" (which tells the filter how likely a sensor reading is given a hypothesized state) had to be handcrafted by experts.

Recently, Differentiable Particle Filters (DPFs) emerged, allowing researchers to learn these models directly from data using neural networks. However, many current DPFs use "pseudo-likelihoods," such as cosine similarity between feature vectors or unnormalized scalar outputs from a network.

The problem? These aren't valid probability densities. If your measurement model doesn't integrate to one, the particle weights become mathematically inconsistent, leading to poor quantification of uncertainty and suboptimal tracking, especially when sensors are noisy or environments are cluttered.

Methods

The authors propose the DPF-CM (Conditional Measurement) framework. The core innovation is replacing heuristic scoring functions with a Conditional Normalizing Flow (CNF).

  1. Valid Densities: Normalizing flows use a series of invertible transformations to turn a simple base distribution (like a Gaussian) into a complex one. Because these transformations are invertible, the "change of variables" formula allows the model to calculate the exact probability density of an observation.
  2. Conditioning: The flow is conditioned on the state ($x_t$). This means the model learns a complex likelihood function $p(y_t | x_t)$ that can adapt to the specific geometry and appearance of the environment.
  3. Dimensionality Reduction: To handle high-dimensional inputs like images, the authors first pass the observation through an encoder ($E_\theta$) to create a latent vector ($e_t$). The CNF then operates on this lower-dimensional feature space.
  4. Integration: This CNF-based likelihood is plugged directly into the standard particle filtering weight update step. The entire system—encoder, dynamics model, and measurement flow—is trained end-to-end via gradient descent.

Datasets

The researchers evaluated their approach on a synthetic visual tracking task:

  • The Goal: Track a single red disk moving in a 2D space.
  • The Challenge: The environment contains 25 "distractor" disks of various colors and sizes that move independently. The red disk can be occluded by distractors or move partially out of the frame.
  • Data: 128x128 RGB images. The dataset consisted of 50 trajectories, each 50 time steps long, for training, validation, and testing.

Key Insights and Ideas

  • Mathematical Rigor Pays Off: Moving from a heuristic "similarity score" to a valid probability density isn't just a theoretical improvement; it provides a much more informative signal for the particle filter to weight its hypotheses.
  • Capturing Complexity: Normalizing flows (specifically the RealNVP architecture used here) are excellent at modeling multi-modal or non-Gaussian distributions. This is crucial in tracking because an observation might look like the target or a distractor, creating a complex likelihood surface that simple models miss.
  • Faster Convergence: Because the CNF provides a more accurate gradient for the loss function, the models trained significantly faster than those using standard neural network likelihoods or cosine similarity.

Key Results

The authors compared their method against several baselines, including DPFs using cosine similarity (-COS) and standard neural networks (-NN).

  • Tracking Accuracy: The proposed DPF-CM achieved an average Root Mean Square Error (RMSE) of 2.99, compared to 10.61 for the cosine similarity baseline and 4.26 for the standard neural network approach.
  • Best in Class: When combined with a flow-based proposal distribution (CNF-DPF-CM), the error dropped even further to 2.86.
  • Training Speed: As shown in the paper's validation plots, the CNF-based models reached low error rates in fewer than 50 epochs, while other methods struggled to converge even after 150 epochs.
Method Test RMSE (Lower is Better)
DPF-COS (Baseline) 10.61 ± 2.22
DPF-NN 4.26 ± 0.32
DPF-CM (Ours) 2.99 ± 0.13
CNF-DPF-CM (Ours) 2.86 ± 0.10

Limitations and Future Work

  • Computational Overhead: Normalizing flows are more computationally expensive than simple MLPs or cosine similarity checks. While they improve accuracy, they might increase the per-step inference time.
  • Synthetic vs. Real World: The experiment was conducted on a synthetic "disk tracking" dataset. While this is a standard benchmark for DPFs, the authors note that future work should explore more complex, real-world visual environments.
  • Encoder Dependency: The performance is still heavily dependent on the quality of the image encoder. If the encoder fails to capture relevant features, the CNF cannot compensate for that loss of information.

Summary updated

Abstract

Tuning of measurement models is challenging in real-world applications of sequential Monte Carlo methods. Re-cent advances in differentiable particle filters have led to various efforts to learn measurement models through neural networks. But existing approaches in the differentiable particle filter frame-work do not admit valid probability densities in constructing measurement models, leading to incorrect quantification of the measurement uncertainty given state information. We propose to learn expressive and valid probability densities in measurement models through conditional normalizing flows, to capture the complex likelihood of measurements given states. We show that the proposed approach leads to improved estimation performance and faster training convergence in a visual tracking experiment.
BibTeX
@inproceedings{chen2022conditional,
  author = {Xiongjie Chen and Yunpeng Li},
  title = {{Conditional Measurement Density Estimation in Sequential Monte Carlo via Normalizing Flow}},
  booktitle = {2022},
  year = {2022},
  doi = {10.23919/eusipco55093.2022.9909886},
}

Loading related content...

Figure