The Cramér–Rao Bounds and Sensor Selection for Nonlinear Systems with Uncertain Observations

Zhiguo Wang, Xiaojing Shen, Ping Wang, Yunmin ZhuSensors 2018 · DOI

TL;DR

This paper tackles the challenge of estimating the state of nonlinear systems when sensor measurements are uncertain (e.g., due to occlusions). They propose two novel methods to calculate the Cramér-Rao bound (CRB) for such systems, with the second method significantly reducing computational complexity. This improved CRB then enables an efficient, analytical approach to selecting the optimal subset of sensors for large-scale networks.

What Problem Does This Paper Address?

In many real-world applications, sensors don't always provide perfect measurements. They can be affected by noise, interference, or even complete failures, such as a sensor being temporarily blocked from observing a target. This "uncertainty" in measurements makes it difficult to accurately estimate the state of a system, especially when the system dynamics are nonlinear. Traditional methods for calculating performance bounds like the Cramér-Rao bound (CRB) often struggle with these uncertainties, leading to high computational costs or inaccurate results. Furthermore, in large sensor networks, using all available sensors can be inefficient and resource-intensive. Therefore, there's a need for robust methods to estimate system states under measurement uncertainty and to intelligently select the most informative subset of sensors.

Methods

The paper introduces two primary methods for deriving the posterior Cramér-Rao bound (PCRB) for nonlinear systems with uncertain observations:

  1. Recursive Formula with Gaussian Mixture Model: This approach directly uses the recursive formula for the CRB and models the uncertain measurements as a Gaussian mixture distribution. While theoretically sound, it involves computing complex integrals, making it computationally expensive, especially for large sensor networks.
  2. Expectation-Maximization Inspired Approach: This is the paper's main contribution. It leverages the idea of the Expectation-Maximization (EM) algorithm by introducing binary (0-1) latent variables to represent the uncertainty in each sensor's observation. Since the standard CRB conditions are not met for discrete variables, they approximate these discrete latent variables with continuous ones. By taking a limiting process of the CRB for this continuous approximation, they derive a new, computationally efficient PCRB. This method avoids complex integrals and significantly reduces the computational burden.

Based on this second, more efficient PCRB, the authors then develop an analytical method for sensor selection. This involves formulating the problem as an optimization task to maximize a measure of information (related to the trace of the Fisher information matrix) while selecting a fixed number of sensors.

Datasets

Not discussed in the paper. The paper uses simulated data for its numerical examples.

Key Insights and Ideas

  • Uncertainty is a major hurdle for CRB: The paper highlights that standard CRB calculations are ill-suited for systems with uncertain measurements, particularly when these uncertainties are modeled as Gaussian mixtures.
  • EM inspiration for tractability: Adapting ideas from the EM algorithm by introducing latent variables offers a powerful way to handle the complexity of Gaussian mixture models in CRB calculations.
  • Continuous approximation for discrete uncertainty: The clever use of continuous variables to approximate discrete latent variables is key to deriving a computationally tractable CRB. This avoids difficult integrals.
  • Analytical sensor selection: The derived, efficient CRB allows for an analytical solution to the sensor selection problem, which is a significant advantage over iterative or numerical optimization methods.
  • Trade-off between accuracy and computation: The paper presents two CRB methods, one more accurate but computationally intensive, and the second less accurate (though shown to be close in simulations) but much faster, making it suitable for large-scale applications.

Key Results

  • Two PCRB methods: The paper successfully derives two methods for calculating the PCRB for nonlinear systems with uncertain observations.
  • Computational efficiency: The second method, inspired by EM, significantly reduces the computational complexity compared to the first method, especially as the number of sensors increases. Figure 4 shows a dramatic difference in computation time.
  • Effective sensor selection: The proposed analytical sensor selection method, based on the efficient PCRB, is demonstrated to perform well. Example 2 shows that the proposed algorithm achieves better performance (lower mean squared error) than existing methods [5, 28] in selecting sensors for a wireless sensor network.
  • Performance validation: Numerical examples (Example 1 and Example 2) validate the effectiveness of both the proposed PCRB calculation methods and the sensor selection strategy. Figures 2 and 3 show that both PCRB methods yield similar results, while Figures 10-13 demonstrate the superior performance of the proposed sensor selection method in terms of mean squared error.

Limitations and Future Work

  • Approximation in the second method: The second PCRB method relies on approximating discrete latent variables with continuous ones. While simulations show it's effective and close to the "accurate" bound, it's an approximation. The paper notes that it's not always clear if this approximate bound is strictly lower or higher than the accurate one.
  • Large-scale sensor networks: The primary motivation for the second method is its suitability for large-scale sensor networks due to reduced computational burden. The paper demonstrates this advantage in simulations.
  • Future work: The paper implicitly suggests that further exploration of the theoretical properties of the approximate bound and its application to even larger and more complex systems would be valuable. The analytical nature of the sensor selection also opens doors for its integration into real-time adaptive systems.

Summary updated

Abstract

This paper considers the problems of the posterior Cramér-Rao bound and sensor selection for multi-sensor nonlinear systems with uncertain observations. In order to effectively overcome the difficulties caused by uncertainty, we investigate two methods to derive the posterior Cramér-Rao bound. The first method is based on the recursive formula of the Cramér-Rao bound and the Gaussian mixture model. Nevertheless, it needs to compute a complex integral based on the joint probability density function of the sensor measurements and the target state. The computation burden of this method is relatively high, especially in large sensor networks. Inspired by the idea of the expectation maximization algorithm, the second method is to introduce some 0-1 latent variables to deal with the Gaussian mixture model. Since the regular condition of the posterior Cramér-Rao bound is unsatisfied for the discrete uncertain system, we use some continuous variables to approximate the discrete latent variables. Then, a new Cramér-Rao bound can be achieved by a limiting process of the Cramér-Rao bound of the continuous system. It avoids the complex integral, which can reduce the computation burden. Based on the new posterior Cramér-Rao bound, the optimal solution of the sensor selection problem can be derived analytically. Thus, it can be used to deal with the sensor selection of a large-scale sensor networks. Two typical numerical examples verify the effectiveness of the proposed methods.
BibTeX
@inproceedings{wang2018cramerrao,
  author = {Zhiguo Wang and Xiaojing Shen and Ping Wang and Yunmin Zhu},
  title = {{The Cramér–Rao Bounds and Sensor Selection for Nonlinear Systems with Uncertain Observations}},
  booktitle = {Sensors},
  year = {2018},
  doi = {10.3390/s18041103},
}
Figure