Ensemble transform Kalman-Bucy filters

Javier Amezcua, Kayo Ide, Eugenia Kalnay, Sebastian Reich

TL;DR

This paper introduces and evaluates "ensemble transform Kalman-Bucy filters" (ETKBFs) that adapt the continuous Kalman-Bucy filter for ensemble data assimilation. They propose a more stable numerical integration method and a transform-based approach that significantly reduces computational cost by working in a lower-dimensional "weight space."

What Problem Does This Paper Address?

Traditional Kalman filters are optimal for linear systems but struggle with the nonlinearities inherent in many real-world models, like those used in weather forecasting. Ensemble Kalman Filters (EnKFs) address this by using a collection of model states (an ensemble) to approximate the forecast distribution. However, adapting the continuous-time Kalman-Bucy Filter (KBF) to an ensemble setting presents challenges. Specifically, the ordinary differential equations (ODEs) governing the analysis step in these ensemble KBFs can become "stiff" under certain conditions (e.g., when observational errors are small relative to background errors). This stiffness can cause numerical integration schemes to fail or become prohibitively slow. The paper aims to develop more robust and efficient ensemble KBFs that can handle these stiff ODEs.

Methods

The authors build upon two existing ensemble KBF formulations (BGR09 and BR10). Their key contributions include:

  • Analysis of ODE Stiffness: They demonstrate that the ODEs in these formulations become stiff when the ratio of background error covariance to observational error covariance (denoted by $\beta$) is large. This stiffness can lead to numerical instability with standard integration methods like Euler forward.
  • Diagonally Semi-Implicit (DSI) Integration: To address stiffness, they propose a DSI integration method. This method offers improved stability and computational affordability compared to explicit methods, especially for stiff problems, by treating some terms implicitly. They also explore using variable step sizes for further efficiency.
  • Transform-Based Approach (Ensemble Space): A major innovation is the development of "ensemble transform" versions of these filters. Instead of updating the full model state (which can be very high-dimensional), they transform the problem into an ensemble space where the variables are "weights" of dimension equal to the ensemble size. This significantly reduces computational cost and complexity. They derive ODEs for these weights and apply the DSI method to them.

Datasets

The paper uses three models for evaluation:

  • Lorenz 1963 (L63) model: A 3-variable nonlinear model, used to test the DSI method and the impact of observation frequency.
  • Lorenz 1996 (L96) model: A 40-variable nonlinear model, used to test the effect of localization and adaptive inflation.
  • SPEEDY model: A medium-complexity atmospheric general circulation model (AGCM), used to assess practical applicability in a more realistic setting.

No new benchmarks are introduced; rather, existing models are used to evaluate the performance of the proposed methods against established techniques like the Local Ensemble Transform Kalman Filter (LETKF).

Key Insights and Ideas

  • Stiffness is a Real Problem: The ratio of background to observational error variance ($\beta$) is a critical factor determining the stiffness of the ODEs in ensemble KBFs. Large $\beta$ values (common with infrequent observations or long assimilation windows) necessitate more robust integration schemes.
  • DSI Integration is Key: The proposed DSI method significantly improves stability and efficiency, especially for infrequent observations where $\beta$ is large. It allows for fewer integration steps to achieve comparable performance to explicit methods.
  • Ensemble Space is the Future: Transforming the problem into the "weight space" of the ensemble is a game-changer. It drastically reduces the dimensionality of the problem, making computations much faster and more scalable, particularly for high-dimensional models.
  • Equivalence with LETKF: The transform-based ensemble KBFs (ETKBFs) show performance comparable to the well-established LETKF, suggesting they are a viable alternative.

Key Results

  • Improved Stability and Efficiency: The DSI method with variable step sizes allowed the ETKBF and DETKBF to achieve performance comparable to LETKF with significantly fewer pseudo-time steps (e.g., 8 steps for infrequent L63 observations vs. ~70-300 for Euler forward).
  • Comparable Performance: In experiments with the L63 and L96 models, the proposed ETKBF and DETKBF achieved RMSE values very close to, or indistinguishable from, the LETKF. For the SPEEDY model, similar equivalence was observed, even in data-sparse regions.
  • Computational Advantage: The transform-based approach (working in weight space) is computationally more efficient, especially for high-dimensional models, as the computations are performed in a space whose dimension equals the ensemble size, not the model dimension.
  • Robustness in Data-Sparse Regions: The DSI method ensures proper performance even in data-sparse regions where ODEs are prone to stiffening.

Limitations and Future Work

  • Parameter Tuning: While the DSI method reduces the need for many steps, the optimal number of steps and the choice of variable step sizes still require some heuristic investigation.
  • R-localization Improvement: The paper suggests that computing $\beta$ locally and allowing each gridpoint to use a different number of steps based on local stiffness could further improve R-localization implementations.
  • Continuous Formulation: The authors note that the continuous formulation of the ensemble Kalman filter allows for seamless integration with incremental analysis updates (IAU), which they plan to explore in future work to avoid imbalances introduced by sequential assimilation.
  • Nonlinear Observation Operators: The equivalence of the transform-based approach to LETKF holds for linear observation operators. The study of this equivalence when the observation operator is nonlinear is noted as an interesting area for future research.

Summary updated

Abstract

Two recent works have adapted the Kalman-Bucy filter into an ensemble setting. In the first formulation, BR10, the full ensemble is updated in the analysis step as the solution of single set of ODEs in pseudo-BGR09, the ensemble of perturbations is updated by the solution of an ordinary differential equation (ODE) in pseudo-time, while the mean is updated as in the standard KF. In the second formulation, BR10, the full ensemble is updated in the analysis step as the solution of single set of ODEs in pseudo-time. Neither requires matrix inversions except for the frequently diagonal observation error covariance. We analyze the behavior of the ODEs involved in these formulations. We demonstrate that they stiffen for large magnitudes of the ratio of background to observational error covariance, and that using the integration scheme proposed in both BGR09 and BR10 can lead to failure. An integration scheme that is both stable and is not computationally expensive is proposed. We develop transform-based alternatives for these Bucy-type approaches so that the integrations are computed in ensemble space where the variables are weights (of dimension equal to the ensemble size) rather than model variables. Finally, the performance of our ensemble transform Kalman-Bucy implementations is evaluated using three models: the 3-variable Lorenz 1963 model, the 40-variable Lorenz 1996 model, and a medium complexity atmospheric general circulation model (AGCM) known as SPEEDY. The results from all three models are encouraging and warrant further exploration of these assimilation techniques.
BibTeX
@inproceedings{amezcua2011ensemble,
  author = {Javier Amezcua and Kayo Ide and Eugenia Kalnay and Sebastian Reich},
  title = {{Ensemble transform Kalman-Bucy filters}},
  booktitle = {Quarterly},
  year = {2011},
}
Figure