Kronecker weights for instability analysis of Markov jump linear systems

Wenjie Mei, Masaki Ogura

Introduction

Markov Jump Linear Systems (MJLS) are a vital class of stochastic systems used to model dynamics that switch between different linear regimes based on a Markov chain. These systems find applications in diverse fields, including power grid management, satellite control, and predator-prey population modeling. A central concern in the study of MJLS is "exponential $p$th mean stability"—the determination of whether a system's state will decay to zero on average.

While control theory provides a robust suite of tools to prove a system is stable (such as Lyapunov functions), proving that a system is unstable is surprisingly difficult. Traditional criteria often rely on the spectral abscissa of specific matrices, but these bounds are frequently "loose," meaning they may fail to detect instability even when the system is blowing up. This paper introduces a novel framework using "Kronecker weights" to create auxiliary systems that serve as rigorous certificates for instability.

Methodology: Lifting the Dimension

The authors' primary innovation is the construction of auxiliary MJLS using Kronecker products. The process follows four key steps:

  1. Auxiliary System Construction: Instead of analyzing the original system directly, the authors construct a higher-dimensional auxiliary system. This is achieved by taking the Kronecker product of the original system matrices with a set of "weight" matrices ($W_i$).
  2. Instability Certification: The researchers prove a fundamental theorem: if this higher-dimensional auxiliary system is unstable, then the original system must also be unstable.
  3. Spectral Optimization: The challenge lies in finding the specific weight matrices that best reveal the system's instability. This is framed as a spectral optimization problem, where the goal is to maximize the spectral abscissa of an affine matrix family.
  4. Skew-Symmetric Constraints: To ensure that the weight matrices themselves do not introduce artificial instability, the search is restricted to skew-symmetric matrices. These matrices effectively "rotate" the state space without adding or removing energy, allowing the inherent instability of the Markov switching to be isolated and identified.

Theoretical Insights

The Power of Dimensional Lifting

By "lifting" the system into a higher-dimensional space, the Kronecker weight framework captures complex interactions between switching modes that standard eigenvalue analysis of individual modes often misses. This approach allows for a more granular view of the stochastic transitions.

Monotonicity and Tightness

A significant theoretical contribution of this work is the "monotonicity result." The authors demonstrate that as the size ($m$) of the weight matrices increases, the instability analysis becomes strictly "tighter." This implies that with sufficient computational power, one can detect instability with increasing certainty by simply increasing the matrix dimensions.

Numerical Validation

As a theoretical advancement in systems and control, the paper validates its findings through numerical examples where traditional criteria are known to fail.

In one notable example (Example 3), the standard stability criterion (Proposition 3) yielded a negative spectral abscissa ($\mu = -0.07$), which would incorrectly suggest the system is stable. However, by applying the new Kronecker weight method with $2 \times 2$ weight matrices, the authors found a value of $\ge 0.29$. This result successfully provided a certificate of instability where previous methods could not.

Limitations and Future Directions

Despite its efficacy, the method faces certain challenges:

  • Computational Complexity: The use of Kronecker products causes the size of the matrices to grow rapidly ($nm$, where $n$ is the state count and $m$ is the weight matrix size). This places a practical limit on the "tightness" achievable based on available hardware.
  • Local Optima: The underlying optimization problem is non-convex and non-smooth. While gradient-based algorithms like the BFGS method are effective, they may occasionally get stuck in local optima, potentially failing to find the instability certificate even if one exists.

Future research may focus on developing specialized optimization algorithms or identifying specific system structures that allow for more efficient weight selection, further reducing the computational burden of the framework.

Summary updated

Abstract

In this study, the authors analyse the instability of continuous‐time Markov jump linear systems. Although there exist several effective criteria for the stability of Markov jump linear systems, there is a lack of methodologies for verifying their instability. In this study, they present a novel criterion for the exponential mean instability of Markov jump linear systems. The main tool of the authors' analysis is an auxiliary Markov jump linear system, which results from taking the Kronecker products of the given system matrices and a set of appropriate matrix weights. They show that the problem of finding matrix weights for tighter instability analysis can be transformed into the spectral optimisation problem on an affine matrix family, which can be efficiently solved by gradient‐based non‐smooth optimisation algorithms. They confirm the effectiveness of the proposed methods by numerical examples.
BibTeX
@inproceedings{mei2018kronecker,
  author = {Wenjie Mei and Masaki Ogura},
  title = {{Kronecker weights for instability analysis of Markov jump linear systems}},
  booktitle = {IET},
  year = {2018},
  doi = {10.1049/iet-cta.2018.5506},
}
Figure