Distributed Stabilization of Two Interdependent Markov Jump Linear Systems With Partial Information

Guanze Peng, Juntao Chen, Quanyan ZhuIEEE Control. Syst. Lett 2021 · OpenReview

TL;DR

This paper tackles the challenge of stabilizing complex systems composed of two interconnected Markov Jump Linear Systems (MJLSs) where the system's operational mode is not directly observable and depends on the states of other interconnected systems. The authors propose novel centralized and distributed control strategies that can achieve stochastic stability even with partial information, offering a more practical approach for real-world applications.

What Problem Does This Paper Address?

Many modern systems, like power grids or communication networks, are not isolated but rather interdependent. The failure or operational mode of one system can directly influence another, creating complex cascading effects. Traditional control methods often assume full observability of system states and modes, which is unrealistic in many scenarios. Furthermore, systems with abrupt changes in their dynamics, modeled as Markov Jump Linear Systems (MJLSs), become even more challenging when their mode transitions are influenced by the states of other systems and these modes are only indirectly observable through noisy signals. This paper addresses the critical need for robust control strategies that can stabilize such interdependent MJLSs under realistic conditions of partial information and inter-system dependencies.

Methods

The core of this work lies in developing a mathematical framework for two interdependent MJLSs. The interdependency is modeled such that the transition rate matrix of one system's mode depends on the state of the other system. Crucially, the system modes themselves are not directly observed; instead, the controllers rely on partial, possibly noisy, observations.

The authors propose two main control design approaches:

  1. Centralized Control: This approach treats the two MJLSs as a single, integrated system. A stabilizing controller is designed based on global information of the system states and partial mode observations. This method provides a theoretical foundation for stabilization.
  2. Distributed Control: Recognizing that global information might be impractical, this approach focuses on designing individual controllers for each MJLS. These controllers only require local state information and partial mode observations, aiming to stabilize the overall integrated system without needing to share all information between subsystems. This is achieved by ensuring that the local stabilizing controllers contribute to the global stability of the system-of-systems.

The stabilization conditions are derived using Linear Matrix Inequality (LMI) techniques, a standard tool in modern control theory for synthesizing controllers that guarantee stability. The paper also leverages Lyapunov functions and Dynkin's formula to formally prove the stability properties of the proposed control strategies.

Datasets

Not discussed in the paper. The paper presents a numerical example with synthesized system parameters.

Key Insights and Ideas

  • Interdependency is Key: The paper highlights that simply treating systems as independent is insufficient when their modes are coupled. The control design must explicitly account for these interdependencies.
  • Partial Information is Manageable: A significant contribution is demonstrating that robust stabilization is achievable even when system modes are not directly observable, relying instead on indirect signals. This opens doors for controlling real-world systems where full observability is a luxury.
  • Distributed Control for Scalability: The development of distributed controllers is crucial for practical implementation. It reduces the communication burden and computational complexity compared to centralized approaches, making it more scalable for larger systems.
  • LMIs as a Powerful Synthesis Tool: The use of LMIs provides a systematic way to design controllers that guarantee stability under complex conditions, offering a concrete method for engineers to implement these strategies.

Key Results

The paper successfully formulates a framework for interdependent MJLSs with partial information and derives sufficient conditions for stochastic stabilization.

  • Centralized Control: A centralized controller is designed that can stochastically stabilize the integrated system, with conditions expressed in terms of LMIs.
  • Distributed Control: A distributed control strategy is proposed that achieves stabilization of the overall system by designing individual controllers for each MJLS. This approach is shown to be more practical due to reduced information requirements.
  • Numerical Validation: A numerical example with two coupled MJLSs demonstrates the effectiveness of the designed distributed controllers. The results show that the system can be stabilized with satisfactory performance even with partial mode observations, though trajectories are slightly less smooth than with full observation.

Limitations and Future Work

  • Focus on Two Systems: The current framework is primarily developed for two interdependent MJLSs. Extending this to a larger number of interconnected systems would be a valuable future direction.
  • Specific Interdependency Structure: The paper considers a chain-like interdependency. Investigating more general forms of interdependency could broaden the applicability.
  • Optimal Control: The current work focuses on stabilization. Extending the framework to optimal control problems, considering state and control costs, is suggested as future work.
  • Robustness to Uncertainty: While the paper addresses partial information, further exploration into robustness against other forms of uncertainty (e.g., parameter variations) could be beneficial.

Summary updated

Abstract

In this letter, we study the stabilization of two interdependent Markov jump linear systems (MJLSs) with partial information, where the interdependency arises as the transition of the mode of one system depends on the states of the other system. First, we formulate a framework for the two interdependent MJLSs to capture the interactions between various entities in the system, where the modes of the system cannot be observed directly. Instead, a signal which contains information of the modes can be observed. Then, depending on the scope of the available system state information (global or local), we design centralized and distributed controllers, respectively, that can stochastically stabilize the overall interdependent MJLS. In addition, we derive the sufficient stabilization conditions for the system under both types of information structure. Finally, we use a numerical example to illustrate the effectiveness of the designed controllers.
BibTeX
@inproceedings{peng2021distributed,
  author = {Guanze Peng and Juntao Chen and Quanyan Zhu},
  title = {{Distributed Stabilization of Two Interdependent Markov Jump Linear Systems With Partial Information}},
  booktitle = {IEEE Control. Syst. Lett},
  year = {2021},
  url = {https://openreview.net/forum?id=rkPqFrYPAD},
}
Figure