Control of Multi-Layer Mobile Autonomous Systems in Adversarial Environments: A Games-in-Games Approach

Juntao Chen, Quanyan Zhu

TL;DR

This paper introduces a "games-in-games" framework to design secure and resilient multi-layer mobile autonomous systems (MAS) that can maintain network connectivity even when attacked. By modeling the interactions between network operators and a jamming attacker as a Stackelberg game within a larger Nash game, the authors propose a meta-equilibrium solution and an iterative algorithm to achieve it, demonstrating improved performance under cyberattacks.

What Problem Does This Paper Address?

Modern applications increasingly rely on interconnected mobile autonomous systems (MAS), such as fleets of drones and ground robots working together. These systems are often organized into "multi-layer" networks, where different groups of robots (e.g., drones and ground vehicles) form their own subnetworks but must still communicate and coordinate globally. A critical challenge is maintaining robust network connectivity, especially when these systems operate in adversarial environments. Jamming attacks, for instance, can disrupt communication links and fragment the network, severely degrading performance. Traditional control methods often assume a single, cooperative network or a fully centralized system, which are insufficient for multi-layer MAS with independent operators and the threat of sophisticated cyberattacks. This paper addresses the need for a framework that can handle uncoordinated decision-making among network operators and proactively defend against adversarial attacks to ensure reliable network connectivity.

Methods

The core of this paper is the development of a "games-in-games" framework. This framework models the problem as follows:

  • Nash Game: Two independent network operators (each controlling a layer of the MAS) aim to maximize the global network connectivity. Their uncoordinated decision-making is modeled as a Nash game.
  • Stackelberg Game: Each network operator also faces a jamming attacker who tries to minimize network connectivity. The operator acts as the leader, and the attacker as the follower, forming a Stackelberg game. This captures the operator's need to anticipate and defend against attacks.

The authors propose a meta-equilibrium as the solution concept, which simultaneously satisfies the Nash equilibrium for the operators and the Stackelberg equilibrium for each operator-attacker pair. To implement this, they reformulate the problem using semidefinite programming (SDP), which allows for efficient convex optimization. An iterative algorithm is then designed, where network operators update their robot positions sequentially, taking into account the attacker's potential actions. This algorithm is proven to converge asymptotically to the meta-equilibrium.

Datasets

Not discussed in the paper. The paper uses simulated case studies with defined parameters for network size, robot positions, communication strength functions, and attack scenarios.

Key Insights and Ideas

  • Games-in-Games for Security: The novel "games-in-games" framework effectively integrates uncoordinated network control (Nash game) with adversarial defense (Stackelberg game), providing a holistic approach to secure MAS design.
  • Meta-Equilibrium: This solution concept is crucial for characterizing the system's behavior, capturing both the strategic interactions between network operators and their defensive postures against attackers.
  • Agile Resilience: The proposed iterative algorithm not only maintains connectivity under attack but also demonstrates the MAS's ability to recover quickly after an attack is detected and removed.
  • Anticipation is Key: Proactively designing the network by anticipating worst-case attacks (even a single link removal) significantly enhances resilience compared to designs that ignore adversaries.
  • Non-Uniqueness of Equilibria: The paper highlights that multiple meta-equilibrium configurations can exist, suggesting that future work might involve equilibrium selection mechanisms to ensure optimal performance.

Key Results

  • The proposed iterative algorithm converges asymptotically to a meta-equilibrium, ensuring a secure and connected MAS network.
  • Case studies demonstrate that the secure MAS network, designed with the games-in-games approach, remains connected under jamming attacks, while a network designed without considering attacks becomes disconnected. For example, one case study showed a connectivity of 0.17 for the secure network versus complete disconnection (connectivity 0) for the non-secure network after two link attacks.
  • The system exhibits agile resilience, quickly recovering connectivity after GPS spoofing attacks are removed. For instance, connectivity dropped from 0.58 to 0.37 during an attack but recovered rapidly.

Limitations and Future Work

  • Non-Uniqueness of Equilibria: The paper acknowledges that multiple meta-equilibria can exist. Future work could focus on developing mechanisms for equilibrium selection to guide the system towards a desired, high-connectivity state, potentially involving a central planner.
  • Heterogeneous Security Requirements: The current model assumes uniform security considerations. Future research could explore scenarios where different network layers or agents have varying security needs or estimations of attack severity.
  • Sophisticated Attackers: The attacker model is primarily reactive (best response). Extending the framework to handle more sophisticated attackers who might make decisions over longer time horizons or employ more complex strategies is a promising direction.
  • Decentralized Control: While the algorithm is iterative, further research into fully decentralized implementation of the meta-equilibrium concept would be valuable.

Summary updated

Abstract

Mobile autonomous system (MAS) becomes pervasive especially in the vehicular and robotic networks. Multiple heterogeneous MAS networks can be integrated together as a multi-layer MAS network to offer holistic services. The network connectivity of multi-layer MAS plays an important role in the information exchange between agents within and across different layers of the network. In this paper, we establish a games-in-games framework to capture the uncoordinated nature of decision makings under adversarial environment at different layers. Specifically, each network operator controls the mobile agents in his own subnetwork and designs a secure strategy to maximize the global network connectivity by considering the behavior of jamming attackers that aim to disconnect the network. The solution concept of meta-equilibrium is proposed to characterize the system-of-systems behavior of the autonomous agents. For online implementation of the control, we design a resilient algorithm that improves the network algebraic connectivity iteratively. We show that the designed algorithm converges to a meta-equilibrium asymptotically. Finally, we use case studies of a two-layer MAS network to corroborate the security and agile resilience of the network controlled by the proposed strategy.
BibTeX
@article{chen2020control,
  author = {Juntao Chen and Quanyan Zhu},
  title = {{Control of Multi-Layer Mobile Autonomous Systems in Adversarial Environments: A Games-in-Games Approach}},
  journal = {IEEE Trans. Control. Netw. Syst.},
  year = {2020},
  url = {https://openreview.net/forum?id=XLYCQ0uETd},
}
Figure