Non-Parametric Neuro-Adaptive Coordination of Multi-Agent Systems

Christos K. Verginis, Zhe Xu, Ufuk Topcu

Abstract

This paper introduces a hybrid control framework for multi-agent systems (MAS) that integrates neural network-based predictive control with online adaptive laws. By leveraging offline imitation data to initialize agent policies and employing real-time adaptation to compensate for unknown or time-varying dynamics, the proposed method ensures stable formation tracking in decentralized environments. Simulation results with five agents demonstrate robust convergence and precise formation maintenance along complex trajectories.

Introduction

Coordinating a swarm of robots to maintain a specific formation is a fundamental challenge in robotics, typically hindered by the lack of perfect mathematical models and the presence of dynamic, unpredictable environments. Traditional control methods often fail when physical dynamics change—such as through mechanical wear or payload variations. While neural networks excel at approximating these nonlinearities, they often lack the formal stability guarantees necessary for safety-critical applications. This work bridges the gap by combining the predictive power of neural networks with the robustness of adaptive control theory.

Methodology

The proposed "Neuro-Adaptive" framework operates in two distinct phases:

  1. Offline Learning (The Prior): Each agent is equipped with a neural network trained on imitation data—state-action pairs from successful historical runs. This provides a baseline policy ($u_{i,nn}$) that captures the general requirements of the formation task.
  2. Online Adaptive Control (The Correction): During deployment, a distributed control law augments the neural network's output with an adaptive feedback term. This term utilizes adaptation variables ($\hat{d}_{i,1}, \hat{d}_{i,2}$) that function as tunable safety buffers, automatically adjusting to compensate for real-time deviations caused by model inaccuracies or environmental changes.

The system is entirely decentralized; each agent relies solely on local information from its immediate neighbors in the communication graph, ensuring scalability.

Key Results and Discussion

The framework was validated using a simulated group of five aerial vehicles tasked with maintaining a geometric formation while following a complex, looping leader trajectory.

Convergence of formation error signals for five agents over time.

As shown in Figure 1, the formation error signals—representing a combination of position and velocity errors—consistently converged toward zero. This convergence occurred within approximately 50 seconds, even in the presence of unknown nonlinearities.

Final formation and complex trajectory tracking at t = 55 seconds.

Figure 2 illustrates the final state of the system at $t=55$ seconds. The agents successfully maintained their relative positions while tracing a sophisticated path, demonstrating the effectiveness of the hybrid approach in handling "model drift" without requiring retraining of the underlying neural networks.

Conclusion

The neuro-adaptive approach offers a scalable solution for multi-agent coordination by treating neural networks as non-parametric priors that are refined by classical adaptive control. While the current results are promising, future work should address the dependency on high-quality training data and validate the system on physical hardware to account for real-world communication constraints and sensor noise.

Summary updated

BibTeX
@inproceedings{verginis2022non,
  author = {Christos K. Verginis and Zhe Xu and Ufuk Topcu},
  title = {{Non-Parametric Neuro-Adaptive Coordination of Multi-Agent Systems}},
  booktitle = {AAMAS},
  year = {2022},
}
Figure