CoACT: Coordination via Aligned Centralized Training in Multi-Agent Reinforcement Learning

Oussama Azizi, Frans A Oliehoek, Matthijs T. J. SpaanCLaRAMAS @ AAMAS 2026 · OpenReview

Abstract

Cooperative Multi-Agent Reinforcement Learning (MARL) has achieved remarkable success in complex tasks, with Centralized Training Decentralized Execution (CTDE) being the dominant paradigm for training cooperative agents. However, most CTDE methods do not account for the fact that agents are heterogeneous, each receiving observations generated by a different subset of state factors. In this work, we show that this heterogeneity can be exploited for a more efficient learning: by treating agents observation as partial views of the same underlying factors, and leveraging this structural dependency, we can can align the agents' representations during training to improve sample efficiency of existing state-of-the-art CTDE algorithms.
BibTeX
@inproceedings{azizi2026coact,
  author = {Oussama Azizi and Frans A Oliehoek and Matthijs T. J. Spaan},
  title = {{CoACT: Coordination via Aligned Centralized Training in Multi-Agent Reinforcement Learning}},
  booktitle = {CLaRAMAS @ AAMAS},
  year = {2026},
  url = {https://openreview.net/forum?id=Oc0QipuIV0},
}

Loading related content...

Figure