Evaluating Robustness of Cooperative MARL

Nhan Pham, Lam M. Nguyen, Jie Chen, Thanh Lam Hoang, Subhro Das, Tsui-Wei WengICLR 2022 · OpenReview

Abstract

In recent years, a proliferation of methods were developed for multi-agent reinforcement learning (MARL). In this paper, we focus on evaluating the robustness of MARL agents in continuous control tasks. In particular, we propose the first model-based approach to perform adversarial attacks for cooperative MARL. We design effective attacks to degrade the MARL agent's performance by adversarially perturbing the states of agent(s) and solving an optimization problem. In addition, we also developed several strategies to select the most vulnerable agents that help to further decrease the team reward of MARL. Extensive numerical experiments on multi-agent Mujoco tasks verify the effectiveness of our proposed approach.
BibTeX
@inproceedings{pham2022evaluating,
  author = {Nhan Pham and Lam M. Nguyen and Jie Chen and Thanh Lam Hoang and Subhro Das and Tsui-Wei Weng},
  title = {{Evaluating Robustness of Cooperative MARL}},
  booktitle = {International Conference on Learning Representations},
  year = {2022},
  url = {https://openreview.net/forum?id=HHpWuWayMo},
}

Loading related content...

Figure