Who Gets the Reward & Who Gets the Blame? Evaluation-Aligned Training Signals for Multi-LLM Agents
Lists
Only you see this
Abstract
Large Language Models (LLMs) in multi-agent systems (MAS) have shown promise for complex tasks, yet current training methods lack principled ways to connect system-level evaluation with agent- and message-level learning. We propose a theoretical framework that unifies cooperative game–theoretic attribution with process reward modeling to transform \emph{$\text{system evaluation} \rightarrow \text{agent credit} \rightarrow \text{response-level signals}$}. Unlike prior approaches that rely only on attribution (Shapley) or step-level labels (PRM), our method produces local, signed, and credit-conserving signals. In success cases, Shapley-based credit assignment fairly allocates outcomes across agents and is refined into per-message rewards that promote cooperation while discouraging redundancy or sabotage; in failure cases, first-error localization yields repair-aware preferences that penalize harmful steps while rewarding corrective attempts. The resulting signals are bounded, cooperative, and directly compatible with reinforcement- or preference-based post-training, providing a unified and auditable pathway from global evaluation to local supervision in LLM multi-agent training. Our contribution is conceptual: we present a theoretical foundation and training signals, leaving empirical validation for future work.
BibTeX
@misc{yang2025who,
author = {Chih-Hsuan Yang and Tanwi Mallick and Le Chen and Krishnan Raghavan and Azton Wells and Amal Gueroudji and Ian Foster and Rajeev Thakur},
title = {{Who Gets the Reward \& Who Gets the Blame? Evaluation-Aligned Training Signals for Multi-LLM Agents}},
year = {2025},
eprint = {2511.10687},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2511.10687},
}