Abstract
The supply of public goods, such as pandemic control, often requires individuals or regions to sacrifice local interests for collective welfare, leading to a crisis of governance legitimacy. This paper applies Multi-Agent Reinforcement Learning (MARL) to computationally model the "Calculus of Consent"—a social choice theory explaining why rational agents waive liberties for the common good. We demonstrate that as regions increase their collaboration level, they transition from self-centered policies to altruistic strategies that maximize global welfare and protect vulnerable populations.
Introduction
Providing public goods like climate mitigation or pandemic management creates a fundamental tension between local economic interests and shared global benefits. Centralized authorities often struggle to justify restrictive policies to self-interested local governments whose economies may suffer. This paper addresses the need for a framework that can quantitatively reason through these trade-offs, providing a rational basis for collaborative governance. We propose that MARL can serve as a "computational reasoning" tool to justify the "Calculus of Consent," where independent regions voluntarily accept restrictions to achieve superior global outcomes.
The Intelligent Region Collaboration (IRC) Framework
We introduce the Intelligent Region Collaboration (IRC) framework, which models regions as autonomous learning agents within a MARL environment.
Architecture and Reward Mixing
The core of the IRC framework is a reward mixing ratio, $\alpha$. Each agent $i$ optimizes a weighted sum of its local reward $R_i$ and the global reward $R_g$: $$\tilde{R}_i = R_i + \alpha R_g$$ By varying $\alpha$, we simulate a spectrum of collaboration levels, from purely self-interested ($\alpha \approx 0$) to highly altruistic.
The model utilizes Graph Neural Networks (GNNs) to capture regional interdependencies and a decoupled critic architecture. Each agent maintains a local critic for its own value and accesses a shared global critic, allowing it to balance individual and collective impacts during policy learning.
Epidemiological Environment
The environment is simulated using a Susceptible-Infected-Hospitalized-Recovered (SIHR) model. Costs are calculated based on pandemic tolerance (medical capacity) and lockdown tolerance (economic resilience). Agents decide the proportion of incoming traffic to permit, balancing infection control against economic mobility.
Experimental Setup
We evaluate the framework in a 5-region artificial environment. Region 0 serves as the outbreak source. The remaining four regions represent combinations of high/low pandemic tolerance ($H$) and high/low lockdown tolerance ($L$). This setup allows for controlled experiments on how different regional characteristics influence collaborative behavior.
Results and Discussion
The IRC model consistently outperformed static and threshold-based baselines across all collaboration levels.
The Shift to Altruism
At low collaboration levels ($\alpha=0.01$), agents behave selfishly. Resilient regions maintain high mobility despite spreading the virus, while vulnerable regions are forced into extreme isolation. However, as $\alpha$ increases to 10.0, a significant shift occurs: resilient regions (high $L$) voluntarily enforce stricter controls to "shield" their more vulnerable neighbors (low $H$).
Balancing the Burden
Collaboration leads to a more equitable distribution of the economic burden. Instead of one region suffering total lockdown, the burden is shared to minimize global hospitalization and maximize total utility. As $\alpha$ increased from 0.01 to 10.0, global hospitalization dropped significantly from 59.46 to 27.21, while the global reward rose from 103.89 to 108.13. Radar plots of regional actions confirm that higher collaboration results in a "balanced" area of mobility, proving that agents learn to coordinate rather than acting in silos.
Conclusion
This work demonstrates that MARL can provide a computational foundation for collaborative governance. By quantifying the benefits of cooperation, the IRC framework offers a path toward legitimizing the sacrifices required for public goods. Future work will expand the action space to include intra-regional policies like vaccination and explore more complex macroeconomic indicators to refine the cost-benefit analysis of collaborative strategies.
Summary updated