The entropic basis of collective behaviour

Richard P. Mann, Roman GarnettJournal of The Royal Society Interface 2015 · DOI

TL;DR

This paper proposes a novel framework for understanding collective behavior by applying the principle of maximum entropy to an agent's future possibilities. It demonstrates that agents maximizing their future path entropy naturally exhibit cohesive behavior, leading to collective intelligence and social interaction rules akin to Weber's Law, without needing explicit models of information transfer or social forces.

What Problem Does This Paper Address?

Understanding how groups of intelligent agents, from animals to humans, exhibit collective intelligence and coordinated behavior is a long-standing challenge. While existing models often focus on individual decision-making, information cascades, or abstract "social forces," this paper aims to provide a more fundamental, unifying explanation rooted in statistical mechanics. Specifically, it seeks to explain emergent group phenomena like cohesion and intelligent decision-making from a purely entropic perspective, without pre-specifying interaction rules or information flow mechanisms.

Methods

The core of the paper is the application of the "causal entropic principle" to collective decision-making. This principle posits that intelligent agents will choose behaviors that maximize their uncertainty (entropy) over all possible future paths. The authors develop an abstract model where agents face a branching tree of future choices, with each branch leading to an unknown number of subsequent options. They then derive the optimal distribution of agents across these choices by assuming they uniformly distribute themselves across the final possible outcomes, weighted by the probability of those future trees. This leads to a probabilistic model for group decisions. They extend this to continuous decision spaces and derive emergent social interaction rules.

Datasets

Not discussed in the paper. The paper focuses on theoretical modeling and simulation of hypothetical scenarios rather than empirical data analysis.

Key Insights and Ideas

  • Entropy as a Driver of Cohesion: The most striking insight is that maximizing future path entropy, rather than immediate gain or explicit coordination, naturally leads to group cohesion. Agents tend to stick together to explore a wider range of future possibilities collectively.
  • Emergent Social Forces: The paper shows that common assumptions in collective behavior models, such as "social forces" or linearly additive interactions, can emerge as a consequence of this entropic principle, rather than being fundamental.
  • Weber's Law as a Fundamental Interaction Rule: The derived social interaction rules for individual agents closely resemble Weber's Law, suggesting a fundamental, statistically-derived basis for this observed stimulus-response relationship in biological systems.
  • Collective Intelligence from Ignorance: The framework suggests that collective intelligence arises not from perfect knowledge, but from a principled way of dealing with uncertainty about the future.

Key Results

  • The model predicts a tendency for groups to reach a consensus decision, especially when the probability of future branches becoming extinct is high.
  • For a group of eight agents deciding between two options with unequal future branching, the causal entropic prediction shows significantly greater cohesion (agents choosing the same option) compared to random choice.
  • The derived social interaction rule for an individual agent, conditioned on the choices of others, perfectly matches Weber's Law with a single "pseudo-observation."
  • The model predicts that collective intelligence, such as a group's ability to avoid a threat, increases with group size and is influenced by the probability of future path extinction, mirroring findings from "many-eyes" models.

Limitations and Future Work

  • Conflicting Information/Preferences: The current model assumes a consistent rule for all agents and doesn't explicitly handle groups with conflicting information or preferences, which is acknowledged as a limitation. Future work could explore assigning different beliefs to agents.
  • Continuous Space Generalization: While the paper sketches how the model could apply to continuous spaces (e.g., collective motion), a full quantitative derivation for such scenarios is left for future research.
  • Empirical Validation: The paper is primarily theoretical. Future work would involve testing these predictions against empirical data from animal groups and human populations.
  • Broader Applications: The authors suggest the causal entropic principle could be a general framework for understanding complex intelligent systems beyond animal groups, including organizations and global social systems, which warrants further exploration.

Summary updated

Abstract

We identify a unique viewpoint on the collective behaviour of intelligent agents. We first develop a highly general abstract model for the possible future lives these agents may encounter as a result of their decisions. In the context of these possibilities, we show that the causal entropic principle, whereby agents follow behavioural rules that maximize their entropy over all paths through the future, predicts many of the observed features of social interactions among both human and animal groups. Our results indicate that agents are often able to maximize their future path entropy by remaining cohesive as a group and that this cohesion leads to collectively intelligent outcomes that depend strongly on the distribution of the number of possible future paths. We derive social interaction rules that are consistent with maximum entropy group behaviour for both discrete and continuous decision spaces. Our analysis further predicts that social interactions are likely to be fundamentally based on Weber's law of response to proportional stimuli, supporting many studies that find a neurological basis for this stimulus-response mechanism and providing a novel basis for the common assumption of linearly additive 'social forces' in simulation studies of collective behaviour.
BibTeX
@article{mann2015entropic,
  author = {Richard P. Mann and Roman Garnett},
  title = {{The entropic basis of collective behaviour}},
  journal = {Journal of The Royal Society Interface},
  year = {2015},
  doi = {10.1098/rsif.2015.0037},
}
Figure