The Min-Max theory of language behavior

Hiram RingarXiv 2026 · arXiv

TL;DR

The Min-Max theory proposes that language evolution is a tug-of-war between speaker efficiency (minimizing effort) and hearer clarity (maximizing information). By using computational simulations, this paper demonstrates that while modern AI models are "self-centered" producers that push complex information to the end of a sentence, human language is uniquely shaped by a "hearer-centric" drive to front-load important content.

What Problem Does This Paper Address?

A central mystery in linguistics is why word orders (like Subject-Verb vs. Verb-Subject) shift over centuries. Previous theories often focused on a single driver: either production efficiency (making it easy for the speaker) or surprisal minimization (making it clear for the listener).

The "Min-Max" theory attempts to unify these into a single optimization process. However, earlier work was largely based on post-hoc observations of language corpora. This paper seeks to move from description to validation, using mathematical modeling and neural networks to see if these "universal forces" actually trigger the structural changes we see in history.

Methods

The author employs a multi-pronged computational approach:

  • Dynamical Replicator Systems: A mathematical framework that treats different word orders as "variants" competing for survival in a population over generations.
  • Information Bottleneck Grounding: Instead of just counting characters (which is biased by spelling), the paper defines "word weight" using Description Length (bits)—the actual amount of information a word carries in a vector space.
  • Iterated Learning Paradigm (ILP): Simulating "generations" of AI agents where the output of one model becomes the training data for the next.
  • Atomic Token Forcing: A technical fix to prevent standard tokenizers (like BPE) from artificially penalizing long words by splitting them into multiple pieces. This ensures the model reacts to the weight of the information, not just the number of tokens.

Datasets

  • Synthetic Data: The primary experiments use abstract, synthetic corpora designed to isolate variables like token length and informational weight ($\alpha$).
  • taggedPBC: A massive parallel corpus of 1,942 natural languages is used as the "ground truth" to compare AI behavior against real-world human language patterns.

Key Insights and Ideas

  • The "Syntactic Ceiling": Pre-trained models like GPT-2 are too "frozen" by their training data to evolve. They exhibit a rigid preference for their native word order (English SV), regardless of how much you manipulate word length.
  • Generational Hysteresis: Language change isn't a smooth slide; it’s a "snap." Grammars possess structural inertia, staying locked in an old pattern even after the pressures that created it have vanished, until a critical threshold is crossed.
  • The Human-Machine Divergence: This is the "aha moment." Causal transformers (like GPT) are architecturally "speaker-centric." They prefer a "Historical Runway"—placing short, easy tokens first to make the heavy, high-information tokens easier to process at the end.
  • Hearer-Centricity: Human languages often do the opposite. In languages with complex verbs, humans tend to front-load the "heavy" verb (VS order). This suggests human evolution prioritizes the listener's need for immediate context over the speaker's ease.

Key Results

The paper identifies that word order evolution acts as a step-function. In "tabula rasa" (starting from scratch) models, increasing the informational pressure ($\alpha$) triggers a sudden phase transition in word order.

As shown in the evaluation of pre-trained models, the "syntactic ceiling" is incredibly high. Even when a noun is "extremely heavy" (43 characters), the model's preference for the standard Subject-Verb (SV) order barely budges, as seen in the narrow margins of Table 1:

Table 1: LLM word order preferences showing the "syntactic ceiling" in GPT-2.

In contrast, the Phonetic Elision experiments showed that as words "eroded" (got shorter) over generations, the grammar remained stable for three generations before suddenly "collapsing" into a new word order at Generation 4.

Limitations and Future Work

The biggest limitation identified is the causal mask of current LLMs. Because they only look "backward" to predict the next token, they are fundamentally biased toward speaker-centric optimization.

The author suggests that future work should move away from simple "next-token" prediction and instead use Encoder-Decoder communication games. By forcing two agents to cooperate over a "noisy channel," researchers might better simulate the bidirectional feedback loops that drive real human language evolution. Additionally, the model needs to be expanded from simple intransitive sentences (SV/VS) to more complex transitive structures (SOV, SVO, VSO).

Summary updated

Abstract

The "Min-Max" theory of language behavior proposes that humans engage simultaneously in minimization of processing effort and maximization of information content, and that this is a primary driver in language evolution (Ring, 2025). This claim seeks to unify observations from language processing (Mahowald et al., 2013; Futrell et al., 2015; Yadav et al., 2020; Hawkins, 2014), interaction (Hörberg and Sjons, 2023; Tucker et al., 2025; Jaeger and Tily, 2011; Smith and Culbertson, 2025), and corpora (Levshina and Moran, 2021; Levshina, 2023; Newmeyer, 2017), which suggest that considerations of processing efficiency and information content are both implicated in human communication. The interaction between these two processes provides an explanation for human linguistic behavior at various levels (Linders and Louwerse, 2023) and predicts historical developments in language, i.e. related to word order (Ring, 2025). Given that the original formulation of the Min-Max theory is based on observational data, the current paper seeks to validate the theory mathematically. Through a series of experiments that use computational models to investigate the theory's predictions, pretrained and iterated learning models are queried with synthetic data. The experiments show that manipulating the variables of token length and the weight of information content in a tabula rasa model results in word order change, as predicted by the theory. The experiments also identify important differences between computational models and observations of human language data, suggesting that current transformer-based language models may not accurately represent psycholinguistic processes. The overall findings indicate that evolutionary trajectories in language are highly susceptible to minimization of processing and maximization of information content.
BibTeX
@misc{ring2026min,
  author = {Hiram Ring},
  title = {{The Min-Max theory of language behavior}},
  year = {2026},
  eprint = {2611.04406},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.04406},
}
Figure