Competition and Selection Among Conventions

Rahmtin Rotabi, Cristian Danescu-Niculescu-Mizil, Jon KleinbergarXiv 2017 · DOI · arXiv

TL;DR

How do arbitrary social conventions—like community jargon or coding styles—win out over their competitors? By analyzing 24 years of arXiv LaTeX source files, this paper reveals that the success of a convention depends heavily on the experience of its adopters and its public visibility. Crucially, the authors find a striking division of labor in collaborations: younger researchers win "invisible" fights (like macro names), while senior researchers dictate highly "visible" choices (like paper titles).

What Problem Does This Paper Address?

Conventions constantly compete for dominance in social and technical ecosystems. However, studying how one convention triumphs over another is notoriously difficult due to two main challenges:

  1. Substantive Shift: As conventions evolve, their underlying meaning often changes too. For example, if a new political slogan catches on, it might be because it carries a slightly different, more appealing message, confounding purely social network effects. To isolate social dynamics, researchers need neutral variation—instances where the meaning stays exactly the same, but the form changes.
  2. Local vs. Global Dynamics: Most diffusion models look at global trends (how an idea spreads across a whole population), but conventions are often negotiated locally, face-to-face, when individuals interact or collaborate.

The authors tackle these challenges by finding a perfect digital laboratory: user-defined LaTeX macros in scientific papers.

Methods

In LaTeX, a macro consists of a name (the convention) and a body (the exact code/meaning). For example, \def\Reals{\mathbb{R}} and \def\R{\mathbb{R}} have different names but identical bodies. This provides a perfect control for meaning.

The authors define two main phenomena to track competition:

  • Changeovers: Global shifts where one macro name replaces another for the same body over time.
  • Fights: Local interactions where two authors who previously used different names for the same macro body collaborate on a new two-authored paper. The name that appears in the joint paper is the "winner."

The authors use logistic regression to predict the outcomes of both global changeovers and local fights. To test the effect of visibility, they extend this "fight" framework from invisible macro names to highly visible paper title styles (e.g., use of colons or question marks) and low-visibility macro bodies (e.g., choosing between \epsilon and \varepsilon).

Datasets

The dataset comes from a complete snapshot of source files from the e-print arXiv, spanning 24 years (July 1991 to September 2015).

From over a million papers, they extracted macros from the subset written in LaTeX, resulting in:

  • 583,078 papers containing at least one macro.
  • 22,628,300 total macro definitions.
  • 2,586,548 unique macro bodies.
  • 222,689 unique authors.

Key Insights and Ideas

  • The Name Doesn't Matter, the Network Does: Orthographic features of a macro name (length, capitalization) have zero predictive power over whether it will become dominant. Success is driven entirely by social structure and adopter characteristics.
  • The Generational Hand-off: Successful conventions typically start among "younger" (less experienced) authors and successfully transition to "older" (more experienced) authors. If a convention stays trapped among less experienced authors, or starts entirely with senior authors, it rarely achieves global dominance.
Average usage and adoption experience for macro names over time.
  • The Visibility Caricature: There is a clear power dynamic based on how visible a choice is to the public. In a collaboration, younger researchers win the invisible fights (macro names), while older researchers win the visible ones (paper titles). Senior authors willingly cede control over low-level implementation details but assert authority over public-facing presentation.

Key Results

  • Global Changeover Prediction: Using only the experience levels of early adopters, the authors predicted whether a macro would undergo a global changeover with 60% accuracy (compared to a 50% random baseline). Name features yielded exactly 50%.
Figure 1: Changeover in conventions. (a) An example changeover: \fund surpasses the once-dominant \Yfund as the preferred name used to invoke Young tableau; y-axis indicates the percentage of users of each name out of all authors using the respective body. (b) Aggregated temporal usage trends of early name (Ne) and late name (Nℓ) for all macros undergoing changeovers; their crossing point is well before the middle of their lifespan. (c) The distribution of crossing points (percentage out of all macros undergoing changeovers).
  • Local Macro Fights: Younger authors dominate macro name fights. A model using just the experience of the two authors predicted the winner with 58.2% accuracy, which improved to 67.3% when adding network features (like betweenness centrality) and author flexibility.
  • The Visibility Reversal: As the experience gap between co-authors grows, the younger author becomes increasingly likely to win invisible macro name fights. Conversely, in highly visible title style fights, the older author wins 57% of the time, and their win rate increases as the experience gap widens.
Win rates for older authors across invisible, visible, and low-visibility fights.

Limitations and Future Work

  • Domain Specificity: The study is restricted to the arXiv, a community with unique collaboration norms and demographics. How well these findings generalize to other collaborative environments, like open-source software development or corporate settings, remains to be seen.
  • Co-authorship Proxy: The paper treats the final submitted LaTeX file as the ground truth for a "fight," but cannot observe the actual iterative editing process or conversations that led to those choices.
  • Future Directions: The authors suggest applying this methodology to large source-code repositories (like GitHub) where naming conventions change while code behavior remains constant, and building formal mathematical models of convention evolution based on biological evolutionary theories.

Summary updated

Abstract

In many domains, a latent competition among different conventions determines which one will come to dominate. One sees such effects in the success of community jargon, of competing frames in political rhetoric, or of terminology in technical contexts. These effects have become widespread in the online domain, where the data offers the potential to study competition among conventions at a fine-grained level. In analyzing the dynamics of conventions over time, however, even with detailed on-line data, one encounters two significant challenges. First, as conventions evolve, the underlying substance of their meaning tends to change as well; and such substantive changes confound investigations of social effects. Second, the selection of a convention takes place through the complex interactions of individuals within a community, and contention between the users of competing conventions plays a key role in the convention's evolution. Any analysis must take place in the presence of these two issues. In this work we study a setting in which we can cleanly track the competition among conventions. Our analysis is based on the spread of low-level authoring conventions in the eprint arXiv over 24 years: by tracking the spread of macros and other author-defined conventions, we are able to study conventions that vary even as the underlying meaning remains constant. We find that the interaction among co-authors over time plays a crucial role in the selection of them; the distinction between more and less experienced members of the community, and the distinction between conventions with visible versus invisible effects, are both central to the underlying processes. Through our analysis we make predictions at the population level about the ultimate success of different synonymous conventions over time--and at the individual level about the outcome of "fights" between people over convention choices.
BibTeX
@misc{rotabi2017competition,
  author = {Rahmtin Rotabi and Cristian Danescu-Niculescu-Mizil and Jon Kleinberg},
  title = {{Competition and Selection Among Conventions}},
  year = {2017},
  eprint = {1702.06527},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1702.06527},
}
Figure