Predicting the Growth of Morphological Families from Social and Linguistic Factors

Valentin Hofmann, Janet B. Pierrehumbert, Hinrich Schütze

Introduction

When a topic explodes in the public consciousness, language does more than repeat existing terms; it mutates. The word "Trump," for instance, did not merely spike in frequency leading up to the 2016 U.S. election; it catalyzed an entire ecosystem of new terms, including trumpification, antitrumpism, and trumpster. This phenomenon illustrates the critical distinction between token frequency (the total count of a word) and type frequency (the number of unique, morphologically related words in a family).

Token and type frequency of the root 'trump' in r/politics, showing the surge leading up to the 2016 election.

In their ACL 2020 paper, Hofmann et al. investigate this through the lens of Morphological Family Expansion Prediction (MFEP). They seek to determine whether the growth of these "word families"—sets of words sharing a common root—can be predicted using social and linguistic indicators.

The MFEP Task and Methodology

The authors formalize MFEP as a binary classification task: given a "context interval" of 18 months, will a morphological family increase in size during the subsequent 6-month "probe interval"? To address this, they employed a Random Forest classifier to evaluate three categories of predictors:

  1. Linguistic (Endogenous): Current family size ($|F|$), testing the "rich-get-richer" hypothesis where larger families attract more affixes.
  2. Frequency-based (Exogenous): The "trending behavior" of the parent word ($z^{(p)}$), measured by frequency deviations from historical averages.
  3. Dissemination-based: Metrics tracking how widely a word is spread across users and threads, alongside its Topicality (niche specificity).

The study utilized a massive ten-year slice (2007–2018) of the Baumgartner Reddit Corpus, focusing on four diverse subreddits: r/politics, r/gaming, r/movies, and r/nba to capture a wide range of discourse.

Key Results and Insights

The Random Forest models achieved high predictive accuracy, reaching 80.9% for absolute growth and 70.8% for relative growth. Analysis of feature importance revealed several critical insights:

  • The "Rich-Get-Richer" Effect: Current family size emerged as the strongest predictor of future growth, accounting for approximately 39% of feature importance in absolute growth scenarios. Linguistically productive families tend to remain productive.
  • The Catalyst for Small Families: For smaller families, linguistic productivity is often insufficient for expansion. Instead, growth is primarily driven by the trending behavior of the parent word. External events act as the necessary catalyst for morphological innovation in these cases.
  • Predictability of Extremes: The model is significantly more effective at predicting large jumps in family size than minor fluctuations, suggesting that extreme linguistic shifts on social media are less "noisy" and more predictable than typical variations.
Feature importance for predicting absolute growth ($l_a$) in morphological families, highlighting the dominance of family size $|F|$.

Conclusion

This research demonstrates that morphological expansion is a predictable process driven by a combination of internal linguistic productivity and external social forcing. By identifying the factors that cause word families to "boom," MFEP offers a potential tool for virality detection and for understanding how communities reshape their vocabularies in response to a changing world.

Summary updated

BibTeX
@inproceedings{hofmann2020predicting,
  author = {Valentin Hofmann and Janet B. Pierrehumbert and Hinrich Schütze},
  title = {{Predicting the Growth of Morphological Families from Social and Linguistic Factors}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2020},
  doi = {10.18653/v1/2020.acl-main.649},
}
Figure