Past, Present, Future: A Computational Investigation of the Typology of Tense in 1000 Languages

Ehsaneddin Asgari, Hinrich Schütze

Abstract

We present SuperPivot, an analysis method for low-resource languages that occur in a superparallel corpus, i.e., in a corpus that contains an order of magnitude more languages than parallel corpora currently in use. We show that SuperPivot performs well for the crosslingual analysis of the linguistic phenomenon of tense. We produce analysis results for more than 1000 languages, conducting - to the best of our knowledge - the largest crosslingual computational study performed to date. We extend existing methodology for leveraging parallel corpora for typological analysis by overcoming a limiting assumption of earlier work: We only require that a linguistic feature is overtly marked in a few of thousands of languages as opposed to requiring that it be marked in all languages under investigation.

Introduction

Most of the world’s 7,000+ languages are "low-resource," lacking the digital infrastructure—such as lexicons, parsers, and taggers—that powers modern Natural Language Processing (NLP). This scarcity makes large-scale linguistic typology, the study of how different languages structure information, a significant challenge. Traditional computational approaches often rely on the "limiting assumption" that a linguistic feature, such as the past tense, must be overtly and consistently marked in every language being studied.

This research introduces SuperPivot, a method designed to bridge the resource and encoding gaps. By leveraging "superparallel" corpora—specifically the Bible, which exists in over a thousand translations—the researchers demonstrate that it is possible to project linguistic markers from "overt" languages to those where such features are subtle or hidden. This study represents the largest cross-lingual computational investigation to date, covering over 1,000 languages.

Methodology: The SuperPivot Framework

The SuperPivot framework follows a five-step process to project linguistic knowledge across the Parallel Bible Corpus (PBC), which contains translations of the New Testament in 1,169 languages.

  1. Feature Selection: The study focuses on tense (past, present, and future) as a primary test case for typological analysis.
  2. Head Pivot Search: The researchers identify "head languages" where tense is marked cleanly and overtly. Creole languages, such as Seychelles Creole, are prioritized because they are often "younger" and exhibit more regular, surface-level markers compared to older languages with complex historical morphology.
  3. Expansion: Through word-level alignment, markers from these head languages are projected to 100 other languages to establish a robust set of "pivots."
  4. N-gram Projection: To bypass the need for pre-existing tokenizers, the system searches for character n-grams (sequences of 2-6 characters) that correlate with the pivots. This allows for the automatic discovery of suffixes like "-ed" in English or "-te" in German.
  5. Linguistic Analysis: The resulting markers are used to map tense usage across the entire corpus, allowing for a global comparison of linguistic structures.
Head pivots identified for past, present, and future tenses, highlighting the use of Creole languages as anchors.

Results and Typological Insights

The SuperPivot method proved highly effective, achieving a Mean Reciprocal Rank (MRR) of 0.85 in n-gram detection, indicating that the correct linguistic markers were consistently identified.

Tense as a Genetic Fingerprint

One of the most striking findings is that tense marking serves as a strong predictor of a language's genetic relationship. When languages mark tense similarly within the SuperPivot model, they are highly likely to belong to the same language family. This suggests that tense systems are deeply rooted in linguistic ancestry.

Typological Mapping

The study produced comprehensive visualizations that act as "maps" of global tense typology. These maps successfully cluster languages based on tense markers, revealing patterns that align closely with known language families. They even distinguish between subtle variations, such as "past progressive" versus "simple past," in languages for which no prior digital tools existed.

Typological tree showing the clustering of languages by tense markers, with colors indicating language families.

Discussion and Future Work

While SuperPivot is a powerful tool for low-resource language analysis, it faces challenges with "templatic" morphology, such as in Arabic, where meaning is changed through internal vowel shifts rather than additive prefixes or suffixes. Additionally, the reliance on the Bible as a primary corpus introduces potential noise due to free translation styles that may alter tense for naturalness in the target language.

Future research aims to extend this methodology beyond simple n-grams to capture more complex features like reduplication and templatic changes. The ultimate goal is to unify these findings into a single, comprehensive model of global tense typology, further closing the gap in our understanding of the world's diverse linguistic landscape.

Summary updated

Abstract

We present SuperPivot, an analysis method for low-resource languages that occur in a superparallel corpus, i.e., in a corpus that contains an order of magnitude more languages than parallel corpora currently in use. We show that SuperPivot performs well for the crosslingual analysis of the linguistic phenomenon of tense. We produce analysis results for more than 1000 languages, conducting - to the best of our knowledge - the largest crosslingual computational study performed to date. We extend existing methodology for leveraging parallel corpora for typological analysis by overcoming a limiting assumption of earlier work: We only require that a linguistic feature is overtly marked in a few of thousands of languages as opposed to requiring that it be marked in all languages under investigation.
BibTeX
@inproceedings{asgari2017past,
  author = {Ehsaneddin Asgari and Hinrich Schütze},
  title = {{Past, Present, Future: A Computational Investigation of the Typology of Tense in 1000 Languages}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2017},
  url = {https://openreview.net/forum?id=S1VWSGGubB},
}
Figure