MultiCoPIE: A Multilingual Corpus of Potentially Idiomatic Expressions for Cross-lingual PIE Disambiguation

Uliana Sentsova, Debora Ciminari, Josef van Genabith, Cristina España-Bonet2025 · DOI

Abstract

Language models excel at compositionality but often struggle with non-compositional phenomena like idioms. This work introduces MultiCoPIE, a corpus of potentially idiomatic expressions (PIEs) in Catalan, Italian, and Russian. By fine-tuning XLM-RoBERTa on English PIE data and evaluating cross-lingual transfer, we demonstrate that models can effectively generalize idiomaticity detection to unseen languages. Performance is notably higher for "shared idioms"—those with direct English counterparts—highlighting the role of cross-lingual lexical overlap in model generalization.

Introduction

In natural language processing, the principle of compositionality suggests that the meaning of a complex expression is determined by the meanings of its constituent parts. Idioms like "kick the bucket" or "break the ice" defy this principle. Many are Potentially Idiomatic Expressions (PIEs), which can be interpreted either figuratively or literally depending on the context. While English has extensive resources for PIE disambiguation, other languages lack such data. This paper introduces MultiCoPIE to bridge this gap and explores the efficacy of cross-lingual transfer from English to Catalan, Italian, and Russian.

The MultiCoPIE Corpus

The MultiCoPIE corpus was manually curated by extracting idiom instances from the OSCAR web corpus. It includes 123 Catalan, 111 Italian, and 145 Russian idioms, totaling nearly 8,000 annotated instances. Each entry provides linguistic features such as semantic compositionality, part-of-speech tags for the idiom head, and English equivalents.

Table 1: Statistics of the MultiCoPIE corpus across Catalan, Italian, and Russian.

Methodology

The researchers used XLM-RoBERTa, a transformer model pre-trained on over 100 languages. The model was fine-tuned on the English MAGPIE corpus and the SemEval-2022 Task 2a dataset. Evaluation focused on three settings: zero-shot (testing on unseen idioms), one-shot (seeing one example of an idiom), and random (standard mixed training). The study also investigated the impact of surrounding context (sentences before and after the target) on disambiguation performance.

Results and Discussion

The "Shared Idiom" Advantage

A significant driver of performance is cross-lingual lexical overlap. Idioms with direct counterparts in English (e.g., Italian rompere il ghiaccio vs. English break the ice) are classified with much higher accuracy. For "shared and seen" idioms, accuracy reached 0.95 across all languages. This suggests that the model leverages shared semantic embeddings across languages for these equivalents.

Contextual Impact

Surprisingly, providing additional surrounding context did not significantly improve performance. The "signal" for idiomaticity appears to be largely contained within the sentence containing the PIE itself. In some instances, extra context even acted as a distractor for the model, leading to slightly lower precision.

Cross-Lingual Transfer Performance

The English-tuned model demonstrated strong zero-shot transfer capabilities. For Catalan and Italian, the cross-lingual model achieved F1-scores of 0.94 and 0.92 respectively, outperforming models trained on limited native data. However, for Russian, a monolingual baseline remained more effective (0.91 F1 vs. 0.89 F1), likely due to the language's higher morphological complexity and its substantial representation in the original XLM-R pre-training.

Table 2: Performance metrics for the cross-lingual model compared to baselines across the three target languages.

Conclusion

The introduction of MultiCoPIE enables more robust research into multilingual idiomaticity. The results confirm that cross-lingual transfer is a viable strategy for PIE disambiguation, especially when idioms share lexical or semantic roots across languages. Future work will expand this research to non-Indo-European languages and address the natural data imbalance between figurative and literal usages.

Summary updated

Abstract

Language models are able to handle compositionality and, to some extent, noncompositional phenomena such as semantic idiosyncrasy, a feature most prominent in the case of idioms.This work introduces the MultiCoPIE corpus that includes potentially idiomatic expressions in Catalan, Italian, and Russian, extending the language coverage of PIE corpus data.The new corpus provides additional linguistic features of idioms, such as their semantic compositionality, part-of-speech of idiom head as well as their corresponding idiomatic expressions in English.With this new resource at hand, we first fine-tune an XLM-RoBERTa model to classify figurative and literal usage of potentially idiomatic expressions in English.We then study cross-lingual transfer to the languages represented in the MultiCoPIE corpus, evaluating the model's ability to generalize an idiom-related task to languages not seen during fine-tuning.We show the effect of 'cross-lingual lexical overlap': the performance of the model, fine-tuned on English idiomatic expressions and tested on the MultiCoPIE languages, increases significantly when classifying 'shared idioms'idiomatic expressions that have direct counterparts in English with similar form and meaning.While this observation raises questions about the generalizability of cross-lingual learning, the results from experiments on PIEs demonstrate strong evidence of effective cross-lingual transfer, even when accounting for idioms similar across languages.
BibTeX
@misc{sentsova2025multicopie,
  author = {Uliana Sentsova and Debora Ciminari and Josef van Genabith and Cristina España-Bonet},
  title = {{MultiCoPIE: A Multilingual Corpus of Potentially Idiomatic Expressions for Cross-lingual PIE Disambiguation}},
  year = {2025},
  doi = {10.18653/v1/2025.mwe-1.8},
}
Figure