No article text was recorded for this version.
multilingual evaluation gap
Version 1 of 1177 papers187 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Beyond Static Leaderboards: A Roadmap to Naturalistic, Functional Evaluation of LLMs
- Blog: HuLU: Hungarian Language Understanding Benchmark Kit
- Blog: Findings of the WMT 2022 Shared Tasks in Unsupervised MT and Very Low Resource Supervised MT
- Blog: SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects
- Blog: Lessons Learned from GPT-SW3: Building the First Large-Scale Generative Language Model for Swedish
- Blog: MUG-Eval: A Proxy Evaluation Framework for Multilingual Generation Capabilities in Any Language
- Blog: mGPT: Few-Shot Learners Go Multilingual
- Blog: Invited Talk: The Way Towards Massively Multilingual Language Models
- Blog: BEIR-NL: Zero-shot Information Retrieval Benchmark for the Dutch Language
- Blog: Everything you need to know about Multilingual LLMs: Towards fair, performant and reliable models for languages of the world
- Blog: SSF-KW: Keyword-Guided Multi-Task Learning for Robust Extractive Summarization
- Blog: Multi-Reference Benchmarks for Russian Grammatical Error Correction
- Blog: Achievements and Challenges in Japanese Question Answering: Insights from Quiz Competition Results
- Blog: Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning
- Blog: Navigating Text-to-Image Generative Bias Across Indic Languages
- Blog: Proceedings of the Second Workshop on Scaling Up Multilingual & Multi-Cultural Evaluation
- Blog: Navigating Text-to-Image Generative Bias across Indic Languages
- Blog: Prompting Large Language Models for Italian Clinical Reports: A Benchmark Study
- Blog: Russian SuperGLUE 1.1: Revising the Lessons not Learned by Russian NLP-models
- Blog: Neural Cross-Lingual Transfer and Limited Annotated Data for Named Entity Recognition in Danish
- Blog: Fauno: The Italian Large Language Model that will leave you senza parole!
- Blog: Testing Low-Resource Language Support in LLMs Using Language Proficiency Exams: the Case of Luxembourgish
- Blog: MINERS: Multilingual Language Models as Semantic Retrievers
- Blog: FewCLUE: A Chinese Few-shot Learning Evaluation Benchmark
- Blog: B-REASO: A Multi-Level Multi-Faceted Bengali Evaluation Suite for Foundation Models
- Blog: "Knowing When You Don't Know": A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation
- Blog: CLUE: A Chinese Language Understanding Evaluation Benchmark
- Blog: Dólares or Dollars? Unraveling the Bilingual Prowess of Financial LLMs Between Spanish and English
- Blog: Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes
- Blog: Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languages
- Blog: MedMT5: An Open-Source Multilingual Text-to-Text LLM for the Medical Domain
- Blog: Open foundation models for Azerbaijani language
- Blog: ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages
- Blog: KLUE: Korean Language Understanding Evaluation
- Blog: Multilingual Lexical Simplification via Paraphrase Generation
- Blog: Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models
- Blog: Goldfish: Monolingual Language Models for 350 Languages
- Blog: MULTI: multimodal understanding leaderboard with text and images
- Blog: RUSSE: The First Workshop on Russian Semantic Similarity
- Blog: CantoNLU: A benchmark for Cantonese natural language understanding
- Blog: Latxa: An Open Language Model and Evaluation Suite for Basque
- Blog: Developing High-Quality TTS for Punjabi and Urdu: Benchmarking against MMS Models
- Blog: MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs
- Blog: Distilling the Knowledge of Romanian BERTs Using Multiple Teachers
- Blog: skLEP: A Slovak General Language Understanding Benchmark
- Blog: FlauBERT: Unsupervised Language Model Pre-training for French
- Blog: GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages
- Blog: Fauno: The Italian Large Language Model that will leave you senza parole!
- Blog: Lego-MT: Towards Detachable Models in Massively Multilingual Machine Translation
- Blog: Benchmarking Hindi LLMs: A New Suite of Datasets and a Comparative Analysis
- Blog: IDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehension
- Blog: XNLI: Evaluating Cross-lingual Sentence Representations
- Blog: UINAUIL: A Unified Benchmark for Italian Natural Language Understanding
- Blog: Evaluating Contextualized Representations of (Spanish) Ambiguous Words: A New Lexical Resource and Empirical Analysis
- Blog: ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages
- Blog: Teasing LLMs Adapted to Italian
- Blog: Sequence Tagging with Contextual and Non-Contextual Subword Representations: A Multilingual Evaluation
- Blog: BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets
- Blog: Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models
- Blog: Pretraining Finnish ModernBERTs
Showing 60 of 177 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_multilingual_evaluation_gap_28588383,
title = {multilingual evaluation gap},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/multilingual-evaluation-gap/rdr_28588383400c40528ff546634f8c848b},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_multilingual_evaluation_gap_28588383_v1,
title = {multilingual evaluation gap},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/multilingual-evaluation-gap/rdr_28588383400c40528ff546634f8c848b/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}