No article text was recorded for this version.
masked language modeling
Version 1 of 154 papers54 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Transformer Architectures for Vocabulary Test Item Difficulty Prediction
- Blog: RoBERT – A Romanian BERT Model
- Blog: Arabic Dialect Identification Using BERT-Based Domain Adaptation
- Blog: Generative or Discriminative? Revisiting Text Classification in the Era of Transformers
- Blog: Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model
- Blog: Pretraining without wordpieces: learning over a vocabulary of millions of words
- Blog: Enhancing SPARQL Generation by Triplet-order-sensitive Pre-training
- Blog: LiBERTa: Advancing Ukrainian Language Modeling through Pre-training from Scratch
- Blog: CebBERT: A Lightweight Data-Transparent DistilBERT Model for Cebuano Language Processing
- Blog: A Language Model Trained on Uruguayan Spanish News Text
- Blog: Can bidirectional encoder become the ultimate winner for downstream applications of foundation models?
- Blog: SocBERT: A Pretrained Model for Social Media Text
- Blog: Cross-Lingual Universal Dependency Parsing Only From One Monolingual Treebank
- Blog: Self-Supervised Intermediate Fine-Tuning of Biomedical Language Models for Interpreting Patient Case Descriptions
- Blog: FlauBERT : des modèles de langue contextualisés pré-entraînés pour le français
- Blog: An Investigation of Noise in Morphological Inflection
- Blog: Contrastive learning of T cell receptor representations
- Blog: Sentiment Analysis of Sinhala News Comments Using Transformers
- Blog: Failure Identification from Unstable Log Data using Deep Learning
- Blog: Scaling Sparse and Dense Retrieval in Decoder-Only LLMs
- Blog: A Pretrained Language Model for Cyber Threat Intelligence
- Blog: Too Many Cooks Spoil the Model: Are Bilingual Models for Slovene Better than a Large Multilingual Model?
- Blog: Experiments in Multi-Variant Natural Language Processing for Nahuatl
- Blog: Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese
- Blog: Linguistic Productivity: the Case of Determiners in English
- Blog: Masked Reasoner at SemEval-2020 Task 4: Fine-Tuning RoBERTa for Commonsense Reasoning
- Blog: Identifying Faked Responses in Questionnaires with Self-Attention-Based Autoencoders
- Blog: Enhancing Transformer Models for Igbo Language Processing: A Critical Comparative Study
- Blog: MedAI at SemEval-2021 Task 10: Negation-aware Pre-training for Source-free Negation Detection Domain Adaptation
- Blog: A Bidirectional Transformer Based Alignment Model for Unsupervised Word Alignment
- Blog: AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation
- Blog: Coarse-Tuning for Ad-hoc Document Retrieval Using Pre-trained Language Models
- Blog: Representation Learning for Stack Overflow Posts: How Far are We?
- Blog: Chat GPT: From Natural Language Processing to Responsible AI - Implications, Challenges, and Future Developments
- Blog: FBK@SMM4H2020: RoBERTa for Detecting Medications on Twitter
- Blog: CodeSSM: Towards State Space Models for Code Understanding
- Blog: Lacuna Language Learning: Leveraging RNNs for Ranked Text Completion in Digitized Coptic Manuscripts
- Blog: Challenges in Neural Language Identification: NRC at VarDial 2020
- Blog: Analyzing BERT's Knowledge of Hypernymy via Prompting
- Blog: THE ILLUSION OF LATENT GENERALIZATION: BI- DIRECTIONALITY AND THE REVERSAL CURSE
- Blog: AMBERT: A Pre-trained Language Model with Multi-Grained Tokenization
- Blog: Task Compass: Scaling Multi-task Pre-training with Task Prefix
- Blog: HanTrans: An Empirical Study on Cross-Era Transferability of Chinese Pre-trained Language Model
- Blog: From FreEM to D'AlemBERT: a Large Corpus and a Language Model for Early Modern French
- Blog: Reasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddings
- Blog: mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models
- Blog: ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification
- Blog: POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training
- Blog: Microsoft Translator at WMT 2019: Towards Large-Scale Document-Level Neural Machine Translation
- Blog: On the importance of pre-training data volume for compact language models
- Blog: MANER: Mask Augmented Named Entity Recognition for Extreme Low-Resource Languages
- Blog: mALBERT: Is a Compact Multilingual BERT Model Still Worth It?
- Blog: Semi-supervised Meta-learning for Cross-domain Few-shot Intent Classification
- Blog: HateBERT: Retraining BERT for Abusive Language Detection in English
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_masked_language_modeling_0c347ba9,
title = {masked language modeling},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/masked-language-modeling/rdr_0c347ba95865481885cd500e50c9bded},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_masked_language_modeling_0c347ba9_v1,
title = {masked language modeling},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/masked-language-modeling/rdr_0c347ba95865481885cd500e50c9bded/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}