No article text was recorded for this version.
random masking inefficiency (uninformative token masking)
Version 1 of 116 papers17 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Train No Evil: Selective Masking for Task-Guided Pre-Training
- Blog: Self-Evolution Learning for Discriminative Language Model Pretraining
- Blog: SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis
- Blog: DisorBERT: A Double Domain Adaptation Model for Detecting Signs of Mental Disorders in Social Media
- Blog: DILBERT: Customized Pre-Training for Domain Adaptation with Category Shift, with an Application to Aspect Extraction
- Blog: Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategies
- Blog: Saliency-based Multi-View Mixed Language Training for Zero-shot Cross-lingual Classification
- Blog: Difference-Masking: Choosing What to Mask in Continued Pretraining
- Blog: Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models
- Blog: Choose Your Words Wisely: Domain-adaptive Masking Makes Language Models Learn Faster
- Blog: Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation
- Blog: Prompt Discriminative Language Models for Domain Adaptation
- Blog: eMLM: A New Pre-training Objective for Emotion Related Tasks
- Blog: NB-MLM: Efficient Domain Adaptation of Masked Language Models for Sentiment Analysis
- Blog: Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords
- Blog: Knowledge Enhanced Masked Language Model for Stance Detection
History & citation
Current · Permanent link
- This direction split from Informed Masking for Efficient Language Model Adaptation (62% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_random_masking_inefficiency_uninformativ_4376d4be,
title = {random masking inefficiency (uninformative token masking)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/random-masking-inefficiency-uninformative-token-masking/rdr_4376d4bec317466f9721c82fc10cec16},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_random_masking_inefficiency_uninformativ_4376d4be_v1,
title = {random masking inefficiency (uninformative token masking)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/random-masking-inefficiency-uninformative-token-masking/rdr_4376d4bec317466f9721c82fc10cec16/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}