No article text was recorded for this version.
domain-adaptive pre-training
Version 1 of 198 papers107 conceptsfrozen 2026-10-04
Papers in this version
- Blog: A Continual Pre-training Approach to Tele-Triaging Pregnant Women in Kenya
- Blog: The Road of Adaptive AI for Precision in Cybersecurity
- Blog: Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledge
- Blog: AdminSet and AdminBERT: a Dataset and a Pre-trained Language Model to Explore the Unstructured Maze of French Administrative Documents
- Blog: SemEval-2023 Task 10: Explainable Detection of Online Sexism
- Blog: CamemBERT-bio: Leveraging Continual Pre-training for Cost-Effective Models on French Biomedical Data
- Blog: PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English
- Blog: COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning
- Blog: BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition
- Blog: DCU at SemEval-2023 Task 10: A Comparative Analysis of Encoder-only and Decoder-only Language Models with Insights into Interpretability
- Blog: ConfliBERT-Arabic: A Pre-trained Arabic Language Model for Politics, Conflicts and Violence
- Blog: MilaNLP at SemEval-2023 Task 10: Ensembling Domain-Adapted and Regularized Pretrained Language Models for Robust Sexism Detection
- Blog: CrossNER: Evaluating Cross-Domain Named Entity Recognition
- Blog: UA-KO at SemEval-2022 Task 11: Data Augmentation and Ensembles for Korean Named Entity Recognition
- Blog: Deploying Multi-task Online Server with Large Language Model
- Blog: A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation
- Blog: DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores
- Blog: NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysis
- Blog: AdaPrompt: Adaptive Model Training for Prompt-based NLP
- Blog: Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling
- Blog: SkillSpan: Hard and Soft Skill Extraction from English Job Postings
- Blog: Domain adaptation in practice: Lessons from a real-world information extraction pipeline
- Blog: ELiRF-VRAIN at BioNLP Task 1B: Radiology Report Summarization
- Blog: A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios
- Blog: Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systems
- Blog: The challenges of temporal alignment on Twitter during crises
- Blog: PrecogIIITH@WASSA2023: Emotion Detection for Urdu-English Code-mixed Text
- Blog: Depression Risk Prediction for Chinese Microblogs via Deep-Learning Methods: Content Analysis
- Blog: Pre-trained Language Models for the Legal Domain: A Case Study on Indian Law
- Blog: Building Salesforce Neural Machine Translation System
- Blog: AdaPrompt: Adaptive Model Training for Prompt-based NLP
- Blog: RemoteCLIP: A Vision Language Foundation Model for Remote Sensing
- Blog: Sailor: Open Language Models for South-East Asia
- Blog: TADPOLE: Task ADapted Pre-Training via AnOmaLy DEtection
- Blog: Enhancing Rumor Detection Methods with Propagation Structure Infused Language Model
- Blog: Exploring Dense Retrieval for Dialogue Response Selection
- Blog: Investigating Continual Pretraining in Large Language Models: Insights and Implications
- Blog: COCO-DR: Combating the Distribution Shift in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning
- Blog: BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets
- Blog: SKAM at SemEval-2023 Task 10: Linguistic Feature Integration and Continuous Pretraining for Online Sexism Detection and Classification
- Blog: Named Entity Recognition with Small Strongly Labeled and Large Weakly Labeled Data
- Blog: Rethinking Semi-supervised Learning with Language Models
- Blog: Investigating Continual Pretraining in Large Language Models: Insights and Implications
- Blog: AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization
- Blog: AX-MABSA: A Framework for Extremely Weakly Supervised Multi-label Aspect Based Sentiment Analysis
- Blog: Structured and interpretable patient embeddings from Single-Cell Foundation Models
- Blog: DeepTagger: Knowledge Enhanced Named Entity Recognition for Web-Based Ads Queries
- Blog: Cross-domain Generalization for AMR Parsing
- Blog: Attention at SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS)
- Blog: How to age BERT Well: Continuous Training for Historical Language Adaptation
- Blog: Zero-Shot Entity Linking by Reading Entity Descriptions
- Blog: Using Language Models to Improve Rule-based Linguistic Annotation of Modern Historical Japanese Corpora
- Blog: Are we there yet? Exploring clinical domain knowledge of BERT models
- Blog: ELiRF-VRAIN at BioLaySumm: Boosting Lay Summarization Systems Performance with Ranking Models
- Blog: Quantifying Memorization in Continual Pre-training with Japanese General or Industry-Specific Corpora
- Blog: Pre-trained language models in Spanish for health insurance coverage
- Blog: Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association
- Blog: How Far Is Too Far? Studying the Effects of Domain Discrepancy on Masked Language Models
- Blog: How Useful is Continued Pre-Training for Generative Unsupervised Domain Adaptation?
- Blog: Parameter-Efficient Legal Domain Adaptation
Showing 60 of 98 papers.
History & citation
Current · Permanent link
- This direction split from Continual Pretraining for Domain Adaptation (81% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_domain_adaptive_pre_training_512120ce,
title = {domain-adaptive pre-training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/domain-adaptive-pre-training/rdr_512120ce741d4ee9af29eedac4194777},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_domain_adaptive_pre_training_512120ce_v1,
title = {domain-adaptive pre-training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/domain-adaptive-pre-training/rdr_512120ce741d4ee9af29eedac4194777/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}