No article text was recorded for this version.
pre-training task misalignment
Version 2 of 2167 papers172 conceptsfrozen 2026-10-04
Papers in this version
- Blog: HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification
- Blog: Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner
- Blog: An Investigation of Suitability of Pre-Trained Language Models for Dialogue Generation - Avoiding Discrepancies
- Blog: The Power of Scale for Parameter-Efficient Prompt Tuning
- Blog: Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models
- Blog: NER-BERT: A Pre-trained Model for Low-Resource Entity Tagging
- Blog: Rethinking Invariance in In-context Learning
- Blog: PPT: Pre-trained Prompt Tuning for Few-shot Learning
- Blog: DSP: Discriminative Soft Prompts for Zero-Shot Entity and Relation Extraction
- Blog: PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation
- Blog: General Framework for Self-Supervised Model Priming for Parameter-Efficient Fine-tuning
- Blog: Towards Unified Prompt Tuning for Few-shot Text Classification
- Blog: Meta Learning for Natural Language Processing: A Survey
- Blog: Multi-pretraining for Large-scale Text Classification
- Blog: METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
- Blog: Leveraging Prompt Learning and Pause Encoding for Alzheimer's Disease Detection
- Blog: MVP: Multi-task Supervised Pre-training for Natural Language Generation
- Blog: Synthesize, Prompt and Transfer: Zero-shot Conversational Question Generation with Pre-trained Language Model
- Blog: Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognition
- Blog: Making Parameter-efficient Tuning More Efficient: A Unified Framework for Classification Tasks
- Blog: Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner
- Blog: Efficient Intent Detection with Dual Sentence Encoders
- Blog: MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models
- Blog: Solving Aspect Category Sentiment Analysis as a Text Generation Task
- Blog: Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors
- Blog: Description-Driven Task-Oriented Dialog Modeling
- Blog: Unsupervised Pre-training for Biomedical Question Answering
- Blog: Enhancing Pre-Trained Language Representations Based on Contrastive Learning for Unsupervised Keyphrase Extraction
- Blog: What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?
- Blog: Instruction Pre-Training: Language Models are Supervised Multitask Learners
- Blog: Zero-Shot Code Representation Learning via Prompt Tuning
- Blog: Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification
- Blog: Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning
- Blog: Rethink the Effectiveness of Text Data Augmentation: An Empirical Analysis
- Blog: Token Prediction as Implicit Classification for Generative AI Authorship Verification
- Blog: Enhancing Tabular Reasoning with Pattern Exploiting Training
- Blog: DirectQE: Direct Pretraining for Machine Translation Quality Estimation
- Blog: mPMR: A Multilingual Pre-trained Machine Reader at Scale
- Blog: Bridging the Gap between Language Model and Reading Comprehension: Unsupervised MRC via Self-Supervision
- Blog: Automatic Bi-modal Question Title Generation for Stack Overflow with Prompt Learning
- Blog: Declaration-based Prompt Tuning for Visual Question Answering
- Blog: Meta-tuning Language Models to Answer Prompts Better
- Blog: Unsupervised Pre-training for Natural Language Generation: A Literature Review
- Blog: CPT: Colorful Prompt Tuning for pre-trained vision-language models
- Blog: ConVEx: Data-Efficient and Few-Shot Slot Labeling
- Blog: BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining
- Blog: Finetuned Language Models are Zero-Shot Learners
- Blog: Prompt-Learning for Cross-Lingual Relation Extraction
- Blog: Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding
- Blog: Integration of Old and New Knowledge for Generalized Intent Discovery: A Consistency-driven Prototype-Prompting Framework
- Blog: From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Models to Pre-trained Machine Reader
- Blog: Instruction Tuning for Large Language Models: A Survey
- Blog: P3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning
- Blog: Exploiting Contextual Target Attributes for Target Sentiment Classification
- Blog: HybridPrompt: Bridging Language Models and Human Priors in Prompt Tuning for Visual Question Answering
- Blog: Simple and Effective Semi-Supervised Question Answering
- Blog: LabelPrompt: Effective Prompt-based Learning for Relation Classification
- Blog: OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue
- Blog: When Phrases Meet Probabilities: Enabling Open Relation Extraction with Cooperating Large Language Models
- Blog: PUnifiedNER: A Prompting-Based Unified NER System for Diverse Datasets
Showing 60 of 167 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_pre_training_task_misalignment_ef3d0341,
title = {pre-training task misalignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/pre-training-task-misalignment/rdr_ef3d0341256248b5b8bcc0a31c6f5a49},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}This exact version (version 2, frozen text):
@misc{lacuna_pre_training_task_misalignment_ef3d0341_v2,
title = {pre-training task misalignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/pre-training-task-misalignment/rdr_ef3d0341256248b5b8bcc0a31c6f5a49/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-22},
}