No article text was recorded for this version.
pre-training objective alignment
Version 2 of 2197 papers248 conceptsfrozen 2026-10-04
Papers in this version
- Blog: PPT: Pre-trained Prompt Tuning for Few-shot Learning
- Blog: DSP: Discriminative Soft Prompts for Zero-Shot Entity and Relation Extraction
- Blog: Synthesize, Prompt and Transfer: Zero-shot Conversational Question Generation with Pre-trained Language Model
- Blog: Unsupervised Pre-training for Biomedical Question Answering
- Blog: Discriminative Language Model as Semantic Consistency Scorer for Prompt-based Few-Shot Text Classification
- Blog: Efficient Data Learning for Open Information Extraction with Pre-trained Language Models
- Blog: Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Models
- Blog: Rethink the Effectiveness of Text Data Augmentation: An Empirical Analysis
- Blog: Token Prediction as Implicit Classification for Generative AI Authorship Verification
- Blog: CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuning
- Blog: A Good Prompt Is Worth Millions of Parameters? Low-resource Prompt-based Learning for Vision-Language Models
- Blog: Declaration-based Prompt Tuning for Visual Question Answering
- Blog: Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner
- Blog: Rethinking Visual Prompt Learning as Masked Visual Token Modeling
- Blog: FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization
- Blog: HybridPrompt: Bridging Language Models and Human Priors in Prompt Tuning for Visual Question Answering
- Blog: A Small and Fast BERT for Chinese Medical Punctuation Restoration
- Blog: Query-as-context Pre-training for Dense Passage Retrieval
- Blog: A Kernel-Based View of Language Model Fine-Tuning
- Blog: Zero-shot Triplet Extraction by Template Infilling
- Blog: Model-tuning Via Prompts Makes NLP Models Adversarially Robust
- Blog: Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?
- Blog: Inductive Graph Alignment Prompt: Bridging the Gap between Graph Pre-training and Inductive Fine-tuning From Spectral Perspective
- Blog: Advancing Pancreatic Cancer Prediction with a Next Visit Token Prediction Head on Top of Med-BERT
- Blog: FewshotQA: A simple framework for few-shot learning of question answering tasks using pre-trained text-to-text models
- Blog: Exploiting the Potential of Seq2Seq Models as Robust Few-Shot Learners
- Blog: Graph Prompting for Graph Learning Models: Recent Advances and Future Directions
- Blog: Toward a stable and low-resource PLM-based medical diagnostic system via prompt tuning and MoE structure
- Blog: InstructionNER: A Multi-Task Instruction-Based Generative Framework for Few-shot NER
- Blog: DirectQE: Direct Pretraining for Machine Translation Quality Estimation
- Blog: Prompt-based Connective Prediction Method for Fine-grained Implicit Discourse Relation Recognition
- Blog: MPLinker: Multi-template Prompt-tuning with Adversarial Training for Issue-commit Link Recovery
- Blog: Rethinking visual prompt learning as masked visual token modeling
- Blog: Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognition
- Blog: Making Pre-trained Language Models Better Few-shot Learners
- Blog: Prompt Discriminative Language Models for Domain Adaptation
- Blog: STT: Soft Template Tuning for Few-Shot Adaptation
- Blog: Graph Prompting for Graph Learning Models: Recent Advances and Future Directions
- Blog: Zero-Shot Commonsense Question Answering with Cloze Translation and Consistency Optimization
- Blog: Pseudo Zero Pronoun Resolution Improves Zero Anaphora Resolution
- Blog: Zero-shot Triplet Extraction by Template Infilling
- Blog: Aligning the Objective of LLM-Based Program Repair
- Blog: Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition
- Blog: Advancing Pancreatic Cancer Prediction with a Next Visit Token Prediction Head on top of Med-BERT
- Blog: Compositional Task-Oriented Parsing as Abstractive Question Answering
- Blog: Declaration-based Prompt Tuning for Visual Question Answering
- Blog: No more fine-tuning? an experimental evaluation of prompt tuning in code intelligence
- Blog: No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence
- Blog: Declaration-based Prompt Tuning for Visual Question Answering
- Blog: Self-Pro: A Self-Prompt and Tuning Framework for Graph Neural Networks
- Blog: Few-Shot Question Answering by Pretraining Span Selection
- Blog: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer
- Blog: Champion Solution for the WSDM2023 Toloka VQA Challenge
- Blog: When does Parameter-Efficient Transfer Learning Work for Machine Translation?
- Blog: Unsupervised Question Answering by Cloze Translation
- Blog: PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation
- Blog: A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding
- Blog: Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models
- Blog: RAVEN: In-Context Learning with Retrieval Augmented Encoder-Decoder Language Models
- Blog: Prompt-Augmented Linear Probing: Scaling beyond the Limit of Few-Shot In-Context Learners
Showing 60 of 197 papers.
History & citation
Current · Permanent link
- Prompt Aligned Continued Pretraining for Language Models merged into this direction (56% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_pre_training_objective_alignment_dcccd68b,
title = {pre-training objective alignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/pre-training-objective-alignment/rdr_dcccd68b03c246d0a033e8ba43536a9a},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_pre_training_objective_alignment_dcccd68b_v2,
title = {pre-training objective alignment},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/pre-training-objective-alignment/rdr_dcccd68b03c246d0a033e8ba43536a9a/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}