No article text was recorded for this version.
fine-tuning instability
Version 1 of 159 papers71 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Handling Variance of Pretrained Language Models in Grading Evidence in the Medical Literature
- Blog: Can pre-trained Transformers be used in detecting complex sensitive sentences? - A Monsanto case study
- Blog: Graph Empirical Mode Decomposition-Based Data Augmentation Applied to Gifted Children MRI Analysis
- Blog: Language and Noise Transfer in Speech Enhancement Generative Adversarial Network
- Blog: Prompt Tuning for Discriminative Pre-trained Language Models
- Blog: S$^4$-Tuning: A Simple Cross-lingual Sub-network Tuning Method
- Blog: KINLP at SemEval-2023 Task 12: Kinyarwanda Tweet Sentiment Analysis
- Blog: Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection
- Blog: Supervised Contrastive Learning Approach for Contextual Ranking
- Blog: Representation Projection Invariance Mitigates Representation Collapse
- Blog: Answering questions by learning to rank - Learning to rank by answering questions
- Blog: PreRadE: Pretraining Tasks on Radiology Images and Reports Evaluation Framework
- Blog: Model Selection for Cross-lingual Transfer
- Blog: Exploring the Role of Task Transferability in Large-Scale Multi-Task Learning
- Blog: Evaluation of Transfer Learning and Domain Adaptation for Analyzing German-Speaking Job Advertisements
- Blog: Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts
- Blog: Robust Transfer Learning with Pretrained Language Models through Adapters
- Blog: On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
- Blog: Supervised Speech Representation Learning for Parkinson's Disease Classification
- Blog: Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
- Blog: Revisiting Few-sample BERT Fine-tuning
- Blog: How Reliable are Model Diagnostics?
- Blog: AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT
- Blog: Prompt-free and Efficient Few-shot Learning with Language Models
- Blog: Fighting Randomness with Randomness: Mitigating Optimisation Instability of Fine-Tuning using Delayed Ensemble and Noisy Interpolation
- Blog: Domain Adversarial Fine-Tuning as an Effective Regularizer
- Blog: What to talk about and how? Selective Generation using LSTMs with Coarse-to-Fine Alignment
- Blog: Correlation-Aware Mutual Learning for Semi-supervised Medical Image Segmentation
- Blog: Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets
- Blog: Language Models Lack Temporal Generalization and Bigger is Not Better
- Blog: IDPG: An Instance-Dependent Prompt Generation Method
- Blog: Should We Still Pretrain Encoders with Masked Language Modeling?
- Blog: Simple and Effective Input Reformulations for Translation
- Blog: The MultiBERTs: BERT Reproductions for Robustness Analysis
- Blog: Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning
- Blog: Neural Model Reprogramming with Similarity Based Mapping for Low-Resource Spoken Command Recognition
- Blog: An Empirical Investigation of Word Alignment Supervision for Zero-Shot Multilingual Neural Machine Translation
- Blog: PromptDA: Label-guided Data Augmentation for Prompt-based Few Shot Learners
- Blog: Biological Factor Regulatory Neural Network
- Blog: Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflicts
- Blog: Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning
- Blog: Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively
- Blog: Rethinking Why Intermediate-Task Fine-Tuning Works
- Blog: Unsupervised Data Augmentation with Naive Augmentation and without Unlabeled Data
- Blog: How many data points is a prompt worth?
- Blog: Data-Efficient Image Quality Assessment with Attention-Panel Decoder
- Blog: Noise Stability Regularization for Improving BERT Fine-tuning
- Blog: Semi-supervised Learning with Weakly-Related Unlabeled Data: Towards Better Text Categorization
- Blog: Columbia at SemEval-2019 Task 7: Multi-task Learning for Stance Classification and Rumour Verification
- Blog: Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts
- Blog: Improving Commonsense Causal Reasoning by Adversarial Training and Data Augmentation
- Blog: Precise Task Formalization Matters in Winograd Schema Evaluations
- Blog: Model Balancing Helps Low-data Training and Fine-tuning
- Blog: Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level
- Blog: Demographic-Aware Language Model Fine-tuning as a Bias Mitigation Technique
- Blog: Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation
- Blog: Argument Relation Classification through Discourse Markers and Adversarial Training
- Blog: TCGAN: Convolutional Generative Adversarial Network for Time Series Classification and Clustering
- Blog: Better Fine-Tuning by Reducing Representational Collapse
History & citation
Current · Permanent link
- This direction split from Mitigating Fine-tuning Instability in Large Language Models (51% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_fine_tuning_instability_ae01ec74,
title = {fine-tuning instability},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/fine-tuning-instability/rdr_ae01ec74e0b247668711c96f85c6a0b6},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_fine_tuning_instability_ae01ec74_v1,
title = {fine-tuning instability},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/fine-tuning-instability/rdr_ae01ec74e0b247668711c96f85c6a0b6/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}