No article text was recorded for this version.
catastrophic forgetting (catastrophic forgetting in fine-tuning)
Version 1 of 1189 papers215 conceptsfrozen 2026-10-04
Papers in this version
- Blog: How transfer learning impacts linguistic knowledge in deep NLP models?
- Blog: On the Nature of BERT: Correlating Fine-Tuning and Linguistic Competence
- Blog: On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representations
- Blog: Linguistic Profiling of a Neural Language Model
- Blog: CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP
- Blog: Scientific Keyphrase Identification and Classification by Pre-Trained Language Models Intermediate Task Transfer Learning
- Blog: Intermediate-Task Transfer Learning with Pretrained Language Models: When and Why Does It Work?
- Blog: Unsupervised Pre-training for Natural Language Generation: A Literature Review
- Blog: Low-Resource Cross-Lingual Adaptive Training for Nigerian Pidgin
- Blog: How transfer learning impacts linguistic knowledge in deep NLP models?
- Blog: Learn and Don't Forget: Adding a New Language to ASR Foundation Models
- Blog: Updating Only Encoders Prevents Catastrophic Forgetting of End-to-End ASR Models
- Blog: A Survey on Contextual Embeddings
- Blog: Multi-Concept Customization of Text-to-Image Diffusion
- Blog: On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers
- Blog: LFKQG: A Controlled Generation Framework with Local Fine-tuning for Question Generation over Knowledge Bases
- Blog: Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual Learning
- Blog: Acquiring Knowledge from Pre-trained Model to Neural Machine Translation
- Blog: Assessing the Bilingual Knowledge Learned by Neural Machine Translation Models
- Blog: On the Effects of Fine-tuning Language Models for Text-Based Reinforcement Learning
- Blog: Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correction
- Blog: Encoder and Decoder, Not One Less for Pre-trained Language Model Sponsored NMT
- Blog: Mitigating Catastrophic Forgetting in Language Transfer via Model Merging
- Blog: Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models
- Blog: The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model design
- Blog: DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
- Blog: Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense
- Blog: Language Models for German Text Simplification: Overcoming Parallel Data Scarcity through Style-specific Pre-training
- Blog: SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
- Blog: Deep Fusing Pre-trained Models into Neural Machine Translation
- Blog: Language Models are Universal Embedders
- Blog: OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining
- Blog: A Neighbourhood Framework for Resource-Lean Content Flagging
- Blog: K-ON: Stacking Knowledge On the Head Layer of Large Language Model
- Blog: FLAME: Frozen Large Language Models Enable Data-Efficient Language-Image Pre-training
- Blog: Cross-lingual Pre-training Based Transfer for Zero-shot Neural Machine Translation
- Blog: Combining Static and Contextualised Multilingual Embeddings
- Blog: Sequential Continual Pre-Training for Neural Machine Translation
- Blog: Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution
- Blog: An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models
- Blog: A Novel Two-step Fine-tuning Framework for Transfer Learning in Low-Resource Neural Machine Translation
- Blog: MunTTS: A Text-to-Speech System for Mundari
- Blog: Code-Switching Curriculum Learning for Multilingual Transfer in LLMs
- Blog: Domain Adaptation of NMT models for English-Hindi Machine Translation Task at AdapMT ICON 2020
- Blog: Contrastive Alignment of Vision to Language Through Parameter-Efficient Transfer Learning
- Blog: Bert Adapter and Contrastive Learning for Continual Classification of Aspect Sentiment Task Sequences
- Blog: Chat Vector: A Simple Approach to Equip LLMs With New Language Chat Capabilities
- Blog: Are U a Joke Master? Pun Generation via Multi-Stage Curriculum Learning towards a Humor LLM
- Blog: Regularization techniques for fine-tuning in neural machine translation
- Blog: Conditions for Catastrophic Forgetting in Multilingual Translation
- Blog: AuGPT: Dialogue with Pre-trained Language Models and Data Augmentation
- Blog: InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions
- Blog: Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling
- Blog: SnakModel: Lessons Learned from Training an Open Danish Large Language Model
- Blog: Encoder-Agnostic Adaptation for Conditional Language Generation
- Blog: A Gentle Push Funziona Benissimo: Making Instructed Models in Italian via Contrastive Activation Steering
- Blog: How Does Adversarial Fine-Tuning Benefit BERT?
- Blog: Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer
- Blog: Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction
- Blog: Learning to Generate Instruction Tuning Datasets for Zero-Shot Task Adaptation
Showing 60 of 189 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_catastrophic_forgetting_catastrophic_for_9d86c7ef,
title = {catastrophic forgetting (catastrophic forgetting in fine-tuning)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/catastrophic-forgetting-catastrophic-forgetting-in-fine-tuning/rdr_9d86c7efc7334f258671eb583ca31095},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_catastrophic_forgetting_catastrophic_for_9d86c7ef_v1,
title = {catastrophic forgetting (catastrophic forgetting in fine-tuning)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/catastrophic-forgetting-catastrophic-forgetting-in-fine-tuning/rdr_9d86c7efc7334f258671eb583ca31095/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}