No article text was recorded for this version.
sparse parameter updates
Version 1 of 1269 papers337 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Deep Partial Updating: Towards Communication Efficient Updating for On-Device Inference
- Blog: Overcoming General Knowledge Loss with Selective Parameter Finetuning
- Blog: LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
- Blog: Sparse Memory Finetuning as a Low-Forgetting Alternative to LoRA and Full Finetuning
- Blog: Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
- Blog: Pay Attention to Small Weights
- Blog: Learning Where to Edit Vision Transformers
- Blog: PALM: Pushing Adaptive Learning Rate Mechanisms for Continual Test-Time Adaptation
- Blog: Modular and On-demand Bias Mitigation with Attribute-Removal Subnetworks
- Blog: Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuning
- Blog: FISH-Tuning: Enhancing PEFT Methods with Fisher Information
- Blog: Continual Learning via Sparse Memory Finetuning
- Blog: Composable Sparse Fine-Tuning for Cross-Lingual Transfer
- Blog: Safety-Utility Conflicts Are Not Global: Surgical Alignment via Head-Level Diagnosis
- Blog: TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models
- Blog: Few-Shot and Continual Learning with Attentive Independent Mechanisms
- Blog: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
- Blog: Interpreting and Improving Large Language Models in Arithmetic Calculation
- Blog: Robust and Interpretable Adaptation of Equivariant Materials Foundation Models via Sparsity-promoting Fine-tuning
- Blog: ALPS: Attention Localization and Pruning Strategy for Efficient Adaptation of Large Language Models
- Blog: PALM: Pushing Adaptive Learning Rate Mechanisms for Continual Test-Time Adaptation
- Blog: Class-Incremental Learning based on Label Generation
- Blog: MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning
- Blog: Module-Aware Parameter-Efficient Machine Unlearning on Transformers
- Blog: Gradient-based Parameter Selection for Efficient Fine-Tuning
- Blog: APLA: A Simple Adaptation Method for Vision Transformers
- Blog: SparseGrad: A Selective Method for Efficient Fine-tuning of MLP Layers
- Blog: MicroEdit: Neuron-level Knowledge Disentanglement and Localization in Lifelong Model Editing
- Blog: Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval
- Blog: A Unified Speaker Adaptation Approach for ASR
- Blog: Constraining Sequential Model Editing with Editing Anchor Compression
- Blog: Parameter-Efficient Fine-Tuning without Introducing New Latency
- Blog: RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning
- Blog: Delta Embedding Learning
- Blog: GEM: A Scale-Aware and Distribution-Sensitive Sparse Fine-Tuning Framework for Effective Downstream Adaptation
- Blog: Simple Continual Learning Strategies for Safer Classifers
- Blog: Representation Memorization for Fast Learning New Knowledge without Forgetting
- Blog: VisualGPT: Data-efficient Image Captioning by Balancing Visual Input and Linguistic Knowledge from Pretraining
- Blog: S2FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity
- Blog: SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning
- Blog: GDI-Bench: A Benchmark for General Document Intelligence with Vision and Reasoning Decoupling
- Blog: Parameter-Masked Decoupled Optimization for Cross-Domain Class-Incremental Learning
- Blog: SBoRA: Low-Rank Adaptation with Regional Weight Updates
- Blog: SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
- Blog: Distribution-Aware Continual Test Time Adaptation for Semantic Segmentation
- Blog: NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits
- Blog: Practical Continual Forgetting for Pre-trained Vision Models
- Blog: MODEL SHAPLEY: Find Your Ideal Parameter Player via One Gradient Backpropagation
- Blog: Transfer Learning via 𝓁1 Regularization
- Blog: Controlling Forgetting with Test-Time Data in Continual Learning
- Blog: Neural Routing in Meta Learning
- Blog: MEMOIR: Lifelong Model Editing with Minimal Overwrite and Informed Retention for LLMs
- Blog: Dual-Phase Continual Learning: Supervised Adaptation Meets Unsupervised Retention
- Blog: Improving Sparse Memory Finetuning
- Blog: Interpret and Improve In-Context Learning via the Lens of Input-Label Mappings
- Blog: Pretraining with hierarchical memories: separating long-tail and common knowledge
- Blog: From IID to the Independent Mechanisms assumption in continual learning
- Blog: Exploring the Translation Mechanism of Large Language Models
- Blog: Overcoming Generic Knowledge Loss with Selective Parameter Update
- Blog: Learning and Unlearning of Fabricated Knowledge in Language Models
Showing 60 of 269 papers.
History & citation
Current · Permanent link
- Sparse Parameter Selection and Masked Adaptation merged into this direction (52% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_sparse_parameter_updates_23638c5b,
title = {sparse parameter updates},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/sparse-parameter-updates/rdr_23638c5b6f284307b9fb1339b12b1cf7},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_sparse_parameter_updates_23638c5b_v1,
title = {sparse parameter updates},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/sparse-parameter-updates/rdr_23638c5b6f284307b9fb1339b12b1cf7/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}