No article text was recorded for this version.
dynamic subspace optimization
Version 1 of 117 papers23 conceptsfrozen 2026-10-04
Papers in this version
- Blog: GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
- Blog: Towards Efficient Optimizer Design for LLM via Structured Fisher Approximation with a Low-Rank Extension
- Blog: Improving Neural Network Training in Low Dimensional Random Bases
- Blog: Nonparametric Teaching of Implicit Neural Representations
- Blog: LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
- Blog: Flora: Low-Rank Adapters Are Secretly Gradient Compressors
- Blog: LOZO+: Provably Efficient Zeroth-Order Fine-Tuning via Greedy Low-Rank Subspace Selection
- Blog: Breaking the Frozen Subspace: Importance Sampling for Low-Rank Optimization in LLM Pretraining
- Blog: OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning
- Blog: From Complexity to Simplicity: Adaptive ES-Active Subspaces for Blackbox Optimization
- Blog: Low-Rank Gradient Descent
- Blog: Gradient Weight-normalized Low-rank Projection for Efficient LLM Training
- Blog: UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter Efficient Fine-Tuning of Large Models
- Blog: Query Efficient Black-Box Visual Prompting with Subspace Learning
- Blog: Subspace Networks: Scaling Decentralized Training with Communication-Efficient Model Parallelism
- Blog: Low-rank Momentum Factorization for Memory Efficient Training
- Blog: GRASS: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
History & citation
Current · Permanent link
- This direction split from Dynamic Subspace Projection for Memory Efficient Training (76% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_dynamic_subspace_optimization_8bc2546a,
title = {dynamic subspace optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/dynamic-subspace-optimization/rdr_8bc2546ae3334954be3cb96de20915fc},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}This exact version (version 1, frozen text):
@misc{lacuna_dynamic_subspace_optimization_8bc2546a_v1,
title = {dynamic subspace optimization},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/dynamic-subspace-optimization/rdr_8bc2546ae3334954be3cb96de20915fc/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-22},
}