No article text was recorded for this version.
low-rank expressivity bottleneck (rank-constrained representation loss)
Version 1 of 127 papers30 conceptsfrozen 2026-10-04
Papers in this version
- Blog: FedPara: Low-rank Hadamard Product for Communication-Efficient Federated Learning
- Blog: Efficient Learning with Sine-Activated Low-Rank Matrices
- Blog: Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization
- Blog: Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding Helps
- Blog: Run-Time Efficient RNN Compression for Inference on Edge Devices
- Blog: Structured Transforms for Small-Footprint Deep Learning
- Blog: Compressing Large Language Models using Low Rank and Low Precision Decomposition
- Blog: Pushing the limits of RNN Compression
- Blog: LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing
- Blog: Low-Rank Compression for IMC Arrays
- Blog: LaX: Boosting Low-Rank Training of Foundation Models via Latent Crossing
- Blog: Compressing Pre-trained Language Models by Matrix Decomposition
- Blog: Rank and run-time aware compression of NLP Applications
- Blog: Low-Rank Embedding of Kernels in Convolutional Neural Networks under Random Shuffling
- Blog: SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform
- Blog: GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning
- Blog: Tensorized Embedding Layers
- Blog: Low-rank Gradient Approximation For Memory-Efficient On-device Training of Deep Neural Network
- Blog: Towards Interpretability Without Sacrifice: Faithful Dense Layer Decomposition with Mixture of Decoders
- Blog: Speech and Language Recognition with Low-rank Adaptation of Pretrained Models
- Blog: LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation
- Blog: Adaptive Basis Selection for Exponential Family Smoothing Splines with Application in Joint Modeling of Multiple Sequencing Samples
- Blog: Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models
- Blog: Hypoformer: Hybrid Decomposition Transformer for Edge-friendly Neural Machine Translation
- Blog: Towards Efficient Communication and Secure Federated Recommendation System via Low-rank Training
- Blog: Generative Flows with Matrix Exponential
- Blog: Learning Extremely Lightweight and Robust Model with Differentiable Constraints on Sparsity and Condition Number
History & citation
Current · Permanent link
- Overcoming the Rank Bottleneck in Model Compression merged into this direction (54% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_low_rank_expressivity_bottleneck_rank_co_743658de,
title = {low-rank expressivity bottleneck (rank-constrained representation loss)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/low-rank-expressivity-bottleneck-rank-constrained-representation-loss/rdr_743658de93aa4f8eb2d659593c8975db},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_low_rank_expressivity_bottleneck_rank_co_743658de_v1,
title = {low-rank expressivity bottleneck (rank-constrained representation loss)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/low-rank-expressivity-bottleneck-rank-constrained-representation-loss/rdr_743658de93aa4f8eb2d659593c8975db/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}