No article text was recorded for this version.
distributed communication bottleneck (gradient transmission overhead)
Version 1 of 149 papers49 conceptsfrozen 2026-10-04
Papers in this version
- Blog: vqSGD: Vector Quantized Stochastic Gradient Descent
- Blog: MARINA: Faster Non-Convex Distributed Learning with Compression
- Blog: LASER: Linear Compression in Wireless Distributed Optimization
- Blog: GPT Carry-On: Training Foundation Model for Customization Could Be Simple, Scalable and Affordable
- Blog: Unbiased Quantization of the L1 Ball for Communication-Efficient Distributed Mean Estimation
- Blog: Truncated Non-Uniform Quantization for Distributed SGD
- Blog: Quantized Frank-Wolfe: Faster Optimization, Lower Communication, and Projection Free
- Blog: Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients
- Blog: Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerability
- Blog: Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification and Local Computations
- Blog: MARINA: Faster Non-Convex Distributed Learning with Compression
- Blog: Distributed Learning with Sparse Communications by Identification
- Blog: Linearly Converging Error Compensated SGD
- Blog: Communication-Efficient and Byzantine-Robust Distributed Learning
- Blog: Gradient-free Federated Learning Methods with l1 and l2-randomization for Non-smooth Convex Stochastic Optimization Problems
- Blog: Optimal Compression of Unit Norm Vectors in the High Distortion Regime
- Blog: Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants
- Blog: Noisy SIGNSGD Is More Differentially Private Than You (Might) Think
- Blog: Quantizing data for distributed learning
- Blog: vqSGD: Vector Quantized Stochastic Gradient Descent
- Blog: Communication-Efficient Asynchronous Stochastic Frank-Wolfe over Nuclear-norm Balls
- Blog: Collaborative Compressors in Distributed Mean Estimation with Limited Communication Budget
- Blog: A Double Residual Compression Algorithm for Efficient Distributed Learning
- Blog: LENA: Communication-Efficient Distributed Learning with Self-Triggered Gradient Uploads
- Blog: SignGD with error feedback meets lazily aggregated technique: Communication-efficient algorithms for distributed learning
- Blog: EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learning
- Blog: Communication-Efficient Distributed SGD With Compressed Sensing
- Blog: JointSQ: Joint Sparsification-Quantization for Distributed Learning
- Blog: Quantized Frank-Wolfe: Communication-Efficient Distributed Optimization
- Blog: Differentially private partitioned variational inference
- Blog: Federated Learning on Heterogeneous and Long-Tailed Data via Classifier Re-Training with Federated Features
- Blog: SGD with low-dimensional gradients with applications to private and distributed learning
- Blog: Double Quantization for Communication-Efficient Distributed Optimization
- Blog: Coordinate-Descent Diffusion Learning by Networked Agents
- Blog: Adaptive Top- K in SGD for Communication-Efficient Distributed Learning
- Blog: MLitB: machine learning in the browser
- Blog: Collaborative Machine Learning at the Wireless Edge with Blind Transmitters
- Blog: Distributed Bilevel Optimization with Communication Compression
- Blog: Communication-Efficient Distributed Optimization with Quantized Preconditioners
- Blog: Distributed Learning with Sublinear Communication
- Blog: Distributed Mean Estimation with Limited Communication
- Blog: Echo-CGC: A Communication-Efficient Byzantine-tolerant Distributed Machine Learning Algorithm in Single-Hop Radio Network
- Blog: Randomized Distributed Mean Estimation: Accuracy vs Communication
- Blog: Energy and Spectrum Efficient Federated Learning via High-Precision Over-the-Air Computation
- Blog: DQ-SGD: Dynamic Quantization in SGD for Communication-Efficient Distributed Learning
- Blog: cpSGD: Communication-efficient and differentially-private distributed SGD
- Blog: Limits on Gradient Compression for Stochastic Optimization
- Blog: Distributed Extra-gradient with Optimal Complexity and Communication Guarantees
- Blog: DRIVE: One-bit Distributed Mean Estimation
History & citation
Current · Permanent link
- This direction split from Overcoming the Communication Bottleneck in Distributed Learning (88% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_distributed_communication_bottleneck_gra_1227d047,
title = {distributed communication bottleneck (gradient transmission overhead)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/distributed-communication-bottleneck-gradient-transmission-overhead/rdr_1227d0473674473bb77b95dcf7b1ac5b},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_distributed_communication_bottleneck_gra_1227d047_v1,
title = {distributed communication bottleneck (gradient transmission overhead)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/distributed-communication-bottleneck-gradient-transmission-overhead/rdr_1227d0473674473bb77b95dcf7b1ac5b/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}