No article text was recorded for this version.
communication-efficient distributed training
Version 2 of 2723 papers885 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Communication-Efficient Algorithms for Decentralized and Stochastic Optimization
- Blog: Local SGD Converges Fast and Communicates Little
- Blog: The Role of Local Steps in Local SGD
- Blog: Projection-free Distributed Online Learning with Strongly Convex Losses
- Blog: STL-SGD: Speeding Up Local SGD with Stagewise Communication Period
- Blog: Sample and Communication Efficient Fully Decentralized MARL Policy Evaluation via a New Approach: Local TD update
- Blog: Distributed learning of multilingual DNN feature extractors using GPUs
- Blog: Convergence of Distributed Adaptive Optimization with Local Updates
- Blog: Accelerating Gossip SGD with Periodic Global Averaging
- Blog: Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training
- Blog: Learn Locally, Correct Globally: A Distributed Algorithm for Training Graph Neural Networks
- Blog: From Local SGD to Local Fixed-Point Methods for Federated Learning
- Blog: OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
- Blog: Photon: Federated LLM Pre-Training
- Blog: Distributed Stochastic Gradient MCMC
- Blog: DiLoCo: Distributed Low-Communication Training of Language Models
- Blog: Distributed Offline Policy Optimization Over Batch Data
- Blog: Federated Recommendation System via Differential Privacy
- Blog: Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities
- Blog: Fast Adaptive Federated Bilevel Optimization
- Blog: A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks
- Blog: Convergence of Distributed Adaptive Optimization with Local Updates
- Blog: Practical Distributed Learning: Secure Machine Learning with Communication-Efficient Local Updates
- Blog: Eager Updates For Overlapped Communication and Computation in DiLoCo
- Blog: OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
- Blog: FedYolo: Augmenting Federated Learning with Pretrained Transformers
- Blog: Data-Dependent Convergence for Consensus Stochastic Optimization
- Blog: Decentralized Word2Vec Using Gossip Learning
- Blog: Communication-Efficient Robust Federated Learning Over Heterogeneous Datasets
- Blog: One-Point Gradient-Free Methods for Composite Optimization with Applications to Distributed Optimization
- Blog: SCOPE: Scalable Composite Optimization for Learning on Spark
- Blog: Toward Communication Efficient Adaptive Gradient Method
- Blog: On Data Dependence in Distributed Stochastic Optimization
- Blog: Near-Optimal Distributed Minimax Optimization under the Second-Order Similarity
- Blog: Partial Model Averaging in Federated Learning: Performance Guarantees and Benefits
- Blog: Intermittent Pulling with Local Compensation for Communication-Efficient Federated Learning
- Blog: Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
- Blog: Robust Federated Learning: The Case of Affine Distribution Shifts
- Blog: Shuffle-QUDIO: accelerate distributed VQE with trainability enhancement and measurement reduction
- Blog: Bayesian Over-the-Air FedAvg via Channel Driven Stochastic Gradient Langevin Dynamics
- Blog: Communication-Efficient Consensus Mechanism for Federated Reinforcement Learning
- Blog: On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization
- Blog: Compositional Federated Learning: Applications in Distributionally Robust Averaging and Meta Learning
- Blog: FlexPD: A Flexible Framework Of First-Order Primal-Dual Algorithms for Distributed Optimization
- Blog: Decentralized Learning with Random Walks and Communication-Efficient Adaptive Optimization
- Blog: SLSGD: Secure and Efficient Distributed On-device Machine Learning
- Blog: Communication-Efficient Distributed Deep Learning: A Comprehensive Survey
- Blog: Optimal Distributed Training With Co-Adaptive Data Parallelism in Heterogeneous Environments
- Blog: Distributed Training Strategies for the Structured Perceptron
- Blog: Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
- Blog: Decentralized gradient tracking with local steps
- Blog: Fed-LAMB: Layerwise and Dimensionwise Locally Adaptive Optimization Algorithm
- Blog: Improving Communication Efficiency of Federated Distillation via Accumulating Local Updates
- Blog: Proximal SCOPE for Distributed Sparse Learning
- Blog: LocalKMeans: Convergence of Lloyd's Algorithm with Distributed Local Iterations
- Blog: SparkNet: Training Deep Networks in Spark Philipp Moritz
- Blog: SparkNet: Training Deep Networks in Spark
- Blog: Communication trade-offs for synchronized distributed SGD with large step size
- Blog: Stochastic Coded Federated Learning: Theoretical Analysis and Incentive Mechanism Design
- Blog: Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
Showing 60 of 723 papers.
History & citation
Current · Permanent link
- Decoupling Local Updates from Global Consensus via Gradient Sliding merged into this direction (67% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_communication_efficient_distributed_trai_23d11305,
title = {communication-efficient distributed training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/communication-efficient-distributed-training/rdr_23d11305dbed4dd6b3b74ae93a3731bb},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_communication_efficient_distributed_trai_23d11305_v2,
title = {communication-efficient distributed training},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/communication-efficient-distributed-training/rdr_23d11305dbed4dd6b3b74ae93a3731bb/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}