No article text was recorded for this version.
straggler problem (straggler bottleneck)
Version 2 of 2765 papers840 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Introduction to ParLearning 2018
- Blog: Near-Optimal Straggler Mitigation for Distributed Gradient Methods
- Blog: Revisiting Distributed Synchronous SGD
- Blog: High-Throughput Synchronous Deep RL
- Blog: DropCompute: simple and more robust distributed synchronous training via compute variance reduction
- Blog: Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models via Malleable Data and Model Parallelization
- Blog: DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames
- Blog: CosmoFlow: Using Deep Learning to Learn the Universe at Scale
- Blog: A Hitchhiker's Guide On Distributed Training Of Deep Neural Networks
- Blog: TensorFlow: A system for large-scale machine learning
- Blog: BootSeer: Analyzing and Mitigating Initialization Bottlenecks in Large-Scale LLM Training
- Blog: MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs
- Blog: Scaling Neural Machine Translation
- Blog: Decentralised convex optimisation with probability-proportional-to-size quantization
- Blog: OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
- Blog: High-performance Kernel Machines with Implicit Distributed Optimization and Randomization
- Blog: Straggler-Resilient Decentralized Learning via Adaptive Asynchronous Updates
- Blog: EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models
- Blog: RL in the Wild: Characterizing RLVR Training in LLM Deployment
- Blog: Motivating Learners in Multi-Orchestrator Mobile Edge Learning: A Stackelberg Game Approach
- Blog: Ultima: Robust and Tail-Optimal AllReduce for Distributed Deep Learning in the Cloud
- Blog: Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques, and Tools
- Blog: BLoad: Enhancing Neural Network Training with Efficient Sequential Data Handling
- Blog: SparkNet: Training Deep Networks in Spark Philipp Moritz
- Blog: Efficient Pre-Training of LLMs via Topology-Aware Communication Alignment on More Than 9600 GPUs
- Blog: Improving Efficiency in Large-Scale Decentralized Distributed Training
- Blog: DropCompute: simple and more robust distributed synchronous training via compute variance reduction
- Blog: User Assignment and Resource Allocation for Hierarchical Federated Learning over Wireless Networks
- Blog: HetSeq: Distributed GPU Training on Heterogeneous Infrastructure
- Blog: Privacy is What We Care About
- Blog: Parameter Database : Data-centric Synchronization for Scalable Machine Learning
- Blog: Understanding Stragglers in Large Model Training Using What-if Analysis
- Blog: Beat the long tail: Distribution-Aware Speculative Decoding for RL Training
- Blog: Laminar: A Scalable Asynchronous RL Post-Training Framework
- Blog: Addressing Algorithmic Bottlenecks in Elastic Machine Learning with Chicle
- Blog: Ringmaster ASGD: The First Asynchronous SGD with Optimal Time Complexity
- Blog: Decentralized Asynchronous Optimization with DADAO allows Decoupling and Acceleration
- Blog: SDPipe: A Semi-Decentralized Framework for Heterogeneity-aware Pipeline-parallel Training
- Blog: Laminar: A Scalable Asynchronous RL Post-Training Framework
- Blog: fairseq: A Fast, Extensible Toolkit for Sequence Modeling
- Blog: Simplifying Distributed Neural Network Training on Massive Graphs: Randomized Partitions Improve Model Aggregation
- Blog: Deep-Edge: An Efficient Framework for Deep Learning Model Update on Heterogeneous Edge
- Blog: A case for disaggregation of ML data processing
- Blog: SCOPE: Scalable Composite Optimization for Learning on Spark
- Blog: lo-fi: distributed fine-tuning without communication
- Blog: DBS: Dynamic Batch Size For Distributed Deep Neural Network Training
- Blog: VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement
- Blog: dSTAR: Straggler Tolerant and Byzantine Resilient Distributed SGD
- Blog: Distributed Multi-task Relationship Learning
- Blog: A Distributed Training Algorithm of Generative Adversarial Networks with Quantized Gradients
- Blog: Reducing Energy Bloat in Large Model Training
- Blog: DSAG: A Mixed Synchronous-Asynchronous Iterative Method for Straggler-Resilient Learning
- Blog: fairseq: A Fast, Extensible Toolkit for Sequence Modeling
- Blog: Distributed Machine Learning for Predictive Analytics in Mobile Edge Computing Based IoT Environments
- Blog: SYNTHESIS: A Semi-Asynchronous Path-Integrated Stochastic Gradient Method for Distributed Learning in Computing Clusters
- Blog: Understanding Stragglers in Large Model Training Using What-if Analysis
- Blog: Parallelizing Word2Vec in Shared and Distributed Memory
- Blog: Variance-Reduced Decentralized Stochastic Optimization with Accelerated Convergence
- Blog: Adaptive Worker Grouping for Communication-Efficient and Straggler-Tolerant Distributed SGD
- Blog: Decentralized Distributed PPO: Mastering PointGoal Navigation
Showing 60 of 765 papers.
History & citation
Current · Permanent link
- Implicit Momentum in Asynchronous Distributed Optimization merged into this direction (50% overlap)
- Approximate Gradient Coding for Straggler Mitigation merged into this direction (65% overlap)
- Gradient Coding for Straggler Resilient Distributed Learning merged into this direction (100% overlap)
- Bounded Staleness for Distributed Machine Learning merged into this direction (58% overlap)
- Sequential Coding for Bursty Straggler Mitigation merged into this direction (73% overlap)
- Asynchronous Distributed Optimization and Delay Tolerance merged into this direction (73% overlap)
- Weighted Gradient Aggregation for Heterogeneous Clusters merged into this direction (67% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_straggler_problem_straggler_bottleneck_54ce34bf,
title = {straggler problem (straggler bottleneck)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/straggler-problem-straggler-bottleneck/rdr_54ce34bf4fa94739b53424e7cdc14eca},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 2, frozen text):
@misc{lacuna_straggler_problem_straggler_bottleneck_54ce34bf_v2,
title = {straggler problem (straggler bottleneck)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/straggler-problem-straggler-bottleneck/rdr_54ce34bf4fa94739b53424e7cdc14eca/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-21},
}