IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Parallel Blockwise Knowledge Distillation for Deep Neural Network Compression2021
Partitioning-Based Scheduling of OpenMP Task Systems With Tied Tasks2021
Petrel: Heterogeneity-Aware Distributed Deep Learning Via Hybrid Synchronization2021
Planetary Normal Mode Computation: Parallel Algorithms, Performance, and Reproducibility2021
Privacy-Preserving Multi-Keyword Searchable Encryption for Distributed Systems2021
Privacy-Preserving Similarity Search With Efficient Updates in Distributed Key-Value Stores2021
Proof of Federated Learning: A Novel Energy-Recycling Consensus Algorithm2021
QShield: Protecting Outsourced Cloud Data Queries With Multi-User Access Control Based on SGX2021
Realizing Best Checkpointing Control in Computing Systems2021
Recent Advances of Resource Allocation in Network Function Virtualization2021
ReliableBox: Secure and Verifiable Cloud Storage With Location-Aware Backup2021
Scalable Energy Games Solvers on GPUs2021
SEIZE: Runtime Inspection for Parallel Dataflow Systems2021
Self-Balancing Federated Learning With Global Imbalanced Data in Mobile Systems2021
SGD$\_$_Tucker: A Novel Stochastic Optimization Strategy for Parallel Sparse Tucker Decomposition2021
Silhouette: Efficient Cloud Configuration Exploration for Large-Scale Analytics2021
Spartan: A Sparsity-Adaptive Framework to Accelerate Deep Neural Network Training on GPUs2021
Systematically Landing Machine Learning onto Market-Scale Mobile Malware Detection2021
Tardiness Bounds for Sporadic Gang Tasks Under Preemptive Global EDF Scheduling2021
TCStream: Large-Scale Graph Triangle-Counting on a single Machine using GPUs2021
The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs With Hybrid Parallelism2021
The Deep Learning Compiler: A Comprehensive Survey2021
Timestamped State Sharing for Stream Analytics2021
Towards Efficient Distributed Subgraph Enumeration Via Backtracking-Based Framework2021
Towards Efficient Large-Scale Interprocedural Program Static Analysis on Distributed Data-Parallel Computation2021
Towards Efficient Scheduling of Federated Mobile Devices Under Computational and Statistical Heterogeneity2021
Towards Minimizing Resource Usage With QoS Guarantee in Cloud Gaming2021
Transformations of High-Level Synthesis Codes for High-Performance Computing2021
Trust: Triangle Counting Reloaded on GPUs2021
VeriML: Enabling Integrity Assurances and Fair Payments for Machine Learning as a Service2021
Why Dataset Properties Bound the Scalability of Parallel Machine Learning Training Algorithms2021
YuenyeungSpTRSV: A Thread-Level and Warp-Level Fusion Synchronization-Free Sparse Triangular Solve2021
Abstraction Layer For Standardizing APIs of Task-Based Engines2020
Accelerating Sparse Cholesky Factorization on Sunway Manycore Architecture2020
Accelerating Stochastic Gradient Descent Based Matrix Factorization on FPGA2020
Achieving Load-Balanced, Redundancy-Free Cluster Caching with Selective Partition2020
aeSpTV: An Adaptive and Efficient Framework for Sparse Tensor-Vector Product Kernel on a High-Performance Computing Platform2020
A Game-Theoretical Approach for User Allocation in Edge Computing Environment2020
A Highly Reliable Metadata Service for Large-Scale Distributed File Systems2020
A High Throughput B+tree for SIMD Architectures2020
Analyzing the Performance Trade-Off in Implementing User-Level Threads2020
An Optimal Locality-Aware Task Scheduling Algorithm Based on Bipartite Graph Modelling for Spark Applications2020
A Novel Low Cost Interconnection Architecture Based on the Generalized Hypercube2020
APMigration: Improving Performance of Hybrid Memory Performance via An Adaptive Page Migration Method2020
Architectural Support for NVRAM Persistence in GPUs2020
A Truthful and Efficient Incentive Mechanism for Demand Response in Green Datacenters2020
A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA2020
Automated Fine-Grained CPU Cap Control in Serverless Computing Platform2020
Boosting the Performance of SSDs via Fully Exploiting the Plane Level Parallelism2020
Combinatorial Auctions for Temperature-Constrained Resource Management in Manycores2020

« prev Page 15/46 next »