IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
AESM2 Attribute-Based Encrypted Search for Multi-Owner and Multi-User Distributed Systems2023
A Framework for Mapping DRL Algorithms With Prioritized Replay Buffer Onto Heterogeneous Platforms2023
Alleviating the Impact of Abnormal Events Through Multi-Constrained VM Placement2023
A Multi-GPU Aggregation-Based AMG Preconditioner for Iterative Linear Solvers2023
An Efficient Hierarchical-Reduction Architecture for Aggregation in Route Travel Time Estimation2023
An Improved NSGA-III Algorithm Based on Deep Q-Networks for Cloud Storage Optimization of Blockchain2023
An Instability-Resilient Renewable Energy Allocation System for a Cloud Datacenter2023
A Novel Parallel Algorithm for Sparse Tensor Matrix Chain Multiplication via TCU-Acceleration2023
A Space-Efficient Fair Cache Scheme Based on Machine Learning for NVMe SSDs2023
A Survey on Auto-Parallelism of Large-Scale Deep Learning Training2023
Auction-Based Cluster Federated Learning in Mobile Edge Computing Systems2023
AutoRS: Environment-Dependent Real-Time Scheduling for End-to-End Autonomous Driving2023
Back to Homogeneous Computing: A Tightly-Coupled Neuromorphic Processor With Neuromorphic ISA2023
Benzene: Scaling Blockchain With Cooperation-Based Sharding2023
Bio-ESMD: A Data Centric Implementation for Large-Scale Biological System Simulation on Sunway TaihuLight Supercomputer2023
CHEESE: Distributed Clustering-Based Hybrid Federated Split Learning Over Edge Networks2023
COFFEE: Cross-Layer Optimization for Fast and Efficient Executions of Sinkhorn-Knopp Algorithm on HPC Systems2023
Consistent Low Latency Scheduler for Distributed Key-Value Stores2023
CoopEdge+: Enabling Decentralized, Secure and Cooperative Multi-Access Edge Computing Based on Blockchain2023
Critique of "A Parallel Framework for Constraint-Based Bayesian Network Learning via Markov Blanket Discovery" by SCC Team From Tsinghua University2023
Critique of: "A Parallel Framework for Constraint-Based Bayesian Network Learning via Markov Blanket Discovery" by SCC Team From UC San Diego2023
Dap-FL: Federated Learning Flourishes by Adaptive Tuning and Secure Aggregation2023
DeepBoot: Dynamic Scheduling System for Training and Inference Deep Learning Tasks in GPU Cluster2023
Design of a Quantization-Based DNN Delta Compression Framework for Model Snapshots and Federated Learning2023
Differentiated Consistency for Worldwide Gossips2023
Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numeric Behaviors2023
Distributed Approaches to Butterfly Analysis on Large Dynamic Bipartite Graphs2023
Distributed Evolution Strategies for Black-Box Stochastic Optimization2023
EESaver: Saving Energy Dynamically for Green Multi-Access Edge Computing2023
Enabling Balanced Data Deduplication in Mobile Edge Computing2023
Enabling Efficient Random Access to Hierarchically Compressed Text Data on Diverse GPU Platforms2023
Energy-Aware, Device-to-Device Assisted Federated Learning in Edge Computing2023
ENLARGE: An Efficient SNN Simulation Framework on GPU Clusters2023
Expediting Distributed DNN Training With Device Topology-Aware Graph Deployment2023
Faster Federated Learning With Decaying Number of Local SGD Steps2023
FCDedup: A Two-Level Deduplication System for Encrypted Data in Fog Computing2023
Federated Ensemble Model-Based Reinforcement Learning in Edge Computing2023
Federated Learning Over Coupled Graphs2023
FedMDS: An Efficient Model Discrepancy-Aware Semi-Asynchronous Clustered Federated Learning Framework2023
FedProf: Selective Federated Learning Based on Distributional Representation Profiling2023
Fold3D: Rethinking and Parallelizing Computational and Communicational Tasks in the Training of Large DNN Models2023
Frequency-Domain Inference Acceleration for Convolutional Neural Networks Using ReRAMs2023
From Deterioration to Acceleration: A Calibration Approach to Rehabilitating Step Asynchronism in Federated Optimization2023
FSP: Towards Flexible Synchronous Parallel Frameworks for Distributed Machine Learning2023
FT-BLAS: A Fault Tolerant High Performance BLAS Implementation on x86 CPUs2023
Full-Stack Optimizing Transformer Inference on ARM Many-Core CPU2023
GossipFL: A Decentralized Federated Learning Framework With Sparsified and Adaptive Communication2023
GraphAGILE: An FPGA-Based Overlay Accelerator for Low-Latency GNN Inference2023
HashCache: Accelerating Serverless Computing by Skipping Duplicated Function Execution2023
HE-Booster: An Efficient Polynomial Arithmetic Acceleration on GPUs for Fully Homomorphic Encryption2023

« prev Page 7/46 next »