IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
COIN: A Container Workload Prediction Model Focusing on Common and Individual Changes in Workloads2022
Combinatorial BLAS 2.0: Scaling Combinatorial Algorithms on Distributed-Memory Systems2022
ComboTree: A Persistent Indexing Structure With Universal Operational Efficiency and Scalability2022
Communication-Efficient $k$k-Means for Edge-Based Machine Learning2022
Communication-Efficient Federated Learning With Compensated Overlap-FedAvg2022
Context-Aware Online Client Selection for Hierarchical Federated Learning2022
Cooperative Edge Caching Based on Temporal Convolutional Networks2022
Cooperative Scheduling Schemes for Explainable DNN Acceleration in Satellite Image Analysis and Retraining2022
Cost-Effective Web Application Replication and Deployment in Multi-Cloud Environment2022
Cost-Efficient Server Configuration and Placement for Mobile Edge Computing2022
Critique of: “A Parallel Framework for Constraint-Based Bayesian Network Learning via Markov Blanket Discovery” by SCC Team From UC San Diego2022
Critique of "MemXCT: Memory-Centric X-Ray CT Reconstruction With Massive Parallelization" by SCC Team From Georgia Tech2022
Critique of "MemXCT: Memory-Centric X-Ray CT Reconstruction With Massive Parallelization" by SCC Team From Peking University2022
Critique of "MemXCT: Memory-Centric X-Ray CT Reconstruction With Massive Parallelization" by SCC Team From Tsinghua University2022
Critique of "MemXCT: Memory-Centric X-Ray CT Reconstruction With Massive Parallelization" by SCC Team From University of California San Diego2022
CSEdge: Enabling Collaborative Edge Storage for Multi-Access Edge Computing Based on Blockchain2022
Cuttlefish: Neural Configuration Adaptation for Video Analysis in Live Augmented Reality2022
Data, User and Power Allocations for Caching in Multi-Access Edge Computing2022
Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning2022
Deep Neural Network Training With Distributed K-FAC2022
Dependent Function Embedding for Distributed Serverless Edge Computing2022
DePo: Dynamically Offload Expensive Event Processing to the Edge of Cyber-Physical Systems2022
Detecting Performance Variance for Parallel Applications Without Source Code2022
DHash: Dynamic Hash Tables With Non-Blocking Regular Operations2022
DIESEL+: Accelerating Distributed Deep Learning Tasks on Image Datasets2022
Differentially Private Byzantine-Robust Federated Learning2022
DONE: Distributed Approximate Newton-type Method for Federated Edge Learning2022
DRAS: Deep Reinforcement Learning for Cluster Scheduling in High Performance Computing2022
DrTM+B: Replication-Driven Live Reconfiguration for Fast and General Distributed Transaction Processing2022
DS-ADMM++: A Novel Distributed Quantized ADMM to Speed up Differentially Private Matrix Factorization2022
Dynamic GPU Energy Optimization for Machine Learning Training Workloads2022
E3NE: An End-to-End Framework for Accelerating Spiking Neural Networks With Emerging Neural Encoding on FPGAs2022
EdgeDR: An Online Mechanism Design for Demand Response in Edge Clouds2022
EdgeTB: A Hybrid Testbed for Distributed Machine Learning at the Edge With High Fidelity2022
Efficient and Accurate Flow Record Collection With HashFlow2022
Efficient and Automated Deployment Architecture for OpenStack in TianHe SuperComputing Environment2022
Efficient and Secure Deep Learning Inference in Trusted Processor Enabled Edge Clouds2022
Efficient Data Redistribution Algorithms From Irregular to Block Cyclic Data Distribution2022
Efficient Distributed Approaches to Core Maintenance on Large Dynamic Graphs2022
Efficient Flow-Based Scheduling for Geo-Distributed Simulation Tasks in Collaborative Edge and Cloud Environments2022
Efficient Function Queryable and Privacy Preserving Data Aggregation Scheme in Smart Grid2022
Eiffel: Efficient and Fair Scheduling in Adaptive Federated Learning2022
Elastic and Reliable Bandwidth Reservation Based on Distributed Traffic Monitoring and Control2022
Elastic Deep Learning in Multi-Tenant GPU Clusters2022
Elastic Resource Allocation Against Imbalanced Transaction Assignments in Sharding-Based Permissioned Blockchains2022
Enabling In-Network Floating-Point Arithmetic for Efficient Computation Offloading2022
Energy-Aware Non-Preemptive Task Scheduling With Deadline Constraint in DVFS-Enabled Heterogeneous Clusters2022
Energy-Efficient Offloading for DNN-Based Smart IoT Systems in Cloud-Edge Environments2022
Error-Compensated Sparsification for Communication-Efficient Decentralized Training in Edge Environment2022
Evaluating Spatial Accelerator Architectures with Tiled Matrix-Matrix Multiplication2022

« prev Page 10/46 next »