IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
All-to-All Personalized Communication in a Wormhole-Routed Torus1996
A Necessary and Sufficient Condition for Deadlock-Free Routing in Cut-Through and Store-and-Forward Networks1996
An Efficient Optimal Reconfiguration Algorithm for FDDI-Based Networks1996
A Time- and Cost-Optimal Algorithm for Interlocking Sets-With Applications1996
Efficient LRU-Based Buffering in a LAN Remote Caching Architecture1996
Efficient termination detection for loosely synchronous applications in multicomputers1996
Fault-Tolerant Wormhole Routing in Meshes without Virtual Channels1996
Localizing Failures in Distributed Synchronization1996
MAD Kernels: An Experimental Testbed to Study Multiprocessor Memory System Behavior1996
On General Results for All-to-All Broadcast1996
Optimal Layouts of Midimew Networks1996
Performance Analysis of Finite-Buffered Asynchronous Multistage Interconnection Networks1996
Randomized Routing with Shorter Paths1996
Routing schemes for multiple random broadcasts in arbitrary network topologies1996
Scheduling in and out forests in the presence of communication delays1996
Scheduling Soft Real-Time Jobs Over Dual Non-Real-Time Servers1996
The Block Distributed Memory Model1996
A Hierarchical Approach to Parallel Multiquery Scheduling1995
A Measurement-Based Model to Predict the Performance Impact of System Modifications: A Case Study1995
A Necessary and Sufficient Condition for Deadlock-Free Adaptive Routing in Wormhole Networks1995
A Notation for Deterministic Cooperating Processes1995
A Parallel Simulated Annealing Algorithm with Low Communication Overhead1995
A Theory of Deadlock-Free Adaptive Multicast Routing in Wormhole Networks1995
A Total Ordering Multicast Protocol Using Propagation Trees1995
Efficient Geometric Algorithms on the EREW PRAM1995
Efficient Parallel Binary Search on Sorted Arrays, with Applications1995
Generalized Multiway Branch Unit for VLIW Microprocessors1995
Hot-Potato Algorithms for Permutation Routing1995
Processor Mapping Techniques Toward Efficient Data Redistribution1995
Resource-Constrained Software Pipelining1995
The Message Flow Model for Routing in Wormhole-Routed Networks1995
A Decomposition Algorithm for Optimal Static Load Balancing in Tree Hierarchy Network Configurations1994
A Genetic Algorithm for Multiprocessor Scheduling1994
Aggressive Transmissions of Short Messages Over Redundant Paths1994
Analysis of Processor Allocation in Multiprogrammed, Distributed-Memory Parallel Processing Systems1994
A Performance Study of Robust Distributed Load Sharing Strategies1994
Concurrent Processing of Linearly Ordered Data Structures on Hypercube Multicomputers1994
Deadlock-Free Multicast Wormhole Routing in 2-D Mesh Multicomputers1994
E-kernel: an embedding kernel on the IBM victor V256 multiprocessor for program mapping and network reconfiguration1994
Index Transformation Algorithms in a Linear Algebra Framework1994
Multiclass Replicated Data Management: Exploiting Replication to Improve Efficiency1994
Optimal NODUP All-to-All Broadcast Schemes in Distributed Computing Systems1994
Parallel Algorithms for the Longest Common Subsequence Problem1994
Partitioning Message Patterns for Bundled Omega Networks1994
Performance Analysis of Two Different Algorithms for Ethernet-FDDI Interconnection1994
Performance Evaluation of Transaction Processing Coupling Architectures for Handling System Dynamics1994
Reading Many Variables in One Atomic Operation: Solutions with Linear or Sublinear Complexity1994
Repeated Computation of Global Functions in a Distributed Environment1994
Unicast-Based Multicast Communication in Wormhole-Routed Networks1994
Unstructured Tree Search on SIMD Parallel Computers1994

« prev Page 45/46 next »