IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Real-Time Digital Signal Processing of Phased Array Radars2003
Reducing False Sharing and Improving Spatial Locality in a Unified Compilation Framework2003
Refactoring Middleware with Aspects2003
Request Redirection Algorithms for Distributed Web Systems2003
Split-Path Enhanced Pipeline Scheduling2003
The Master-Slave Paradigm with Heterogeneous Processors2003
Tiling, Block Data Layout, and Memory Hierarchy Performance2003
An Efficient Partitioning Algorithm for Distributed Virtual Environment Systems2002
An Experimental Evaluation of I/O Optimizations on Different Applications2002
Automatic Recovery from Disk Failure in Continuous-Media Servers2002
Boosting the Performance of Myrinet Networks2002
Decentralized Resource Management for a Distributed Continuous Media Server2002
Design and Performance Analysis of a Distributed Java Virtual Machine2002
Energy-Efficient Routing in the Broadcast Communication Model2002
Integration of pricing with call admission control to meet QoS requirements in cellular networks2002
Observations on Using Genetic-Algorithms for Channel Allocation in Mobile Computing2002
On the Asymptotical Optimality of Multilayered Decentralized Consensus Protocol2002
Orthogonal Striping and Mirroring in Distributed RAID for I/O-Centric Cluster Computing2002
Performance Analysis of a Distributed Question/Answering System2002
Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach2002
Performance Optimization Problem in Speculative Prefetching2002
Real-Time Concurrency Control in a Multiprocessor Environment2002
Sequential and Parallel Cellular Automata-Based Scheduling Algorithms2002
A Cost-Effective Approach to Deadlock Handling in Wormhole Networks2001
A General Theory for Deadlock-Free Adaptive Routing Using a Mixed Set of Resources2001
An Evaluation of Cache Invalidation Strategies in Wireless Environments2001
An Optimal Index Reshuffle Algorithm for Multidimensional Arrays and Its Applications for Parallel Architectures2001
A Protocol for Deadlock-Free Dynamic Reconfiguration in High-Speed Local Area Networks2001
A Strategy to Manage Cache Consistency in a Disconnected Distributed Environment2001
Augmented Ring Networks2001
Compiler-Directed Collective-I/O2001
Embedding Hamiltonian Paths in Faulty Arrangement Graphs with the Backtracking Method2001
Energy-Efficient Permutation Routing in Radio Networks2001
Generalized Communicators in the Message Passing Interface2001
Impact of Workload and System Parameters on Next Generation Cluster Scheduling Mechanisms2001
Implementing E-Transactions with Asynchronous Replication2001
Matrix Multiplication on Heterogeneous Platforms2001
Observations on Using Genetic Algorithms for Dynamic Load-Balancing2001
Static and Dynamic Locality Optimizations Using Integer Linear Programming2001
The Power of Two Choices in Randomized Load Balancing2001
Time Stamp Algorithms for Runtime Parallelization of DOACROSS Loops with Dynamic Dependences2001
Wavefront Diffusion and LMSR: Algorithms for Dynamic Repartitioning of Adaptive Meshes2001
Analytical Results for Optimal Choice of Location Update Interval for Mobility Database Failure Restoration in PCS Networks2000
A Routing Protocol for Anycast Messages2000
A Unified Framework for Optimizing Locality, Parallelism, and Communication in Out-of-Core Computations2000
Efficient Execution of Time Warp Programs on Heterogeneous, NOW Platforms2000
High-Performance Routing in Networks of Workstations with Irregular Topology2000
How Useful Is Old Information?2000
Incremental Design of Scalable Interconnection Networks Using Basic Building Blocks2000
Minimizing Data and Synchronization Costs in One-Way Communication2000

« prev Page 43/46 next »