IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
On the Use of Virtual Channels in Networks of Workstations with Irregular Topology2000
Performance Evaluation of Storage Systems Based on Network-Attached Disks2000
Scalable Hardware-Algorithms for Binary Prefix Sums2000
Software-Based Rerouting for Fault-Tolerant Pipelined Communication2000
Tighter Layouts of the Cube-Connected Cycles2000
Adaptive-Trail Routing and Performance Evaluation in Irregular Networks Using Cut-Through Switches1999
A Linear Algebra Framework for Automatic Determination of Optimal Data Layouts1999
Asynchronous Tree-Based Multicasting in Wormhole-Switched MINs1999
Chameleon: A Software Infrastructure for Adaptive Fault Tolerance1999
Combined Task and Message Scheduling in Distributed Real-Time Systems1999
Computer Vision Algorithms on Reconfigurable Logic Arrays1999
Dynamically Configurable Message Flow Control for Fault-Tolerant Routing1999
Efficient Algorithms for Block-Cyclic Array Redistribution Between Processor Sets1999
Genetic Scheduling for Parallel Processor Systems: Comparative Studies and Performance Issues1999
Optimal Clustering of Tree-Sweep Computations for High-Latency Parallel Environments1999
Parallel Parsing Algorithms for Static Dictionary Compression1999
Safety and Reliability Driven Task Allocation in Distributed Systems1999
Software-Directed Register Deallocation for Simultaneous Multithreaded Processors1999
Synthesizing Efficient Out-of-Core Programs for Block Recursive Algorithms Using Block-Cyclic Data Distributions1999
Access Control and Signatures via Quorum Secret Sharing1998
A Framework for Reinforcement-Based Scheduling in Parallel Processor Systems1998
Analysis of Task Assignment Policies in Scalable Distributed Web-Server Systems1998
An Efficient Method for Approximating Submesh Reliability of Two-Dimensional Meshes1998
Computing Performance Bounds of Fork-Join Parallel Programs Under a Multiprocessing Environment1998
Diskless Checkpointing1998
On Submesh Allocation for Mesh Multicomputers: A Best-Fit Allocation and a Virtual Submesh Allocation for Faulty Meshes1998
Optimized Broadcasting and Multicasting Protocols in Cut-Through Routed Networks1998
Parallel Algorithms for Relational Coarsest Partition Problems1998
Scheduling Algorithms for Parallel Gaussian Elimination With Communication Costs1998
Theoretical Analysis for Communication-Induced Checkpointing Protocols with Rollback-Dependency Trackability1998
Accounting for Memory Bank Contention and Delay in High-Bandwidth Multiprocessors1997
An Optimal Algorithm for Global Termination Detection in Shared-Memory Asynchronous Multiprocessor Systems1997
An Optimal Multiplication Algorithm on Reconfigurable Mesh1997
A Shortest-Path Routing Algorithm for Incomplete WK-Recursive Networks1997
A Theory of Fault-Tolerant Routing in Wormhole Networks1997
Bandwidth-Optimal Complete Exchange on Wormhole-Routed 2D/3D Torus Networks: A Diagonal-Propagation Approach1997
Comments on "A New Family of Cayley Graph Interconnection Networks of Constant Degree Four"1997
Constant Time Algorithms for Computational Geometry on the Reconfigurable Mesh1997
Deadline Assignment in a Distributed Soft Real-Time System1997
Efficient Algorithms for All-to-All Communications in Multiport Message-Passing Systems1997
Heuristics for scheduling I/O operations1997
Highly Scalable Parallel Algorithms for Sparse Matrix Factorization1997
Optimal Software Multicast in Wormhole-Routed Multistage Networks1997
Parallel Cluster Identification for Multidimensional Lattices1997
Parallel Execution of Hash Joins in Parallel Databases1997
Performance Evaluation of Switch-Based Wormhole Networks1997
Recovery Analysis of Data Sharing Systems under Deferred Dirty Page Propagation Policies1997
Synthesizing Variable Instruction Issue Interpreters for Implementing Functional Parallelism on SIMD Computers1997
The Performance of the Cedar Multistage Switching Network1997
A Concurrent Architecture for Serializable Production Systems1996

« prev Page 44/46 next »