IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Joint Participant and Learning Topology Selection for Federated Learning in Edge Clouds2024
KLNK: Expanding Page Boundaries in a Distributed Shared Memory System2024
Locality-Preserving Graph Traversal With Split Live Migration2024
Logical Synchrony and the Bittide Mechanism2024
Long-Range MD Electrostatics Force Computation on FPGAs2024
MoltDB: Accelerating Blockchain via Ancient State Segregation2024
MPMoE: Memory Efficient MoE for Pre-Trained Models With Adaptive Pipeline Parallelism2024
Opca: Enabling Optimistic Concurrent Access for Multiple Users in Oblivious Data Storage2024
Optimizing Full-Spectrum Matrix Multiplications on ARMv8 Multi-Core CPUs2024
Optimizing I/O Performance Through Effective vCPU Scheduling Interference Management2024
Optimizing Multi-Grid Preconditioned Conjugate Gradient Method on Multi-Cores2024
Parallel and Distributed Bayesian Network Structure Learning2024
PeakFS: An Ultra-High Performance Parallel File System via Computing-Network-Storage Co-Optimization for HPC Applications2024
Privacy-Preserving Data Selection for Horizontal and Vertical Federated Learning2024
Privacy Preserving Task Push in Spatial Crowdsourcing With Unknown Popularity2024
Proteus: Simulating the Performance of Distributed DNN Training2024
Pyxis: Scheduling Mixed Tasks in Disaggregated Datacenters2024
RADAR: A Skew-Resistant and Hotness-Aware Ordered Index Design for Processing-in-Memory Systems2024
Real-Time Offloading for Dependent and Parallel Tasks in Cloud-Edge Environments Using Deep Reinforcement Learning2024
Redundancy-Free and Load-Balanced TGNN Training With Hierarchical Pipeline Parallelism2024
Revisiting PM-Based B+-Tree With Persistent CPU Cache2024
Runtime Performance Anomaly Diagnosis in Production HPC Systems Using Active Learning2024
Sampling-Based Multi-Job Placement for Heterogeneous Deep Learning Clusters2024
Sophisticated Orchestrating Concurrent DLRM Training on CPU/GPU Platform2024
SpatialSSJP: QoS-Aware Adaptive Approximate Stream-Static Spatial Join Processor2024
SR-FDIL: Synergistic Replay for Federated Domain-Incremental Learning2024
SunwayLB: Enabling Extreme-Scale Lattice Boltzmann Method Based Computing Fluid Dynamics Simulations on Advanced Heterogeneous Supercomputers2024
Swift: Expedited Failure Recovery for Large-Scale DNN Training2024
Synchronize Only the Immature Parameters: Communication-Efficient Federated Learning By Freezing Parameters Adaptively2024
TAC+: Optimizing Error-Bounded Lossy Compression for 3D AMR Simulations2024
Taking Advantage of the Mistakes: Rethinking Clustered Federated Learning for IoT Anomaly Detection2024
TCSA: Efficient Localization of Busy-Wait Synchronization Bugs for Latency-Critical Applications2024
TeGraph+: Scalable Temporal Graph Processing Enabling Flexible Edge Modifications2024
Towards Efficient Graph Processing in Geo-Distributed Data Centers2024
TrieKV: A High-Performance Key-Value Store Design With Memory as Its First-Class Citizen2024
US-Byte: An Efficient Communication Framework for Scheduling Unequal-Sized Tensor Blocks in Distributed Deep Learning2024
Versa-DNN: A Versatile Architecture Enabling High-Performance and Energy-Efficient Multi-DNN Acceleration2024
VisionAGILE: A Versatile Domain-Specific Accelerator for Computer Vision Tasks2024
ViTeGNN: Towards <u>V</u>ersatile <u>I</u>nference of <u>Te</u>mporal <u>G</u>raph <u>N</u>eural <u>N</u>etworks on FPGA2024
WASP: Efficient Power Management Enabling Workload-Aware, Self-Powered AIoT Devices2024
X-Shard: Optimistic Cross-Shard Transaction Processing for Sharding-Based Blockchains2024
Accelerated Information Dissemination for Replica Selection in Distributed Key-Value Store Systems2023
Accelerating Content-Defined Chunking for Data Deduplication Based on Speculative Jump2023
Accelerating Convolutional Neural Networks by Exploiting the Sparsity of Output Activation2023
Accelerating Deep Learning Inference via Model Parallelism and Partial Computation Offloading2023
Accelerating Distributed DNN Training via Transport Layer Scheduling2023
Accelerating Distributed GNN Training by Codes2023
Accelerating k-Shape Time Series Clustering Algorithm Using GPU2023
A Comprehensive Performance Model of Sparse Matrix-Vector Multiplication to Guide Kernel Optimization2023
AdaptChain: Adaptive Scaling Blockchain With Transaction Deduplication2023

« prev Page 6/46 next »