IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Retrospecting Available CPU Resources: SMT-Aware Scheduling to Prevent SLA Violations in Data Centers2025
Ripple: Enabling Decentralized Data Deduplication at the Edge2025
RL-Based Hybrid CPU Scaling for Soft Deadline Constrained Tasks in Container Clouds2025
Safe Multi-Agent Deep Reinforcement Learning for the Management of Autonomous Connected Vehicles at Future Intersections2025
SEMSO: A Secure and Efficient Multi-Data Source Blockchain Oracle2025
Slark: A Performance Robust Decentralized Inter-Datacenter Deadline-Aware Coflows Scheduling Framework With Local Information2025
SMore: Enhancing GPU Utilization in Deep Learning Clusters by Serverless-Based Co-Location Scheduling2025
Sparrow: Expediting Smart Contract Execution for Blockchain Sharding via Inter-Shard Caching2025
Spread+: Scalable Model Aggregation in Federated Learning With Non-IID Data2025
Spreeze: High-Throughput Parallel Reinforcement Learning Framework2025
SSpMM: Efficiently <u>S</u> calable <u>SpMM</u> Kernels Across Multiple Generations of Tensor Cores2025
SSS-DIMM: Removing Redundant Data Movement in Trusted DIMM-Based Near-Memory-Processing Kernel Offloading via Secure Space Sharing2025
Survey on Characterizing and Understanding GNNs From a Computer Architecture Perspective2025
Taming Offload Overheads in a Massively Parallel Open-Source RISC-V MPSoC: Analysis and Optimization2025
Task-Aware Service Placement for Distributed Learning in Wireless Edge Networks2025
The Design of a High-Performance Fine-Grained Deduplication Framework for Backup Storage2025
TOP: Task-Based Operator Parallelism for Asynchronous Deep Learning Inference on GPU2025
ToT: Triangle Counting on Tensor Cores2025
Toward Load-Balanced Redundancy Transitioning for Erasure-Coded Storage2025
Towards Communication-Efficient Out-of-Core Graph Processing on the GPU2025
Towards Efficiency and Decentralization: A Blockchain Assisted Distributed Fuzzy-Rough Feature Selection2025
Two-Dimensional Balanced Partitioning and Efficient Caching for Distributed Graph Analysis2025
UMPIPE: Unequal Microbatches-Based Pipeline Parallelism for Deep Neural Network Training2025
VAHRM: Variation-Aware Resource Management in Heterogeneous Supercomputing Systems2025
ViTeGNN: Towards Versatile Inference of Temporal Graph Neural Networks on FPGA2025
WCET Estimation for CNN Inference on FPGA SoC With Multi-DPU Engines2025
XDGNN: Efficient Distributed GNN Training via Explanation-Guided Subgraph Expansion2025
A 3D Hybrid Optical-Electrical NoC Using Novel Mapping Strategy Based DCNN Dataflow Acceleration2024
Acceleration of Multi-Body Molecular Dynamics With Customized Parallel Dataflow2024
AdaptChain: Adaptive Data Sharing and Synchronization for NFV Systems on Heterogeneous Architectures2024
Adaptive QoS-Aware Microservice Deployment With Excessive Loads via Intra- and Inter-Datacenter Scheduling2024
Agile Cache Replacement in Edge Computing via Offline-Online Deep Reinforcement Learning2024
A High-Performance Genomic Accelerator for Accurate Sequence-to-Graph Alignment Using Dynamic Programming Algorithm2024
A Memory-Efficient Hybrid Parallel Framework for Deep Neural Network Training2024
A Multidimensional Communication Scheduling Method for Hybrid Parallel DNN Training2024
An Efficient Bottleneck Planes Exclusion Method for Reconfiguring 3D VLSI Arrays2024
An Offline-Transfer-Online Framework for Cloud-Edge Collaborative Distributed Reinforcement Learning2024
A State-of-the-Art Review With Code About Connected Components Labeling on GPUs2024
A Survey on Performance Modeling and Prediction for Distributed DNN Training2024
AutoDDL: Automatic Distributed Deep Learning With Near-Optimal Bandwidth Cost2024
Availability-Aware Revenue-Effective Application Deployment in Multi-Access Edge Computing2024
Bayesian-Driven Automated Scaling in Stream Computing With Multiple QoS Targets2024
BCB-SpTC: An Efficient Sparse High-Dimensional Tensor Contraction Employing Tensor Core Acceleration2024
BIRD+: Design of a Lightweight Communication Compressor for Resource-Constrained Distribution Learning Platforms2024
Breaking the Memory Wall for Heterogeneous Federated Learning via Model Splitting2024
BurstBalancer: Do Less, Better Balance for Large-Scale Data Center Traffic2024
CLIC: An Extensible and Efficient Cross-Platform Data Analytics System2024
CloudSentry: Two-Stage Heavy Hitter Detection for Cloud-Scale Gateway Overload Protection2024
CloudSimPer: Simulating Geo-Distributed Datacenters Powered by Renewable Energy Mix2024
CODE$^{+}$+: Fast and Accurate Inference for Compact Distributed IoT Data Collection2024

« prev Page 4/46 next »