IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Distributed and Dynamic Service Placement in Pervasive Edge Computing Networks2021
Distributed Task Migration Optimization in MEC by Extending Multi-Agent Deep Reinforcement Learning Approach2021
DL2: A Deep Learning-Driven Scheduler for Deep Learning Clusters2021
DTransE: Distributed Translating Embedding for Knowledge Graph2021
E2bird: Enhanced Elastic Batch for Improving Responsiveness and Throughput of Deep Learning Services2021
Efficient Data Loader for Fast Sampling-Based GNN Training on Large Graphs2021
Efficient Forwarding Anomaly Detection in Software-Defined Networks2021
Efficient Methods for Mapping Neural Machine Translator on FPGAs2021
Efficient Virtual Network Embedding of Cloud-Based Data Center Networks into Optical Networks2021
Elastic Scheduling for Microservice Applications in Clouds2021
Elastic Significant Bit Quantization and Acceleration for Deep Neural Networks2021
Enabling Scalable and Extensible Memory-Mapped Datastores in Userspace2021
Energy-Aware Inference Offloading for DNN-Driven Applications in Mobile Edge Clouds2021
Energy-Efficient Hardware-Accelerated Synchronization for Shared-L1-Memory Multiprocessor Clusters2021
e-PoS: Making Proof-of-Stake Decentralized and Fair2021
Fast Adaptive Task Offloading in Edge Computing Based on Meta Reinforcement Learning2021
Feluca: A Two-Stage Graph Coloring Algorithm With Color-Centric Paradigm on GPU2021
Fine-Grained Multi-Query Stream Processing on Integrated Architectures2021
Fine-Grained Powercap Allocation for Power-Constrained Systems Based on Multi-Objective Machine Learning2021
FT-CNN: Algorithm-Based Fault Tolerance for Convolutional Neural Networks2021
gIM: GPU Accelerated RIS-Based Influence Maximization Algorithm2021
Group Reassignment for Dynamic Edge Partitioning2021
Hardware Accelerator Integration Tradeoffs for High-Performance Computing: A Case Study of GEMM Acceleration in N-Body Methods2021
High Performance Multivariate Geospatial Statistics on Manycore Systems2021
High-Performance Routing With Multipathing and Path Diversity in Ethernet and HPC Networks2021
Hone: Mitigating Stragglers in Distributed Stream Processing With Tuple Scheduling2021
e-PoS: Making Proof-of-Stake Decentralized and Fair2021
iMLBench: A Machine Learning Benchmark Suite for CPU-GPU Integrated Architectures2021
Improving the Performance of Deduplication-Based Storage Cache via Content-Driven Cache Management Methods2021
Investigating the Adoption of Hybrid Encrypted Cloud Data Deduplication With Game Theory2021
Large-Scale Analysis of Docker Images and Performance Implications for Container Storage Systems2021
Learning-Driven Interference-Aware Workload Parallelization for Streaming Applications in Heterogeneous Cluster2021
Learning Spatiotemporal Failure Dependencies for Resilient Edge Computing Services2021
Lewat: A Lightweight, Efficient, and Wear-Aware Transactional Persistent Memory System2021
MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning2021
Modeling and Analyzing Waiting Policies for Cloud-Enabled Schedulers2021
MO-Tree: An Efficient Forwarding Engine for Spatiotemporal-Aware Pub/Sub Systems2021
Multi-Agent Imitation Learning for Pervasive Edge Computing: A Decentralized Computation Offloading Algorithm2021
Multi-Hop Multi-Task Partial Computation Offloading in Collaborative Edge Computing2021
Multi-Queue Request Scheduling for Profit Maximization in IaaS Clouds2021
Mutual Information Driven Federated Learning2021
Network-Aware Locality Scheduling for Distributed Data Operators in Data Centers2021
O3BNN-R: An Out-of-Order Architecture for High-Performance and Regularized BNN Inference2021
Octans: Optimal Placement of Service Function Chains in Many-Core Systems2021
On Consortium Blockchain Consistency: A Queueing Network Model Approach2021
Online Collaborative Data Caching in Edge Computing2021
Online Scheduling Technique To Handle Data Velocity Changes in Stream Workflows2021
Optimizing Resource Allocation for Data-Parallel Jobs Via GCN-Based Prediction2021
Optimizing the LINPACK Algorithm for Large-Scale PCIe-Based CPU-GPU Heterogeneous Systems2021
Overlapping Communication With Computation in Parameter Server for Scalable DL Training2021

« prev Page 14/46 next »