IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Modeling Analysis and Cost-Performance Ratio Optimization of Virtual Machine Scheduling in Cloud Computing2020
NVGraph: Enforcing Crash Consistency of Evolving Network Analytics in NVMM Systems2020
On-Edge Multi-Task Transfer Learning: Model and Practice With Data-Driven Task Allocation2020
On Fault-Tolerant Bin Packing for Online Resource Allocation2020
Online Deadline-Aware Task Dispatching and Scheduling in Edge Computing2020
Online Placement and Scaling of Geo-Distributed Machine Learning Jobs via Volume-Discounting Brokerage2020
Online Scheduling of Task Graphs on Heterogeneous Platforms2020
Optimized Block-Based Algorithms to Label Connected Components on GPUs2020
Optimizing Streaming Parallelism on Heterogeneous Many-Core Architectures2020
Pache: A Packet Management Scheme of Cache in Data Center Networks2020
PALE: Time Bounded Practical Agile Leader Election2020
Performance Analysis of Trial and Error Algorithms2020
Performance-Aware Speculative Resource Oversubscription for Large-Scale Clusters2020
Performance Optimization for Relative-Error-Bounded Lossy Compression on Scientific Data2020
Power-Aware Allocation of Graph Jobs in Geo-Distributed Cloud Networks2020
P-PFC: Reducing Tail Latency with Predictive PFC in Lossless Data Center Networks2020
Quantum Game Analysis on Extrinsic Incentive Mechanisms for P2P Services2020
Quantum Supremacy Circuit Simulation on Sunway TaihuLight2020
QWEB: High-Performance Event-Driven Web Architecture With QAT Acceleration2020
Random Priority-Based Thrashing Control for Distributed Shared Memory2020
REACT: Scalable and High-Performance Regular Expression Pattern Matching Accelerator for In-Storage Processing2020
Reliability-Aware Network Service Provisioning in Mobile Edge-Cloud Networks2020
SaberLDA: Sparsity-Aware Learning of Topic Models on GPUs2020
Scheduling Periodical Multi-Stage Jobs With Fuzziness to Elastic Cloud Resources2020
SF-Sketch: A Two-Stage Sketch for Data Streams2020
SGD_Tucker: A Novel Stochastic Optimization Strategy for Scalable Parallel Sparse Tucker Decomposition2020
Single Restart with Time Stamps for Parallel Task Processing with Known and Unknown Processors2020
Sova: A Software-Defined Autonomic Framework for Virtual Network Allocations2020
System Error Prediction for Business Support Systems in Telecommunications Networks2020
Task Scheduling for Energy Consumption Constrained Parallel Applications on Heterogeneous Computing Systems2020
The Design of Fast Content-Defined Chunking for Data Deduplication Based Storage Systems2020
Thread-Level Locking for SIMT Architectures2020
Toward Designing Cost-Optimal Policies to Utilize IaaS Clouds with Online Learning2020
Towards Accurate Prediction for High-Dimensional and Highly-Variable Cloud Workloads with Deep Learning2020
Towards Fair and Privacy-Preserving Federated Deep Models2020
Towards Usable Cloud Storage Auditing2020
Traffic-Aware Erasure-Coded Archival Schemes for In-Memory Stores2020
Turbo: Dynamic and Decentralized Global Analytics via Machine Learning2020
A Bi-layered Parallel Training Architecture for Large-Scale Convolutional Neural Networks2019
A Correlation-Aware Page-Level FTL to Exploit Semantic Links in Workloads2019
A Framework for Mesoscopic Traffic Simulation in GPU2019
A General Analysis Framework for Soft Real-Time Tasks2019
A Hybrid Approach for Optimizing Parallel Clustering Throughput using the GPU2019
An Efficient Application Partitioning Algorithm in Mobile Environments2019
An Efficient Ring-Based Metadata Management Policy for Large-Scale Distributed File Systems2019
An I/O Efficient Distributed Approximation Framework Using Cluster Sampling2019
A Novel Task-Duplication Based Clustering Algorithm for Heterogeneous Computing Environments2019
A Performance Model for GPU Architectures that Considers On-Chip Resources: Application to Medical Image Registration2019
Applying Transactional Memory for Concurrency-Bug Failure Recovery in Production Runs2019
Auction Mechanisms in Cloud/Fog Computing Resource Allocation for Public Blockchain Networks2019

« prev Page 17/46 next »