IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Optimizing Lossy Compression Rate-Distortion from Automatic Online Selection between SZ and ZFP2019
Parallelizing Word2Vec in Shared and Distributed Memory2019
Parallel Traversal of Large Ensembles of Decision Trees2019
Parana: A Parallel Neural Architecture Considering Thermal Problem of 3D Stacked Memory2019
Performance-Aware Model for Sparse Matrix-Matrix Multiplication on the Sunway TaihuLight Supercomputer2019
PFP: Improving the Reliability of Deduplication-based Storage Systems with Per-File Parity2019
Piggyback Game: Efficient Event Stream Dissemination in Online Social Network Systems2019
Privacy Regulation Aware Process Mapping in Geo-Distributed Cloud Data Centers2019
Profit Maximization for Admitting Requests with Network Function Services in Distributed Clouds2019
Profit Maximization for Cloud Brokers in Cloud Computing2019
Promenade: Proportionally Fair Multipath Rate Control in Datacenter Networks with Random Network Coding2019
Quasi-Streaming Graph Partitioning: A Game Theoretical Approach2019
Recent Advances in Matrix Partitioning for Parallel Computing on Heterogeneous Platforms2019
Resource-Aware Scheduling for Dependable Multicore Real-Time Systems: Utilization Bound and Partitioning Algorithm2019
Resource-Efficient Index Shard Replication in Large Scale Search Engines2019
Response Time Bounds for Typed DAG Parallel Tasks on Heterogeneous Multi-Cores2019
RF-RPC: Remote Fetching RPC Paradigm for RDMA-Enabled Network2019
SEALDB: An Efficient LSM-tree Based KV Store on SMR Drives with Sets and Dynamic Bands2019
SimEDC: A Simulator for the Reliability Analysis of Erasure-Coded Data Centers2019
Smart Contract-Based Negotiation for Adaptive QoS-Aware Service Composition2019
T-Gaming: A Cost-Efficient Cloud Gaming System at Scale2019
Towards Efficient Multi-Channel Data Broadcast for Multimedia Streams2019
Towards Fast and Lightweight Checkpointing for Mobile Virtualization Using NVRAM2019
Towards Low-Latency Batched Stream Processing by Pre-Scheduling2019
Ultra-Fast Bloom Filters using SIMD Techniques2019
Using Differential Execution Analysis to Identify Thread Interference2019
Wide-Area Spark Streaming: Automated Routing and Batch Sizing2019
Workload-Adaptive Configuration Tuning for Hierarchical Cloud Schedulers2019
Adaptive Resource Allocation and Provisioning in Multi-Service Cloud Environments2018
Adaptive Scheduling Parallel Jobs with Dynamic Batching in Spark Streaming2018
A Differentiated Caching Mechanism to Enable Primary Storage Deduplication in Clouds2018
A Double Auction Mechanism to Bridge Users' Task Requirements and Providers' Resources in Two-Sided Cloud Markets2018
A Fault-Tolerant Framework for Asynchronous Iterative Computations in Cloud Environments2018
A Flattened Metadata Service for Distributed File Systems2018
A Model Predictive Controller for Managing QoS Enforcements and Microarchitecture-Level Interferences in a Lambda Platform2018
An Auto-Tuner for OpenCL Work-Group Size on GPUs2018
Argobots: A Lightweight Low-Level Threading and Tasking Framework2018
A Study of Systems with Multiple Operating Levels, Probabilistic Thresholds and Hysteresis2018
A Survey on Recent OS-Level Energy Management Techniques for Mobile Processing Units2018
Asynchronous Task-Based Polar Decomposition on Single Node Manycore Architectures2018
Auditing Big Data Storage in Cloud Computing Using Divide and Conquer Tables2018
A Write-Friendly and Cache-Optimized Hashing Scheme for Non-Volatile Memory Systems2018
Blocking Analysis for Spin Locks in Real-Time Parallel Tasks2018
Cache-Oblivious MPI All-to-All Communications Based on Morton Order2018
Capacity Optimization for Resource Pooling in Virtualized Data Centers with Composable Systems2018
CoMan: Managing Bandwidth Across Computing Frameworks in Multiplexed Datacenters2018
Computing Hierarchical Summary from Two-Dimensional Big Data Streams2018
Confluence: Speeding Up Iterative Distributed Operations by Key-Dependency-Aware Partitioning2018
Context-Aware Task Migration for HART-Centric Collaboration over FiWi Based Tactile Internet Infrastructures2018
Core Maintenance in Dynamic Graphs: A Parallel Approach Based on Matching2018

« prev Page 19/46 next »