IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
TridentKV: A Read-Optimized LSM-Tree Based KV Store via Adaptive Indexing and Space-Efficient Partitioning2022
UFC2: User-Friendly Collaborative Cloud2022
Votes-as-a-Proof (VaaP): Permissioned Blockchain Consensus Protocol Made Simple2022
vPipe: A Virtualized Acceleration System for Achieving Efficient and Scalable Pipeline Parallel DNN Training2022
VQL: Efficient and Verifiable Cloud Query Services for Blockchain Systems2022
Work-Stealing Prefix Scan: Addressing Load Imbalance in Large-Scale Image Registration2022
Wukong+G: Fast and Concurrent RDF Query Processing Using RDMA-Assisted GPU Graph Exploration2022
zMesh: Theories and Methods to Exploring Application Characteristics to Improve Lossy Compression Ratio for Adaptive Mesh Refinement2022
3D Perception With Slanted Stixels on GPU2021
A Case for Pricing Bandwidth: Sharing Datacenter Networks With Cost Dominant Fairness2021
Accelerating Binarized Neural Networks via Bit-Tensor-Cores in Turing GPUs2021
Accelerating End-to-End Deep Learning Workflow With Codesign of Data Preprocessing and Scheduling2021
Accelerating Federated Learning Over Reliability-Agnostic Clients in Mobile Edge Computing Systems2021
Accelerating Gossip-Based Deep Learning in Heterogeneous Edge Computing Platforms2021
Accelerating Large-Scale Prioritized Graph Computations by Hotness Balanced Partition2021
Accurate Differentially Private Deep Learning on the Edge2021
Achieving Probabilistic Atomicity With Well-Bounded Staleness and Low Read Latency in Distributed Datastores2021
Adaptive Preference-Aware Co-Location for Improving Resource Utilization of Power Constrained Datacenters2021
Adaptive SpMV/SpMSpV on GPUs for Input Vectors of Varied Sparsity2021
A Distributed Framework for EA-Based NAS2021
A Fault-Tolerant Distributed Framework for Asynchronous Iterative Computations2021
A Game-Based Approach for Cost-Aware Task Assignment With QoS Constraint in Collaborative Edge and Cloud Environments2021
A GPU Acceleration Framework for Motif and Discord Based Pattern Mining2021
A Hybrid Fuzzy Convolutional Neural Network Based Mechanism for Photovoltaic Cell Defect Detection With Electroluminescence Images2021
An Automatic Synthesizer of Advising Tools for High Performance Computing2021
An Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee2021
An Efficient Parallel Secure Machine Learning Framework on GPUs2021
An Elastic Task Scheduling Scheme on Coarse-Grained Reconfigurable Architectures2021
An Incremental Iterative Acceleration Architecture in Distributed Heterogeneous Environments With GPUs for Deep Learning2021
A Probabilistic Machine Learning Approach to Scheduling Parallel Loops With Bayesian Optimization2021
ARENA: Asynchronous Reconfigurable Accelerator Ring to Enable Data-Centric Parallel Computing2021
A Scalable Multi-Layer PBFT Consensus for Blockchain2021
A Thread Level SLO-Aware I/O Framework for Embedded Virtualization2021
Auditing Cache Data Integrity in the Edge Computing Environment2021
Biscotti: A Blockchain System for Private and Secure Federated Learning2021
BOSSA: A Decentralized System for Proofs of Data Retrievability and Replication2021
Breaking (Global) Barriers in Parallel Stochastic Optimization With Wait-Avoiding Group Averaging2021
Burst Load Evacuation Based on Dispatching and Scheduling In Distributed Edge Networks2021
Canary: Decentralized Distributed Deep Learning Via Gradient Sketch and Partition in Multi-Interface Networks2021
CASpMV: A Customized and Accelerative SpMV Framework for the Sunway TaihuLight2021
Co-Active: A Workload-Aware Collaborative Cache Management Scheme for NVMe SSDs2021
Coarse-Grained Parallel Routing With Recursive Partitioning for FPGAs2021
Cost-Effective App Data Distribution in Edge Computing2021
Critique of “MemXCT: Memory-Centric X-Ray CT Reconstruction With Massive Parallelization” by SCC Team From University of California San Diego2021
Critique of "Planetary Normal Mode Computation: Parallel Algorithms, Performance, and Reproducibility" by SCC Team From National Tsing Hua University2021
Critique of "Planetary Normal Mode Computation: Parallel Algorithms, Performance, and Reproducibility" by SCC Team From Peking University2021
Critique of "Planetary Normal Mode Computation: Parallel Algorithms, Performance, and Reproducibility" by SCC Team From Tsinghua University2021
DeepSlicing: Collaborative and Adaptive CNN Inference With Low Latency2021
Design and Evaluation of a Risk-Aware Failure Identification Scheme for Improved RAS in Erasure-Coded Data Centers2021
Distributed and Collective Deep Reinforcement Learning for Computation Offloading: A Practical Perspective2021

« prev Page 13/46 next »