IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Dynamic Resizing on Active Warps Scheduler to Hide Operation Stalls on GPUs2017
Dynamic Service Placement for Mobile Micro-Clouds with Predicted Future Costs2017
Efficient Data Center Flow Scheduling Without Starvation Using Expansion Ratio2017
Efficient Resource Constrained Scheduling Using Parallel Two-Phase Branch-and-Bound Heuristics2017
Elastic Reliability Optimization Through Peer-to-Peer Checkpointing in Cloud Computing2017
Enabling Efficient and Reliable Transition from Replication to Erasure Coding for Clustered File Systems2017
Enabling Parallel Simulation of Large-Scale HPC Network Systems2017
Energy Efficiency for Clustered Heterogeneous Multicores2017
Enhancing the Malloc System with Pollution Awareness for Better Cache Performance2017
ExCCC-DCN: A Highly Scalable, Cost-Effective and Energy-Efficient Data Center Structure2017
Exploiting the Parallelism Between Conflicting Critical Sections with Partial Reversion2017
Failure Diagnosis for Distributed Systems Using Targeted Fault Injection2017
Fence-Free Synchronization with Dynamically Serialized Synchronization Variables2017
FiDoop-DP: Data Partitioning in Frequent Itemset Mining on Hadoop Clusters2017
Global EDF Schedulability Analysis for Parallel Tasks on Multi-Core Platforms2017
GroupTrust: Dependable Trust Management2017
HL-PCM: MLC PCM Main Memory with Accelerated Read2017
H-PARAFAC: Hierarchical Parallel Factor Analysis of Multidimensional Big Data2017
Improving Execution Concurrency of Large-Scale Matrix Multiplication on Distributed Data-Parallel Platforms2017
Improving Performance for Flash-Based Storage Systems through GC-Aware Cache Management2017
Improving Performance of Heterogeneous MapReduce Clusters with Adaptive Task Tuning2017
Large-Scale VM Placement with Disk Anti-Colocation Constraints Using Hierarchical Decomposition and Mixed Integer Programming2017
Lightweight Virtual Memory Support for Zero-Copy Sharing of Pointer-Rich Data Structures in Heterogeneous Embedded SoCs2017
Managing Battery Aging for High Energy Availability in Green Datacenters2017
MIA: Metric Importance Analysis for Big Data Workload Characterization2017
Mitigating Service Variability in MapReduce Clusters via Task Cloning: A Competitive Analysis2017
Moving Hadoop into the Cloud with Flexible Slot Management and Speculative Execution2017
Oasis: Scaling Out Datacenter Sustainably and Economically2017
Online QoS Prediction for Runtime Service Adaptation via Adaptive Matrix Factorization2017
On the Implication of NTC versus Dark Silicon on Emerging Scale-Out Workloads: The Multi-Core Architecture Perspective2017
Operation-Level Wait-Free Transactional Memory with Support for Irrevocable Operations2017
Opportunistic Mobile Data Offloading with Deadline Constraints2017
Optimizing Graph Processing on GPUs2017
Parallel Deep Neural Network Training for Big Data on Blue Gene/Q2017
PIC: Enable Large-Scale Privacy Preserving Content-Based Image Search on Cloud2017
PLAN: Joint Policy- and Network-Aware VM Management for Cloud Data Centers2017
Privacy-Aware Scheduling SaaS in High Performance Computing Environments2017
Prophet: A Parallel Instruction-Oriented Many-Core Simulator2017
Raccoon: A Novel Network I/O Allocation Framework for Workload-Aware VM Scheduling in Virtual Environments2017
Random Regular Graph and Generalized De Bruijn Graph with $k$ -Shortest Path Routing2017
Rapid Calculation of Max-Min Fair Rates for Multi-Commodity Flows in Fat-Tree Networks2017
Reactive Molecular Dynamics on Massively Parallel Heterogeneous Architectures2017
Reliable Virtual Machine Placement and Routing in Clouds2017
Repair Tree: Fast Repair for Single Failure in Erasure-Coded Distributed Storage Systems2017
Resource Sharing in Multicore Mixed-Criticality Systems: Utilization Bound and Blocking Overhead2017
Scalable Adaptive NUMA-Aware Lock2017
Scheduling for Workflows with Security-Sensitive Intermediate Data by Selective Tasks Duplication in Clouds2017
Scheduling Independent Moldable Tasks on Multi-Cores with GPUs2017
Scientific Workflow Mining in Clouds2017
Seek-Efficient I/O Optimization in Single Failure Recovery for XOR-Coded Storage Systems2017

« prev Page 22/46 next »