IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
STR: Hybrid Tensor Re-Generation to Break Memory Wall for DNN Training2023
Swing: Providing Long-Range Lossless RDMA via PFC-Relay2023
Tag-Sharer-Fusion Directory: A Scalable Coherence Directory With Flexible Entry Formats2023
Task Placement and Resource Allocation for Edge Machine Learning: A GNN-Based Multi-Agent Reinforcement Learning Paradigm2023
TDTA: Topology-Based Real-Time DAG Task Allocation on Identical Multiprocessor Platforms2023
TFormer: A Transmission-Friendly ViT Model for IoT Devices2023
Topology-Aware Scheduling Framework for Microservice Applications in Cloud2023
Towards Correlated Data Trading for High-Dimensional Private Data2023
Tripartite Graph Aided Tensor Completion For Sparse Network Measurement2023
TSC-VEE: A TrustZone-Based Smart Contract Virtual Execution Environment2023
TurboMGNN: Improving Concurrent GNN Training Tasks on GPU With Fine-Grained Kernel Fusion2023
UMA-MF: A Unified Multi-CPU/GPU Asynchronous Computing Framework for SGD-Based Matrix Factorization2023
$f$funcX: Federated Function as a Service for Science2022
$run$ runData: Re-Distributing Data via Piggybacking for Geo-Distributed Data Analytics Over Edges2022
A Bi-Objective Learn-and-Deploy Scheduling Method for Bursty and Stochastic Requests on Heterogeneous Cloud Servers2022
Accelerating Backward Aggregation in GCN Training With Execution Path Preparing on GPUs2022
Accelerating Bayesian Neural Networks via Algorithmic and Hardware Optimizations2022
Accelerating Geostatistical Modeling and Prediction With Mixed-Precision Computations: A High-Productivity Approach With PaRSEC2022
AccTFM: An Effective Intra-Layer Model Parallelization Strategy for Training Large-Scale Transformer-Based Models2022
Adaptive and Efficient Resource Allocation in Cloud Datacenters Using Actor-Critic Deep Reinforcement Learning2022
Adaptive Resource Efficient Microservice Deployment in Cloud-Edge Continuum2022
Adaptive Vertical Federated Learning on Unbalanced Features2022
A Decentralized Federated Learning Framework via Committee Mechanism With Convergence Guarantee2022
AGCM-3DLF: Accelerating Atmospheric General Circulation Model via 3-D Parallelization and Leap-Format2022
A Global Cost-Aware Container Scheduling Strategy in Cloud Data Centers2022
A Low-Power Transprecision Floating-Point Cluster for Efficient Near-Sensor Data Analytics2022
An Accurate and Efficient Large-Scale Regression Method Through Best Friend Clustering2022
An Efficient Index-Based Approach to Distributed Set Reachability on Small-World Graphs2022
An Efficient Parallel Reinforcement Learning Approach to Cross-Layer Defense Mechanism in Industrial Control Systems2022
An In-Depth Study of Microservice Call Graph and Runtime Performance2022
A Parallel Secure Flow Control Framework for Private Data Sharing in Mobile Edge Cloud2022
A Pattern-Based SpGEMM Library for Multi-Core and Many-Core Architectures2022
A Potential Game Theoretic Approach to Computation Offloading Strategy Optimization in End-Edge-Cloud Computing2022
A Practical and Efficient Bidirectional Access Control Scheme for Cloud-Edge Data Sharing2022
Astraea: A Fair Deep Learning Scheduler for Multi-Tenant GPU Clusters2022
Astrea: Auto-Serverless Analytics Towards Cost-Efficiency and QoS-Awareness2022
A Survey of GPU Multitasking Methods Supported by Hardware Architecture2022
AUCTION: Automated and Quality-Aware Client Selection Framework for Efficient Federated Learning2022
A Unified Framework for Flexible Playback Latency Control in Live Video Streaming2022
Auto-GNAS: A Parallel Graph Neural Architecture Search Framework2022
Automatic Generation of High-Performance Convolution Kernels on ARM CPUs for Deep Learning2022
Batch Crowdsourcing for Complex Tasks Based on Distributed Team Formation in E-Markets2022
Benchmarking 50-Photon Gaussian Boson Sampling on the Sunway TaihuLight2022
Bridging the Gap between Deep Learning and Frustrated Quantum Spin System for Extreme-Scale Simulations on New Generation of Sunway Supercomputer2022
Busy-Time Scheduling on Heterogeneous Machines: Algorithms and Analysis2022
Characterizing Performance of Graph Neighborhood Communication Patterns2022
Cloud Object Storage Synchronization: Design, Analysis, and Implementation2022
CNNPC: End-Edge-Cloud Collaborative CNN Inference With Joint Model Partition and Compression2022
Co-Concurrency Mechanism for Multi-GPUs in Distributed Heterogeneous Environments2022
CoFilter: High-Performance Switch-Accelerated Stateful Packet Filter for Bare-Metal Servers2022

« prev Page 9/46 next »