IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Hierarchical Federated Learning With Momentum Acceleration in Multi-Tier Networks2023
HierFedML: Aggregator Placement and UE Assignment for Hierarchical Federated Learning in Mobile Edge Computing2023
HiFlash: Communication-Efficient Hierarchical Federated Learning With Adaptive Staleness Control and Heterogeneity-Aware Client-Edge Association2023
High-Level Data Abstraction and Elastic Data Caching for Data-Intensive AI Applications on Cloud-Native Platforms2023
HPC Hardware Design Reliability Benchmarking With HDFIT2023
Hypergraph-Based Numerical Neural-Like P Systems for Medical Image Segmentation2023
iGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud2023
Improving the Scalability of GPU Synchronization Primitives2023
Incentive Mechanism Design for Joint Resource Allocation in Blockchain-Based Federated Learning2023
Joint Caching and Routing in Cache Networks With Arbitrary Topology2023
Joint Deployment and Request Routing for Microservice Call Graphs in Data Centers2023
Large-Scale Measurements and Prediction of DC-WAN Traffic2023
LB-Chain: Load-Balanced and Low-Latency Blockchain Sharding via Account Migration2023
Learning to Schedule Multi-Server Jobs With Fluctuated Processing Speeds2023
Leveraging Deep Reinforcement Learning With Attention Mechanism for Virtual Network Function Placement and Routing2023
Merak: An Efficient Distributed DNN Training Framework With Automated 3D Parallelism for Giant Foundation Models2023
mpi4py.futures: MPI-Based Asynchronous Task Execution for Python2023
Multi-Job Intelligent Scheduling With Cross-Device Federated Learning2023
Multi-SP Network Slicing Parallel Relieving Edge Network Conflict2023
Neighbor Graph Based Tensor Recovery For Accurate Internet Anomaly Detection2023
NIOT: A Novel Inference Optimization of Transformers on Modern CPUs2023
Node Essentiality Assessment and Distributed Collaborative Virtual Network Embedding in Datacenters2023
On Jointly Optimizing Partial Offloading and SFC Mapping: A Cooperative Dual-Agent Deep Reinforcement Learning Approach2023
On-Line Network Traffic Anomaly Detection Based on Tensor Sketch2023
Online Reconfiguration of IoT Applications in the Fog: The Information-Coordination Trade-Off2023
On Model Transmission Strategies in Federated Learning With Lossy Communications2023
On the Design and Evaluation of an Optimal Security-and-Time Cognizant Data Placement for Dynamic Fog Environments2023
P4SGD: Programmable Switch Enhanced Model-Parallel Training on Generalized Linear Models on Distributed FPGAs2023
Parallel Training of Pre-Trained Models via Chunk-Based Dynamic Memory Management2023
Personalized Edge Intelligence via Federated Self-Knowledge Distillation2023
PetaKV: Building Efficient Key-Value Store for File System Metadata on Persistent Memory2023
Practical Cloud-Edge Scheduling for Large-Scale Crowdsourced Live Streaming2023
Practice of Streaming Processing of Dynamic Graphs: Concepts, Models, and Systems2023
Privacy vs. Efficiency: Achieving Both Through Adaptive Hierarchical Federated Learning2023
ProScale: Proactive Autoscaling for Microservice With Time-Varying Workload at the Edge2023
Redesign and Accelerate the AIREBO Bond-Order Potential on the New Sunway Supercomputer2023
Revisiting Core Maintenance for Dynamic Hypergraphs2023
RHDOFS: A Distributed Online Algorithm Towards Scalable Streaming Feature Selection2023
RLPTO: A Reinforcement Learning-Based Performance-Time Optimized Task and Resource Scheduling Mechanism for Distributed Machine Learning2023
RLQ: Workload Allocation With Reinforcement Learning in Distributed Queues2023
Robustness Analysis and Enhancement of Deep Reinforcement Learning-Based Schedulers2023
RTGPU: Real-Time GPU Scheduling of Hard Deadline Parallel Tasks With Fine-Grain Utilization2023
Scheduling Parallel Real-Time Tasks on Virtual Processors2023
Securing Deployed Smart Contracts and DeFi With Distributed TEE Cluster2023
Securing Distributed SGD Against Gradient Leakage Threats2023
Securing Fine-Grained Data Sharing and Erasure in Outsourced Storage Systems2023
Shuffle Differential Private Data Aggregation for Random Population2023
Simeuro: A Hybrid CPU-GPU Parallel Simulator for Neuromorphic Computing Chips2023
SketchINT: Empowering INT With TowerSketch for Per-Flow Per-Switch Measurement2023
Sparse Stream Semantic Registers: A Lightweight ISA Extension Accelerating General Sparse Linear Algebra2023

« prev Page 8/46 next »