IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Energy Efficient and Multi-Resource Optimization for Virtual Machine Placement by Improving MOEA/D2025
Everything Distributed and Asynchronous: A Practical System for Key Management Service2025
Exploiting Fine-Grained Task-Level Parallelism for Variant Calling Acceleration2025
Fast and Scalable Neural Network Quantum States Method for Molecular Potential Energy Surfaces2025
Featherlight Stateful WebAssembly for Serverless Inference Workflows2025
FedBiF: Communication-Efficient Federated Learning via Bits Freezing2025
FedCSpc: A Cross-Silo Federated Learning System With Error-Bounded Lossy Parameter Compression2025
FedEFsz: Fair Cross-Silo Federated Learning System With Error-Bounded Lossy Compression2025
FedLoRE: Communication-Efficient and Personalized Edge Intelligence Framework via Federated Low-Rank Estimation2025
FHE4DMM: A Low-Latency Distributed Matrix Multiplication With Fully Homomorphic Encryption2025
Flips: A Flexible Partitioning Strategy Near Memory Processing Architecture for Recommendation System2025
GEREM: Fast and Precise Error Resilience Assessment for GPU Microarchitectures2025
GPComp: Using GPU and SSD-GPU Peer to Peer DMA to Accelerate LSM-Tree Compaction for Key-Value Store2025
GraFetch: Accelerating Graph Applications Through Domain Specific Hierarchical Hybrid Prefetching2025
GreenFlow: A Carbon-Efficient Scheduler for Deep Learning Workloads2025
High Performance OpenCL-Based GEMM Kernel Auto-Tuned by Bayesian Optimization2025
HTLL: Latency-Aware Scalable Blocking Mutex2025
IceFrog: A Layer-Elastic Scheduling System for Deep Learning Training in GPU Clusters2025
IoT-Dedup: Device Relationship-Based IoT Data Deduplication Scheme2025
IRHunter: Universal Detection of Instruction Reordering Vulnerabilities for Enhanced Concurrency in Distributed and Parallel Systems2025
Kairos: Deterministic Scheduling Enhanced by User Collaboration for Deep Learning Workloads2025
Large-Scale Neural Network Quantum States Calculation for Quantum Chemistry on a New Sunway Supercomputer2025
Leveraging Graph Analysis to Pinpoint Root Causes of Scalability Issues for Parallel Applications2025
Loci: Federated Continual Learning of Heterogeneous Tasks at Edge2025
m$^{2}$2LLM: A Multi-Dimensional Optimization Framework for LLM Inference on Mobile Devices2025
Mapping Large-Scale Spiking Neural Network on Arbitrary Meshed Neuromorphic Hardware2025
MCG-Sched: Multi-Cluster GPU Scheduling for Resource Fragmentation Reduction and Load Balancing2025
MemTunnel: A CXL-Based Rack-Scale Host Memory Pooling Architecture for Cloud Service2025
MIST: Towards MPI Instant Startup and Termination on Tianhe HPC Systems2025
Monte: SFCs Migration Scheme in the Distributed Programmable Data Plane2025
MUCVR: Edge Computing-Enabled High-Quality Multi-User Collaboration for Interactive MVR2025
Multi-Agent Collaboration for Workflow Task Offloading in End-Edge-Cloud Environments Using Deep Reinforcement Learning2025
NDP: Network Division Positioning for Irregular Multi-Hop Networks2025
New Scheduling Algorithm and Analysis for Partitioned Periodic DAG Tasks on Multiprocessors2025
Oases: Efficient Large-Scale Model Training on Commodity Servers via Overlapped and Automated Tensor Model Parallelism2025
Object Proxy Patterns for Accelerating Distributed Applications2025
Ocelot: An Interactive, Efficient Distributed Compression-As-a-Service Platform With Optimized Data Compression Techniques2025
Online Container Caching for IoT Data Processing in Serverless Edge Computing2025
Online Elastic Resource Provisioning With QoS Guarantee in Container-Based Cloud Computing2025
Optimizing Data Locality by Integrating Intermediate Data Partitioning and Reduce Task Scheduling in Spark Framework2025
Optimizing Management of Persistent Data Structures in High-Performance Analytics2025
Paralfetch: Fast Application Launch on Personal Computing/Communication Devices2025
Parallel Wormhole Filters: High-Performance Approximate Membership Query Data Structures for Persistent Memory2025
Performance Portability Assessment in Gaia2025
PimBeam: Efficient Regular Path Queries Over Graph Database Using Processing-in-Memory2025
PipeMesh: Achieving Memory-Efficient Computation-Communication Overlap for Training Large Language Models2025
Popularity-Aware Data Placement in Erasure Coding-Based Edge Storage Systems2025
Productivity, Portability, Performance, and Reproducibility: Data-Centric Python2025
Raccoon: Lightweight Support for Comprehensive Control Flows in Reconfigurable Spatial Architectures2025
Response Time Analysis and Optimal Priority Assignment for Global Non-Preemptive Fixed-Priority Rigid Gang Scheduling2025

« prev Page 3/46 next »