IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Exploring Data Analytics Without Decompression on Embedded GPU Systems2022
Exploring Query Processing on CPU-GPU Integrated Edge Device2022
Fairness-Aware VNF Sharing and Rate Coordination for High Efficient Service Scheduling2022
FARNN: FPGA-GPU Hybrid Acceleration Platform for Recurrent Neural Networks2022
FarSpot: Optimizing Monetary Cost for HPC Applications in the Cloud Spot Market2022
Fast Proactive Repair in Erasure-Coded Storage: Analysis, Design, and Implementation2022
Federated Learning With Nesterov Accelerated Gradient2022
FenceKV: Enabling Efficient Range Query for Key-Value Separation2022
Flexible Clustered Federated Learning for Client-Level Data Distribution Shift2022
Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems2022
FRuDA: Framework for Distributed Adversarial Domain Adaptation2022
Gaviss : Boosting the Performance of GPU-Accelerated NFV Systems via Data Sharing2022
GraphOpt: Constrained-Optimization-Based Parallelization of Irregular Graphs2022
G-SLIDE: A GPU-Based Sub-Linear Deep Learning Engine via LSH Sparsification2022
HEROv2: Full-Stack Open-Source Research Platform for Heterogeneous Computing2022
Heterogeneous Systolic Array Architecture for Compact CNNs Hardware Accelerators2022
HiTDL: High-Throughput Deep Learning Inference at the Hybrid Mobile Edge2022
HSA-Net: Hidden-State-Aware Networks for High-Precision QoS Prediction2022
Hydra: A Decentralized File System for Persistent Memory and RDMA Networks2022
Astrea:Auto-Serverless Analytics Towards Cost-Efficiency and QoS-Awareness2022
Eiffel: Efficient and Fair Scheduling in Adaptive Federated Learning2022
Improving Cache Utilization of Nested Parallel Programs by Almost Deterministic Work Stealing2022
Improving Fairness for SSD Devices through DRAM Over-Provisioning Cache Management2022
Improving Federated Learning With Quality-Aware User Incentive and Auto-Weighted Model Aggregation2022
Improving I/O Performance for Exascale Applications Through Online Data Layout Reorganization2022
Incentive-Aware Autonomous Client Participation in Federated Learning2022
zMesh: Theories and Methods to Exploring Application Characteristics to Improve Lossy Compression Ratio for Adaptive Mesh Refinement2022
Joint Coverage-Reliability for Budgeted Edge Application Deployment in Mobile Edge Computing Environment2022
Leveraging Code Snippets to Detect Variations in the Performance of HPC Systems2022
LightFed: An Efficient and Secure Federated Edge Learning System on Model Splitting2022
Lightweight and Accurate DNN-Based Anomaly Detection at Edge2022
Liquid: Intelligent Resource Estimation and Network-Efficient Scheduling for Deep Learning Jobs on Distributed GPU Clusters2022
LOCUS: User-Perceived Delay-Aware Service Placement and User Allocation in MEC Environment2022
LoomIO: Object-Level Coordination in Distributed File Systems2022
Lossy Compression of Communication Traces Using Recurrent Neural Networks2022
Maximizing User Service Satisfaction for Delay-Sensitive IoT Applications in Edge Computing2022
Meet: Rack-Level Pooling Based Load Balancing in Datacenter Networks2022
MemXCT: Design, Optimization, Scaling, and Reproducibility of X-Ray Tomography Imaging2022
Mobility-Aware Offloading and Resource Allocation for Distributed Services Collaboration2022
Monodirectional Evolutional Symport Tissue P Systems With Promoters and Cell Division2022
Multi-Swarm Co-Evolution Based Hybrid Intelligent Optimization for Bi-Objective Multi-Workflow Scheduling in the Cloud2022
Multi-Task Federated Learning for Personalised Deep Neural Networks in Edge Computing2022
NeoFlow: A Flexible Framework for Enabling Efficient Compilation for High Performance DNN Training2022
NetSHa: In-Network Acceleration of LSH-Based Distributed Search2022
NetSync: A Network Adaptive and Deduplication-Inspired Delta Synchronization Approach for Cloud Storage Services2022
NITI: Training Integer Neural Networks Using Integer-Only Arithmetic2022
OCTOPUS: Overcoming Performance and Privatization Bottlenecks in Distributed Learning2022
Online Learning for Distributed Computation Offloading in Wireless Powered Mobile Edge Computing Networks2022
Online Orchestration of Collaborative Caching for Multi-Bitrate Videos in Edge Computing2022
Online Power Management for Multi-Cores: A Reinforcement Learning Based Approach2022

« prev Page 11/46 next »