IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Cooperative Memory Expansion via OS Kernel Support for Networked Computing Systems2020
COPA: Highly Cost-Effective Power Back-Up for Green Datacenters2020
Cost-Aware Partitioning for Efficient Large Graph Processing in Geo-Distributed Datacenters2020
Countdown Slack: A Run-Time Library to Reduce Energy Footprint in Large-Scale MPI Applications2020
Cross-Rack-Aware Updates in Erasure-Coded Data Centers: Design and Evaluation2020
cuPC: CUDA-Based Parallel PC Algorithm for Causal Structure Learning on GPU2020
Customizable Scale-Out Key-Value Stores2020
Data-Parallel Hashing Techniques for GPU Architectures2020
Deep Learning Research and Development Platform: Characterizing and Scheduling with QoS Guarantees on GPU Clusters2020
Designing Energy-Efficient MPSoC with Untrustworthy 3PIP Cores2020
Distributed Graph Computation Meets Machine Learning2020
Dynamic Undervolting to Improve Energy Efficiency on Multicore X86 CPUs2020
EEPC: A Framework for Energy-Efficient Parallel Control of Connected Cars2020
Efficient Algorithms for Delay-Aware NFV-Enabled Multicasting in Mobile Edge Clouds With Resource Sharing2020
Efficient Compute-Intensive Job Allocation in Data Centers via Deep Reinforcement Learning2020
Efficient Performance Estimation and Work-Group Size Pruning for OpenCL Kernels on GPUs2020
Enabling Encrypted Boolean Queries in Geographically Distributed Databases2020
Enabling Runtime SpMV Format Selection through an Overhead Conscious Method2020
Endpoint-Flexible Coflow Scheduling Across Geo-Distributed Datacenters2020
Energy-Efficient Parallel Real-Time Scheduling on Clustered Multi-Core2020
Errata to "Exploring Fault-Tolerant Erasure Codes for Scalable All-Flash Array Clusters"2020
Errata to "On-Edge Multi-Task Transfer Learning: Model and Practice With Data-Driven Task Allocation"2020
ESetStore: An Erasure-Coded Storage System With Fast Data Recovery2020
Evaluating Modern GPU Interconnect: PCIe, NVLink, NV-SLI, NVSwitch and GPUDirect2020
Exploring New Opportunities to Defeat Low-Rate DDoS Attack in Container-Based Cloud Environment2020
Exploring Token-Oriented In-Network Prioritization in Datacenter Networks2020
Faster Parallel Core Maintenance Algorithms in Dynamic Graphs2020
FeatherCNN: Fast Inference Computation with TensorGEMM on ARM Architectures2020
FedSCR: Structure-based Communication Reduction for Federated Learning2020
Fully Homomorphic based Privacy-Preserving Distributed Expectation Maximization on Cloud2020
GA-Par: Dependable Microservice Orchestration Framework for Geo-Distributed Clouds2020
Generalized Cost-Based Job Scheduling in Very Large Heterogeneous Cluster Systems2020
gMig: Efficient vGPU Live Migration with Overlapped Software-Based Dirty Page Verification2020
GPGPU Performance Estimation With Core and Memory Frequency Scaling2020
GPU-Accelerated Real-Time Stereo Estimation With Binary Neural Network2020
gQoS: A QoS-Oriented GPU Virtualization with Adaptive Capacity Sharing2020
Heterogeneous edge offloading with incomplete information2020
Heterogeneous Edge Offloading With Incomplete Information: A Minority Game Approach2020
HeteroYARN: A Heterogeneous FPGA-Accelerated Architecture Based on YARN2020
Hotspot-Aware Hybrid Memory Management for In-Memory Key-Value Stores2020
Improving HW/SW Adaptability for Accelerating CNNs on FPGAs Through A Dynamic/Static Co-Reconfiguration Approach2020
Improving MPI Collective I/O for High Volume Non-Contiguous Requests With Intra-Node Aggregation2020
Interval Job Scheduling With Machine Launch Cost2020
Large-Scale Automatic K-Means Clustering for Heterogeneous Many-Core Supercomputer2020
Learning driven computation offloading for asymmetrically informed edge computing2020
Local-Density Subspace Distributed Clustering for High-Dimensional Data2020
Location-Aware and Budget-Constrained Service Deployment for Composite Applications in Multi-Cloud Environment2020
Low-Cost Datacenter Load Balancing With Multipath Transport and Top-of-Rack Switches2020
Millimeter-Scale and Billion-Atom Reactive Force Field Simulation on Sunway Taihulight2020
Minimizing Tardiness for Data-Intensive Applications in Heterogeneous Systems: A Matching Theory Perspective2020

« prev Page 16/46 next »