IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Collaboration in Federated Learning With Differential Privacy: A Stackelberg Game Analysis2024
ComboFunc: Joint Resource Combination and Container Placement for Serverless Function Scaling With Heterogeneous Container2024
Communication-Efficient Regret-Optimal Distributed Online Convex Optimization2024
Competitive Analysis of Online Elastic Caching of Transient Data in Multi-Tiered Content Delivery Network2024
Cost-Effective and Robust Service Provisioning in Multi-Access Edge Computing2024
Cost-Effective Server Deployment for Multi-Access Edge Networks: A Cooperative Scheme2024
Critique of “Productivity, Portability, Performance Data-Centric Python” by SCC Team From Sun Yat-sen University2024
DeepCAT+: A Low-Cost and Transferrable Online Configuration Auto-Tuning Approach for Big Data Frameworks2024
DeepTM: Efficient Tensor Management in Heterogeneous Memory for DNN Training2024
Demystifying the Cost of Serverless Computing: Towards a Win-Win Deal2024
Distributed Evolution Strategies With Multi-Level Learning for Large-Scale Black-Box Optimization2024
Distributed Semi-Supervised Learning With Consensus Consistency on Edge Devices2024
Distributed Task Processing Platform for Infrastructure-Less IoT Networks: A Multi-Dimensional Optimization Approach2024
DyLaClass: Dynamic Labeling Based Classification for Optimal Sparse Matrix Format Selection in Accelerating SpMV2024
Efficient Distributed Edge Computing for Dependent Delay-Sensitive Tasks in Multi-Operator Multi-Access Networks2024
Efficient Schedule Construction for Distributed Execution of Large DNN Models2024
Efficient Utilization of Multi-Threading Parallelism on Heterogeneous Systems for Sparse Tensor Contraction2024
ElasticBatch: A Learning-Augmented Elastic Scheduling System for Batch Inference on MIG2024
Enabling Efficient Erasure Coding in Disaggregated Memory Systems2024
Enabling Streaming Analytics in Satellite Edge Computing via Timely Evaluation of Big Data Queries2024
Exploring the Design Space of Distributed Parallel Sparse Matrix-Multiple Vector Multiplication2024
FAST: Enhancing Federated Learning Through Adaptive Data Sampling and Local Training2024
Faster and Scalable MPI Applications Launching2024
Faster-BNI: Fast Parallel Exact Inference on Bayesian Networks2024
FastLoad: Speeding Up Data Loading of Both Sparse Matrix and Vector for SpMV on GPUs2024
FastTuning: Enabling Fast and Efficient Hyper-Parameter Tuning With Partitioning and Parallelism of Search Space2024
FedHAP: Federated Hashing With Global Prototypes for Cross-Silo Retrieval2024
FedICT: Federated Multi-Task Distillation for Multi-Access Edge Computing2024
FedREM: Guided Federated Learning in the Presence of Dynamic Device Unpredictability2024
FEUAGame: Fairness-Aware Edge User Allocation for App Vendors2024
FHVAC: Feature-Level Hybrid Video Adaptive Configuration for Machine-Centric Live Streaming2024
Flexible and Efficient Memory Swapping Across Mobile Devices With LegoSwap2024
FlexRaft: Exploiting Flexible Erasure Coding for Minimum-Cost Consensus and Fast Recovery2024
Freyr $^+$+: Harvesting Idle Resources in Serverless Computing via Deep Reinforcement Learning2024
Gamora: Learning-Based Buffer-Aware Preloading for Adaptive Short Video Streaming2024
GeoScale: Microservice Autoscaling With Cost Budget in Geo-Distributed Edge Clouds2024
G-Learned Index: Enabling Efficient Learned Index on GPU2024
Graft: Efficient Inference Serving for Hybrid Deep Learning With SLO Guarantees via DNN Re-Alignment2024
Graph-Centric Performance Analysis for Large-Scale Parallel Applications2024
Hierarchical Reinforcement Learning with Partner Modeling for Distributed Multi-agent Cooperation2024
High-Performance Hardware Acceleration Architecture for Cross-Silo Federated Learning2024
High-Throughput GPU Implementation of Dilithium Post-Quantum Digital Signature2024
HiHGNN: Accelerating HGNNs Through Parallelism and Data Reusability Exploitation2024
HI-Kyber: A Novel High-Performance Implementation Scheme of Kyber Based on GPU2024
HitGNN: High-Throughput GNN Training Framework on CPU+Multi-FPGA Heterogeneous Platform2024
Hopscotch: A Hardware-Software Co-Design for Efficient Cache Resizing on Multi-Core SoCs2024
HPETC: History Priority Enhanced Tensor Completion for Network Distance Measurement2024
HRCM: A Hierarchical Regularizing Mechanism for Sparse and Imbalanced Communication in Whole Human Brain Simulations2024
InSS: An Intelligent Scheduling Orchestrator for Multi-GPU Inference With Spatio-Temporal Sharing2024
Joint Optimization of Parallelism and Resource Configuration for Serverless Function Steps2024

« prev Page 5/46 next »