IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Online Pricing and Trading of Private Data in Correlated Queries2022
Online Thread Auto-Tuning for Performance Improvement and Resource Saving2022
On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Federated Learning2022
Optimal Embedding of Aggregated Service Function Tree2022
Optimal Repair-Scaling Trade-off in Locally Repairable Codes: Analysis and Evaluation2022
Optimization of Reactive Force Field Simulation: Refactor, Parallelization, and Vectorization for Interactions2022
Optimizing Depthwise Separable Convolution Operations on GPUs2022
Optimizing DNN Compilation for Distributed Training With Joint OP and Tensor Fusion2022
Optimizing Error-Bounded Lossy Compression for Scientific Data With Diverse Constraints2022
Optimizing Network Transfers for Data Analytic Jobs Across Geo-Distributed Datacenters2022
Optimizing video caching at the edge2022
Optimizing Video Caching at the Edge: A Hybrid Multi-Point Process Approach2022
Parallel and Asynchronous Smart Contract Execution2022
Parallel and Distributed Structured SVM Training2022
PayDebt: Reduce Buffer Occupancy Under Bursty Traffic on Large Clusters2022
Pistis: Issuing Trusted and Authorized Certificates With Distributed Ledger and TEE2022
PLVER: Joint Stable Allocation and Content Replication for Edge-Assisted Live Video Delivery2022
POCLib: A High-Performance Framework for Enabling Near Orthogonal Processing on Compression2022
PostMan: Rapidly Mitigating Bursty Traffic via On-Demand Offloading of Packet Processing2022
Power-Aware Checkpointing for Multicore Embedded Systems2022
PPOAccel: A High-Throughput Acceleration Framework for Proximal Policy Optimization2022
Privacy-Preserving Deduplication of Sensor Compressed Data in Distributed Fog Computing2022
Privacy-Preserving Efficient Federated-Learning Model Debugging2022
PS+: A Simple yet Effective Framework for Fast Training on Parameter Server2022
PushBox: Making Use of Every Bit of Time to Accelerate Completion of Data-Parallel Jobs2022
QoS-Aware Co-Scheduling for Distributed Long-Running Applications on Shared Clusters2022
QoS-Aware Scheduling of Remote Rendering for Interactive Multimedia Applications in Edge Computing2022
Real-Time Scheduling of Parallel Task Graphs With Critical Sections Across Different Vertices2022
Redesigning and Optimizing UCSF DOCK3.7 on Sunway TaihuLight2022
ReHy: A ReRAM-Based Digital/Analog Hybrid PIM Architecture for Accelerating CNN Training2022
Reputation-Aware Hedonic Coalition Formation for Efficient Serverless Hierarchical Federated Learning2022
ScaleFlux: Efficient Stateful Scaling in NFV2022
Scaling Poisson Solvers on Many Cores via MMEwald2022
SGCNAX: A Scalable Graph Convolutional Neural Network Accelerator With Workload Balancing2022
SmartVM: A Smart Contract Virtual Machine for Fast On-Chain DNN Computations2022
State Space Model and Queuing Network Based Cloud Resource Provisioning for Meshed Web Systems2022
Taming System Dynamics on Resource Optimization for Data Processing Workflows: A Probabilistic Approach2022
Taskflow: A Lightweight Parallel and Heterogeneous Task Graph Computing System2022
TDFL: Truth Discovery Based Byzantine Robust Federated Learning2022
TensorOpt: Exploring the Tradeoffs in Distributed DNN Training With Auto-Parallelism2022
Tensorox: Accelerating GPU Applications via Neural Approximation on Unused Tensor Cores2022
TherMa-MiCs: Thermal-Aware Scheduling for Fault-Tolerant Mixed-Criticality Systems2022
The State of the Art of Metadata Managements in Large-Scale Distributed File Systems - Scalability, Performance and Availability2022
The Supermarket Model With Known and Predicted Service Times2022
TianheGraph: Customizing Graph Search for Graph500 on Tianhe Supercomputer2022
TODG: Distributed Task Offloading With Delay Guarantees for Edge Computing2022
Topology-Aware Neural Model for Highly Accurate QoS Prediction2022
Towards Efficient and Stable K-Asynchronous Federated Learning With Unbounded Stale Gradients on Non-IID Data2022
Towards Revenue-Driven Multi-User Online Task Offloading in Edge Computing2022
TriangleKV: Reducing Write Stalls and Write Amplification in LSM-Tree Based KV Stores With Triangle Container in NVM2022

« prev Page 12/46 next »