IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Semi-External Memory Sparse Matrix Multiplication for Billion-Node Graphs2017
Semi-Online Algorithms for Computational Task Offloading with Communication Delay2017
Service-Oriented Architecture on FPGA-Based MPSoC2017
Stochastic Resource Provisioning for Containerized Multi-Tier Web Services in Clouds2017
TLB-Based Temporality-Aware Classification in CMPs with Multilevel TLBs2017
Traffic At-a-Glance: Time-Bounded Analytics on Large Visual Traffic Data2017
Traffic-Aware Geo-Distributed Big Data Analytics with Predictable Job Completion Time2017
Traffic Load Balancing Schemes for Devolved Controllers in Mega Data Centers2017
Trajectory Pattern Mining for Urban Computing in the Cloud2017
Trends in Data Locality Abstractions for HPC Systems2017
Understanding Big Data Analytics Workloads on Modern Processors2017
Understanding Co-Running Behaviors on Integrated CPU/GPU Architectures2017
Using Switchable Pins to Increase Off-Chip Bandwidth in Chip-Multiprocessors2017
VarCatcher: A Framework for Tackling Performance Variability of Parallel Workloads on Multi-Core2017
Workload Consolidation for Cloud Data Centers with Guaranteed QoS Using Request Reneging2017
統合CPU/GPUアーキテクチャの理解Co走行挙動【Powered by NICT】2017
高速並列ベースのマルチコアCPUと多数コアGPU混合複合進化大域的最適化アプローチ【Powered by NICT】2017
Accelerating Irregular Computation in Massive Short Reads Mapping on FPGA Co-Processor2016
Achieving Optimal Block Pipelining in Organized Network Coded Gossip2016
Achieving Optimal Traffic Engineering Using a Generalized Routing Framework2016
A Constraint Programming Scheduler for Heterogeneous High-Performance Computing Machines2016
A Delayed Container Organization Approach to Improve Restore Speed for Deduplication Systems2016
A Distributed and Scalable Approach to Semi-Intrusive Load Monitoring2016
A Family of Fault-Tolerant Efficient Indirect Topologies2016
A Framework for Practical Dynamic Software Updating2016
A Framework of Price Bidding Configurations for Resource Usage in Cloud Computing2016
A General Approach to Scalable Buffer Pool Management2016
A Hop-by-Hop Routing Mechanism for Green Internet2016
A Hybrid Parallel Solving Algorithm on GPU for Quasi-Tridiagonal System of Linear Equations2016
A Loosely-Coupled Full-System Multicore Simulation Framework2016
An Analytical Solution for Probabilistic Guarantees of Reservation Based Soft Real-Time Systems2016
An Efficient Privacy-Preserving Ranked Keyword Search Method2016
A Performance Debugging Framework for Unnecessary Lock Contentions with Record/Replay Techniques2016
A Secure and Dynamic Multi-Keyword Ranked Search Scheme over Encrypted Cloud Data2016
Assessing the Suitability of King Topologies for Interconnection Networks2016
A Survey Of Architectural Approaches for Data Compression in Cache and Main Memory Systems2016
A Survey of Software Techniques for Using Non-Volatile Memories for Storage and Main Memory Systems2016
A Survey Of Techniques for Architecting DRAM Caches2016
A Survey of Techniques for Modeling and Improving Reliability of Computing Systems2016
Autonomic Performance and Power Control for Co-Located Web Applications in Virtualized Datacenters2016
Building Semi-Elastic Virtual Clusters for Cost-Effective HPC Cloud Resource Provisioning2016
Burstiness-Aware Resource Reservation for Server Consolidation in Computing Clouds2016
Cache Line Aware Algorithm Design for Cache-Coherent Architectures2016
Carbon-Aware Online Control of Geo-Distributed Cloud Services2016
CloudArmor: Supporting Reputation-Based Trust Management for Cloud Services2016
Cloud Customer's Historical Record Based Resource Pricing2016
Collaboration- and Fairness-Aware Big Data Management in Distributed Clouds2016
Continuous Answering Holistic Queries over Sensor Networks2016
Cost-Aware Caching: Caching More (Costly Items) for Less (ISPs Operational Expenditures)2016
Cost Minimization for Rule Caching in Software Defined Networking2016

« prev Page 23/46 next »