IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Distributed Selfish Replication2006
Effectively Utilizing Global Cluster Memory for Large Data-Intensive Parallel Programs2006
Efficient and Adaptive Epidemic-Style Protocols for Reliable and Scalable Multicast2006
Efficient Distributed Low-Cost Backbone Formation for Wireless Networks2006
Exploiting Geographical and Temporal Locality to Boost Search Efficiency in Peer-to-Peer Systems2006
Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web Servers2006
High-Level Buffering for Hiding Periodic Output Cost in Scientific Simulations2006
Impact of Sensing Coverage on Greedy Geographic Routing Algorithms2006
Improving Query Response Delivery Quality in Peer-to-Peer Systems2006
Large Scaling Unstructured Peer-to-Peer Networks with Heterogeneity-Aware Topology and Routing2006
Load-Balanced Short-Path Routing in Wireless Networks2006
Localized Protocols for Ad Hoc Clustering and Backbone Formation: A Performance Comparison2006
Localized Topology Control for Unicast and Broadcast in Wireless Ad Hoc Networks2006
Maximal Lifetime Scheduling for Sensor Surveillance Systems with K Sensors to One Target2006
Messages Scheduling for Parallel Data Redistribution between Clusters2006
Multiprocessor Scheduling and Rescheduling with Use of Cellular Automata and Artificial Immune System Support2006
On Composing Stream Applications in Peer-to-Peer Environments2006
On Optimizing Backoff Counter Reservation and Classifying Stations for the IEEE 802.11 Distributed Wireless LANs2006
Optimal Resource Allocation in Overlay Multicast2006
Overall Blocking Behavior Analysis of General Banyan-Based Optical Switching Networks2006
PeerCluster: A Cluster-Based Peer-to-Peer System2006
Random Coverage with Guaranteed Connectivity: Joint Scheduling for Wireless Sensor Networks2006
Resource Allocation for Session-Based Two-Dimensional Service Differentiation on e-Commerce Servers2006
Time-Critical On-Demand Data Broadcast: Algorithms, Analysis, and Performance Evaluation2006
Twins: A Dual Addressing Space Representation for Self-Organizing Networks2006
A Distributed Approach to Node Clustering in Decentralized Peer-to-Peer Networks2005
A Family of Mechanisms for Congestion Control in Wormhole Networks2005
An Energy-Efficient Slack Distribution Technique for Multimode Distributed Real-Time Embedded Systems2005
A Spatiotemporal Communication Protocol for Wireless Sensor Networks2005
A Two-Level Directory Architecture for Highly Scalable cc-NUMA Multiprocessors2005
Comment on "Issues and Challenges in the Performance Analysis of Real Disk Arrays'2005
Communication and Memory Optimal Parallel Data Cube Construction2005
Dynamic Layer Management in Superpeer Architectures2005
Efficient Assignment and Scheduling for Heterogeneous DSP Systems2005
Fundamental Trade-Offs in Aggregate Packet Scheduling2005
Improving Source Routing Reliability in Mobile Ad Hoc Networks2005
Improving the Performance of Distributed Virtual Environment Systems2005
In-Kernel Integration of Operating System and Infiniband Functions for High Performance Computing Clusters: A DSM Example2005
Integrating Web Caching and Web Prefetching in Client-Side Proxies2005
Location Awareness in Unstructured Peer-to-Peer Systems2005
NoC Synthesis Flow for Customized Domain Specific Multiprocessor Systems-on-Chip2005
On-Chip Interconnects and Instruction Steering Schemes for Clustered Microarchitectures2005
On Optimal Replication of Data Object at Hierarchical and Transparent Web Proxies2005
Optimal Path Embedding in Crossed Cubes2005
Optimizing Array-Intensive Applications for On-Chip Multiprocessors2005
Part I: A Theory for Deadlock-Free Dynamic Network Reconfiguration2005
Part II: A Methodology for Developing Deadlock-Free Dynamic Network Reconfiguration Processes2005
Perimeter-Based Defense against High Bandwidth DDoS Attacks2005
Pipelining Broadcasts on Heterogeneous Platforms2005
QoS-Aware Replica Placement for Content Distribution2005

« prev Page 41/46 next »