IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Reducing Server Data Traffic Using a Hierarchical Computation Model2005
Scheduling Divisible Loads on Star and Tree Networks: Results and Open Problems2005
Shared Data Allocation in a Mobile Computing System: Exploring Local and Global Optimization2005
The exchanged hypercube2005
Traffic Scheduling Solutions with QoS Support for an Input-Buffered MultiMedia Router2005
You Can Run, But You Can't Hide: An Effective Statistical Methodology to Trace Back DDoS Attackers2005
Access pattern restructuring for memory energy2004
A Core Stateless Bandwidth Broker Architecture for Scalable Support of Guaranteed Services2004
An Architecture for High-Performance Scalable Shared-Memory Multiprocessors Exploiting On-Chip Integration2004
An Effective Methodology to Improve the Performance of the Up*/Down* Routing Algorithm2004
An Energy-Efficient Permutation Routing Protocol for Single-Hop Radio Networks2004
Applications of k-Local MST for Topology Control and Broadcasting in Wireless Ad Hoc Networks2004
A Proportional-Delay DiffServ-Enabled Web Server: Admission Control and Dynamic Adaptation2004
Design and Analysis of Location Management for 3G Cellular Networks2004
Design, Implementation, and Evaluation of Differentiated Caching Services2004
Distributed Admission Control for Anycast Flows2004
EMPOWER: A Cluster Architecture Supporting Network Emulation2004
Harmonic proportional bandwidth allocation and scheduling for service differentiation on streaming servers2004
Measuring the Robustness of a Resource Allocation2004
Minimal Cost Replication of Dynamic Web Contents under Flat Update Delivery2004
On Generalized Max-Min Rate Allocation and Distributed Convergence Algorithm for Packet Networks2004
Optimizing Graph Algorithms for Improved Cache Performance2004
Partial Delaunay Triangulation and Degree Limited Localized Bluetooth Scatternet Formation2004
QoS in InfiniBand Subnetworks2004
Quasidynamic Layout Optimizations for Improving Data Locality2004
Scheduling Strategies for Master-Slave Tasking on Heterogeneous Processor Platforms2004
Sharc: Managing CPU and Network Bandwidth in Shared Clusters2004
Studying energy trade offs in offloading computation/compilation in Java-enabled mobile devices2004
The Minimal Cost Distribution Tree Problem for Recursive Expiration-Based Consistency Management2004
A Comparison of Three Artificial Life Techniques for Reporting Cell Planning in Mobile Computing2003
Adaptive Core Selection and Migration Method for Multicast Routing in Mobile Ad Hoc Networks2003
A high-performance application data environment for large-scale scientific computations2003
Algorithms for supporting compiled communication2003
An Efficient Parallel Prefix Sums Architecture with Domino Logic2003
An Integrated Approach to Parallel Scheduling Using Gang-Scheduling, Backfilling, and Migration2003
Correlation Prefetching with a User-Level Memory Thread2003
Deadlock-Free Dynamic Reconfiguration Schemes for Increased Network Dependability2003
Distributed Initialization Algorithms for Single-Hop Ad Hoc Networks with Minislotted Carrier Sensing2003
Evolving Cellular Automata for Location Management in Mobile Computing Networks2003
FC3D: Flow Control-Based Distributed Deadlock Detection Mechanism for True Fully Adaptive Routing in Wormhole Networks2003
Geometric Spanners for Wireless Ad Hoc Networks2003
Guest Editorial: Special Section on Middleware Infrastructures2003
Guest editorial: Special section on security in distributed computing systems2003
Localized Delaunay Triangulation with Application in Ad Hoc Wireless Networks2003
MVSS: An Active Storage Architecture2003
On Exploring Aggregate Effect for Efficient Cache Replacement in Transcoding Proxies2003
Optimal remapping in dynamic bulk synchronous computations via a stochastic control approach2003
Probabilistic Reliable Dissemination in Large-Scale Systems2003
Processor allocation in the mesh multiprocessors using the leapfrog method2003
Protecting BGP Routes to Top-Level DNS Servers2003

« prev Page 42/46 next »