IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
SnapMig: Accelerating VM Live Storage Migration by Leveraging the Existing VM Snapshots in the Cloud2018
TA-Update: An Adaptive Update Scheme with Tree-Structured Transmission in Erasure-Coded Storage Systems2018
Time- and Cost- Efficient Task Scheduling across Geo-Distributed Data Centers2018
Toward High Mobile GPU Performance Through Collaborative Workload Offloading2018
Towards Bandwidth Guarantee for Virtual Clusters Under Demand Uncertainty in Multi-Tenant Clouds2018
Towards Quality Aware Information Integration in Distributed Sensing Systems2018
Triggered-Issuance and Triggered-Execution: A Control Paradigm to Minimize Pipeline Stalls in Distributed Controlled Coarse-Grained Reconfigurable Arrays2018
Tsumiki: A Meta-Platform for Building Your Own Testbed2018
Vertex Coloring with Communication Constraints in Synchronous Broadcast Networks2018
Workload Scheduling for Massive Storage Systems with Arbitrary Renewable Supply2018
Accelerating Decision Tree Based Traffic Classification on FPGA and Multicore Platforms2017
A Collision-Mitigation Cuckoo Hashing Scheme for Large-Scale Storage Systems2017
ACStor: Optimizing Access Performance of Virtual Disk Images in Clouds2017
A Declarative Optimization Engine for Resource Provisioning of Scientific Workflows in Geo-Distributed Clouds2017
aHDFS: An Erasure-Coded Data Archival System for Hadoop Clusters2017
A High Performance Block Eigensolver for Nuclear Configuration Interaction Calculations2017
Algorithms for Balanced Graph Colorings with Applications in Parallel Computing2017
An Alternating Direction Method Approach to Cloud Traffic Management2017
Analysis of Minimum Interaction Time for Continuous Distributed Interactive Computing2017
An Efficient In-Memory Checkpoint Method and its Practice on Fault-Tolerant HPL2017
An Energy-Efficient Storage Strategy for Cloud Datacenters Based on Variable K-Coverage of a Hypergraph2017
An Incrementally Scalable and Cost-Efficient Interconnection Structure for Data Centers2017
An Online Auction Mechanism for Dynamic Virtual Cluster Provisioning in Geo-Distributed Clouds2017
A Parallel Random Forest Algorithm for Big Data in a Spark Cloud Computing Environment2017
AppBooster: Boosting the Performance of Interactive Mobile Applications with Computation Offloading and Parameter Tuning2017
Application Execution Time Prediction for Effective CPU Provisioning in Virtualization Environment2017
Astro: Auto-Generation of Synthetic Traces Using Scaling Pattern Recognition for MPI Workloads2017
A Survey of Techniques for Architecting and Managing GPU Register File2017
A Technique for Efficient Query Estimation over Distributed Data Streams2017
ATOM: Efficient Tracking, Monitoring, and Orchestration of Cloud Resources2017
Beehive: Erasure Codes for Fixing Multiple Failures in Distributed Storage Systems2017
Building an Efficient Put-Intensive Key-Value Store with Skip-Tree2017
Building NVRAM-Aware Swapping Through Code Migration in Mobile Devices2017
Cloudde: A Heterogeneous Differential Evolution Algorithm and Its Distributed Cloud Version2017
CloudScout: A Non-Intrusive Approach to Service Dependency Discovery2017
CloudScout:サービス依存性発見のための非侵襲的アプローチ【Powered by NICT】2017
Cluster-Aware Virtual Machine Collaborative Migration in Media Cloud2017
Combining Vertex-Centric Graph Processing with SPARQL for Large-Scale RDF Data Analytics2017
Computer Generation of High Throughput and Memory Efficient Sorting Designs on FPGA2017
Computing Maximum Cardinality Matchings in Parallel on Bipartite Graphs via Tree-Grafting2017
Cooper: Expedite Batch Data Dissemination in Computer Clusters with Coded Gossips2017
CoRE: Cooperative End-to-End Traffic Redundancy Elimination for Reducing Cloud Bandwidth Cost2017
Cost-Aware Big Data Processing Across Geo-Distributed Datacenters2017
Cutting Latency Tail: Analyzing and Validating Replication without Canceling2017
Deadline-Constrained Cost Optimization Approaches for Workflow Scheduling in Clouds2017
Design and Implementation of a Communication-Optimal Classifier for Distributed Kernel Support Vector Machines2017
DGLB: Distributed Stochastic Geographical Load Balancing over Cloud Networks2017
Dissecting GPU Memory Hierarchy Through Microbenchmarking2017
Distributed Mining of Contrast Patterns2017
Durable Address Translation in PCM-Based Flash Storage Systems2017

« prev Page 21/46 next »