IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
Developing User Perceived Value Based Pricing Models for Cloud Markets2018
Distributed Privacy-Aware Fast Selection Algorithm for Large-Scale Data2018
Distributed Stream Rebalance for Stateful Operator Under Workload Variance2018
Dynamic Resource Scheduling in Mobile Edge Cloud with Cloud Radio Access Network2018
Early Identification of Critical Blocks: Making Replicated Distributed Storage Systems Reliable Against Node Failures2018
EDC: Improving the Performance and Space Efficiency of Flash-Based Storage Systems with Elastic Data Compression2018
Efficient Disk-Based Directed Graph Processing: A Strongly Connected Component Approach2018
Efficient Performance-Centric Bandwidth Allocation with Fairness Tradeoff2018
Elastic Parity Logging for SSD RAID Arrays: Design, Analysis, and Implementation2018
Enabling Generic, Verifiable, and Secure Data Search in Cloud Services2018
Encoding-Aware Data Placement for Efficient Degraded Reads in XOR-Coded Storage Systems: Algorithms and Evaluation2018
Energy Efficiency Aware Task Assignment with DVFS in Heterogeneous Hadoop Clusters2018
Eunomia: Scaling Concurrent Index Structures Under Contention Using HTM2018
ExaGeoStat: A High Performance Unified Software for Geostatistics on Manycore Systems2018
Exploring Customizable Heterogeneous Power Distribution and Management for Datacenter2018
G-CRS: GPU Accelerated Cauchy Reed-Solomon Coding2018
GFlink: An In-Memory Computing Architecture on Heterogeneous CPU-GPU Clusters for Big Data2018
G-ML-Octree: An Update-Efficient Index Structure for Simulating 3D Moving Objects Across GPUs2018
GraphD: Distributed Vertex-Centric Graph Processing Beyond the Memory Limit2018
kNN-DP: Handling Data Skewness in kNN Joins Using MapReduce2018
Learning-Based Memory Allocation Optimization for Delay-Sensitive Big Data Processing2018
Long-Term Multi-Resource Fairness for Pay-as-you Use Computing Systems2018
Malleable Task-Graph Scheduling with a Practical Speed-Up Model2018
Managing Risk in a Derivative IaaS Cloud2018
MeLoDy: A Long-Term Dynamic Quality-Aware Incentive Mechanism for Crowdsourcing2018
Minimal Cost Server Configuration for Meeting Time-Varying Resource Demands in Cloud Centers2018
Minimize the Make-span of Batched Requests for FPGA Pooling in Cloud Computing2018
M-Oscillating: Performance Maximization on Temperature-Constrained Multi-Core Processors2018
MSGD: A Novel Matrix Factorization Approach for Large-Scale Collaborative Filtering Recommender Systems on GPUs2018
Neurostream: Scalable and Energy Efficient Deep Learning with Smart Memory Cubes2018
NN-DP: Handling Data Skewness inJoins Using MapReduce2018
On Cost-Driven Collaborative Data Caching: A New Model Approach2018
Online Auction for IaaS Clouds: Towards Elastic User Demands and Weighted Heterogeneous VMs2018
Online Tuning of EASY-Backfilling using Queue Reordering Policies2018
On the Synchronization Bottleneck of OpenStack Swift-Like Cloud Storage Systems2018
Optimizations of Unstructured Aerodynamics Computations for Many-core Architectures2018
OrthoNoC: A Broadcast-Oriented Dual-Plane Wireless Network-on-Chip Architecture2018
Parallel Algorithm for Incremental Betweenness Centrality on Large Graphs2018
Penguin: Efficient Query-Based Framework for Replaying Large Scale Historical Data2018
PEPS++: Towards Extreme-Scale Simulations of Strongly Correlated Quantum Many-Particle Models on Sunway TaihuLight2018
Power-Aware and Performance-Guaranteed Virtual Machine Placement in the Cloud2018
Preserving Model Privacy for Machine Learning in Distributed Systems2018
Quadboost: A Scalable Concurrent Quadtree2018
Quantifying the Impact of Variability and Heterogeneity on the Energy Efficiency for a Next-Generation Ultra-Green Supercomputer2018
Race-Condition-Aware and Hardware-Oriented Task Partitioning and Scheduling Using Entropy Maximization2018
Replication-Based Fault-Tolerance for Large-Scale Graph Processing2018
Scalable Data Race Detection for Lock-Intensive Programs with Pending Period Representation2018
Scalable GPU Virtualization with Dynamic Sharing of Graphics Memory Space2018
Secure Integrated Circuit Design via Hybrid Cloud2018
Sketch Acceleration on FPGA and its Applications in Network Anomaly Detection2018

« prev Page 20/46 next »