IEEE TPDS

2,283 papers361 directions
IEEE Transactions on Parallel and Distributed Systems (TPDS) is a research venue that has published work in the fields of parallel processing and distributed computing since 1994. Within the machine learning and artificial intelligence community, the venue serves as a platform for research focused on the computational infrastructure and systems-level optimizations required for large-scale modeling. Its contributions often address the intersection of hardware architecture and algorithmic efficiency, covering topics such as memory system overhead, resource management, and the evolution of hardware-specific GPU kernels. Recent publications in the venue highlight a focus on scaling and optimizing deep learning workflows. This includes research into load balancing for Mixture-of-Experts (MoE) models, federated learning for resource-constrained environments, and collaborative inference in edge computing. The venue also features work on hardware-grounded energy profiling for sustainable deep learning and the development of specialized accelerators for graph convolution networks and sparse tensor decompositions. These studies aim to improve the performance of streaming inference and multi-dimensional search through techniques like hierarchical pruning and recursive statistical updates. The venue’s corpus includes contributions from researchers such as Keqin Li, Yunhao Liu, and Torsten Hoefler. By addressing issues like geographic bias in global machine learning and the automation of GPU kernel optimization, the venue facilitates the development of more efficient and accessible AI systems. Its role in the community is defined by its emphasis on the underlying systems that support machine learning, ranging from high-performance computing I/O analysis to the implementation of sparse kernels on modern tensor cores.

Papers by Year

2026 64
2025 119
2024 121
2023 130
2022 212
2021 165
2020 130
2019 102
2018 99
2017 117
2016 134
2015 182
2014 197
2013 124
2012 99
2011 82
2010 55
2009 58
2008 52
2007 49
2006 36
2005 31
2004 23
2003 28
2002 16
2001 19
2000 13
1999 14
1998 11
1997 19
1996 18
1995 14
1994 19
1993 17
1992 8
1991 2
1990 6

Top Research Directions

Research directions most represented by papers from this venue.

Hierarchical Model Aggregation for Multi-Tier Networks 5
Communication Efficient Distributed Training of Large Models 5
Decentralized Model Training via Federated Learning 5
Mitigating Cold Start Latency in Serverless Computing 4
Federated Learning Robustness to Statistical Data Heterogeneity 4
Dynamic Workload Redistribution in Parallel Systems 4
Hyperparameter Sensitivity in Federated Learning 4
Overcoming the Interconnect Bottleneck in Memory Offloading 4
Balancing Power Law Workloads in Parallel Graph Processing 4
Overcoming the Hardware Homogeneity Assumption 4
Decentralized Aggregation for Robust Federated Learning 4
Automated Tuning of Hardware Execution Schedules 3
Aligning Logical Communication with Physical Hardware Topologies 3
The Throughput Delay Tradeoff in Resource Allocation 3
Joint Communication and Computation Resource Allocation 3

Top Authors

AuthorPapers
Hai Jin60
Song Guo51
José Duato42
Xiang-Yang Li33
Baochun Li31
Bingsheng He29
Kenli Li27
Xiaohua Jia27
Viktor Prasanna25
Xueyan Tang23
Laurence Tianruo Yang22
Xue Liu22
Philip S. Yu19
Qiang He18
Yanmin Zhu18
Changjun Jiang17
Feng Zhang17
Ling Liu17
Lionel Ni17
Sanglu Lu17

Impactful Papers

Papers from this venue that shaped research clusters.

Foundational

Influential

Related Venues

Venues with the most similar research cluster distributions.

Papers

TitleYear
A Virtual Multi-Channel GPU Fair Scheduling Method for Virtual Machines2019
Bandwidth and Energy Efficient Image Sharing for Situation Awareness in Disasters2019
Batch Allocation for Tasks with Overlapping Skill Requirements in Crowdsourcing2019
BLOT: Bandit Learning-Based Offloading of Tasks in Fog-Enabled Networks2019
Clip: A Disk I/O Focused Parallel Out-of-Core Graph Processing System2019
Cloud Scheduling with Discrete Charging Units2019
CongraPlus: Towards Efficient Processing of Concurrent Graph Queries on NUMA Machines2019
Continuously Distinct Sampling over Centralized and Distributed High Speed Data Streams2019
COOPER-SCHED: A Cooperative Scheduling Framework for Mobile Edge Computing with Expected Deadline Guarantee2019
Correlation-Aware Stripe Organization for Efficient Writes in Erasure-Coded Storage: Algorithms and Evaluation2019
Data Prefetching and Eviction Mechanisms of In-Memory Storage Systems Based on Scheduling for Big Data Processing2019
Deadline-Aware MapReduce Job Scheduling with Dynamic Resource Availability2019
Diamond Sketch: Accurate Per-flow Measurement for Big Streaming Data2019
Efficient and Scalable Functional Dependency Discovery on Distributed Data-Parallel Platforms2019
Efficient Data Placement and Replication for QoS-Aware Approximate Query Evaluation of Big Data Analytics2019
Efficient Lossy Compression for Scientific Data Based on Pointwise Relative Error Bound2019
Efficient Time-Evolving Stream Processing at Scale2019
Enabling Encrypted Rich Queries in Distributed Key-Value Stores2019
Enabling Flexible Resource Allocation in Mobile Deep Learning Systems2019
Enabling Heterogeneous Network Function Chaining2019
Energy-Efficient Multiple Producer-Consumer2019
Engineering Algorithms for Scalability through Continuous Validation of Performance Expectations2019
Exploiting GPUs for Efficient Gradient Boosting Decision Tree Training2019
Exploring Fault-Tolerant Erasure Codes for Scalable All-Flash Array Clusters2019
Exploring GPU-Accelerated Routing for FPGAs2019
Fast Deep Neural Network Training on Distributed Systems and Cloud TPUs2019
Functional and Contextual Attention-Based LSTM for Service Recommendation in Mashup Creation2019
GCache: Neighborhood-Guided Graph Caching in a Distributed Environment2019
GreenDB: Energy-Efficient Prefetching and Caching in Database Clusters2019
Hardware Accelerated Semantic Declarative Memory Systems through CUDA and MapReduce2019
Harnessing Data Movement in Virtual Clusters for In-Situ Execution2019
Hierarchical Hybrid Memory Management in OS for Tiered Memory Systems2019
High-Performance Tucker Factorization on Heterogeneous Platforms2019
HitGraph: High-throughput Graph Processing Framework on FPGA2019
HSDC: A Highly Scalable Data Center Network Architecture for Greater Incremental Scalability2019
Hytrace: A Hybrid Approach to Performance Bug Diagnosis in Production Cloud Infrastructures2019
Improving Restore Performance in Deduplication Systems via a Cost-Efficient Rewriting Scheme2019
Integrating Concurrency Control in n-Tier Application Scaling Management in the Cloud2019
Intra-Task Priority Assignment in Real-Time Scheduling of DAG Tasks on Multi-Cores2019
ISEE: An Intelligent Scene Exploration and Evaluation Platform for Large-Scale Visual Surveillance2019
Local Differential Private Data Aggregation for Discrete Distribution Estimation2019
Luopan: Sampling-Based Load Balancing in Data Center Networks2019
Making Big Data Open in Edges: A Resource-Efficient Blockchain-Based Approach2019
Managing Recurrent Virtual Network Updates in Multi-Tenant Datacenters: A System Perspective2019
MOANA: Modeling and Analyzing I/O Variability in Parallel System Experimental Design2019
moDNN: Memory Optimal Deep Neural Network Training on Graphics Processing Units2019
Multi-Hop Cooperative Computation Offloading for Industrial IoT-Edge-Cloud Computing Environments2019
Online Job Scheduling with Redundancy and Opportunistic Checkpointing: A Speedup-Function-Based Analysis2019
On the Feasibility of Inter-Domain Routing via a Small Broker Set2019
Optimizing Finite Volume Method Solvers on Nvidia GPUs2019

« prev Page 18/46 next »