RHAPSODY: Execution of Hybrid AI-HPC Workflows at Scale
Lists
Only you see this
Abstract
Hybrid AI-HPC workflows combine large-scale simulation, training, high-throughput inference, and tightly coupled, agent-driven control within a single execution campaign. These workflows impose heterogeneous and often conflicting requirements on runtime systems, spanning MPI executables, persistent AI services, fine-grained tasks, and low-latency AI-HPC coupling. Existing systems typically address only subsets of these requirements, limiting their ability to support emerging AI-HPC applications at scale. We present RHAPSODY, a multi-runtime middleware that enables concurrent execution of heterogeneous AI-HPC workloads through uniform abstractions for tasks, services, resources, and execution policies. Rather than replacing existing runtimes, RHAPSODY composes and coordinates them, allowing simulation codes, inference services, and agentic workflows to coexist within a single job allocation on leadership-class HPC platforms. We evaluate RHAPSODY with Dragon and vLLM on multiple HPC systems using representative heterogeneous, inference-at-scale, and tightly coupled AI-HPC workflows. Our results show that RHAPSODY introduces minimal runtime overhead, sustains increasing heterogeneity at scale, achieves near-linear scaling for high-throughput inference workloads, and data- and control-efficient coupling between AI and HPC tasks in agentic workflows.
BibTeX
@misc{alsaadi2025rhapsody,
author = {Aymen Alsaadi and Mason Hooten and Mariya Goliyad and Andre Merzky and Andrew Shao and Mikhail Titov and Tianle Wang and Yian Chen and Maria Kalantzi and Kent Lee and Andrew Park and Indira Pimpalkhare and Nick Radcliffe and Colin Wahl and Pete Mendygral and Matteo Turilli and Shantenu Jha},
title = {{RHAPSODY: Execution of Hybrid AI-HPC Workflows at Scale}},
year = {2025},
eprint = {2512.20795},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2512.20795},
}Loading related content...