vCUDA: GPU-Accelerated High-Performance Computing in Virtual Machines

Lin Shi, Hao Chen, Jianhua Sun, Kenli Li

Abstract

This paper describes vCUDA, a general-purpose graphics processing unit (GPGPU) computing solution for virtual machines (VMs). vCUDA allows applications executing within VMs to leverage hardware acceleration, which can be beneficial to the performance of a class of high-performance computing (HPC) applications. The key insights in our design include API call interception and redirection and a dedicated RPC system for VMs. With API interception and redirection, Compute Unified Device Architecture (CUDA) applications in VMs can access a graphics hardware device and achieve high computing performance in a transparent way. In the current study, vCUDA achieved a near-native performance with the dedicated RPC system. We carried out a detailed analysis of the performance of our framework. Using a number of unmodified official examples from CUDA SDK and third-party applications in the evaluation, we observed that CUDA applications running with vCUDA exhibited a very low performance penalty in comparison with the native environment, thereby demonstrating the viability of vCUDA architecture.
BibTeX
@article{shi2012vcuda,
  author = {Lin Shi and Hao Chen and Jianhua Sun and Kenli Li},
  title = {{vCUDA: GPU-Accelerated High-Performance Computing in Virtual Machines}},
  journal = {IEEE Trans. Computers},
  year = {2012},
  doi = {10.1109/tc.2011.112},
}

Loading related content...

Figure