Communication-Aware Load Balancing for Parallel Applications on Clusters
Lists
Only you see this
Abstract
Cluster computing has emerged as a primary and cost-effective platform for running parallel applications, including communication-intensive applications that transfer a large amount of data among the nodes of a cluster via the interconnection network. Conventional load balancers have proven effective in increasing the utilization of CPU, memory, and disk I/O resources in a cluster. However, most of the existing load-balancing schemes ignore network resources, leaving an opportunity to improve the effective bandwidth of networks on clusters running parallel applications. For this reason, we propose a communication-aware load-balancing technique that is capable of improving the performance of communication-intensive applications by increasing the effective utilization of networks in cluster environments. To facilitate the proposed load-balancing scheme, we introduce a behavior model for parallel applications with large requirements of network, CPU, memory, and disk I/O resources. Our load-balancing scheme can make full use of this model to quickly and accurately determine the load induced by a variety of parallel applications. Simulation results generated from a diverse set of both synthetic bulk synchronous and real parallel applications on a cluster show that our scheme significantly improves the performance, in terms of slowdown and turn-around time, over existing schemes by up to 206 percent (with an average of 74 percent) and 235 percent (with an average of 82 percent), respectively.
BibTeX
@article{qin2010communication,
author = {Xiao Qin and Hong Jiang and Adam Manzanares and Xiaojun Ruan and Shu Yin},
title = {{Communication-Aware Load Balancing for Parallel Applications on Clusters}},
journal = {IEEE Trans. Computers},
year = {2010},
url = {https://openreview.net/forum?id=yFWfx8u35C},
}Loading related content...