LoomIO: Object-Level Coordination in Distributed File Systems
Lists
Only you see this
Abstract
Device-level interference is recognized as a major cause of the performance degradation in distributed file systems. Although the approaches of mitigating interference through coordination at application-level, middleware-level, and server-level have shown beneficial results in previous studies, we find their effectiveness is largely reduced since I/O requests are re-arranged by underlying object file systems. In this research study, we prove that object-level coordination is critical and often the key to address the interference issue, as the scheduling of object requests determines the device-level accesses and thus determines the actual I/O bandwidth and latency. This article proposes an object-level coordination system, LoomIO, which uses an OBOP (One-Broadcast-One-Propagate) method and a time-limited coordination process to deliver highly efficient coordination service. Specifically, LoomIO enables object requests to achieve an optimized scheduling decision within a few milliseconds and largely mitigates the device-level interference. We have implemented a LoomIO prototye and integrated it into Ceph file system. The evaluation results show that LoomIO achieved the considerable improvements in resource utilization (by up to 35%), in I/O throughput (by up to 31%), and in 99th percentile latency (by up to 54%) compared to the K-optimal method which uses the same scheduling algorithm as LoomIO but does not have the coordination support.
BibTeX
@article{hua2022loomio,
author = {Yusheng Hua and Xuanhua Shi and Kang He and Hai Jin and Wei Xie and Ligang He and Yong Chen},
title = {{LoomIO: Object-Level Coordination in Distributed File Systems}},
journal = {IEEE Trans. Parallel Distributed Syst.},
year = {2022},
doi = {10.1109/tpds.2021.3126260},
}Loading related content...