PUSH: A Pipelined Reconstruction I/Of or Erasure-Coded Storage Clusters

Jianzhong Huang, Xianhai Liang, Xiao Qin, Qiang Cao, Changsheng XieIEEE TPDS 2015 · OpenReview

Abstract

A key design goal of erasure-coded storage clusters is to minimize reconstruction time, which in turn leads to high reliability by reducing vulnerability window size. PULL-Rep and PULL-Sur are two existing reconstruction schemes based on PULL-type transmission, where a rebuilding node initiates reconstruction by sending a set of read requests to surviving nodes to retrieve surviving blocks. To eliminate the transmission bottleneck of replacement nodes in PULL-Rep and mitigate the extra overhead caused by noncontiguous disk access in PULL-Sur, we incorporate PUSH-type transmissions to node reconstruction, where the reconstruction procedure is divided into multiple tasks accomplished by surviving nodes in a pipelining manner. We also propose two PUSH-based reconstruction schemes (i.e., PUSH-Rep and PUSH-Sur), which can not only exploit the I/O parallelism of PULL-Sur, but also maintain sequential I/O accesses inherited from PULL-Rep. We build four reconstruction-time models to study the reconstruction process and estimate the reconstruction time of the four schemes in large-scale storage clusters. We implement a proof-of-concept prototype where the four reconstruction schemes are deployed and quantitatively evaluated. Experimental results show that the PUSH-based reconstruction schemes outperform the PULL-based counterparts. In a real-world (9,6)RS-coded storage cluster, PUSH-Rep speeds up the reconstruction time by a factor of 5.76 compared with PULL-Rep; PUSH-Sur accelerates the reconstruction by a factor of 1.85 relative to PULL-Sur.
BibTeX
@article{huang2015push,
  author = {Jianzhong Huang and Xianhai Liang and Xiao Qin and Qiang Cao and Changsheng Xie},
  title = {{PUSH: A Pipelined Reconstruction I/Of or Erasure-Coded Storage Clusters}},
  journal = {IEEE Trans. Parallel Distributed Syst.},
  year = {2015},
  url = {https://openreview.net/forum?id=nMLpl8VW4o},
}

Loading related content...

Figure