Fail-slow fault tolerance needs programming support

Andrew Yoo, Yuanli Wang, Ritesh Sinha, Shuai Mu, Tianyin Xu

Abstract

The need for fail-slow fault tolerance in modern distributed systems is highlighted by the increasingly reported fail-slow hardware/software components that lead to poor performance system-wide. We argue that fail-slow fault tolerance not only needs new distributed protocol designs, but also desires programming support for implementing and verifying fail-slow fault-tolerant code. Our observation is that the inability of tolerating fail-slow faults in existing distributed systems is often rooted in the implementations and is difficult to understand and debug. We designed the Dependably Fast Library (DepFast) for implementing fail-slow tolerant distributed systems. DepFast provides expressive interfaces for taking control of possible fail-slow points in the program to prevent unexpected slowness propagation once and for all. We use DepFast to implement a distributed replicated state machine (RSM) and show that it can tolerate various types of fail-slow faults that affect existing RSM implementations.
BibTeX
@inproceedings{yoo2021fail,
  author = {Andrew Yoo and Yuanli Wang and Ritesh Sinha and Shuai Mu and Tianyin Xu},
  title = {{Fail-slow fault tolerance needs programming support}},
  booktitle = {HotOS},
  year = {2021},
  doi = {10.1145/3458336.3465299},
}

Loading related content...

Figure