SAND: A Fault-Tolerant Streaming Architecture for Network Traffic Analytics
Lists
Only you see this
Abstract
Many long-running network analytics applications impose a high-throughput and high reliability requirements on stream processing systems. However, previous stream processing systems cannot sustain high-speed traffic at the core router level. Furthermore, their fault-tolerant schemes cannot provide strong consistency which is essential for network analytics. In this paper, we present the design and implementation of SAND, a fault-tolerant distributed stream processing system for network analytics. SAND is designed to operate under high-speed network traffic, and it uses a novel check pointing protocol which can perform failure recovery based on upstream backup and check pointing. We prove our fault-tolerant scheme provides strong consistency even under multiple node failure. We implement several real-world network analytics applications on SAND, evaluate their performance using network traffic captured from commercial cellular core networks, and demonstrate that SAND can sustain high-speed network traffic and that our fault-tolerant scheme is efficient.
BibTeX
@inproceedings{liu2014sand,
author = {Qin Liu and John C. S. Lui and Cheng He and Lujia Pan and Wei Fan and Yunlong Shi},
title = {{SAND: A Fault-Tolerant Streaming Architecture for Network Traffic Analytics}},
booktitle = {DSN},
year = {2014},
doi = {10.1109/dsn.2014.91},
}Loading related content...