SMART: Dual-channel Southbound Message Delivery in Clouds with Rate Estimation
Lists
Only you see this
Abstract
Driving southbound messages from a cloud control plane down to the distributed data plane on every compute node is one of the critical challenges in public clouds. Existing message delivery solutions solely based on remote procedure call (RPC) or message queue (MQ) tend to overlook strict resource constraints, e.g., network bandwidth and CPU capacity. This often results in extensive overhead in the control plane or message redundancy in the data plane, especially when a cloud receives highly concurrent user requests or experiences a rapid expansion. To this end, we design a dual-channel southbound message delivery framework, namely SMART, which combines an RPC channel with an MQ channel, to maximize the resource utilization in the cloud network. In the control plane, we implement a message parsing mechanism and propose a delivery channel selection algorithm based on the deep reinforcement learning (DRL) approach to support efficient dual-channel delivery under resource constraints. In the data plane, we design a message agent on each compute node to ensure the order preservation and state consistency of southbound messages. Both experimental and large-scale simulation results show that SMART demonstrates a reduction in control plane overhead by 64% compared to RPC and redundant messages by 45% compared to MQ, respectively.
BibTeX
@inproceedings{luo2024smart,
author = {Luyao Luo and Gongming Zhao and Hongli Xu and Chun-Jen Chung and Liguang Xie},
title = {{SMART: Dual-channel Southbound Message Delivery in Clouds with Rate Estimation}},
booktitle = {IWQoS},
year = {2024},
url = {https://openreview.net/forum?id=DoZshyeils},
}Loading related content...