FOGPLAN: A Lightweight QoS-Aware Dynamic Fog Service Provisioning Framework

Ashkan Yousefpour, Ashish Patil, Genya Ishigaki, Inwoong Kim, Xi Wang, Hakki C. Cankaya, Qiong Zhang, Weisheng Xie, Jason P. Jue

TL;DR

FOGPLAN is a lightweight framework designed to dynamically deploy or release IoT services across "fog" nodes (local computing resources) and the cloud. By using efficient greedy algorithms, it ensures ultra-low latency for delay-sensitive applications like Augmented Reality while minimizing the operational costs for service providers.

What Problem Does This Paper Address?

As Internet of Things (IoT) applications become more complex—think autonomous drones, industrial robotics, and mobile AR—the "Cloud" is starting to show its distance. These applications often require latencies below 10ms, a target the cloud often misses due to unpredictable network hops.

Fog Computing solves this by placing compute and storage at the network edge. However, fog nodes are resource-constrained compared to data centers. Furthermore, IoT traffic is "bursty"; a highway accident might suddenly flood local sensors with data, while a quiet suburb remains idle. Static service placement (deciding once where an app runs) is inefficient: you either over-provision (wasting money) or under-provision (missing latency targets). The authors tackle the QoS-aware Dynamic Fog Service Provisioning (QDFSP) problem: how do we move services between the fog and the cloud in real-time to keep users happy and costs low?

Methods

The authors introduce FOGPLAN, a framework managed by a Fog Service Controller (FSC). The FSC monitors traffic and makes "deploy" or "release" decisions.

  1. Mathematical Modeling: They first formulate the problem as an Integer Nonlinear Programming (INLP) task. They use M/M/c queueing models to estimate waiting times on fog nodes and cloud servers, accounting for processing delays and network propagation.
  2. Greedy Algorithms: Since solving INLP is too slow for large, real-time networks, they propose two lightweight heuristics:
  3. Min-Viol (Minimum Violation): This algorithm is "aggressive" about QoS. It sorts fog nodes by traffic volume and deploys services on the busiest nodes first until latency requirements are met.
  4. Min-Cost: This is budget-conscious. It only deploys a service to a fog node if the projected savings (from reduced cloud fees and avoided latency penalties) outweigh the cost of deployment and local storage.
  5. Application Agnostic: Unlike previous work, FOGPLAN doesn't require deep knowledge of IoT device specs or mobility patterns. It operates primarily on one metric: the aggregated incoming traffic rate.

Datasets

The framework was evaluated using a simulation environment built in Java, utilizing:

  • MAWI Working Group Traffic Traces: Real-world network traffic data from April 2017.
  • DTMC-based Generator: To test scalability and longer durations, the authors created a traffic generator based on Discrete Time Markov Chains, modeled after the patterns found in the MAWI traces.

Key Insights and Ideas

  • The "Fog Continuum": The paper emphasizes that "Fog" isn't just a single layer at the edge; it is a continuum of resources between the device and the cloud. FOGPLAN can manage services anywhere along this path.
  • Statelessness as a Feature: By assuming services are stateless (like Docker containers), FOGPLAN can "release" and "deploy" them almost instantly (under 50ms), making dynamic provisioning practical rather than a theoretical exercise.
  • The Latency-Cost Tradeoff: There is a fundamental tension between the reconfiguration interval (how often you run the algorithm) and performance. Running it too often leads to "impatient provisioning" (churn), while running it too slowly makes the system unresponsive to traffic spikes.
  • Minimalist Information: One of the most practical "aha" moments is that you don't need to track every individual IoT device. By simply monitoring the traffic rate at the fog node, the FSC can make highly effective placement decisions.

Key Results

  • Performance vs. Optimal: In simulations, the Min-Viol algorithm achieved a delay violation rate of only ~3%, performing remarkably close to the mathematically "optimal" (but computationally expensive) INLP solution.
  • Cost Savings: Compared to an "All Cloud" approach—which incurs heavy financial penalties for missing latency targets—FOGPLAN significantly reduced total operational costs.
  • Scalability: The greedy algorithms scale quadratically with the number of fog nodes. In tests with 10,000 fog nodes, the Min-Cost algorithm could determine the placement for a service in just 3.2 seconds, whereas traditional optimization methods would take hours or fail to converge.

Limitations and Future Work

  • Impatient Provisioning: The current framework is reactive. If traffic spikes for only a few seconds, FOGPLAN might deploy a service just as the spike ends.
  • Stateful Applications: The paper focuses on stateless containers. Moving a "stateful" app (one that carries a database or user session) involves data migration overhead that isn't currently modeled.
  • Predictive Intelligence: The authors suggest that future versions of FOGPLAN should incorporate Machine Learning (specifically online learning like "Follow the Regularized Leader") to predict traffic bursts before they happen, allowing the system to move services proactively.

Summary updated

Abstract

Recent advances in the areas of Internet of Things (IoT), big data, and machine learning have contributed to the rise of a growing number of complex applications. These applications will be data-intensive, delay-sensitive, and real-time as smart devices prevail more in our daily life. Ensuring quality of service (QoS) for delay-sensitive applications is a must, and fog computing is seen as one of the primary enablers for satisfying such tight QoS requirements, as it puts compute, storage, and networking resources closer to the user. In this paper, we first introduce FOGPLAN, a framework for QoS-aware dynamic fog service provisioning (QDFSP). QDFSP concerns the dynamic deployment of application services on fog nodes, or the release of application services that have previously been deployed on fog nodes, in order to meet low latency and QoS requirements of applications while minimizing cost. FOGPLAN framework is practical and operates with no assumptions and minimal information about IoT nodes. Next, we present a possible formulation (as an optimization problem) and two efficient greedy algorithms for addressing the QDFSP at one instance of time. Finally, the FOGPLAN framework is evaluated using a simulation based on real-world traffic traces.
BibTeX
@article{yousefpour2019fogplan,
  author = {Ashkan Yousefpour and Ashish Patil and Genya Ishigaki and Inwoong Kim and Xi Wang and Hakki C. Cankaya and Qiong Zhang and Weisheng Xie and Jason P. Jue},
  title = {{FOGPLAN: A Lightweight QoS-Aware Dynamic Fog Service Provisioning Framework}},
  journal = {IEEE Internet of Things Journal},
  year = {2019},
  url = {https://openreview.net/forum?id=r8jvtkwW87},
}

Loading related content...

Figure