Abstract
LightFDG is an integrated approach to flow detection (FD) and flow grooming (FG) in optical wireless data center networks (DCNs), which is interconnected via wavelength division multiplexing (WDM) based free-space optical (FSO) links. Since forwarding bandwidth-hungry elephant flows (EFs) and delay-sensitive mice flows (MFs) on the same path can cause severe performance degradation, the LightFDG optically grooms flows of each class into rack-to-rack (R2R) flows. Then, R2R-MF and R2R-EF flows are separately forwarded over lightpaths of separate MF and EF virtual topologies, respectively. Lightpaths are provisioned by jointly determining the capacity and route based on flows' arrival rate, size, and completion time request. To prevent EFs from congesting the MF lightpaths, high speed and accurate flow-detection mechanisms are also necessary for classifying EFs as soon as possible. Therefore, a fast-lightweight-and-accurate flow detection framework is developed by leveraging the transmission control protocol (TCP) behaviors. The proposed FD scheme has the flexibility of being implemented as in-network or centralized to classify flows of modifiable and unmodifiable hosts, respectively. Since the centralized scheme incurs considerable overhead, the processing and communication overhead is also mitigated by proposed techniques. Numerical results show that LightFDG outperforms traditional load balancers by about 3x for EFs and 10x for MFs. Along with the developed overhead mitigation methods, the centralized scheme is shown to provide up to 62x lower overhead with 100% accuracy and with about 224x higher detection speeds than the existing centralized solutions.
Introduction
Modern data center networks (DCNs) often suffer from "over-subscription," where fixed-capacity wired links become bottlenecks because traffic is frequently concentrated between a small fraction of server racks. While Free-Space Optical (FSO) wireless links offer a reconfigurable solution with massive bandwidth, they introduce a management challenge: the "Elephant and Mice" problem. Bandwidth-hungry Elephant Flows (EFs) (e.g., VM migrations) often share paths with tiny, delay-sensitive Mice Flows (MFs) (e.g., database queries), leading to buffer congestion and increased latency for critical small transfers.
The LightFDG Framework
LightFDG addresses these challenges through an integrated approach that combines ultra-fast flow detection with intelligent traffic grooming. The framework classifies flows in real-time and segregates them into dedicated optical virtual topologies, ensuring that large data transfers do not interfere with time-critical messages.
Fast-Lightweight-and-Accurate Flow Detection (FD)
Instead of traditional packet sampling, which is often slow and inaccurate, LightFDG monitors Transmission Control Protocol (TCP) behaviors. It records the Initial Sequence Number (ISN) of a flow and compares it against subsequent Acknowledgement (ACK) numbers. This allows the system to calculate exactly how many bytes have been sent without inspecting the actual data payload, achieving 100% accuracy with minimal computational cost.
Three-Step Flow Grooming (FG)
To avoid the overhead of managing thousands of individual flows, LightFDG aggregates traffic in three stages:
- Server-to-Server (S2S): Combining flows between specific host pairs.
- Server-to-Rack (S2R): Grouping flows from one server to any server in a destination rack.
- Rack-to-Rack (R2R): The final aggregation at the edge switch.
These R2R flows are then routed over separate virtual topologies (one for MFs, one for EFs) using Wavelength Division Multiplexing (WDM).
Key Results
Evaluations using real-world traces and Mininet emulation demonstrate that LightFDG significantly outperforms traditional load balancers like ECMP:
- Throughput: Performance improved by 3x for Elephant flows and 10x for Mice flows.
- Detection Speed: The centralized detection mechanism is 224x faster than existing state-of-the-art solutions.
- Efficiency: Overhead mitigation techniques, such as "Stop Useless Notifications," reduced communication overhead by up to 62x compared to standard monitoring.
Conclusion
LightFDG provides a robust solution for optical wireless DCNs by integrating precise TCP-based flow detection with hierarchical traffic grooming. By segregating traffic into dedicated virtual topologies, it ensures optimal performance for both bandwidth-intensive and delay-sensitive applications.
Summary updated