Abstract
This paper proposes a two-level decentralized framework to optimize Hierarchical Federated Learning (HFL). By integrating evolutionary game theory to model worker-cluster selection and a deep learning-based auction to price and allocate cluster services, the framework ensures system stability, incentive compatibility, and maximized revenue for edge providers.
The Challenge of Edge Intelligence
Federated Learning (FL) enables AI model training on local data without compromising privacy. However, coordinating thousands of heterogeneous devices (e.g., smartphones, IoT sensors) directly with a central cloud server often leads to high latency and frequent dropouts.
Hierarchical Federated Learning (HFL) addresses this by introducing "cluster heads" (edge servers or base stations) for intermediate data aggregation. Yet, HFL introduces its own coordination hurdles:
- Worker Choice: How do workers decide which cluster to join when rewards and network congestion vary?
- Incentive Design: How can cluster heads and workers be compensated fairly while providing model owners with optimal resources?
- Dynamic Rationality: Real-world network participants adapt slowly and have limited information, unlike the "perfectly rational" agents assumed in traditional models.
The Two-Level Framework
To address these challenges, the authors propose a two-layer optimization strategy that balances the needs of workers, cluster heads, and model owners.
Lower Level: Evolutionary Game Theory
Instead of assuming workers are perfect optimizers, the framework utilizes replicator dynamics. This models a population of workers who migrate between clusters based on their net utility—calculated as rewards minus costs like computation and network congestion. Over time, the system reaches an Evolutionary Equilibrium where no worker has an incentive to switch, providing a stable foundation for training.
Upper Level: Deep Learning-Based Auction
Model owners bid for the services of cluster heads. Traditional auctions often struggle to balance "truthfulness" (bidders revealing their actual value) with "revenue maximization." The authors employ a neural network to learn monotone transform functions for bids.
This architecture ensures the auction is Incentive Compatible (truthful) and Individually Rational while maximizing the cluster head's revenue. By solving for an optimal auction through loss function optimization rather than rigid manual formulas, the system adapts to complex economic constraints.
Key Insights and Results
- Bounded Rationality is Realistic: By using evolutionary games, the model accounts for the fact that workers in massive IoT networks adapt gradually by observing others rather than calculating global optima instantly.
- The Congestion-Reward Trade-off: The paper mathematically proves that a stable equilibrium always exists between the attraction of high reward pools and the deterrent of communication congestion.
- Revenue Superiority: Simulations show that the deep learning-based auction consistently generates higher revenue for cluster heads compared to standard Second Price Auctions (SPA), while maintaining truthfulness.
- Impact of Data Coverage: Clusters with higher data coverage (more workers or higher quality data) were valued significantly higher. For instance, a cluster with 0.4 data coverage earned approximately 25% more revenue than one with 0.26 coverage when model owners required high accuracy.
Conclusion and Future Directions
The proposed framework demonstrates that combining game-theoretic stability with deep learning-driven incentives can effectively manage the complexities of decentralized edge intelligence. Future work will explore the impact of "malicious actors" (e.g., poisoning attacks), social dynamics between data owners, and dynamic selection of the cluster heads themselves.
Summary updated