IronForge: An Open, Secure, Fair, Decentralized Federated Learning

Guangsheng Yu, Xu Wang, Caijun Sun, Qin Wang, Ping Yu, Wei Ni, Ren Ping Liu, Xiwei Xu

TL;DR

This paper introduces IRONFORGE, a novel federated learning (FL) framework that achieves full decentralization, enhanced security, and fairness, even in open networks with heterogeneous resources. By leveraging a Directed Acyclic Graph (DAG) structure and a robust incentive mechanism, IRONFORGE eliminates the need for a central coordinator and addresses key challenges in traditional FL.

What Problem Does This Paper Address?

Federated Learning (FL) has emerged as a powerful paradigm for training machine learning models on decentralized data while preserving privacy. However, existing FL frameworks face several critical limitations:

  1. Network Asynchrony: Real-world networks are inherently asynchronous due to varying computation, bandwidth, and storage capacities among participants. Traditional synchronous FL struggles with this, leading to delays and inefficiencies.
  2. Over-dependence on a Central Coordinator: Most FL systems rely on a single central server to manage the training process and aggregate models. This creates a single point of failure (SPoF) and limits flexibility, as participants are often tied to the coordinator's predefined tasks.
  3. Lack of Open and Fair Incentive Mechanisms: In open FL networks with unevenly distributed resources, participants with fewer resources may be disincentivized to contribute, leading to model overfitting and poor generalization. Existing incentive mechanisms often still rely on a central coordinator.
  4. Security Vulnerabilities: FL systems are susceptible to various attacks, including model poisoning, backdoor attacks, and increasingly, model stealing and collusion attacks, which aim to exploit the incentive mechanisms.

IRONFORGE aims to address all these issues simultaneously, enabling a more robust, scalable, and equitable FL ecosystem.

Methods

IRONFORGE introduces several key innovations:

  • Decentralized Architecture with DAG: Instead of a central coordinator, IRONFORGE utilizes a Directed Acyclic Graph (DAG) structure. This allows for asynchronous operations and eliminates the SPoF. The framework employs two types of DAGs:
  • Global-DAG: A public repository of models, acting as a shared resource pool.
  • Task-DAG: Task-specific DAGs created by users to manage specific training tasks, facilitating decentralized training and incentivization.
  • Asynchronous Training: Inheriting from asynchronous FL principles, IRONFORGE allows participants to contribute models at their own pace, improving efficiency in heterogeneous environments.
  • Open and Fair Incentive Mechanism: IRONFORGE implements a state-consistent incentive mechanism that rewards participants for their contributions and penalizes malicious behavior. This mechanism is designed to work in public, open networks with varying resource distributions.
  • Proof-of-Learning (PoL) for Security: To combat model stealing and collusion attacks, IRONFORGE incorporates a privacy-preserving PoL scheme. This mechanism allows participants to prove they have performed genuine training work without revealing their private data, thus deterring attackers who try to gain rewards by simply stealing models or faking contributions.
  • Noise-Enabled PoL: A novel validation mechanism using noise-enabled Proof-of-Learning (PoL) is introduced to validate the gradient descent process. This helps capture malicious behaviors like faking ownership or embezzling rewards.
  • Settlement Nodes for State Consistency: To ensure state consistency in the Global-DAG, settlement nodes are periodically elected to manage account states and consensus, enabling smart-contract-enhanced incentives.

Datasets

The paper mentions using the MNIST dataset for training and evaluation. They create non-IID training shards to simulate practical network conditions and evaluate the model's performance under various scenarios.

Key Insights and Ideas

  • DAG as a Foundation for Decentralization: The DAG structure is crucial for enabling asynchronous and decentralized operations, moving away from the rigid, centralized model.
  • Incentives are Key to Open FL: For FL to thrive in open, heterogeneous environments, a well-designed incentive system that rewards honest contributions and penalizes malice is paramount. IRONFORGE's state-consistent mechanism is a significant step in this direction.
  • Model Stealing is a Growing Threat: The paper highlights model stealing and collusion attacks as emerging threats, particularly in incentivized FL systems. The PoL mechanism is a novel defense against these.
  • Flexibility in Fairness: IRONFORGE offers different contest and reward strategies (e.g., immediate settlement vs. winner traverse), allowing users to define their own principles of fairness based on their needs.
  • Bandwidth as a Bottleneck: Experimental results suggest that bandwidth plays a critical role in earning rewards, implying that users with higher bandwidth might have an advantage in contributing more frequently.

Key Results

  • Performance: IRONFORGE demonstrates superior performance compared to AsyncFL and BlockFL, with only slightly slower convergence than GoogleFL in scenarios without attacks.
  • Security: The framework shows strong resistance to stealing attacks, followed by backdoor and poisoning attacks. The PoL mechanism effectively prevents dishonest contributors from gaining rewards in stealing and collusion attacks.
  • Fairness: Experiments show a monotonic increase in rewards with improvements in CPU cores, memory, and bandwidth, indicating that the incentive mechanism is fair across different resource levels. The immediate settlement strategy, in particular, provides stable rewards even for users with lower quality data.
  • Efficiency: The DAG-based asynchronous approach contributes to better handling of network asynchrony and resource heterogeneity.

Limitations and Future Work

  • Timestamp Synchronization: The paper acknowledges that the timestamp in IRONFORGE is considered synchronous via external trustworthy servers. Achieving truly decentralized and synchronized timestamps remains a challenge.
  • VRF Seed Security: The fairness of the VRF-elected committees relies on unbiased and unpredictable random seeds. Ensuring the security of these seeds is crucial.
  • Model Melting: While dataset obfuscation helps preserve privacy during PoL, it can decrease model utility. The paper notes that applying training over different data samples or using non-IID noise can reduce privacy decline risks, but further research on balancing utility and privacy is needed.
  • Future Work: The authors suggest that future work could explore more advanced defense strategies against sophisticated attacks and further optimize the incentive mechanisms for diverse fairness definitions. The development of the FLSim testbed also opens avenues for more comprehensive evaluations of FL frameworks.

Summary updated

Abstract

Federated learning (FL) provides an effective machine learning (ML) architecture to protect data privacy in a distributed manner. However, the inevitable network asynchrony, the over-dependence on a central coordinator, and the lack of an open and fair incentive mechanism collectively hinder its further development. We propose \textsc{IronForge}, a new generation of FL framework, that features a Directed Acyclic Graph (DAG)-based data structure and eliminates the need for central coordinators to achieve fully decentralized operations. \textsc{IronForge} runs in a public and open network, and launches a fair incentive mechanism by enabling state consistency in the DAG, so that the system fits in networks where training resources are unevenly distributed. In addition, dedicated defense strategies against prevalent FL attacks on incentive fairness and data privacy are presented to ensure the security of \textsc{IronForge}. Experimental results based on a newly developed testbed FLSim highlight the superiority of \textsc{IronForge} to the existing prevalent FL frameworks under various specifications in performance, fairness, and security. To the best of our knowledge, \textsc{IronForge} is the first secure and fully decentralized FL framework that can be applied in open networks with realistic network and training settings.
BibTeX
@article{yu2023ironforge,
  author = {Guangsheng Yu and Xu Wang and Caijun Sun and Qin Wang and Ping Yu and Wei Ni and Ren Ping Liu and Xiwei Xu},
  title = {{IronForge: An Open, Secure, Fair, Decentralized Federated Learning}},
  journal = {IEEE Trans. Neural Networks Learn. Syst.},
  year = {2023},
  doi = {10.1109/tnnls.2023.3329249},
}
Figure