FedMint: Intelligent Bilateral Client Selection in Federated Learning With Newcomer IoT Devices

Osama Wehbi, Sarhad Arisdakessian, Omar Abdel Wahab, Hadi Otrok, Safa Otoum, Azzam Mourad, Mohsen Guizani

Federated Learning (FL) is often hailed as the future of privacy-preserving AI, allowing models to be trained across thousands of IoT devices without ever moving raw data to the cloud. However, most FL frameworks suffer from a "one-sided" relationship: the central server picks the devices it wants, often ignoring the device's own resource constraints or profit motives. Even worse, when a brand-new device joins the network, the server has no idea if it’s a high-quality contributor or a "lemon."

A team of researchers from Lebanon, Canada, and the UAE has proposed FedMint, a framework that introduces bilateral matching and an "accuracy bootstrapping" mechanism to make FL selection smarter, fairer, and more efficient for newcomer devices.

TL;DR

FedMint is a novel client selection framework for Federated Learning that uses game theory to allow both servers and IoT devices to "choose" each other based on mutual benefits. It specifically tackles the "newcomer problem" by using a collaborative bootstrapping mechanism to predict the data quality of new devices, resulting in a 20% boost in model accuracy and a 58% increase in device earnings compared to standard approaches.

What Problem Does This Paper Address?

In standard Federated Learning (VanillaFL), the server typically selects a random subset of devices for each training round. This is problematic for two reasons:

  1. Heterogeneity: IoT devices have vastly different CPU, RAM, and data quality (non-IID data). Random selection often picks "stragglers" that slow down the whole process or devices with poor data that degrade the model.
  2. Unilateral Selection: Existing "intelligent" selection models are usually server-centric. They ignore whether the IoT device actually wants to participate (e.g., is the payment worth the battery drain?).
  3. The Newcomer Problem: If a device has never participated before, the server has no historical record of its performance. Without a way to estimate its potential, the server might unfairly ignore a high-quality newcomer or waste resources on a poor one.

Methods

The authors break the selection process into two main phases:

1. Accuracy Bootstrapping (The "Cold Start" Solution)

To handle newcomers, FedMint uses a central bootstrapping server. When a new device joins, active federated servers share metadata (not raw data) about their previous interactions with similar devices (region, device type, resource usage). The bootstrapping server trains a Decision Tree (using Standard Deviation Reduction) to predict the newcomer's likely accuracy.

  • Incentive: To prevent servers from being "free riders," the system limits how many bootstrapping requests a server can make based on how much historical data they contribute to the pool.

2. Bilateral Matching Game

Once accuracies are known (or predicted), FedMint treats client selection as a Matching Game:

  • IoT Devices create a preference list of servers based on the monetary rewards offered.
  • Federated Servers create a preference list of devices based on their predicted/historical accuracy.
  • The Algorithm: A distributed matching algorithm (inspired by the Gale-Shapley stable marriage approach) ensures a stable pairing where no device or server has an incentive to "cheat" or deviate from their assigned partner.

Datasets

The researchers evaluated FedMint using the MNIST dataset (handwritten digits).

  • Non-IID Split: To simulate real-world IoT conditions, the data was distributed across devices such that each device only held 1 to 4 specific digit labels, creating significant data heterogeneity.
  • Simulation Environment: They built a custom platform simulating 100+ IoT devices with varying CPU (300-700 MIPS), RAM (400-900 MB), and network latencies (0.1–5 seconds).

Key Insights and Ideas

  • Bilateralism is Key to Sustainability: By allowing IoT devices to prioritize servers that pay more, the system creates a functional "data marketplace." This prevents device churn and ensures that high-resource devices are compensated for their energy expenditure.
  • Metadata as a Proxy for Quality: The bootstrapping results show that you don't need to see a device's private data to guess its quality. Factors like "Device Type" and "Region" are strong enough predictors to give newcomers a fair initial ranking.
  • Stability over Optimality: By using game theory, the authors prioritize a "stable matching." In a distributed system, a stable state where everyone is "satisfied enough" is often more robust than a theoretically optimal state that requires perfect, centralized knowledge.

Key Results

  • Higher Accuracy: FedMint achieved a global model accuracy of ~66% in the first round, compared to only ~44% for VanillaFL. By the 15th round, FedMint maintained a lead of roughly 20% higher accuracy.
  • Increased Revenue: Because the matching algorithm considers device preferences, the average monetary reward for participating IoT devices increased by more than 58% compared to random selection.
  • Effective Bootstrapping: The bootstrapping mechanism predicted newcomer accuracy with a very low Mean Square Error (MSE) of ~0.01, allowing new devices to integrate into the training process almost as effectively as veteran devices.

Limitations and Future Work

  • Centralization Risk: While the matching is distributed, the bootstrapping mechanism relies on a "Central Bootstrapping Server." This could become a bottleneck or a single point of failure.
  • Privacy of Metadata: While raw training data is kept local, the metadata shared for bootstrapping (device type, region, etc.) might still leak some information. Future work could explore using Differential Privacy on this metadata.
  • Scalability: The current study used 100-150 devices. Testing the game-theoretic matching at the scale of millions of devices would be necessary to prove its real-world viability for the global IoT ecosystem.

Summary updated

Abstract

Federated learning (FL) is a novel distributed privacy-preserving learning paradigm, which enables the collaboration among several participants (e.g., Internet of Things (IoT) devices) for the training of machine learning models. However, selecting the participants that would contribute to this collaborative training is highly challenging. Adopting a random selection strategy would entail substantial problems due to the heterogeneity in terms of data quality, and computational and communication resources across the participants. Although several approaches have been proposed in the literature to overcome the problem of random selection, most of these approaches follow a unilateral selection strategy. In fact, they base their selection strategy on only the federated server’s side, while overlooking the interests of the client devices in the process. To overcome this problem, we present in this article FedMint, an intelligent client selection approach for FL on IoT devices using game theory and bootstrapping mechanism. Our solution involves the design of: 1) preference functions for the client IoT devices and federated servers to allow them to rank each other according to several factors, such as accuracy and price; 2) intelligent matching algorithms that take into account the preferences of both parties in their design; and 3) bootstrapping technique that capitalizes on the collaboration of multiple federated servers in order to assign initial accuracy value for the newly connected IoT devices. We compare our approach against the VanillaFL selection process as well as other state-of-the-art approach and showcase the superiority of our proposal.
BibTeX
@article{wehbi2023fedmint,
  author = {Osama Wehbi and Sarhad Arisdakessian and Omar Abdel Wahab and Hadi Otrok and Safa Otoum and Azzam Mourad and Mohsen Guizani},
  title = {{FedMint: Intelligent Bilateral Client Selection in Federated Learning With Newcomer IoT Devices}},
  journal = {IEEE Internet of Things Journal},
  year = {2023},
  url = {https://openreview.net/forum?id=0yBZF4NH1t},
}
Figure