PerFED-GAN: Personalized Federated Learning via Generative Adversarial Networks

Xingjian Cao, Gang Sun, Hongfang Yu, Mohsen Guizani

TL;DR

PerFED-GAN is a novel personalized federated learning framework that allows clients to use completely different model architectures while still learning from one another. By using Generative Adversarial Networks (GANs) to share synthetic data samples instead of model weights, it achieves up to a 49% improvement in accuracy over local training in highly diverse, non-IID environments.

What Problem Does This Paper Address?

Standard Federated Learning (FL) typically requires every participant (client) to use the exact same neural network architecture. This "global model" approach fails in two major ways:

  1. Data Heterogeneity (Non-IID): A single model often can't handle the diverse data distributions found across different users (e.g., a keyboard predictor for a teenager vs. a professional).
  2. Model Heterogeneity: In the real world, different organizations might have different hardware constraints or proprietary model designs they don't want to share.

Existing "Personalized" FL methods usually still require consistent architectures or rely on sharing model parameters, which risks leaking intellectual property or private data. PerFED-GAN aims to let clients be "black boxes" to each other—keeping their specific architectures and parameters entirely private.

Methods

The authors introduce a strategy based on co-training and GANs. Instead of aggregating gradients or weights at a central server, the process follows these steps:

  1. Local Training: Each client trains their unique model ($M_i$) on their private dataset.
  2. GAN Training: The client uses their trained model as a discriminator. They train a local generator to produce synthetic data samples that "fool" their model into thinking they belong to specific target classes.
  3. Communication: Clients upload these synthetic samples (not their models) to a central server. The server aggregates these samples into a diverse "knowledge pool" and redistributes subsets back to the clients.
  4. In-process Training: Clients update their personalized models using a mix of their original private data and the synthetic data received from the server.

This approach effectively uses synthetic data as a medium for "knowledge distillation" without requiring a shared public dataset or identical model structures.

Datasets

The researchers evaluated PerFED-GAN using three standard computer vision benchmarks, modified for federated settings:

  • CIFAR-10 & CIFAR-100: Used to simulate both IID (Independent and Identically Distributed) and Non-IID scenarios across 100 clients.
  • FEMNIST: A large-scale dataset of handwritten characters from 3,550 users, specifically designed for federated learning research.

To test model heterogeneity, they assigned clients randomly generated CNNs with varying depths (2 or 3 layers) and different filter counts.

Key Insights and Ideas

  • Architecture Agnosticism: This is the "killer feature." Because the medium of exchange is data (images/samples) rather than math (weights), a tiny mobile model can learn from a massive server-grade model.
  • Diversity is a Strength: Counter-intuitively, the method performs significantly better when client data is highly diverse (Non-IID). The authors prove theoretically that greater divergence between client models leads to a lower bound on generalization error.
  • Privacy via Synthesis: By sharing synthetic samples instead of model weights, the framework avoids "white-box" attacks where an adversary reconstructs private data from model gradients.
  • Differential Privacy Integration: The paper demonstrates that PerFED-GAN can be combined with Differential Privacy (DP-CGAN) to further harden the synthetic samples against data leakage with only a small hit to accuracy.

Key Results

  • Accuracy Gains: In Non-IID settings, PerFED-GAN outperformed local training by an average of 35% on CIFAR-10 and 49% on CIFAR-100.
  • Superiority over Baselines: The method outperformed existing personalized FL methods (like FedAvg with fine-tuning and FedProx) by roughly 42% in mean test accuracy when model architectures and data varied significantly.
  • Efficiency: Unlike FedMD (a similar distillation-based approach), PerFED-GAN does not require a massive, labeled public dataset, which is often impossible to obtain in specialized fields like healthcare.

Limitations and Future Work

  • Computational Overhead: Training a GAN locally on an IoT or mobile device is significantly more "expensive" in terms of battery and CPU than simple gradient descent.
  • Communication Costs: Sending synthetic images or data samples can be more bandwidth-intensive than sending compressed model updates, depending on the data type.
  • GAN Stability: GANs are notoriously difficult to train. If a client's local GAN fails to converge or produces "garbage" samples, it could negatively impact the global knowledge pool.

The authors suggest that future work could focus on optimizing the efficiency of the local GAN training to make it more suitable for low-power edge devices.

Summary updated

Abstract

Federated learning is gaining popularity as a distributed machine learning method that can be used to deploy AI-dependent Internet of Things applications while protecting client data privacy and security. Due to the differences of clients, a single global model may not perform well on all clients, so the personalized federated learning method, which trains a personalized model for each client that better suits its individual needs, becomes a research hotspot. Most personalized federated learning research, however, focuses on data heterogeneity while ignoring the need for model architecture heterogeneity. Most existing federated learning methods uniformly set the model architecture of all clients participating in federated learning, which is inconvenient for each client’s individual model and local data distribution requirements, and also increases the risk of client model leakage. This article proposes a federated learning method based on co-training and generative adversarial networks (GANs) that allows each client to design its own model to participate in federated learning training independently without sharing any model architecture or parameter information with other clients or a center. In our experiments, the proposed method outperforms the existing methods in mean test accuracy by 42% when the client’s model architecture and data distribution vary significantly.
BibTeX
@article{cao2023perfed,
  author = {Xingjian Cao and Gang Sun and Hongfang Yu and Mohsen Guizani},
  title = {{PerFED-GAN: Personalized Federated Learning via Generative Adversarial Networks}},
  journal = {IEEE Internet of Things Journal},
  year = {2023},
  url = {https://openreview.net/forum?id=8swbZu0gX7},
}

Loading related content...

Figure