A New Perspective on Privacy Protection in Federated Learning with Granular-Ball Computing

Guannan Lai, Yihui Feng, Xin Yang, Xiaoyu Deng, Hao Yu, Shuyin Xia, Guoyin Wang, Tianrui LiarXiv 2025 · DOI · OpenReview

TL;DR

This paper introduces Granular-Ball Federated Learning (GrBFL), a novel framework that enhances privacy in federated learning by processing images at a coarser granularity. By segmenting images into regions and representing them as graphs, GrBFL significantly reduces the information available to potential attackers, leading to improved privacy without sacrificing model utility or efficiency.

What Problem Does This Paper Address?

Federated Learning (FL) allows multiple clients to collaboratively train a machine learning model without sharing their raw data. However, a critical challenge in FL is balancing privacy, efficiency, and model utility. Existing methods often focus on protecting privacy by altering model parameters or outputs. This paper argues that these approaches overlook a crucial vulnerability: the input data itself. Attackers can still potentially reconstruct sensitive information from model gradients and weights, even if the raw data isn't directly shared. The authors propose addressing this by transforming the input data into a less informative representation before it's used for training, thereby mitigating reconstruction attacks at the source.

Methods

The core of the GrBFL framework lies in its novel approach to input data processing. Instead of using fine-grained pixel data, GrBFL employs Granular-Ball Computing (GBC). This involves:

  1. Granular-Rectangle Generation: Images are segmented into optimal coarse-grained regions (termed "granular-rectangles") using a two-dimensional binary search algorithm based on variance constraints. This process aims to capture essential features while discarding redundant information.
  2. Graph Construction: These granular-rectangles are then represented as nodes in a graph. Edges are formed between nodes that represent overlapping regions in the original image. This transforms the image into a graph structure.
  3. Graph Neural Network (GNN) Training: Clients train their local models using these graph representations, typically with a GNN.
  4. Federated Aggregation: A modified aggregation strategy, FedProx, is used to handle the increased disparity between client models trained on graph data, ensuring stable convergence.

This method fundamentally changes how data is presented to the FL model, making it harder for attackers to reconstruct the original, fine-grained input.

Datasets

The paper evaluates GrBFL on three classic image datasets:

  • MNIST
  • CIFAR-10
  • CIFAR-100

These datasets represent varying levels of difficulty, allowing for a comprehensive evaluation of the model's performance.

Key Insights and Ideas

  • Privacy from the Input: The paper strongly advocates for considering privacy protection from the input data perspective, arguing it's a more fundamental and effective approach than solely focusing on model parameters or outputs.
  • Information Reduction = Privacy: The core idea is that reducing the information content of the input data directly translates to enhanced privacy. By abstracting images into coarse-grained graphs, GrBFL inherently limits the information an attacker can glean.
  • Balancing Act: The "No Free Lunch" principle is acknowledged, but GrBFL aims to achieve a better balance between privacy, efficiency, and utility by tackling the input problem.
  • GBC for FL: Granular-Ball Computing, traditionally used for multi-granularity analysis, is adapted and shown to be effective in the context of federated learning for privacy enhancement.

Key Results

  • Superior Privacy Protection: GrBFL demonstrated significantly better privacy protection compared to baseline methods like LotteryFL and Differential Privacy (DP). Even after many iterations of reconstruction attacks, GrBFL's reconstructed images showed much higher Mean Squared Error (MSE) and a higher privacy score (Sp).
  • Enhanced Efficiency: GrBFL achieved superior communication efficiency (CE), outperforming CNNFL-based methods.
  • Robust Utility: Despite the privacy enhancements and information reduction, GrBFL maintained robust utility, with accuracy remaining competitive.
  • Comprehensive Evaluation: The proposed Privacy-Efficiency-Utility Metric (PEUM) showed GrBFL achieving the best overall performance across datasets. For example, on CIFAR100, GrBFL achieved a PEUM of 0.22 ± 0.02, outperforming other methods.
  • Parameter Robustness: The study found GrBFL to be robust to variations in its key parameters (purity and proximal coefficient), with parameter changes having a minimal impact on performance.

Limitations and Future Work

  • Computational Cost of Graph Construction: While the binary search for granular-rectangle generation is efficient, the overall graph construction process, particularly the edge creation, can have a complexity of O(k²), where k is the number of regions. The paper notes this is efficient for large-scale image processing but could still be a bottleneck for extremely complex graphs.
  • Further Input Impact Investigation: The authors suggest continuing to investigate the impact of various input transformations on FL performance and developing more sophisticated algorithms for GrBFL.
  • Membership Inference Attacks: While experiments were conducted on membership inference attacks, the detailed results are deferred to supplementary materials, suggesting potential for further analysis and discussion.

Summary updated

Abstract

Federated Learning (FL) facilitates collaborative model training while prioritizing privacy by avoiding direct data sharing. However, most existing articles attempt to address challenges within the model's internal parameters and corresponding outputs, while neglecting to solve them at the input level. To address this gap, we propose a novel framework called Granular-Ball Federated Learning (GrBFL) for image classification. GrBFL diverges from traditional methods that rely on the finest-grained input data. Instead, it segments images into multiple regions with optimal coarse granularity, which are then reconstructed into a graph structure. We designed a two-dimensional binary search segmentation algorithm based on variance constraints for GrBFL, which effectively removes redundant information while preserving key representative features. Extensive theoretical analysis and experiments demonstrate that GrBFL not only safeguards privacy and enhances efficiency but also maintains robust utility, consistently outperforming other state-of-the-art FL methods. The code is available at https://github.com/AIGNLAI/GrBFL.
BibTeX
@misc{lai2025new,
  author = {Guannan Lai and Yihui Feng and Xin Yang and Xiaoyu Deng and Hao Yu and Shuyin Xia and Guoyin Wang and Tianrui Li},
  title = {{A New Perspective on Privacy Protection in Federated Learning with Granular-Ball Computing}},
  year = {2025},
  eprint = {2501.04940},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2501.04940},
}
Figure