Introduction
Federated Learning (FL) is a decentralized machine learning paradigm designed to preserve data privacy by training models locally on user devices. Despite its promise, FL faces two critical challenges: the communication bottleneck caused by massive model sizes and the privacy gap where gradient updates can leak sensitive information. ESMFL (Efficient and Secure Models for Federated Learning) addresses these issues by integrating hardware-based security with advanced model pruning.
The ESMFL Framework
The core of ESMFL is a dual-strategy approach that ensures both high security and extreme communication efficiency.
Hardware-Verified Security via Intel SGX
To protect against gradient leakage without the accuracy trade-offs of differential privacy, ESMFL utilizes Intel Software Guard Extensions (SGX). The central server, acting as a Cryptographic Service Provider (CSP), operates a Trusted Execution Environment (TEE) known as an Enclave.
In this architecture, clients perform remote attestation to verify the enclave's integrity before transmitting encrypted model updates. Aggregation occurs within this hardware-protected "black box," preventing even server administrators from accessing raw gradients.
ADMM-Based Weight Pruning
To mitigate the communication bottleneck, ESMFL employs the Alternating Direction Method of Multipliers (ADMM) for model pruning. This process involves a "warm-up" phase with the full model followed by systematic regularization. Unlike simple magnitude pruning, ADMM treats pruning as a mathematical optimization problem, enabling significantly higher compression rates while maintaining model convergence and accuracy.
Experimental Evaluation
The framework was evaluated on MNIST (LeNet-5) and CIFAR-10 (MobileNetV2) datasets across both IID and Non-IID data distributions.
Key Results
ESMFL demonstrates that hardware-based security is highly compatible with model compression. Since SGX does not require adding noise to weights, models remain sparse, facilitating massive reductions in upload size.
- Compression and Accuracy: On MNIST, ESMFL achieved compression rates between 9.99x and 87x with negligible accuracy loss (98.78% vs 98.26%).
- Efficiency: For LeNet-5, the framework reduced communication costs by up to 48.78% and improved total elapsed time by 2.4x.
- Robustness: The system maintains high performance even in challenging Non-IID scenarios.
On the more complex CIFAR-10 dataset using MobileNetV2, ESMFL reached 85.40% accuracy with a 4.95x compression rate, outperforming standard masked pruning baselines.
Discussion and Future Work
ESMFL successfully balances the "privacy vs. efficiency" trade-off. However, current limitations include hardware dependency on Intel SGX and increased computational overhead on the client side due to ADMM. Future research will explore support for other TEEs like ARM TrustZone and evaluate scalability with larger client populations.
Summary updated