Abstract
In the context of personalized federated learning (FL), the critical challenge is to balance local model improvement and global model tuning when the personal and global objectives may not be exactly aligned. Inspired by Bayesian hierarchical models, we develop Act-PerFL, a self-aware personalized FL method where each client can automatically balance the training of its local personal model and the global model that implicitly contributes to other clients' training. Such a balance is derived from the inter-client and intra-client uncertainty quantification. Consequently, Act-PerFL can adapt to the underlying clients' heterogeneity with uncertainty-driven local training and model aggregation. With experimental studies on Sent140 and Amazon Alexa audio data, we show that Act-PerFL can achieve superior personalization performance compared with the existing counterparts.
Introduction
Federated Learning (FL) has emerged as a pivotal paradigm for training machine learning models on decentralized data while preserving user privacy. However, the inherent heterogeneity of edge devices—ranging from varying user habits on smartphones to diverse acoustic environments for smart speakers—presents a significant challenge. A standard global model often fails to capture individual nuances, leading to the "personalization gap."
Personalized FL aims to bridge this gap by tailoring models to individual users. The core difficulty lies in balancing the "tug-of-war" between local fine-tuning and global knowledge retention. Excessive local training leads to overfitting on small datasets, while insufficient training results in a generic model that lacks personal relevance. Current approaches often rely on manual hyperparameter tuning, which is unscalable for millions of diverse users.
Methodology: The Act-PerFL Framework
Presented at the FL4NLP 2022 workshop, Act-PerFL (Active Personalized Federated Learning) addresses personalization through the lens of statistical uncertainty. By employing a Bayesian Hierarchical Model, the framework treats the relationship between users as a probabilistic hierarchy.
Uncertainty Quantification
Act-PerFL models two distinct layers of uncertainty:
- Intra-client uncertainty: Captures the variance and noise within a single user's local dataset.
- Inter-client uncertainty: Measures the degree of divergence between different users across the network.
Self-Aware Local Training
By quantifying these uncertainties in real-time, Act-PerFL enables clients to become "self-aware." The system automatically derives:
- Optimal Initialization: A customized starting point for each training round based on the global prior.
- Adaptive Local Steps: A mathematically derived number of local training iterations (early stopping) to prevent overfitting.
- Uncertainty-Weighted Aggregation: A server-side mechanism that weights client updates based on quantified certainty rather than simple sample counts.
Experimental Evaluation
The researchers evaluated Act-PerFL across two heterogeneous datasets representing distinct modalities:
Amazon Alexa Audio Data
This large-scale, real-world dataset for wake-word detection comprises 39,000 hours of training data. It spans five device types (e.g., Echo Dot, Echo Show), each characterized by unique acoustic profiles and hardware constraints.
Sentiment140
A text-based sentiment analysis dataset involving 772 clients, used to simulate non-IID (Independent and Identically Distributed) user behaviors in natural language processing tasks.
Key Results and Insights
- Superior Audio Performance: On the Alexa dataset, Act-PerFL achieved the lowest relative false accept (FA) rates. The global model reached relative FA scores of 0.91–0.94, outperforming standard FedAvg and specialized methods like DITTO. Personalized models achieved scores as low as 0.90.
- Faster Convergence in NLP: On the Sent140 dataset, Act-PerFL demonstrated significantly faster convergence in both training and test accuracy compared to state-of-the-art methods like pFedMe, requiring fewer communication rounds to reach peak performance.
- Deep Learning Compatibility: Although rooted in Gaussian statistics, the authors implemented Act-PerFL for complex architectures (LSTMs and CNNs) using recursive online variance estimation, ensuring minimal computational overhead.
Conclusion
Act-PerFL frames personalization as a variance reduction problem, allowing clients to autonomously balance local and global objectives. By moving away from fixed heuristics toward uncertainty-driven adaptation, the framework provides a robust solution for large-scale, heterogeneous federated learning environments. Future research will focus on extending the theoretical framework to non-convex loss landscapes and improving stability for extremely sparse local datasets.
Summary updated