Abstract Deep learning-based Channel State Information (CSI) compression is essential for Frequency Division Duplexing (FDD) massive MIMO systems. However, these models often suffer from performance degradation when encountering distribution shifts in wireless environments. This paper proposes an online full-model (FM) fine-tuning strategy that updates both encoder and decoder parameters. To manage the communication overhead of transmitting updated model weights, we employ a "spike-and-slab" prior that encourages sparsity in the weight updates. Our approach significantly improves reconstruction accuracy in dynamic scenarios while maintaining a low update bit-rate.
Introduction
In massive MIMO systems, the base station requires accurate CSI for effective beamforming. In FDD mode, the user equipment (UE) must feedback this high-dimensional CSI matrix, which can consume prohibitive amounts of bandwidth. While deep learning autoencoders have shown promise in compressing CSI, they lack generalization; a model trained for one environment (e.g., static outdoor) often fails when the UE moves into a different environment (e.g., dense urban).
Fine-tuning the model to the new environment is a potential solution, but it introduces the challenge of synchronizing the decoder at the base station. If the cost of sending model updates exceeds the savings from compression, the approach becomes impractical. This work addresses this trade-off by treating model updates as an integral part of the total communication cost.
Methodology
The proposed framework utilizes a convolutional neural network (CNN) autoencoder architecture. The core innovation lies in the joint optimization of reconstruction error and the bit-rate required for both the compressed CSI and the model updates.
To achieve sparse and compressible updates, we introduce a spike-and-slab prior. This prior is a mixture of two Gaussian distributions: a very narrow "spike" centered at zero and a wider "slab." This distribution encourages the network to keep most weight updates at zero, ensuring that only the most critical parameters are transmitted. The updates are further processed through quantization and lossless entropy coding (e.g., CABAC). To enable end-to-end training with non-differentiable quantization, a Straight-Through Estimator (STE) is employed.
Experimental Setup and Datasets
The performance of the proposed method was evaluated using two realistic ray-tracing datasets:
- DeepMIMO: Used for initial training in a static outdoor scenario (Scenario 'O1') and testing under moderate distribution shifts (Scenario 'O2').
- QuaDRiGa: Used to simulate a more challenging transition to a dense urban environment with a mobile user.
The study specifically examined the impact of user mobility, identifying optimal update intervals to balance model freshness against transmission overhead. For a user moving at 5 km/h, updates every 8 to 16 meters were found to be most effective.
Key Results and Discussion
The experimental results demonstrate that full-model fine-tuning is superior to encoder-only updates. In the QuaDRiGa dataset, the proposed method improved the Normalized Mean Square Error (NMSE) from a baseline of -9 dB to approximately -16 dB, nearing the performance of a theoretical "genie-aided" model with zero-cost updates.
The spike-and-slab prior successfully reduced the number of non-zero weight updates by several orders of magnitude. Furthermore, the backbone network remains computationally efficient, requiring only ~475 million FLOPs for inference, which is significantly more efficient than traditional iterative algorithms like ISTA-Net+.
Conclusion
This work presents a robust strategy for adapting CSI compression models to changing wireless environments. By incorporating model update costs into the training objective and leveraging sparse priors, we enable efficient full-model fine-tuning. Future research will explore adaptive update intervals and high-mobility scenarios to further enhance the system's practical utility.
Summary updated