Lightweight Diffusion Models for Resource-Constrained Semantic Communication

Eleonora Grassucci, Giovanni Pignata, Giordano Cicchetti, Danilo Comminiello

TL;DR

Q-GESCO introduces a lightweight framework for generative semantic communication by applying post-training quantization to diffusion models. It slashes memory usage by 75% and computational load by 79% while maintaining—and sometimes even improving—the quality of images reconstructed from compressed semantic maps, even in the presence of channel noise.

What Problem Does This Paper Address?

Semantic communication is a paradigm shift where, instead of transmitting every pixel, a sender transmits the "meaning" of a scene (like a semantic label map). The receiver then uses a generative model, typically a diffusion model, to "re-imagine" the original image.

While diffusion models produce stunningly realistic results, they are notoriously resource-hungry. They require multiple iterative passes (inference steps) and possess massive parameter counts, making them nearly impossible to run on resource-constrained edge devices like smartphones or IoT sensors. Furthermore, these models must be robust enough to handle "noisy" semantic maps caused by interference during wireless transmission. Q-GESCO aims to bridge this gap between high-fidelity generative power and the practical limitations of edge hardware.

Methods

The authors propose Q-GESCO (Quantized GEnerative Semantic COmmunication), which optimizes the existing GESCO framework using Post-Training Quantization (PTQ). Unlike traditional training, PTQ converts model weights from 32-bit floating-point (FP32) to 8-bit integers without requiring a full, expensive retraining cycle.

The pipeline consists of four key steps:

  1. Noise-aware Training: The full-precision model is first trained to handle various levels of noise in the input semantic maps, emulating real-world channel interference.
  2. Quantization: Weights are rounded to a discrete 8-bit set.
  3. Timestep-aware Calibration: This is a critical innovation. Because diffusion models change their internal activation distributions at different stages of the denoising process, the authors create a calibration dataset that samples intermediate steps. They also inject synthetic channel noise (AWGN) into this calibration set to ensure the quantized model remains robust.
  4. Inference: The final calibrated, 8-bit model is deployed at the receiver.
The Q-GESCO pipeline, showing the transition from noise-aware training to quantized inference.

Datasets

The researchers evaluated their framework using the Cityscapes dataset. This well-known benchmark contains urban street scene video frames (256 × 512 resolution) with corresponding semantic maps across 35 distinct classes. It serves as a perfect proxy for applications like autonomous driving or smart city surveillance.

Key Insights and Ideas

  • Quantization as a Regularizer? Interestingly, the 8-bit Q-GESCO model occasionally outperformed its 32-bit counterpart in metrics like FID (Fréchet Inception Distance). This suggests that the quantization and calibration process might act as a form of regularization, helping the model focus on the most essential features for reconstruction.
  • The Importance of Timestep Sampling: You cannot calibrate a diffusion model using only the final output. Because the "look" of the data changes from pure noise to a clear image over $T$ steps, the calibration must account for these shifting distributions to prevent error accumulation.
  • Data-Free Compression: The PTQ approach is "completely data-free" in the sense that it doesn't require the original massive training set to compress the model—just a small, representative calibration set.

Key Results

The results demonstrate that you can have your cake and eat it too:

  • Efficiency: Q-GESCO achieved a 75% reduction in memory footprint (from ~2.7 GB to 674 MB) and a 79% reduction in floating-point operations (FLOPs).
  • Quality: Despite the massive compression, the perceptual quality (measured by LPIPS and FID) remained comparable to the full-precision model. For example, at a Peak Signal-to-Noise Ratio (PSNR) of 100 (low noise), Q-GESCO achieved an FID of 15.82 compared to the baseline's 16.43.
  • Robustness: The model maintained high performance even when the communication channel was highly degraded (PSNR 10).
Visual comparison between the full-precision GESCO and the quantized Q-GESCO. The differences are virtually indistinguishable to the human eye.

Limitations and Future Work

While the results are promising, the authors note a few areas for further exploration:

  • Calibration Time: The calibration process for Q-GESCO takes approximately 13 hours on a high-end NVIDIA RTX8000. While this is a one-time cost, reducing this overhead would be beneficial.
  • Channel Complexity: The study primarily uses Additive White Gaussian Noise (AWGN). Real-world wireless channels involve fading and multi-path effects that may require more sophisticated noise-aware calibration.
  • Scaling: Future work could explore how these quantization techniques scale to even higher resolution images or more complex generative architectures beyond the standard U-Net used in this study.

Summary updated

Abstract

Recently, generative semantic communication models have proliferated as they are revolutionizing semantic communication frameworks, improving their performance, and opening the way to novel applications. Despite their impressive ability to regenerate content from the compressed semantic information received, generative models pose crucial challenges for communication systems in terms of high memory footprints and heavy computational load. In this paper, we present a novel Quantized GEnerative Semantic COmmunication framework, Q-GESCO. The core method of Q-GESCO is a quantized semantic diffusion model capable of regenerating transmitted images from the received semantic maps while simultaneously reducing computational load and memory footprint thanks to the proposed post-training quantization technique. Q-GESCO is robust to different channel noises and obtains comparable performance to the full precision counterpart in different scenarios saving up to 75% memory and 79% floating point operations. This allows resource-constrained devices to exploit the generative capabilities of Q-GESCO, widening the range of applications and systems for generative semantic communication frameworks. The code is available at https://github.com/ispamm/Q-GESCO.
BibTeX
@article{grassucci2025lightweight,
  author = {Eleonora Grassucci and Giovanni Pignata and Giordano Cicchetti and Danilo Comminiello},
  title = {{Lightweight Diffusion Models for Resource-Constrained Semantic Communication}},
  journal = {IEEE Wireless Communications Letters},
  year = {2025},
  doi = {10.1109/lwc.2025.3578724},
}
Figure