AirGC-CD: Gaussian-Circulant Precoding for Exactly Debiasable PAPR Reduction in Over-the-Air Federated Learning

Jonggyu Jang, Hyeonsu Lyu, Hyun Jong YangarXiv 2026 · arXiv

TL;DR

AirGC-CD introduces a novel Gaussian-circulant precoding scheme for over-the-air federated learning that simultaneously compresses model updates and slashes the peak-to-average power ratio (PAPR). By forcing the transmitted signal into a known Gaussian distribution, it allows hardware-induced clipping distortion to be perfectly reversed at the server, yielding an exactly unbiased gradient aggregate. This achieves faster convergence and lower communication overhead at a near-linear computational cost of $\mathcal{O}(d \log d)$.

What Problem Does This Paper Address?

Over-the-air computation (AirComp) is a highly efficient way to scale Federated Learning (FL). Instead of separating edge devices (EDs) into orthogonal time or frequency slots, AirComp lets all devices transmit their analog updates simultaneously over the same channel. The wireless multiple-access channel then naturally aggregates the signals via superposition, keeping communication costs independent of the number of participating devices.

However, analog AirComp-FL faces two major bottlenecks:

  1. High PAPR: Deep learning model updates are heavy-tailed and often nearly sparse. When transmitted directly, they create waveforms with a massive Peak-to-Average Power Ratio (PAPR), frequently exceeding 30 dB. To keep radio-frequency power amplifiers within their linear operating range, devices must either drastically back off their transmit power (which degrades the Signal-to-Noise Ratio, SNR) or clip the signal peaks (which introduces an unremovable bias that harms model convergence).
  2. Communication Overhead: Standard analog AirComp spends one channel use per model parameter ($d$), making large-model training impractical.

The authors address these challenges by asking how an ED can compress transmissions and clip power peaks to protect hardware while still allowing the server to recover an exactly unbiased aggregate at a low computational cost.

Positioning of AirGC-CD against representative schemes

Methods

The authors propose AirGC-CD (Gaussian-Circulant Precoding with Clip-and-Debias), which structurally redesigns the transceiver pipeline:

  • Gaussian-Circulant Sketching & Precoding: The local update vector $\Delta \mathbf{w}_{k,t}$ is zero-padded, sign-flipped via a Rademacher matrix, and convolved with a randomized Gaussian circulant matrix before being subsampled to a smaller sketch dimension $m$. Crucially, this matrix structure guarantees that the output coordinates are exactly Gaussian, regardless of the sparsity or distribution of the underlying model updates.
  • Fast Implementation via FFT: Instead of expensive dense matrix multiplications that cost $\mathcal{O}(md)$, the circulant structure allows the entire sketching operation to be executed via Fast Fourier Transforms (FFTs) in near-linear time ($\mathcal{O}(d \log d)$).
  • Clip-and-Debias Policy: Because the pre-clipped signal is perfectly Gaussian, the authors apply Bussgang’s theorem to model the clipping distortion. The clipped signal is split into a linear scaling factor (the Bussgang gain $\alpha_\gamma$) and an uncorrelated residual. By dividing the clipped signal by $\alpha_\gamma$ before transmission, the clipping distortion is inverted on average, ensuring the final aggregated signal at the parameter server remains completely unbiased.
  • Optimal Clipping Ratio: The authors derive a closed-form solution to dynamically optimize the clipping ratio based on the channel SNR, perfectly balancing the super-exponentially decaying clipping loss against quadratically growing channel noise.
Fig. 1. Schematic diagram of AirGC-CD. At each ED, the local model weight wk,t,i is trained on the local dataset via SGD. The EDs then encode their local update ∆wk,t via Gaussian-circulant sketching. Next, to adjust the MSE tradeoff between the channel noise and clipping loss, we apply clipping, where αγ denotes the Bussgang gain. In the AirComp uplink phase, the EDs simultaneously transmit sk,t over the shared channel. Then, the PS broadcasts the aggregated sketch to EDs via a reliable digital link. Finally, the EDs desketch and recover the average update.

Datasets

The proposed method was evaluated on five standard image classification datasets:

  • CIFAR-10 and CIFAR-100
  • SVHN (Street View House Numbers)
  • Fashion-MNIST
  • Tiny-ImageNet

To simulate a realistic, statistically heterogeneous (non-IID) federated environment, the data was partitioned across 20 edge devices using a Dirichlet distribution with a skew parameter of $\vartheta = 0.1$.

Key Insights and Ideas

  • Shifting the Goal of Precoding: Traditional precoding flattens a block of symbols to minimize PAPR for a specific modulation alphabet. AirGC-CD shifts this paradigm: it precodes to enforce a known statistical distribution (Gaussian). This predictability is what unlocks exact debiasing.
  • Clipping is No Longer Destructive: Usually, clipping is treated as a lossy operation that introduces irreversible bias. Here, because the pre-clipped signal is Gaussian, the bias becomes completely deterministic and removable via a simple scalar division ($\alpha_\gamma$). Clipping only introduces variance, which can be mathematically managed.
  • A Dual-Purpose Operator: The partial Gaussian circulant matrix elegantly serves two purposes simultaneously: it acts as a compressor (reducing dimension from $d$ to $m$) and a hardware-friendly precoder (enabling debiasable PAPR reduction).

Key Results

  • Convergence and Accuracy: AirGC-CD achieves an $\mathcal{O}(1/\sqrt{T})$ convergence rate without a bias floor. In experiments across all five datasets, it consistently outperformed baselines like standard AirFL, AirFL-Sparse, and AirFL-LoRA, particularly in low-SNR regimes (e.g., -20 dB to 0 dB).
  • Overhead Reduction: By compressing updates to $m = 16,384$ channel uses (for an 11-million parameter ResNet-18 model), AirGC-CD dramatically cuts down communication time while maintaining high accuracy.
  • Computational Efficiency: Unlike dense Gaussian sketching which requires $\mathcal{O}(md)$ operations, AirGC-CD's FFT-based implementation runs in $\mathcal{O}(d \log d)$ time, making it highly practical for resource-constrained edge devices.

Limitations and Future Work

  • Performance on Harder Tasks at High SNR: For complex datasets like CIFAR-100 and Tiny-ImageNet under high-SNR conditions, uncompressed AirFL still slightly outperforms AirGC-CD. This occurs because the chosen sketch dimension ($m = 16,384$) is highly compressed relative to the model size ($d \approx 11\times 10^6$). Increasing $m$ closes this gap but increases communication overhead per round.
  • Future Directions: The authors suggest extending this framework to multi-antenna (MIMO) settings and exploring how it handles time-varying fading channels where perfect channel state information (CSI) might not be available.

Summary updated

Abstract

Over-the-air federated learning lets edge devices transmit their local updates simultaneously, reducing the communication overhead. The resulting waveform, however, has a peak-to-average power ratio (PAPR) that grows with the model dimension, and keeping the amplifier in its linear range leaves two remedies: clipping the peaks or backing off the transmit power. Neither remedy is without cost: i) the clipping distortion appears at the receiver as a bias that cannot be removed, and ii) back-off keeps the signal intact but degrades the average signal-to-noise ratio (SNR). Independent of this trade-off, the transmission remains uncompressed, spending one channel use per model parameter, which keeps large-model training out of reach. To address these challenges, we propose AirGC-CD, an over-the-air scheme that precodes each local update with a partial Gaussian circulant matrix before clipping. In AirGC-CD, the precoder's output is exactly Gaussian regardless of the update's sparsity, so the clipping function is designed for a known distribution instead of inheriting it from the data. This enables the clipping to be inverted on average by a single scalar Bussgang gain in closed form, and we prove that the resulting aggregate is exactly unbiased, with clipping adding only variance. The clipping ratio is then the only free parameter left, trading the variance of the clipping against the SNR loss from back-off, and we derive its near-optimum in closed form. Since the precoder is linear, it also acts as a compressor, reducing the transmission from the model dimension d to the sketch dimension m at a cost of only O(dlog d) via two fast Fourier transforms, whereas a Gaussian sketch costs O(md). Experiments on five image datasets show that AirGC-CD outperforms baseline over-the-air FL schemes in most settings, particularly at low SNR, while using fewer channel uses per round.
BibTeX
@misc{jang2026airgc,
  author = {Jonggyu Jang and Hyeonsu Lyu and Hyun Jong Yang},
  title = {{AirGC-CD: Gaussian-Circulant Precoding for Exactly Debiasable PAPR Reduction in Over-the-Air Federated Learning}},
  year = {2026},
  eprint = {2609.23084},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2609.23084},
}
Figure