AFRNet: Adaptive Frequency Redistribution Network for Image Deraining

Dezhi Zhang, Shangrong Yang, Husheng Guo, Zhijie Shen, Wenjian WangarXiv 2026 · arXiv

TL;DR

AFRNet (Adaptive Frequency Redistribution Network) improves image deraining by moving away from the traditional "band-wise" processing of frequency components. By introducing modules that allow wavelet subbands to interact and exchange information, the network effectively separates complex rain artifacts from background textures, achieving state-of-the-art results with significantly fewer parameters than competing models.

What Problem Does This Paper Address?

Removing rain from a single image is a classic "ill-posed" problem: how do you distinguish a thin white rain streak from a thin white architectural detail?

Recent research has turned to the frequency domain (using tools like the Discrete Wavelet Transform) because rain streaks often have distinct spectral signatures. However, the authors identify a major flaw in current frequency-aware models: they treat frequency subbands (like Low-Low, High-Low, etc.) as isolated silos.

In reality, rain artifacts and clean textures are correlated across multiple subbands. If a model processes these bands independently, it lacks the context needed to tell them apart. This leads to two common failures:

  1. Residual rain: Streaks that weren't fully captured in one band remain in the final image.
  2. Over-smoothing: The model mistakes fine details for rain and "washes" them away.

Methods

AFRNet uses a hierarchical encoder-decoder structure (similar to a U-Net) but replaces standard downsampling with Wavelet Transforms. The core innovation lies in two novel modules:

  • Adaptive Frequency Recombination Module (AFRM): Instead of processing the four wavelet subbands separately, AFRM uses a content-dependent mixing matrix to redistribute information across them. This allows a "degraded" subband to leverage complementary structural information from other bands before reconstruction.
  • Subband Compensation Block (SCB): During the decoding process, spatial details are often lost. SCB addresses this by using Inter-Subband Attention (ISA). Unlike standard spatial attention that compares pixels, ISA treats the four wavelet subbands as "tokens." It learns how to use high-resolution features from the encoder to compensate for degradation in the decoder's subbands.
  • AFRBlock: This is the spatial-side workhorse of the network. It combines depthwise convolutions (for local context) with a FourierUnit (for global feature mixing), ensuring the model captures both fine textures and large-scale structures.

Datasets

The authors evaluated AFRNet across a comprehensive suite of benchmarks:

  • Rain13K: A massive collection used for training, with testing on five standard sets (Test100, Rain100H/L, Test2800, Test1200).
  • Rain200L/H & SPA-Data: Benchmarks for light rain, heavy rain, and real-world rainy scenes.
  • RainDS: A specialized dataset for "compound" rain, including streaks (RS), raindrops (RD), and both (RDRS).
  • GoPro: Used to test the model’s transferability to image deblurring.

Key Insights and Ideas

  • Frequency Correlation is Key: The "aha moment" here is the realization that rain isn't just "high-frequency noise." It is a structured signal that spans across the spectral domain. By allowing bands to "talk" to each other, the model gains a much clearer picture of what is rain and what is background.
  • Efficiency through ISA: Spatial attention is computationally expensive ($O(N^2)$ relative to image size). By applying attention across the four subbands instead of pixels, the SCB provides global frequency context at a fraction of the computational cost.
  • Wavelets as an Interface: Using Wavelet Transforms (WT) for downsampling and Inverse Wavelet Transforms (IWT) for upsampling provides a natural mathematical framework for frequency manipulation, which is more principled than simple strided convolutions.

Key Results

AFRNet achieves top-tier performance while remaining remarkably lightweight:

  • Quantitative SOTA: On the Rain13K benchmark, the "Large" version (AFRNet-L) achieved an average PSNR of 31.88 dB, outperforming heavyweights like Restormer and AdaIR.
  • Compound Rain Mastery: On the RainDS dataset, it outperformed the previous best model (UDR-S2Former) by nearly 0.3 dB on compound rain (RDRS) tasks.
  • Parameter Efficiency: AFRNet-S uses only 2.46M parameters, making it roughly 10x smaller than models like Restormer (~26M params) while delivering better or comparable performance.
  • Generalization: When trained on the GoPro deblurring dataset, AFRNet achieved 33.57 dB PSNR, proving that its frequency-redistribution logic applies to other types of image degradation beyond just rain.

Limitations and Future Work

While AFRNet is highly effective, the authors note a few areas for growth:

  • Finer Partitions: The current model uses the standard four-subband wavelet decomposition. Exploring finer frequency partitions might allow for even more precise "routing" of information.
  • All-in-One Restoration: The researchers aim to extend this architecture to handle multiple weather degradations (fog, snow, rain) within a single model.
  • Hardware Optimization: While the GFLOPs are low, Fourier operations can sometimes be tricky to optimize for specific mobile or edge hardware; future work may focus on making these operations more "deployment-friendly."

Summary updated

Abstract

Image deraining aims to recover rain-free images from rain-degraded observations. Recent frequency-aware deraining methods have demonstrated promising performance by removing rain artifacts in the spectral domain. However, since rain artifacts and background textures often appear in several correlated subbands, prior frequency-domain deraining models still enhance frequency subbands separately. Such band-wise processing limits information exchange across subbands. Without context from other subbands, rain and clean content that appear together in one subband cannot be separated. This leads to either residual rain streaks or over-smoothing of fine details. To address this limitation, we propose AFRNet, an Adaptive Frequency Redistribution Network for image deraining. First, we introduce an Adaptive Frequency Recombination Module (AFRM) that performs cross-band modulation among wavelet subbands, enabling information interaction and adaptive recombination of degraded frequency components. We then develop a Subband Compensation Block (SCB) that compensates for decoder subband degradation by leveraging encoder subband features through inter-subband attention in the wavelet domain, alleviating detail loss during reconstruction. Extensive experiments demonstrate that AFRNet achieves competitive performance and consistent results across diverse deraining benchmarks.
BibTeX
@misc{zhang2026afrnet,
  author = {Dezhi Zhang and Shangrong Yang and Husheng Guo and Zhijie Shen and Wenjian Wang},
  title = {{AFRNet: Adaptive Frequency Redistribution Network for Image Deraining}},
  year = {2026},
  eprint = {2611.20522},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.20522},
}
Figure