Cycle-Interactive Generative Adversarial Network for Robust Unsupervised Low-Light Enhancement

Zhangkai Ni, Wenhan Yang, Hanli Wang, Shiqi Wang, Lin Ma, Sam Kwong

Introduction

Low-light image enhancement is a fundamental task in computer vision, aimed at improving the visibility of images captured in poorly lit environments. While supervised methods have achieved significant progress, they rely on paired datasets—perfectly aligned low-light and normal-light versions of the same scene—which are difficult to acquire and often fail to represent real-world noise distributions. Unsupervised methods, such as CycleGAN, offer a promising alternative by learning from unpaired data. However, standard unsupervised models often struggle with noise suppression and the complex "one-to-many" mapping between bright and dark scenes.

The CIGAN Framework

To address these challenges, the authors propose the Cycle-Interactive Generative Adversarial Network (CIGAN). Unlike traditional CycleGAN architectures where enhancement and degradation paths operate independently, CIGAN introduces an interactive mechanism where the two paths share information to improve overall robustness.

The CIGAN architecture featuring interactive enhancement (eGAN) and degradation (dGAN) paths.

The framework consists of two primary components:

  1. Enhancement GAN (eGAN): Learns to map low-light images to normal-light versions.
  2. Degradation GAN (dGAN): Learns to synthesize realistic low-light versions of normal-light images.

Technical Innovations

CIGAN incorporates several key modules to enhance performance:

  • Low-light Guided Transformation (LGT): This module transfers features from real low-light images to the dGAN, enabling it to synthesize more realistic illumination and contrast patterns.
  • Feature Randomized Perturbation (FRP): By injecting learnable random noise into the dGAN's feature space, the model is forced to generate realistic sensor noise. This, in turn, trains the eGAN to become a more effective denoiser.
  • Dual Attention Module (DAM): Integrated into the generators, DAM captures both spatial and channel-wise context, allowing the model to focus on critical image regions.
  • Multi-scale Feature Pyramid Discriminator (MFPD): This discriminator evaluates images at multiple scales to ensure both fine-grained textures and global structural consistency.
  • Logarithmic Image Processing (LIP) Fusion: A stable fusion model used in the eGAN to combine input and generated features effectively.

Experimental Evaluation

CIGAN was evaluated on the LOL (Low-Light) dataset. For training, the authors used an unpaired setup consisting of 1,000 images to demonstrate the model's unsupervised capabilities.

Quantitative Results

CIGAN achieved state-of-the-art performance for unsupervised enhancement, reaching a PSNR of 19.89 and an SSIM of 0.7817. These metrics surpass other leading unsupervised methods like ZeroDCE (PSNR 18.07) and EnlightenGAN (PSNR 18.23), and even rival some supervised approaches.

Qualitative Results

Visual comparisons demonstrate that CIGAN produces images with more natural color reproduction, superior contrast, and significantly reduced noise compared to existing methods.

Qualitative comparison of CIGAN against SICE and ZeroDCE, highlighting superior noise suppression and illumination restoration.

Conclusion

CIGAN represents a significant step forward in unsupervised low-light enhancement. By explicitly modeling the degradation process through an interactive cycle-GAN approach and synthesizing realistic noise, the framework achieves robust restoration of dark, noisy images without the need for paired training data. This interactive paradigm suggests that improving the "inverse" task (degradation) is a powerful strategy for enhancing the primary task (restoration).

Summary updated

Abstract

Getting rid of the fundamental limitations in fitting to the paired training data, recent unsupervised low-light enhancement methods excel in adjusting illumination and contrast of images. However, for unsupervised low light enhancement, the remaining noise suppression issue due to the lacking of supervision of detailed signal largely impedes the wide deployment of these methods in real-world applications. Herein, we propose a novel Cycle-Interactive Generative Adversarial Network (CIGAN) for unsupervised low-light image enhancement, which is capable of not only better transferring illumination distributions between low/normal-light images but also manipulating detailed signals between two domains, e.g., suppressing/synthesizing realistic noise in the cyclic enhancement/degradation process. In particular, the proposed low-light guided transformation feed-forwards the features of low-light images from the generator of enhancement GAN (eGAN) into the generator of degradation GAN (dGAN). With the learned information of real low-light images, dGAN can synthesize more realistic diverse illumination and contrast in low-light images. Moreover, the feature randomized perturbation module in dGAN learns to increase the feature randomness to produce diverse feature distributions, persuading the synthesized low-light images to contain realistic noise. Extensive experiments demonstrate both the superiority of the proposed method and the effectiveness of each module in CIGAN.
BibTeX
@inproceedings{ni2022cycle,
  author = {Zhangkai Ni and Wenhan Yang and Hanli Wang and Shiqi Wang and Lin Ma and Sam Kwong},
  title = {{Cycle-Interactive Generative Adversarial Network for Robust Unsupervised Low-Light Enhancement}},
  booktitle = {ACM Multimedia},
  year = {2022},
  url = {https://openreview.net/forum?id=eC-F6mLTUXo},
}
Figure