Fast Fourier Color Constancy and Grayness Index for ISPA Illumination Estimation Challenge

Yanlin Qian, Ke Chen, Huanglin Yu

Introduction

Color constancy is a fundamental computer vision task that enables camera systems to estimate the intrinsic color of objects by discounting the effects of scene illumination. This process is the cornerstone of automatic white balance (AWB). While deep learning models have achieved impressive performance on traditional benchmarks like the Gehler-Shi and NUS 8-camera datasets, the ISPA Illumination Estimation Challenge introduced the Cube+ dataset, a significantly more demanding benchmark characterized by localized image patches and single-sensor consistency. This paper evaluates two contrasting approaches submitted to the challenge: a learning-based method (Fast Fourier Color Constancy) and a training-free statistical method (Grayness Index).

Methodology

The authors explored the performance spectrum by submitting two distinct algorithms:

  1. Fast Fourier Color Constancy (FFCC): This approach utilizes Barron’s Model P variant, which treats illumination estimation as a spatial localization problem in log-chroma space. By performing convolutions in the Fourier domain, FFCC achieves high computational efficiency. The model was enhanced for the challenge by incorporating deep features from a VGG-16 network (pretrained on Places365) and leveraging image EXIF metadata.
  2. Grayness Index (GI): In contrast, GI is a lightweight, learning-free statistical method. It operates on the assumption that illumination remains constant within local neighborhoods. By identifying nearly achromatic (gray) pixels using a Laplacian-of-Gaussian filter in the log domain, the algorithm estimates the global illuminant without requiring any training data.

The Cube+ Dataset Challenge

The Cube+ dataset consists of 1,707 images captured with a single Canon EOS 550D camera. Despite the lack of cross-sensor variance, the dataset is notoriously difficult due to its focus on localized patches that often lack sufficient color diversity.

Examples of challenging localized image patches from the Cube+ dataset.

A critical finding during the challenge was the sensitivity of learning-based models to metadata. The FFCC model relied heavily on EXIF data, which was withheld for the final undisclosed test set. Substituting missing values with training means led to a measurable performance drop, highlighting the fragility of metadata-dependent systems in blind-test scenarios.

Experimental Results

The evaluation on the undisclosed test set revealed a clear performance gap between the two methods. The FFCC (Model P) achieved a median angular error of 1.64, ranking 3rd in the challenge. The Grayness Index ranked 6th, with a median error of 2.10.

Performance comparison on the undisclosed testing data for the ISPA challenge.

Notably, the GI method exhibited a very high mean error (6.87) compared to its median. This discrepancy is attributed to "outlier" images—such as macro shots or monochromatic scenes—where the assumption of finding gray pixels fails completely. In these cases, the statistical approach produces extreme errors, whereas the learning-based FFCC model remains more robust.

Conclusion

The ISPA challenge demonstrates that the Cube+ dataset represents a new frontier in color constancy research, where models that excel on older benchmarks struggle to maintain low error rates. While learning-based methods like FFCC provide superior accuracy and robustness, their reliance on metadata can be a liability. Conversely, statistical methods like the Grayness Index offer simplicity and require no training, but they remain vulnerable to scenes with limited color variety. Future work will focus on integrating dichromatic cues into the Grayness Index to improve its performance on localized, color-skewed images.

Summary updated

Abstract

We briefly introduce two submissions to the Illumination Estimation Challenge, in the Int'l Workshop on Color Vision, affiliated to the 11th Int'l Symposium on Image and Signal Processing and Analysis. The Fourier-transform-based submission is ranked 3rd, and the statistical Gray-pixel-based one ranked 6th.
BibTeX
@inproceedings{qian2019fast,
  author = {Yanlin Qian and Ke Chen and Huanglin Yu},
  title = {{Fast Fourier Color Constancy and Grayness Index for ISPA Illumination Estimation Challenge}},
  booktitle = {ISPA},
  year = {2019},
  doi = {10.1109/ispa.2019.8868451},
}
Figure