NTIRE 2026 Low-light Enhancement: Twilight Cowboy Challenge

Aleksei Khalin, Egor Ershov, Artyom Panshin, Sergey Korchagin, Georgiy Lobarev, Arseniy Terekhin, Sofiia Dorogova, Amir Shamsutdinov, Yasin Mamedov, Bakhtiyar Khalfin, Bogdan Sheludko, Emil Zilyaev, Nikola Banić, Georgy Perevozchikov, Radu Timofte, Shuai Liu, Yuqian Zhang, Lize Zhang, Yibin Huang, Chaoyu Feng, Luyang Wang, Xiaotao Wang, Dongqing Zou, Lei Lei, Tianli Liu, Dejun Hao, Furkan Kınlı, Andrei Mironov, Alexander Dikov, Aleksei Sadokhin, Vladimir Zvorygin, Constantine Habarlak, Shuwei Yue, Egor Mirantsov, Daniil Okunev, Dmitry Arkhipov, Aleksandr Yugay, Anas M. Ali, Bilel Benjdira, Wadii Boulila, Wei Zhou, Linfeng Li, Lingdong Kong, Jiachen Tu, Guoyi Xu, Yaoxin Jiang, Jiajia Liu, Yaokun ShiarXiv 2026 · arXiv

TL;DR

The NTIRE 2026 Twilight Cowboy Challenge establishes a new state-of-the-art in burst-based low-light image enhancement by processing smartphone images directly in the RAW domain. By jointly tackling extreme sensor noise and geometric misalignment from hand tremors, the top competing methods achieve massive quality improvements, boosting peak signal-to-noise ratio (PSNR) by up to +6.49 dB over traditional baselines.

What Problem Does This Paper Address?

Taking high-quality photos in low-light conditions on a smartphone is a notorious engineering challenge. If you increase the exposure time to let in more light, any slight hand movement blurs the image. To circumvent this, modern smartphones use burst imaging: capturing a rapid sequence of short-exposure shots that are sharp but incredibly noisy.

The core problem is merging these noisy, misaligned frames into a single, clean image. While traditional pipelines perform denoising and frame alignment separately—often after converting the data into standard RGB images—this paper addresses joint motion compensation and denoising directly in the unprocessed Bayer/RAW domain. Operating in the RAW domain preserves authentic sensor statistics but introduces a much more complex inverse problem, as algorithms must remain robust against both extreme photon shot noise and geometric inconsistencies caused by natural hand tremors.

Methods

The paper provides a comprehensive review of the top-performing learning-based architectures designed by the challenge participants. Rather than introducing a single method, it highlights several novel strategies:

  • Dual-Ensemble Frameworks (MiAlgo, 1st Place): The winning solution combined model ensembling (Restormer, XRestormer, and NAFNet backbones) with 8-way geometric test-time augmentation (TTA). They utilized flow-guided deformable alignment to handle large inter-frame motion.
  • GAN-Driven Noise Simulation (DH ISP, 2nd Place): To prevent the network from learning alignment artifacts, this team extracted authentic sensor noise residuals and used a GAN to clone and transfer this realistic noise style onto clean ground-truth images for robust training.
  • Decoupled Normalization and Registration (BAU-Vision, 3rd Place): This pipeline separated global luminance correction (via a Gradient Boosting Regressor) from spatial alignment (using an exposure-invariant optical flow estimator called BetterSpyNet), followed by a Temporal Attention Fusion (TAF) mechanism to mask out misaligned regions.

Datasets

The challenge introduced the Twilight Cowboy Dataset, a new benchmark for low-light computational photography:

  • Size & Scope: 585 real-world scenes capturing both indoor low-light and outdoor nighttime environments.
  • Inputs: Each scene features a burst of 5 misaligned, short-exposure RAW images captured handheld.
  • Ground Truth: To create noise-free references, the organizers mounted smartphones on tripods to capture 270 frames per scene. These frames were intensity-aligned to eliminate external lighting variations (like passing car headlights) and averaged using robust pixel-level mean estimation.

Key Insights and Ideas

  • The Quality vs. Speed Trade-Off: There is a massive gap between benchmark-winning performance and practical deployment. The top-performing model achieved incredible clarity but took over 500 seconds per image, highlighting a critical need for optimization.
  • RAW-Domain Alignment is Crucial: Aligning frames directly on the Bayer mosaic prevents the amplification of demosaicing artifacts, which otherwise bloom into severe color distortions under extreme low-light conditions.
  • Data Cleaning is a Hidden Superpower: The winning team (MiAlgo) realized that the automated ground-truth generation process left subtle misalignments in about 25% of the dataset. Manually filtering out these imperfect pairs during a fine-tuning stage dramatically reduced pixel-shift artifacts in their final outputs.

Key Results

Ten teams successfully surpassed the challenge's established baseline (34.13 dB PSNR).

  • MiAlgo secured first place, reaching an impressive 40.62 dB PSNR and 0.9875 SSIM, though it suffered from an impractical inference time of 514.6 seconds per sample.
  • DH ISP achieved the best balance of performance and practical efficiency, delivering 40.23 dB PSNR in just 10.7 seconds.
  • ColorWorld stood out as the most lightweight architecture, processing samples in 4.7 seconds while maintaining a competitive 36.70 dB PSNR.

The stark trade-offs between computational runtime and reconstruction quality among the top entries are mapped out in Figure 1:

Figure 1. Comparison of mean PSNR scores and inference times per sample for participant solutions. Top-3 solutions are displayed with star markers.

Limitations and Future Work

Despite the impressive performance leaps, two main bottlenecks remain for real-world deployment:

  1. Computational Overhead: The top solutions rely heavily on massive multi-model ensembles and test-time augmentations. Future research must focus on distilling these heavy architectures into lightweight networks capable of running on mobile Neural Processing Units (NPUs) in milliseconds.
  2. Dynamic Scene Motion: While these methods excel at compensating for camera shake (hand tremors), they still struggle with fast-moving objects within the scene, which can cause ghosting artifacts during multi-frame fusion. Developing exposure-invariant, occlusion-aware temporal fusion modules remains an open avenue of research.

Summary updated

Abstract

This paper presents a review of the NTIRE 2026 Low-light Enhancement: Twilight Cowboy Challenge. The objective of the competition was to merge a set of misaligned smartphone images in the raw domain, captured in low-light conditions, into a single, clean image. Introduced setup simultaneously addresses two problems of low-light photography: visual degradations such as high noise and mixed scene illuminants, and the geometric inconsistencies caused by hand movement during multi-frame capture. To advance research in low-light and nighttime computational photography, a challenging dataset was collected comprising 585 real-world scenes, spanning indoor low-light and outdoor nighttime conditions, for training and benchmarking participant solutions. The competition employed a three-stage evaluation protocol: automatic validation via the CodaBench platform in stages one and two, followed by blind assessment on a private test set for the final ranking. Ten teams surpassed the established baseline, achieving improvements of up to +6.49 dB in PSNR and +0.0101 in SSIM, thereby establishing new state-of-the-art performance for burst-based low-light image enhancement. These results demonstrate significant progress in handling real-world noise, motion, and illumination variability in the low-light setting. Comprehensive results, leaderboards, and additional information are publicly available at https://nightimaging.org.
BibTeX
@misc{khalin2026ntire,
  author = {Aleksei Khalin and Egor Ershov and Artyom Panshin and Sergey Korchagin and Georgiy Lobarev and Arseniy Terekhin and Sofiia Dorogova and Amir Shamsutdinov and Yasin Mamedov and Bakhtiyar Khalfin and Bogdan Sheludko and Emil Zilyaev and Nikola Banić and Georgy Perevozchikov and Radu Timofte and Shuai Liu and Yuqian Zhang and Lize Zhang and Yibin Huang and Chaoyu Feng and Luyang Wang and Xiaotao Wang and Dongqing Zou and Lei Lei and Tianli Liu and Dejun Hao and Chunxia Lei and Furkan Kınlı and Andrei Mironov and Alexander Dikov and Aleksei Sadokhin and Vladimir Zvorygin and Constantine Habarlak and Shuwei Yue and Egor Mirantsov and Daniil Okunev and Dmitry Arkhipov and Aleksandr Yugay and Anas M. Ali and Bilel Benjdira and Wadii Boulila and Wei Zhou and Linfeng Li and Lingdong Kong and Jiachen Tu and Guoyi Xu and Yaoxin Jiang and Jiajia Liu and Yaokun Shi},
  title = {{NTIRE 2026 Low-light Enhancement: Twilight Cowboy Challenge}},
  year = {2026},
  eprint = {2608.09782},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2608.09782},
}
Figure