Introduction
Robust feature detection and description are fundamental to computer vision tasks such as Simultaneous Localization and Mapping (SLAM) and Structure-from-Motion (SfM). However, these systems frequently fail in extreme low-light environments where the signal-to-noise ratio (SNR) is exceptionally low. Traditional approaches typically employ a "denoise-then-detect" pipeline, utilizing heavy-duty denoising algorithms (e.g., BM3D or deep learning-based SID) before applying standard feature detectors like SIFT or SuperPoint.
These modular pipelines suffer from two primary drawbacks: high computational latency, which precludes real-time application, and the introduction of denoising artifacts that can lead to "ghost" keypoints. To address these challenges, we present DarkFeat, an end-to-end framework designed to detect and describe features directly from low-light RAW images.
Methodology
DarkFeat shifts the paradigm from hiding noise to learning robustness against it. The framework is built upon three core technical pillars:
Direct RAW Processing
Unlike standard RGB-based methods, DarkFeat operates on RAW sensor data. RAW images preserve the original bit depth and sensing information that is often discarded or distorted by a camera's internal Image Signal Processing (ISP) pipeline, providing a richer signal for feature extraction in dark scenes.
Noise-Robustness and Selective Suppression
The architecture, a modified L2-Net, utilizes a dual-branch training strategy with shared weights. One branch processes "normal" (clean) images while the other processes simulated noisy counterparts.
A key innovation is the Noise Robustness Map (R), a learned mask that identifies image regions where feature extraction remains reliable despite noise. This is coupled with a Selective Suppression Constraint, which enforces consistency between detection scores of noisy and clean images in "strong" feature regions while actively suppressing scores in noise-prone "weak" regions.
High-Fidelity Synthesis
To overcome the lack of large-scale RAW matching datasets, a synthesis pipeline was developed. It employs an invertible-ISP network to convert high-quality RGB datasets (like GL3D) back to RAW, followed by the injection of realistic, physics-based sensor noise calibrated for professional-grade sensors.
Experimental Results
DarkFeat was evaluated on the Matching In the Dark (MID) benchmark, which includes 108 real-world indoor and outdoor scenes captured under varying ISO and exposure settings.
Performance and Efficiency
DarkFeat demonstrates superior accuracy in camera pose estimation compared to state-of-the-art "denoise-then-detect" baselines. Crucially, by eliminating the separate denoising stage, DarkFeat achieves a 70% reduction in computational cost, running at approximately 13 FPS on standard hardware.
Qualitative Robustness
Visual comparisons highlight DarkFeat's ability to ignore noise patterns that typically mislead other detectors. While baselines often match spurious noise artifacts, DarkFeat consistently identifies the underlying structural landmarks of the scene, leading to significantly lower rotation and translation errors.
Conclusion and Future Work
DarkFeat represents the first end-to-end deep learning framework for direct feature extraction from low-light RAW images. By integrating noise handling into the detection process, it offers a high-performance, low-latency solution for autonomous systems operating in the dark. Future research will focus on improving sensor-agnostic generalization and addressing the challenges of combined extreme noise and high-speed motion blur.
Summary updated