Abstract
Outdoor surveillance systems often suffer from reduced image clarity and object saliency due to fog and haze. Features extracted from foggy images—whether for human visual quality or machine-based object detection—differ significantly from those in clear images. This paper proposes an unsupervised prior-hybrid image feature-level enhancement network. By combining traditional atmospheric scattering models with a deep feature-level enhancement module, the system bridges the domain gap without requiring labeled foggy data. Experimental results on real-world datasets like RTTS and Foggy Driving Dense show significant improvements in both visual quality (50.83% increase in gradient ratio) and detection accuracy (6.40% increase in mAP), while maintaining real-time performance at 50 frames per second.
The Challenge of Foggy Surveillance
Outdoor surveillance systems frequently struggle with fog, mist, and haze. These conditions do not just make images look "blurry" to humans; they fundamentally alter the statistical distribution of pixels, affecting saturation, contrast, and contours. This creates a significant "domain gap": an object detector trained on clear images often fails when deployed in foggy environments because the features it relies on have been distorted.
The core challenge in addressing this is two-fold. First, there is a severe scarcity of paired data; it is nearly impossible to capture perfectly synchronized "foggy" and "clear" images of the same real-world scene for supervised training. Second, there is a disconnect between human and machine perception. Traditional dehazing methods focus on making images look good to the human eye, which does not always translate to better performance for automated detection algorithms like Faster R-CNN.
A Hybrid Unsupervised Methodology
To overcome these hurdles, the proposed method utilizes an unsupervised prior-hybrid network consisting of two main stages:
- Traditional Prior-Based Fog Inversion: Instead of relying solely on deep learning, the network uses an extended atmospheric scattering model. This module estimates transmission and illumination to perform an initial "coarse" dehazing. This provides a physically grounded starting point that stabilizes the subsequent learning process.
- Feature-Level Enhancement Module: This deep learning component, based on a Conditional Generative Adversarial Network (CGAN), treats the coarsely dehazed image as input and refines it. Unlike standard pixel-level enhancers, this module uses a target semantic discriminator to analyze domain differences at the feature level. This ensures that the enhanced image retains the specific textures and outlines that object detectors rely on.
Bridging the Feature Gap
A key insight of this research is that pixel-level improvement does not equal feature-level improvement. Improving the global contrast of an image can sometimes introduce artifacts that confuse a detector. By focusing on feature-level enhancement, the network prioritizes "machine-friendly" details like sharp edges and semantic consistency. The inclusion of a semantic discriminator essentially instructs the generator to not just make the image look clear, but to make it look like something a detector can recognize.
Experimental Results and Real-World Impact
The proposed method was evaluated against five state-of-the-art methods using benchmarks such as the RTTS (Real-world Task-driven Testing Set) and Foggy Driving Dense datasets. The results demonstrate a clear advantage:
- Detection Accuracy: On the RTTS dataset, the Mean Average Precision (mAP) improved by 6.40% and Recall by 7.79% compared to the next best algorithm.
- Visual Quality: The gradient ratio (R-value), measuring edge restoration, saw a massive average increase of 50.83%. The perceptual quality metric (IL-NIQE) improved by 6.33%.
- Efficiency: The system processes high-definition video at 50 frames per second (fps), making it highly viable for real-time surveillance and autonomous vehicle applications.
Conclusion and Future Directions
This hybrid approach successfully satisfies the dual requirements of human visual monitoring and automated cross-domain object detection in foggy weather. While the results are impressive, future work will focus on improving texture recovery in extremely dense fog and ensuring temporal consistency for smoother video processing. Extending this framework to handle other complex weather conditions, such as heavy rain or snow, remains a primary goal for future iterations.
Summary updated