Underwater Object Detection Enhancement via Channel Stabilization

Muhammad Ali, Salman Khan2022 · arXiv

TL;DR

This paper tackles the challenge of underwater object detection, particularly for marine debris, by introducing a novel image enhancement technique called "Channel Stabilization." This method, combined with standard object detection frameworks like Detectron2, significantly improves detection accuracy, especially for small objects, by reducing haze and color cast in underwater imagery.

What Problem Does This Paper Address?

The marine environment presents a formidable challenge for object detection due to factors like haze, color distortion (often a blue cast), and varying light conditions. This makes it difficult to accurately identify and locate objects, especially marine debris, which poses a significant threat to ecosystems and human well-being. Existing object detection models, while powerful, often struggle with the unique visual characteristics of underwater scenes. The paper aims to bridge this gap by developing an image enhancement strategy that specifically addresses these underwater visual challenges, thereby boosting the performance of existing detection systems.

Methods

The core of the paper's contribution lies in its image enhancement approach. It begins with a simplified image enhancement model (IEM) that utilizes LAB-stretching and global stretching to address color cast and improve brightness. Following this, the novel Channel Stabilization module is introduced. This module makes assumptions about the typical color distribution in underwater images (blue channel dominance, red channel scarcity) and applies a proportionality scaling factor to refactor these channels, aiming to standardize color quality and reduce dominance of any single color.

Additionally, the authors incorporate a sharpening filter to enhance object contours and edges, making them more discernible. This is applied after the channel stabilization. Data augmentation techniques, such as horizontal flipping and a "broken mirror" method, are also employed to improve model robustness and prevent overfitting. The enhanced images are then fed into the Detectron2 framework, where various backbones (RetinaNet, Faster R-CNN) are evaluated.

Datasets

The primary dataset used for training and evaluation is the TrashCan 1.0 dataset. This dataset is available in two versions:

  • Instance-version: Focuses on individual object instances.
  • Material-version: Categorizes objects by their material.

The paper also mentions benchmarking their approach on other datasets for domain generalization, including UAVVaste, TACO, and UODD.

Key Insights and Ideas

  • Underwater images are inherently "blue-biased": The paper leverages the physical properties of light absorption and scattering in water, which typically result in a blue cast and reduced red light, to inform their channel stabilization strategy.
  • Channel stabilization is key: By actively refactoring color channels to counteract the typical underwater bias, the method significantly improves the visibility and detectability of objects.
  • Simple enhancements yield significant gains: The proposed methods are relatively simple and computationally efficient, yet they achieve substantial improvements in detection accuracy, demonstrating that complex models aren't always necessary for challenging domains.
  • Small objects benefit the most: The enhancement techniques prove particularly effective for detecting small-sized objects, which are often the most challenging to identify in underwater imagery.

Key Results

The proposed method, when integrated with Detectron2 and the RetinaNet backbone, demonstrates significant improvements:

  • Instance-version of TrashCan 1.0: Achieved a 9.53% absolute increase in average precision (AP) for small objects and a 7% absolute gain in bounding box AP compared to the baseline.
  • Material-version of TrashCan 1.0: Showed a 5.39% increase in accuracy for small objects.
  • Overall performance: The paper consistently shows improvements across various metrics (AP, AP50, AP75, APS, APM, APL) for both material and instance versions of the TrashCan dataset when compared to baseline methods and even other state-of-the-art approaches like Faster R-CNN and Deformable Transformer. For instance, their approach with RetinaNet achieved an AP of 44.03 on the instance dataset, outperforming the baseline (34.54) and Faster R-CNN (38.51).

Qualitatively, the paper presents sample images showing a clear visual improvement in clarity and color restoration after applying their enhancement and stabilization techniques.

Limitations and Future Work

  • Limitations: The authors acknowledge that their method faces some difficulty in predicting objects with very dull colors. While visually appealing, background removal techniques, when combined with their enhancement, sometimes degraded mAP scores. They also note that some augmentation combinations can degrade performance, especially in dark or night images.
  • Future Work: The paper suggests exploring better combinations of augmentation techniques along with their image enhancement method to potentially achieve even better results. They also mention that further investigation into domain generalization and performance on night images could be beneficial.

Summary updated

Abstract

The complex marine environment exacerbates the challenges of object Abstract-The complex marine environment exacerbates the challenges of object detection manifold. With the advent of the modern era, marine trash presents a danger to the aquatic ecosystem, and it has always been challenging to address this issue with complete grip. Therefore, there is a significant need to precisely detect marine deposits and locate them accurately in challenging aquatic surroundings. To ensure the safety of the marine environment caused by waste, the deployment of underwater object detection is a crucial tool to mitigate the harm of such waste. Our work explains the image enhancement strategies used and experiments exploring the best detection obtained after applying these methods. Specifically, we evaluate Detectron 2's backbones performance using different base models and configurations for the underwater detection task. We first propose a channel stabilization technique on top of a simplified image enhancement model to help reduce haze and colour cast in training images. The proposed procedure shows improved results on multi-scale size objects present in the data set. After processing the images, we explore various backbones in Detectron2 to give the best detection accuracy for these images. In addition, we use a sharpening filter with augmentation techniques. This highlights the profile of the object which helps us recognize it easily. We demonstrate our results by verifying these on TrashCan Data set, both instance and material version. We then explore the best-performing backbone method for this setting. We apply our channel stabilization and augmentation methods to the best-performing technique. We also compare our detection results from Detectron2 using the best backbones with those from Deformable Transformer. The detection result for small size objects in the Instance-version of TRASHCAN 1.0 gives us a 9.53box we get the absolute gain of 7to the baseline.
BibTeX
@misc{ali2022underwater,
  author = {Muhammad Ali and Salman Khan},
  title = {{Underwater Object Detection Enhancement via Channel Stabilization}},
  year = {2022},
  eprint = {2408.01293},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2408.01293},
}
Figure