RTDETR-MARD: A Multi-Scale Adaptive Real-Time Framework for Floating Waste Detection in Aquatic Environments

Baoshan Sun, Haiyang Tang, Liqing Gao, Kaiyu Bi, Jiabao WenJournal of Marine Science and Engineering 2025 · DOI

TL;DR

This paper introduces RTDETR-MARD, a novel real-time object detection framework designed for accurately identifying floating waste in aquatic environments. By enhancing feature aggregation, fusion, and localization with a multi-scale adaptive approach, it achieves state-of-the-art performance, crucial for effective environmental monitoring.

What Problem Does This Paper Address?

Floating waste, particularly plastics, poses a significant threat to aquatic ecosystems and human health. Detecting and removing this waste efficiently is vital, but current methods face challenges. Traditional manual methods are slow and costly. Modern technology-driven approaches, like those using unmanned surface vessels (USVs), struggle with:

  • Environmental Interference: Varying lighting, water surface fluctuations, reflections, and shadows make detection difficult.
  • Small Target Detection: Tiny waste items like plastic fragments are hard to spot.
  • Cost: Advanced monitoring systems can be expensive, limiting widespread deployment.
  • Robustness: Models need to perform reliably across diverse water conditions.

This paper aims to address these limitations by developing a more accurate, efficient, and robust real-time detection system for floating waste.

Methods

The RTDETR-MARD framework builds upon the RT-DETR (Real-Time Detection Transformer) architecture, introducing three key innovations:

  1. Hierarchical Multi-Scale Feature Integration (Gather-and-Distribute - GD): This mechanism enhances how features from different layers of the network are aggregated and interact. It aims to improve the representation of fine-grained spatial details.
  2. Advanced Feature Fusion Module: This module is composed of four sub-components:
  3. Feature Alignment Module (FAM): Standardizes feature maps from different resolutions to ensure they can be effectively combined.
  4. Information Fusion Module (IFM): Integrates features from multiple semantic levels to improve the recognition of targets at various scales.
  5. Information Injection Module (IIM): Uses an attention mechanism to inject global context from fused features into local features, significantly improving localization accuracy, especially for small objects.
  6. Scale Sequence Feature Fusion (S2F2M): A sequential fusion strategy that extracts scale-specific information by applying Gaussian smoothing and then uses 3D convolution to capture spatial variations.
  7. Wise-IoU Loss Function: Replaces the standard IoU loss with Wise-IoU (WIoUv1), which adaptively adjusts gradient contributions based on prediction quality. This helps to focus on high-quality anchor boxes and improve localization accuracy, particularly for small targets.

Datasets

The authors utilized two datasets for their experiments:

  • FloW Dataset: A specialized dataset for floating waste detection, containing images of a single category of floating waste.
  • Custom Water Surface Waste Dataset: A newly introduced dataset by the authors, featuring a diverse collection of annotated images for floating waste detection.

Key Insights and Ideas

  • The "Gather-and-Distribute" Mechanism is Key: The paper highlights how dynamically gathering and distributing features across different network levels is crucial for handling the scale variations inherent in floating waste detection.
  • Multi-Stage Fusion is Essential: Combining feature alignment, fusion, injection, and scale-specific processing (FAM, IFM, IIM, S2F2M) creates a robust pipeline that addresses both spatial and semantic challenges.
  • Wise-IoU for Precision: Adopting Wise-IoU significantly boosts localization accuracy by intelligently focusing on better-quality anchor boxes, a critical factor for detecting small, elusive waste items.
  • Transformer Advantage in Complex Environments: The paper argues that Transformer architectures, with their global self-attention, are better suited than traditional CNNs for handling the visual complexity (low contrast, irregular shapes, reflections) of aquatic environments.

Key Results

The RTDETR-MARD framework demonstrated strong performance:

  • FloW Dataset: Achieved 86.6% mAP50 at 96.8 FPS.
  • Custom Dataset: Achieved 49.2% mAP50 at 107.5 FPS.

These results represent state-of-the-art performance, surpassing existing models like YOLOv5, YOLOv8, and the baseline RTDETR in terms of accuracy, especially for small target detection, while maintaining high real-time inference speeds. Ablation studies showed that integrating the Feature Fusion Mechanism (FFM) and S2F2M, along with the WIoU loss, progressively improved mAP50.

Limitations and Future Work

The authors acknowledge the following limitations:

  • Offline Testing: The current study is limited to offline testing, and the model has not yet been deployed on fully autonomous platforms like USVs or low-power edge devices.
  • Potential for Compromise: Despite high robustness, performance can still be compromised by certain visual disturbances, such as reflections of large structures, dark plastic blending into backgrounds, or overcast lighting.

Future work directions include:

  • Embedded Systems Integration: Integrating RTDETR-MARD into embedded systems for real-time detection, onboard inference, and active intervention.
  • Mitigating Visual Disturbances: Exploring boundary-aware attention mechanisms and multi-frame temporal information to further improve robustness against visual interference.
  • Broader Applications: Extending the framework's promise to smart environmental governance, sustainable water management, and AI-assisted ecological restoration.

Summary updated

Abstract

Accurate and efficient detection of floating waste is crucial for environmental protection and aquatic ecosystem preservation, yet remains challenging due to environmental interference and the prevalence of small targets. To address these limitations, we propose a Multi-scale Adaptive Real-time Detector (RTDETR-MARD) based on RT-DETR that introduces three key innovations for improved floating waste detection using unmanned surface vessels (USVs). First, our hierarchical multi-scale feature integration leverages the gather-and-distribute mechanism to enhance feature aggregation and cross-layer interaction. Second, we develop an advanced feature fusion module incorporating feature alignment, Information Fusion, information injection, and Scale Sequence Feature Fusion components to ensure precise spatial alignment and semantic consistency. Third, we implement the Wise-IoU loss function to optimize localization accuracy through high-quality anchor supervision. Extensive experiments demonstrate the framework’s effectiveness, achieving state-of-the-art performance of 86.6% mAP50 at 96.8 FPS on the FloW dataset and 49.2% mAP50 at 107.5 FPS on our custom water surface waste dataset. These results confirm RTDETR-MARD’s superior accuracy, real-time capability, and robustness across diverse environmental conditions, making it particularly suitable for practical deployment in ecological monitoring systems where both speed and precision are critical requirements.
BibTeX
@article{sun2025rtdetr,
  author = {Baoshan Sun and Haiyang Tang and Liqing Gao and Kaiyu Bi and Jiabao Wen},
  title = {{RTDETR-MARD: A Multi-Scale Adaptive Real-Time Framework for Floating Waste Detection in Aquatic Environments}},
  journal = {Journal of Marine Science and Engineering},
  year = {2025},
  doi = {10.3390/jmse13050996},
}
Figure