Multi-Task Learning-Enabled Automatic Vessel Draft Reading for Intelligent Maritime Surveillance

Jingxiang Qu, Ryan Wen Liu, Chenjie Zhao, Yu Guo, Sendren Sheng-Dong Xu, Fenghua Zhu, Yisheng Lv

Abstract

Accurate vessel draft reading (VDR) is essential for intelligent maritime surveillance, primarily to monitor ship loading and prevent overloading. While computer vision offers a cost-effective solution for estimating draft depth, traditional methods often struggle with low-quality imagery and high computational demands. This paper presents MTL-VDR, a multi-task learning framework designed for robust and real-time VDR. The system integrates draft mark detection, scale recognition, vessel/water segmentation, and adaptive depth estimation. By employing a shared backbone for simultaneous recognition and segmentation, and incorporating a rule-based correction module, MTL-VDR achieves high accuracy even under challenging conditions like stained hulls. Experimental results demonstrate superior performance, with a computational speed exceeding 40 FPS, meeting the requirements for real-time maritime safety monitoring.

Introduction

Vessel draft reading (VDR) measures the vertical distance between the waterline and the bottom of the hull, serving as the primary indicator of a ship's displacement and total load. In maritime surveillance, automated VDR is critical for identifying overloaded vessels that pose significant safety risks. However, automating this task is difficult due to environmental noise, such as hull corrosion, stains, varying lighting, and the dynamic nature of the waterline. Traditional automated approaches often process detection and segmentation as isolated, computationally expensive steps, which limits their utility for real-time applications.

The MTL-VDR Framework

The proposed MTL-VDR system streamlines the draft reading process into four distinct stages: initial detection, multi-task analysis, rule-based correction, and final depth estimation.

Overview of the Automatic Vessel Draft Reading (VDR) process, from image capturing to final depth estimation.
  1. Draft Mark Detection: The system first identifies the region of interest containing the draft marks using a customized YOLOv8 architecture.
  2. Multi-Task Learning (MTL) Subnet: This core component uses a shared backbone to perform two tasks in parallel: recognizing individual draft scales (digits and units) and segmenting the image into vessel and water regions.
  3. Spatial Distribution Correction: To handle obscured or damaged scales, a correction module applies physical rules—such as the standard 0.2m interval between scales—to validate and correct recognition results.
  4. Adaptive Depth Estimation: Finally, the system calculates the draft depth by geometrically relating the recognized scales to the segmented waterline.

Architecture and Methodology

The heart of MTL-VDR is its multi-task architecture, which balances efficiency and accuracy. By sharing a backbone (DarkNet-53), the model avoids redundant feature extraction for recognition and segmentation.

Detailed architecture of the MTL-VDR model, showing the shared backbone and parallel subnets for segmentation and detection.

To optimize this joint learning process, the authors utilize a dynamic loss weighting strategy based on homoscedastic uncertainty. This ensures that neither the detection task nor the segmentation task dominates the training. Furthermore, a specialized Mean Absolute Vertical Distance (MAVD) loss is introduced for the segmentation subnet. Unlike standard pixel-wise losses, MAVD focuses specifically on the accuracy of the water-vessel boundary, which is the most critical factor for precise depth estimation.

Robustness and Real-World Performance

One of the primary innovations of MTL-VDR is its ability to handle "dirty" data. In real-world maritime environments, draft scales are frequently stained by mud or rust. The system’s spatial correction module acts as a fail-safe; if the neural network misidentifies a digit, the module uses the vertical positions of surrounding, correctly identified scales to interpolate the true value. This physics-based prior prevents the "silly" mistakes common in pure deep learning models.

The performance was evaluated on a newly constructed VDR benchmark dataset containing over 2,200 images. MTL-VDR achieved a Mean Absolute Draft Depth Error (MADDE) of 0.074 meters, significantly outperforming traditional decoupled methods. Crucially, the system maintains an inference speed of approximately 60 FPS on mid-range hardware, making it highly suitable for deployment in live surveillance networks.

Conclusion

MTL-VDR represents a significant advancement in automated maritime surveillance. By integrating multi-task learning with physics-based priors, the system overcomes the limitations of traditional computer vision methods in challenging environments. Future work will focus on enhancing performance in low-visibility conditions like fog or night and adapting the system for the diverse unit systems and hull shapes found in international oceanic shipping.

Summary updated

Abstract

The accurate and efficient vessel draft reading (VDR) is an important component of intelligent maritime surveillance, which could be exploited to assist in judging whether the vessel is normally loaded or overloaded. The computer vision technique with an excellent price-to-performance ratio has become a popular medium to estimate vessel draft depth. However, the traditional estimation methods easily suffer from several limitations, such as sensitivity to low-quality images, high computational cost, etc. In this work, we propose a multi-task learning-enabled computational method (termed MTL-VDR) for generating highly reliable VDR. In particular, our MTL-VDR mainly consists of four components, i.e., draft mark detection, draft scale recognition, vessel/water segmentation, and final draft depth estimation. We first construct a benchmark dataset related to draft mark detection and employ a powerful and efficient convolutional neural network to accurately perform the detection task. The multi-task learning method is then proposed for simultaneous draft scale recognition and vessel/water segmentation. To obtain more robust VDR under complex conditions (e.g., damaged and stained scales, etc.), the accurate draft scales are generated by an automatic correction method, which is presented based on the spatial distribution rules of draft scales. Finally, an adaptive computational method is exploited to yield an accurate and robust draft depth. Extensive experiments have been implemented on the realistic dataset to compare our MTL-VDR with state-of-the-art methods. The results have demonstrated its superior performance in terms of accuracy, robustness, and efficiency. The computational speed exceeds 40 FPS, which satisfies the requirements of real-time maritime surveillance to guarantee vessel traffic safety.
BibTeX
@article{qu2024multi,
  author = {Jingxiang Qu and Ryan Wen Liu and Chenjie Zhao and Yu Guo and Sendren Sheng-Dong Xu and Fenghua Zhu and Yisheng Lv},
  title = {{Multi-Task Learning-Enabled Automatic Vessel Draft Reading for Intelligent Maritime Surveillance}},
  journal = {IEEE Trans. Intell. Transp. Syst.},
  year = {2024},
  url = {https://openreview.net/forum?id=fLTwdjsfWL},
}
Figure