Ship name text detection method with scene priors fusion

Bowei Chen, Yaohua Yi, Ziwei Tang, Jibing Peng, Aiguo YinJournal of Image and Graphics 2024 · DOI

TL;DR

Researchers have developed RS-DBNet, a specialized deep learning model that detects ship names by leveraging "scene priors"—specifically the spatial relationship between a ship's bow and its name. By combining a region supervision module with asymmetric convolutions, the system achieves a 94.2% F1-score on real-world imagery, significantly outperforming general-purpose text detection algorithms while maintaining real-time performance.

What Problem Does This Paper Address?

While Optical Character Recognition (OCR) has matured significantly for documents and street scenes, detecting text on ships remains a "wild west" challenge. The authors identify three primary hurdles:

  1. Extreme Scale Variation: Ship names can appear tiny on a massive cargo vessel or take up half the frame on a small fishing boat.
  2. Drastic Aspect Ratios: Unlike standard text, ship names are often stretched horizontally or vertically along the hull.
  3. Background Interference: Ships are covered in "distractor" text, such as company logos, safety warnings, or "POLICE" labels, which confuse standard models that lack context about where a ship's identity is actually located.

Existing natural scene text detectors (like DBNet or EAST) often fail here because they treat all text as equal, leading to high false-positive rates or missed detections in complex maritime environments.

Methods

The authors propose RS-DBNet, which builds upon the popular Differentiable Binarization Network (DBNet) but adds two novel components:

  • Regional Supervision (RS) Module: This is the "scene prior" core. Recognizing that ship names are almost always located near the bow, the researchers added an auxiliary task during training: detecting the ship's bow. By calculating a "scene prior loss," the model learns to focus its attention on the specific regions where names are likely to exist, effectively filtering out background noise like port signage or unrelated hull markings. Crucially, this module is only used during training, meaning it improves accuracy without slowing down the final inference speed.
  • Ship Name Region Localization (SNRL) Module: To handle the varied shapes of ship names, the authors replaced standard square convolution kernels with asymmetric convolutions (specifically 3x3, 1x3, and 3x1 kernels). This allows the model to better capture the edges of long, thin text blocks and makes it more robust to the perspective distortions common in maritime photography.
  • Backbone: The system uses a ResNet18 + Feature Pyramid Network (FPN) architecture to extract multi-scale features.

Datasets

The study introduces a new benchmark dataset: CBWLZ2023.

  • Composition: 1,659 high-resolution images of various vessels (fishing boats, passenger ships, cargo ships, and warships).
  • Environment: Captured in diverse real-world settings like busy waterways and ports with varying lighting and weather conditions.
  • Availability: The authors have made this dataset publicly available to encourage further research in maritime AI.

Key Insights and Ideas

  • Context is King: The most significant "aha moment" is treating the ship's structure as a landmark. By teaching the model that "names live near bows," the researchers solved the distractor text problem that plagues general OCR.
  • Asymmetry for Geometry: Standard 3x3 kernels are "jacks of all trades" but masters of none when it comes to extreme aspect ratios. Using 1x3 and 3x1 kernels specifically targets the horizontal and vertical features of text, providing sharper boundaries.
  • Zero-Cost Accuracy: Because the Regional Supervision module is a training-time constraint (auxiliary loss), the model gains "intelligence" about ship layouts without requiring extra computational power when deployed on a drone or port camera.

Key Results

The RS-DBNet was tested against eight state-of-the-art (SOTA) general text detectors:

  • Accuracy: Achieved an F1-score of 94.2%, a 2.8% improvement over the baseline DBNet and a 2.3% lead over the previous best-performing model (FCENet).
  • Precision and Recall: It reached a precision of 96.6% and a recall of 91.9%, showing a particularly strong ability to avoid "false alarms" from background text.
  • Speed: The model runs at 21.2 FPS (frames per second) on a standard GPU, making it suitable for real-time monitoring and autonomous navigation systems.
  • Qualitative Improvement: Visual results show the model successfully ignored "POLICE" and "COAST GUARD" markings that fooled other SOTA models, correctly identifying only the unique ship names.

Limitations and Future Work

While highly effective, the authors acknowledge a few areas for improvement:

  • Extreme Weather: The current dataset and model have not been extensively tested in heavy rain, thick fog, or pitch-black night conditions.
  • Unsupervised Learning: The current approach requires manual labeling of both ship names and bows. The authors suggest exploring unsupervised or semi-supervised methods to reduce the labeling burden as the dataset grows.
  • Dataset Expansion: Future work will involve expanding the CBWLZ2023 dataset to include more diverse environmental conditions and vessel types.

Summary updated

Abstract

目的船名文本信息是船舶身份识别的核心要素。真实场景船舶影像中文本区域尺度不一导致船名文本检测存在漏检等问题。同时,现有自然场景文本检测算法难以排除背景文本、图案等因素对船名检测任务的干扰。因此,针对以上问题提出一种融合场景先验的船名检测方法。方法首先,依据船首与船名目标关联性,提出一个基于先验损失的区域监督模块,以约束模型关注船名文本区域特征。然后,为了提高文本区域细粒度,提出一个基于非对称卷积的船名区域定位模块,增强文本区域边缘信息,进一步提高船名检测的召回率。结果本文收集、标注并公开发布了一个真实场景船名文本检测数据集CBWLZ2023进行实验验证,并与最新的8种通用自然场景文本检测方法进行比较。本文算法在船名文本检测任务上取得了94.2%的F1值,相比于性能第2的模型,F1值提高了2.3%;相比于基线模型,F1值提高了2.8%。同时在CBWLZ2023数据集中进行了参数分析实验及消融实验以验证算法各模块的有效性。实验结果证明提出的算法能准确获取边界清晰的文本区域,改善了船名文本检测的效果。结论本文提出的融合场景先验的船名检测模型,可以解决船名文本尺度不一、背景文本干扰带来的问题,在检测精度上超过了现有的场景文本检测算法,具有有效性与先进性。CBWLZ2023可由https://aistudio.baidu.com/aistudio/datasetdetail/224137获取。
BibTeX
@article{chen2024ship,
  author = {Bowei Chen and Yaohua Yi and Ziwei Tang and Jibing Peng and Aiguo Yin},
  title = {{Ship name text detection method with scene priors fusion}},
  journal = {Journal of Image and Graphics},
  year = {2024},
  doi = {10.11834/jig.230564},
}
Figure