Ship Target Identification via Bayesian-Transformer Neural Network

Zhan Kong, Yaqi Cui, Wei Xiong, Fucheng Yang, Zhenyu Xiong, Pingliang XuJournal of Marine Science and Engineering 2022 · DOI

TL;DR

This paper introduces a Bayesian-Transformer Neural Network (BTNN) for ship target identification using only trajectory data. The BTNN not only achieves higher accuracy in classifying nine ship types but also provides more reliable probability estimates, especially in noisy environments, by capturing both data uncertainty and model uncertainty.

What Problem Does This Paper Address?

Accurate ship target identification is crucial for both military surveillance and civilian maritime safety. Existing methods often struggle with limited target classes, require additional sensor data beyond tracks, or lack robust probability estimations, especially when dealing with noisy data. This can lead to misidentifications and potentially dangerous situations, particularly with the rise of autonomous vessels. The paper aims to improve ship identification accuracy and provide more trustworthy confidence scores by leveraging the rich temporal information within ship tracks.

Methods

The core innovation is the Bayesian-Transformer Neural Network (BTNN). It builds upon the Transformer architecture, known for its effectiveness in sequence modeling, by incorporating Bayesian principles.

  • Bayesian-Transformer Encoder (BTE) Module: This module is designed to extract discriminative features from track sequences. It uses a simplified Transformer encoder structure with multiple "Bayesian" multi-head attention layers. The "Bayesian" aspect means that the network's weights are not fixed but follow a probability distribution, allowing the model to express uncertainty.
  • Bayesian Fully Connected Layer and SoftMax: After feature extraction by the BTE modules, a Bayesian fully connected layer and a SoftMax function are used for classification and to output probability distributions.
  • Variational Inference (VI): The BTNN is trained using Variational Inference, a technique to approximate complex posterior distributions of the model's weights. This allows the model to learn distributions over weights rather than point estimates, enabling it to capture both aleatoric (data-inherent) and epistemic (model-inherent) uncertainties.

Datasets

The experiments were conducted using a subset of the European Automatic Identification System (AIS) dataset. This dataset covers a six-month period and includes ship positions. For this study, nine specific vessel types were selected: Fishing, Military Ops, SAR, Tug, Passenger, Cargo, Tanker, Pleasure Craft, and Other. The data was split into 80% for training and 20% for testing.

Key Insights and Ideas

  • Leveraging Track Data Alone: The paper demonstrates that rich ship classification information can be extracted solely from trajectory data, reducing reliance on other sensor modalities.
  • Bayesian Approach for Uncertainty: The integration of Bayesian principles is key. It allows the model to quantify its uncertainty, providing more reliable probability estimates. This is crucial for decision-making, especially in high-stakes scenarios where a model's confidence is as important as its prediction.
  • Transformer for Temporal Features: The Transformer architecture's ability to capture long-range dependencies in sequential data is well-suited for analyzing the complex motion patterns within ship tracks.
  • Improved Robustness to Noise: The Bayesian nature of the BTNN makes it more resilient to noisy track data, a common issue in real-world maritime environments.

Key Results

  • High Accuracy: The BTNN successfully identified nine types of ship targets with an accuracy of 93.96% on the test set. This represents a 3.8% increase compared to traditional methods, reaching an accuracy of 90.16%.
  • Reliable Probabilities: In high-noise environments, the BTNN provided significantly more reliable probability estimates than a non-Bayesian Transformer. Misclassified samples by BTNN tended to have lower predictive probabilities, indicating the model's uncertainty, whereas the non-Bayesian model often assigned high probabilities even to incorrect classifications.
  • Dimension Optimization: Experiments showed that higher dimensions for the encoder layer ($d_1$) and the final feature vector ($d_2$) generally led to better identification accuracy, with $d_1=10$ and $d_2=180$ being selected as optimal.

Limitations and Future Work

  • Data-Driven Nature: The BTNN, like other deep learning models, is data-driven and requires a substantial amount of historical data for training. The performance is highly dependent on the quality and quantity of the dataset.
  • Limited to Target Type: The current model can only predict the type of ship. It cannot provide more specific information about the ship's identity or other concrete details.
  • Future Work: The authors suggest combining this track-based identification method with other information sources to gain more comprehensive ship intelligence. They also highlight the importance of accumulating historical data and establishing robust datasets.

Summary updated

Abstract

Ship target identification is of great significance in both military and civilian fields. Many methods have been proposed to identify the targets using tracks information. However, most of existing studies can only identify two or three types of targets, and the accuracy of identification needs to be further improved. Meanwhile, they do not provide a reliable probability of the identification result under a high-noise environment. To address these issues, a Bayesian-Transformer Neural Network (BTNN) is proposed to complete the ship target identification task using tracks information. The aim of the research is improving the ability of ship target identification to enhance the maritime situation awareness and strengthen the protection of maritime traffic safety. Firstly, a Bayesian-Transformer Encoder (BTE) module that contains four different Bayesian-Transformer Encoders is used to extract discriminate features of tracks. Then, a Bayesian fully connected layer and a SoftMax layer complete the classification. Benefiting from the superiority of the Bayesian neural network, BTNN can provide a reliable probability of the result, which captures both aleatoric uncertainty and epistemic uncertainty. The experiments show that the proposed method can successfully identify nine types of ship targets. Compared with traditional methods, the identification accuracy of BTNN increases by 3.8% from 90.16%. In addition, compared with non-Bayesian Transformer Neural Network, the BTNN can provide a more reliable probability of the identification result under a high-noise environment.
BibTeX
@article{kong2022ship,
  author = {Zhan Kong and Yaqi Cui and Wei Xiong and Fucheng Yang and Zhenyu Xiong and Pingliang Xu},
  title = {{Ship Target Identification via Bayesian-Transformer Neural Network}},
  journal = {Journal of Marine Science and Engineering},
  year = {2022},
  doi = {10.3390/jmse10050577},
}
Figure