Implementation of an Efficient Image Transmission Algorithm for Unmanned Surface Vehicles Based on Semantic Communication

Yuanming Chen, Xiaobin Hong, Bin Cui, Rongfa PengJournal of Marine Science and Engineering 2023 · DOI

TL;DR

This paper introduces the SC-IRT algorithm, a novel semantic communication approach for transmitting images from Unmanned Surface Vehicles (USVs) in challenging maritime environments. By leveraging autoencoders for semantic encoding and Generative Adversarial Networks (GANs) for decoding, SC-IRT significantly reduces data transmission while preserving crucial image information for tasks like object detection, outperforming traditional methods in low-bandwidth and noisy conditions.

What Problem Does This Paper Address?

Unmanned Surface Vehicles (USVs) are increasingly deployed for various maritime tasks, relying heavily on visual image data for situational awareness and remote monitoring. However, the harsh marine environment presents significant challenges for image transmission, including poor signal quality, strong interference, and limited bandwidth. Traditional image compression and transmission methods struggle to meet the real-time and quality demands of USV operations, often leading to distorted images, data loss, and reduced effectiveness of downstream tasks like object detection. This paper aims to bridge this gap by developing an efficient image transmission algorithm tailored for USVs that prioritizes semantic information relevant to specific tasks.

Methods

The core of the proposed solution is the SC-IRT (Semantic Communication-Image Recognition Transmission) algorithm, which employs a semantic communication framework. This framework consists of two main components:

  • Semantic Encoder: This part utilizes an autoencoder network, specifically a Convolutional Neural Network (CNN)-based encoder, to compress input images into a low-dimensional latent semantic representation. This process effectively extracts task-relevant information (e.g., ships, buoys) while discarding irrelevant background details (sea, sky), thereby drastically reducing the amount of data to be transmitted. The encoder is followed by quantization and entropy coding to further compress the semantic information.
  • Semantic Decoder: A Generative Adversarial Network (GAN) is employed for decoding. The GAN's generator reconstructs high-quality images from the received semantic information, while its multi-scale discriminators ensure that the reconstructed images are visually similar to the original and retain semantic fidelity. This adversarial training approach is crucial for generating clear images even with limited transmitted data.

The algorithm is designed to be task-oriented, prioritizing semantic information critical for image recognition tasks.

Datasets

The SC-IRT algorithm was trained and evaluated on the Water Surface Object Detection and Recognition Dataset (WSODD). This dataset comprises 7476 images with 14 types of target objects and over 21,000 water surface instances, captured in diverse maritime conditions (oceans, lakes, rivers; various weather and time periods). The dataset was split into a 7:3 ratio for training (5233 images) and testing (2243 images). The images have a resolution of 1920 × 1080 pixels.

Key Insights and Ideas

  • Task-Oriented Semantic Compression is Key: The paper highlights that for applications like USV operations, compressing images based on their semantic relevance to a specific task (image recognition) is far more effective than generic compression. This allows for significant data reduction without sacrificing critical information.
  • GANs Excel at Semantic Reconstruction: The use of GANs in the decoder proves highly effective in reconstructing visually appealing and semantically accurate images from compressed latent representations, overcoming the limitations of traditional methods in low-bitrate scenarios.
  • Robustness in Challenging Environments: The SC-IRT algorithm demonstrates superior performance in low signal-to-noise ratio (SNR) and low compression ratio scenarios, which are characteristic of maritime communication. This resilience is a critical advantage for USV operations.
  • Balancing Compression and Quality: The SC-IRT algorithm strikes a better balance between compression ratio and image quality (measured by PSNR and SSIM) compared to traditional methods, especially at lower compression ratios.

Key Results

  • Image Quality: Compared to the BPG algorithm, SC-IRT achieved a compression ratio that was 51.6% of BPG's, while PSNR and SSIM values were 7.6% and 5.7% higher, respectively.
  • Object Detection Accuracy: Under low compression ratios (<0.02), SC-IRT maintained object detection accuracy above 0.7, significantly outperforming BPG and HiFIC. In low SNR conditions (<10 dB), SC-IRT also showed a marked advantage in detection accuracy.
  • Time Efficiency: The average total transmission time for SC-IRT was 58.46 ms, which is 59.4% of BPG's and 42.5% of JPEG's total time, indicating a substantial improvement in real-time performance.
  • Visual Effects: Visual comparisons showed that SC-IRT produced images with less noise and distortion, even at a lower compression ratio than other methods.

Limitations and Future Work

  • Dataset Limitations: The authors acknowledge that the experimental environment and dataset were limited in scope. The types of maritime targets and environmental conditions covered were not exhaustive.
  • Scenario Coverage: The experimental scenarios were not comprehensive enough, suggesting a need for further verification in more diverse situations.
  • Generalizing Semantic Knowledge: A key future research direction is to explore how to achieve semantic knowledge sharing across different intelligent tasks and diverse modal sources, moving beyond the current image recognition focus.
  • Expanding Datasets: Future work should focus on expanding the image dataset to include a wider variety of maritime targets and scenarios.
  • Broader Experimental Verification: More extensive experimental verification across a wider range of scenarios is needed.

Summary updated

Abstract

With the increasingly maturing technology of unmanned surface vehicles (USVs), their applications are becoming more and more widespread. In order to meet operational requirements in complex scenarios, the real-time interaction and linkage of a large amount of information is required between USVs, between USVs and mother ships, and between USVs and shore-based monitoring systems. Visual images are the main perceptual information gathered from USVs, and their efficient transmission and recognition directly affect the real-time performance of information exchange. However, poor maritime communication signals, strong channel interference, and low bandwidth pose great challenges to efficient image transmission. Traditional image transmission methods have difficulty meeting the real-time and image quality requirements of visual image transmissions from USVs. Therefore, this paper proposes an efficient method for visual image transmission from USVs based on semantic communication. A self-encoder network for semantic encoding which compresses the image into low-dimensional latent semantics through the encoding end, thereby preserving semantic information while greatly reducing the amount of data transmitted, is designed. On the other hand, a generative adversarial network is designed for semantic decoding. The decoding end decodes and reconstructs high-quality images from the semantic information transmitted through the channel, thereby improving the efficiency of image transmission. The experimental results show that the performance of the algorithm is significantly superior to traditional image transmission methods, achieving the best image quality while transmitting the minimum amount of data. Compared with the typical BPG algorithm, when the compression ratio of the proposed algorithm is 51.6% of that of the BPG algorithm, the PSNR and SSIM values are 7.6% and 5.7% higher than the BPG algorithm, respectively. And the average total time of the proposed algorithm is only 59.4% of that of the BPG algorithm.
BibTeX
@article{chen2023implementation,
  author = {Yuanming Chen and Xiaobin Hong and Bin Cui and Rongfa Peng},
  title = {{Implementation of an Efficient Image Transmission Algorithm for Unmanned Surface Vehicles Based on Semantic Communication}},
  journal = {Journal of Marine Science and Engineering},
  year = {2023},
  doi = {10.3390/jmse11122280},
}
Figure