Topology Data Analysis-based Error Detection for Semantic Image Transmission with Incremental Knowledge-based HARQ

Fei Ni, Rongpeng Li, Zhifeng Zhao, Honggang ZhangChina 2024 · DOI · OpenReview

TL;DR

This paper introduces SC-TDA-HARQ, a novel framework for semantic image transmission that combines Swin Transformers for image encoding with Topological Data Analysis (TDA) for robust error detection. By leveraging TDA to understand the intrinsic geometric and topological features of images, the system can more accurately detect semantic errors and decide when re-transmission is necessary, leading to improved image quality and efficiency, especially under challenging channel conditions.

What Problem Does This Paper Address?

Semantic communication (SemCom) aims to transmit the meaning of information rather than raw bits, promising efficient data delivery. However, SemCom systems, particularly for images, struggle with channel volatility. Traditional re-transmission mechanisms like HARQ are crucial, but simply checking for bit errors isn't enough for semantic accuracy. Existing semantic HARQ (IK-HARQ) methods often rely on simple similarity metrics that are too rigid for image data. This paper addresses the challenge of accurately detecting semantic errors in images transmitted over unreliable channels, which is critical for SemCom's practical deployment, especially in bandwidth-constrained scenarios.

Methods

The proposed SC-TDA-HARQ framework builds upon several key components:

  • Swin Transformer-based Joint Source-Channel Coding (JSCC): This forms the core of the semantic encoder and decoder, leveraging the power of Swin Transformers for effective feature extraction and reconstruction of images.
  • Incremental Knowledge-based HARQ (IK-HARQ): Instead of discarding previously transmitted but potentially corrupted data, IK-HARQ reuses this information as "incremental knowledge" to aid in decoding subsequent transmissions. This is crucial for SemCom where semantic accuracy is paramount.
  • Topological Data Analysis (TDA) for Error Detection: This is the paper's main innovation. Instead of traditional bit-level checks (like CRC) or simple similarity metrics, TDA is used to analyze the intrinsic topological and geometric properties of images. This involves:
  • TDA Encoder: Extracts topological features from images using techniques like height and radial filtration, generating persistence barcodes (PB) and persistence diagrams (PD). These PDs are then vectorized into "persistence signatures" using metrics like Wasserstein amplitude, Bottleneck distance, Betti curve, persistence landscape, heat kernel, and persistent entropy.
  • TDA-based Decision Network: At the receiver, the TDA features of the reconstructed image are compared with those of the original (or previously transmitted) image. This comparison, facilitated by a TDA decoder and a decision network (implemented using a VGG16 model), determines if a semantic error has occurred and if re-transmission is needed. This approach is more robust to semantic ambiguity than prior methods.

Datasets

  • CIFAR10: Used for training and testing lower-resolution images.
  • DIV2K: Used for training high-resolution images.
  • Kodak: Used for testing high-resolution images.

Key Insights and Ideas

  • TDA for Semantic Robustness: The core insight is that TDA can capture subtle, high-level topological and geometric features of images that are more indicative of semantic content than simple pixel-wise similarity. This makes it a powerful tool for detecting semantic errors, even when individual pixels might be slightly corrupted.
  • IK-HARQ + TDA Synergy: Combining IK-HARQ with TDA-based error detection creates a powerful system. IK-HARQ ensures that information is not lost, while TDA provides a more intelligent way to decide when that information needs to be re-transmitted, leading to a significant boost in efficiency and accuracy.
  • Efficiency of Reduced TDA Features: The research found that using a reduced set of TDA features (28 dimensions) could achieve comparable PSNR performance to using the full set (476 dimensions), highlighting the efficiency of the TDA approach.
  • TDA's Advantage in Low SNR/High Compression: The TDA-based error detection proved particularly beneficial in challenging scenarios, such as low Signal-to-Noise Ratios (SNR) and high compression rates, where traditional methods struggle.

Key Results

  • Improved Performance: SC-TDA-HARQ consistently outperformed conventional SemCom schemes (like Deep JSCC and WITT) and separation-based methods (BPG+LDPC) in terms of PSNR and MS-SSIM across various SNRs and compression rates.
  • Significant Gains in Low-Resource Scenarios: The framework showed substantial performance gains, especially under low SNR and high compression rates, demonstrating its effectiveness in bandwidth-constrained environments.
  • Visual Quality: Qualitative results on the Kodak dataset showed that SC-TDA-HARQ avoided block artifacts and produced higher fidelity textures and details compared to other methods.
  • Efficiency: The TDA-based decision-making approach was significantly faster than alternative TDA computation methods, with a running time of 0.113s compared to 5.6h for TDA-Recovery vs. TDA-Computation approaches, respectively.

Limitations and Future Work

  • Computational Cost of TDA: While the paper proposes an efficient TDA-based decision network, the initial computation of TDA features can still be time-consuming. The authors suggest investigating more efficient means to compute TDA for future work.
  • Further Optimization: The paper indicates that with sufficient length of check bits, substantial performance improvements can be anticipated, suggesting further exploration of optimal parameter tuning.
  • Broader Applications: While focused on image transmission, the principles of TDA-based semantic error detection could potentially be extended to other data modalities.

Summary updated

Abstract

Semantic communication (SemCom) aims to achieve high fidelity information delivery under low communication consumption by only guaranteeing semantic accuracy. Nevertheless, semantic communication still suffers from unexpected channel volatility and thus developing a re-transmission mechanism (e.g., hybrid automatic repeat request [HARQ]) is indispensable. In that regard, instead of discarding previously transmitted information, the incremental knowledge-based HARQ (IK-HARQ) is deemed as a more effective mechanism that could sufficiently utilize the information semantics. However, considering the possible existence of semantic ambiguity in image transmission, a simple bit-level cyclic redundancy check (CRC) might compromise the performance of IK-HARQ. Therefore, it emerges a strong incentive to revolutionize the CRC mechanism, so as to reap the benefits of both SemCom and HARQ. In this paper, built on top of swin transformer-based joint source-channel coding (JSCC) and IK-HARQ, we propose a semantic image transmission framework SC-TDA-HARQ. In particular, different from the conventional CRC, we introduce a topological data analysis (TDA)-based error detection method, which capably digs out the inner topological and geometric information of images, so as to capture semantic information and determine the necessity for re-transmission. Extensive numerical results validate the effectiveness and efficiency of the proposed SC-TDA-HARQ framework, especially under the limited bandwidth condition, and manifest the superiority of TDA-based error detection method in image transmission.
BibTeX
@inproceedings{ni2024topology,
  author = {Fei Ni and Rongpeng Li and Zhifeng Zhao and Honggang Zhang},
  title = {{Topology Data Analysis-based Error Detection for Semantic Image Transmission with Incremental Knowledge-based HARQ}},
  booktitle = {China},
  year = {2024},
  doi = {10.23919/jcc.fa.2023-0799.202501},
}
Figure