Discovering Interpretable Semantics from Radio Signals for Contactless Cardiac Monitoring

Jinbo Chen, Haoyu Wang, Guixin Xu, Yuqin Yuan, Xiao‐Chuan Cai, Zhengwu Wei, Dongheng Zhang, Qibin Sun, Tianwei Zhang, Cuntai Guan, Yan ChenAdvanced 2026 · DOI

TL;DR

This paper introduces a novel framework for contactless cardiac monitoring using radio signals by learning interpretable "semantic" representations. By combining intra-modal signal compression with cross-modal alignment to ECG data, they achieve clinical-grade accuracy in heart rhythm monitoring and arrhythmia diagnosis, paving the way for more transparent and reliable remote healthcare.

What Problem Does This Paper Address?

Traditional cardiac monitoring methods often rely on physical contact (e.g., ECG electrodes), which can be uncomfortable and inconvenient for long-term use. Radio signals offer a promising alternative for contactless, operation-free monitoring, but a major hurdle has been the lack of "semantic understanding." This means that while radio signals can detect cardiac motion, interpreting these signals in clinically meaningful terms (like identifying specific heart conditions or rhythm abnormalities) has been challenging. Existing approaches often use black-box models or handcrafted features, lacking transparency and generalizability. This paper aims to bridge this gap by developing a method to extract interpretable semantic information from radio signals, making them clinically useful and trustworthy.

Methods

The core of the proposed method is a semantic representation framework based on the information bottleneck principle. The goal is to find a compressed representation of the radio signal that retains maximum information about the desired cardiac semantics while discarding irrelevant signal variations.

The framework has two key components:

  1. Intra-Modal Semantic Invariant Compression: This involves using a self-supervised approach where a neural encoder compresses the radio signal into a latent representation, and a decoder attempts to reconstruct the original signal. To ensure the latent space captures physiological semantics rather than just signal noise or propagation artifacts, they introduce signal transformations that simulate realistic variations and enforce consistency of the latent representations under these transformations.
  2. Cross-Modal Semantic Invariant Alignment: This component leverages the known relationship between electrical (ECG) and mechanical (radio signal) cardiac activity. They pre-train a variational autoencoder (VAE) on a large ECG dataset to create an "ECG semantic space." Then, they align the radio signal's latent representations with this pre-trained ECG semantic space. This cross-modal alignment acts as a semantic anchor, grounding the radio signal's representations in clinically understood cardiac semantics.

The learned semantic factors can be visualized in both radio and ECG domains, providing a dual-modality interpretability.

Datasets

  • Radio-ECG Paired Dataset: A large-scale dataset of 9518 outpatients with synchronized radio and 12-lead ECG recordings. This dataset was used for training and evaluating the core semantic modeling framework.
  • ECG-Only Dataset: A massive dataset of 85,669 ECG recordings from various public databases, used for pre-training the ECG semantic space.

Key Insights and Ideas

  • Semantics are Key to Trustworthy Remote Monitoring: The paper strongly argues that moving beyond raw signal processing to extracting interpretable semantic meaning is crucial for the clinical translation and adoption of contactless monitoring technologies.
  • Radio Signals Can Encode Rich Cardiac Information: Despite being a "noisy" modality compared to ECG, radio signals, when processed through this semantic framework, can reveal detailed cardiac dynamics.
  • Cross-Modal Alignment is Crucial: Aligning radio signal representations with a pre-trained ECG semantic space is shown to be the primary driver for achieving clinically meaningful semantics, far more so than just compressing the radio signal alone.
  • Interpretable Factors Enable Transparent Diagnosis: The learned semantic factors can be visualized and traced back to clinical concepts, allowing for a more transparent understanding of diagnostic outcomes, unlike traditional black-box models.
  • Daily-Life Monitoring is Feasible: The framework demonstrates robust performance in long-term, real-world daily-life monitoring scenarios, even with natural sleep patterns.

Key Results

  • Semantic Alignment: The learned semantic representations show strong alignment with ground truth semantics, with an average correlation of R = 0.885.
  • Heart Rhythm Monitoring: Achieved a median inter-beat interval (IBI) error of 9.4 ms, significantly outperforming previous radio-based methods by over 12-fold.
  • Arrhythmia Diagnosis:
    • Atrial Fibrillation (AF): F1 score of 0.929.
  • Premature Beats (PB): F1 score of 0.867. These results approach the performance of ECG-model-based methods.

  • Long-Term Monitoring: Demonstrated effectiveness in a 48-subject, 276-hour daily-life monitoring study, showing high correlations for HRV metrics (e.g., R=0.975 for HR) and successful detection of AF and PB events.

  • Robustness: The method shows good performance under mild to moderate body motion but degrades significantly with high-intensity motion.

Limitations and Future Work

  • Synchronized Data Requirement: The current cross-modal alignment requires synchronized radio-ECG pairs, which can be a practical limitation. Future work aims to develop asynchronous or weakly supervised methods.
  • ECG Semantic Space Quality: The performance is sensitive to the quality of the pre-trained ECG semantic space. Further research into advanced semantic modeling strategies for ECG is suggested.
  • Motion Artifacts: The framework's performance degrades under high-intensity body motion. While useful for low-motion states (like sleep), extending it to handle motion artifacts is a key area for future work.
  • Privacy Concerns: The paper acknowledges that contactless monitoring raises privacy issues, suggesting the need for safeguards like user authorization and signal-based identity verification.
  • Clinical Validation: Deeper cardiologist-in-the-loop studies are recommended to further assess clinical utility and practical boundaries.
  • Broader Applications: The authors envision extending the semantic framework for prospective validation across the entire clinical care continuum, from risk prediction to disease management.

Summary updated

Abstract

Radio signals have emerged as a promising modality for cardiac monitoring, enabling fully contactless and operation-free measurement. However, the lack of semantic understanding, i.e., the ability to interpret signal dynamics in clinically meaningful terms, remains a fundamental barrier to performance, interpretability, and clinical translation. Here, we introduce a semantic representation framework for radio-based cardiac monitoring, grounded in an information bottleneck formulation. Our approach leverages intrinsic semantic invariance in the signal by integrating intra-modal variability compression with cross-modal semantic alignment. This enables the transformation of radio measurements into a structured representation space where cardiac semantics are encoded in an interpretable and clinically meaningful manner. We validate the proposed framework on a large-scale cohort of 9518 outpatients. The learned semantic representations exhibit strong alignment with reference semantics. Building on these representations, our method achieves interpretable and clinical-grade cardiac monitoring, including heart rhythm monitoring with a median inter-beat interval error of 9.4 ms (95% CI: 9.3-9.6), and arrhythmia diagnosis for atrial fibrillation and premature beats, with F1 scores of 0.929 (95% CI: 0.906-0.948) and 0.867 (95% CI: 0.847-0.887), respectively. We also demonstrate the effectiveness of the proposed framework in practical long-term, daily-life deployment scenarios. These results highlight semantic representation as a key enabler for achieving reliable and transparent radio cardiac monitoring.
BibTeX
@inproceedings{chen2026discovering,
  author = {Jinbo Chen and Haoyu Wang and Guixin Xu and Yuqin Yuan and Xiao‐Chuan Cai and Zhengwu Wei and Dongheng Zhang and Qibin Sun and Tianwei Zhang and Cuntai Guan and Yan Chen},
  title = {{Discovering Interpretable Semantics from Radio Signals for Contactless Cardiac Monitoring}},
  booktitle = {Advanced},
  year = {2026},
  doi = {10.1002/advs.202524283},
}
Figure