Causal Localization Network for Radar Human Localization With Micro-Doppler Signature

Sunjae Yoon, Gwanhyeong Koo, Jun Yeop Shim, SooHwan Eom, Ji Woo Hong, Chang D. YooIEEE Access 2024 · DOI · OpenReview

Introduction

Traditional human identification systems rely heavily on visual cameras, which face limitations in low-light environments and pose significant privacy risks. Radar technology offers a compelling alternative, providing robust sensing capabilities that are inherently privacy-preserving. However, most existing Radar Human Identification (RHI) research focuses on "trimmed" data—short segments containing a single individual. In real-world scenarios, radar sensors capture continuous, "untrimmed" streams. This paper introduces the Radar Human Localization (RHL) task, which requires identifying both the identity and the temporal boundaries of a specific person within these continuous streams.

The Radar Human Localization (RHL) Task

The RHL task moves beyond simple classification to precise temporal pinpointing. Given an untrimmed micro-Doppler (MD) signature and a target identity, the system must determine exactly when that individual appears and disappears in the recording.

The Radar Human Localization (RHL) system identifies a specific target and its temporal boundaries within a continuous radar stream.

Understanding Micro-Doppler Signatures

The core data used for this task is the micro-Doppler signature. These signatures capture the unique frequency shifts caused by the movement of various body parts. For instance, the rapid swing of arms and legs creates distinct patterns compared to the slower, more rhythmic movement of the torso. These patterns serve as a "gait fingerprint" for identification.

Micro-Doppler signatures visualize the frequency shifts of various body parts over time, capturing unique gait characteristics.

The Causal Localization Network (CLNet)

To address the RHL task, the authors propose the Causal Localization Network (CLNet), which utilizes three specialized modules:

  • Patch-wise Doppler Encoding (PDE): This module uses a sliding window and CNN to extract features from MD signatures. A window size of approximately 3 seconds (45 frames) was found to be the "sweet spot" for capturing a full human gait cycle.
  • Target-guided Doppler Encoding (TDE): Since the system is looking for a specific person, it employs a Transformer-based attention mechanism to focus on signal components that match the target's gait characteristics.
  • Causal Localization Head (CLH): This module implements a sequential prediction strategy. It first predicts frame-level scores, then the start time, and finally uses both to determine the end time. This causal flow narrows the search space and stabilizes the training process.

Dataset: IDRad-TBA

Due to the lack of existing untrimmed radar datasets for localization, the researchers developed IDRad-TBA (Temporal Boundary Annotation). Built from the IDRad dataset, it contains 5,000 synthesized MD signatures. These were created by stitching together segments of real recordings using a gradual region-based method to ensure realistic transitions and prevent the model from learning artificial "seams."

Results and Key Findings

CLNet demonstrates a significant performance leap over traditional models adapted for localization. On the IDRad-TBA test set, CLNet achieved a Recall@1 (at IoU=0.7) of 13.20%, vastly outperforming a standard deep CNN baseline (2.31%). At a more relaxed threshold (IoU=0.3), the model reached 41.99% R@1, proving its effectiveness in locating targets within the data stream. Ablation studies confirmed that the causal prediction approach—predicting start time before end time—is vital for maintaining high localization precision.

Conclusion

The introduction of the RHL task and the CLNet architecture represents a significant step toward practical, privacy-preserving human monitoring using radar. While current work assumes a single person is visible at a time, future research will aim to extend these capabilities to multi-person environments and explore weakly-supervised learning techniques to reduce the need for expensive frame-by-frame temporal annotations.

Summary updated

Abstract

The Micro-Doppler (MD) signature includes unique characteristics from different-sized body parts such as arms, legs, and torso. Existing radar identification systems have attempted to classify human identification using these characteristics in MD signatures, achieving remarkable classification performance. However, we argue that radar identification systems should also be extended to perform more fine-grained tasks for greater identification flexibility. In this paper, we introduce the radar human localization (RHL) task, which involves temporally localizing human identifications within untrimmed MD signatures. To facilitate RHL, we have constructed a micro-Doppler dataset named IDRad-TBA. Additionally, we propose the Causal Localization Network (CLNet) as the baseline system for RHL, built on the IDRad-TBA dataset. CLNet utilizes a novel temporal causal prediction approach for MD signature localization. Experimental results demonstrate CLNet’s effectiveness in executing the RHL task. Our project is available at: https://github.com/dbstjswo505/CLNet .
BibTeX
@article{yoon2024causal,
  author = {Sunjae Yoon and Gwanhyeong Koo and Jun Yeop Shim and SooHwan Eom and Ji Woo Hong and Chang D. Yoo},
  title = {{Causal Localization Network for Radar Human Localization With Micro-Doppler Signature}},
  journal = {IEEE Access},
  year = {2024},
  doi = {10.1109/access.2024.3352022},
}
Figure