Qualitative Action Recognition by Wireless Radio Signals in Human-Machine Systems

Shaohe Lv, Yong Lu, Mianxiong Dong, Xiaodong Wang, Yong Dou, Weihua Zhuang

Introduction

In human-machine systems, such as semi-autonomous driving, the quality of an action—the "how"—is often as critical as the action itself. While traditional systems focus on identifying what action occurred (e.g., braking), the WiQ system introduces a method for qualitative action recognition. By analyzing subtle fluctuations in narrowband wireless radio signals (Received Signal Strength, or RSS), WiQ can assess driving quality, identify individual drivers, and detect fatigue or distraction without the need for intrusive cameras or wearable sensors.

Methodology: The WiQ Architecture

The WiQ system is built upon three core pillars designed to extract physical motion characteristics from radio signal noise.

1. Gradient-Based Boundary Detection

To analyze an action, the system must first segment it from the continuous signal stream. WiQ employs a gradient-based method to identify sharp changes in signal strength that correspond to the initiation and completion of pedal movements.

RSS sequence and its corresponding gradient series used for boundary detection.

As shown in the figure above, the rate of change (gradient) in RSS serves as a virtual speedometer. High gradients correlate with rapid physical movements, allowing the system to distinguish between smooth and erratic actions. This insight allows a simple radio wave to act as a proxy for the physical speed of the driver's foot.

2. Deep Learning Engine

The segmented features—including duration, speed (gradients), and distance (signal range)—are fed into a five-layer Convolutional Neural Network (CNN) paired with a Normalized Multilayer Perceptron (NMLP). This engine learns the "signature" of different driving styles. The authors found that second-order statistics, like the variance of the gradient, were critical for reducing error rates by up to 14%.

3. Activity-Based Fusion

Recognizing isolated actions can be prone to error in noisy environments. WiQ improves robustness by treating driving as a sequence of actions, or an "activity."

Examples of individual actions and complex driving activities recognized by WiQ.

By fusing quality information across a sequence (e.g., a "Hill-Start" involving clutch release, brake release, and throttle pressing), the system achieves a more stable assessment of the driver’s state. This activity-based approach allows the system to maintain high performance even when individual action signals are degraded by noise.

Experimental Evaluation

The system was evaluated using a USRP N210 platform with 15 participants of varying experience levels (Novice to Experienced). The data scope included six specific pedal actions and five complex driving activities.

  • Body Status Recognition: WiQ achieved a 97% accuracy rate in distinguishing between normal driving, light distraction, and heavy distraction.
  • Driver Identification: The system successfully identified specific individuals from a pool of 15 with 88% average accuracy in high-SNR conditions. This demonstrates that driving "quality" acts as a biometric signature.
  • Robustness: Even in low-SNR environments (4-8 dB), activity-based fusion maintained identification accuracy at approximately 75%, significantly outperforming standard SVM or kNN approaches.

Conclusion

WiQ demonstrates that narrowband radio signals can provide high-fidelity qualitative data about human-machine interaction. By shifting the focus from "which" action to "how" it is performed, the system enables non-intrusive monitoring of driver fatigue, experience, and identity. While current implementations are offline, future work aims to address real-time constraints and environmental sensitivity to enable deployment in real-world vehicle cabins.

Summary updated

BibTeX
@article{lv2017qualitative,
  author = {Shaohe Lv and Yong Lu and Mianxiong Dong and Xiaodong Wang and Yong Dou and Weihua Zhuang},
  title = {{Qualitative Action Recognition by Wireless Radio Signals in Human-Machine Systems}},
  journal = {IEEE Trans. Hum. Mach. Syst.},
  year = {2017},
  doi = {10.1109/thms.2017.2693242},
}
Figure