PowerSkel: A Device-Free Framework Using CSI Signal for Human Skeleton Estimation in Power Station

Cunyi Yin, Xiren Miao, Jing Chen, Hao Jiang, Jianfei Yang, Yunjiao Zhou, Min Wu, Zhenghua Chen

Abstract

Safety monitoring in power stations is critical yet challenging due to harsh lighting, visual occlusions, and the impracticality of wearable devices. This paper presents PowerSkel, a novel device-free framework that leverages WiFi Channel State Information (CSI) to estimate human skeletal poses. By integrating low-cost ESP32-based mutual sensing networks with a specialized "CKDformer" neural network, PowerSkel achieves a high accuracy of 96.27% (PCK@50). The system is robust to electromagnetic interference through Sparse Adaptive Filtering (SAF) and maintains performance in total darkness, offering a cost-effective and privacy-preserving solution for industrial safety.

Introduction

Power stations represent high-stakes environments where real-time safety monitoring is essential. Traditional surveillance methods often fail: video cameras are limited by poor lighting and blind spots, while wearable sensors are often rejected by staff due to discomfort or safety risks. WiFi-based sensing has emerged as a promising alternative, using the perturbations in wireless signals caused by human movement to infer activity without requiring cameras or wearables. However, the high-interference electromagnetic environment of power stations poses significant challenges for existing WiFi sensing techniques.

The PowerSkel Framework

The authors propose PowerSkel, an end-to-end pipeline tailored for industrial power scenarios. The framework consists of three primary components: a mutual sensing network, a denoising algorithm, and a deep learning architecture for pose estimation.

The PowerSkel framework: from data acquisition with CSI sensors to pose estimation via the CKDformer.

Low-Cost Mutual Sensing Network

Instead of relying on expensive specialized hardware, PowerSkel utilizes custom-built sensors based on the ESP32 IoT chip. These nodes form a "mutual sniffing" network where each device functions as both a transmitter and a receiver. This configuration creates a dense web of signal paths, capturing a richer spatial representation of the environment compared to traditional one-to-one links.

Sparse Adaptive Filtering (SAF)

To mitigate the intense electromagnetic interference typical of power infrastructure, the Sparse Adaptive Filtering (SAF) algorithm was developed. SAF exploits signal sparsity to reconstruct clean CSI data, effectively removing noise before the signal is processed by the neural network.

CKDformer Architecture

The core of the pose estimation engine is the CKDformer. It utilizes a Conformer backbone—a hybrid architecture that integrates Convolutional Neural Networks (CNNs) for local feature extraction with Transformers for capturing global context. This dual capability is crucial for distinguishing fine-grained movements (e.g., operating a switch) from overall body posture.

The CKDformer architecture leverages collaborative knowledge distillation to refine pose estimation.

To further enhance performance, the system employs Collaborative Knowledge Distillation (CKD). During training, multiple "student" models share information, preventing the system from converging on the limitations of a single model and resulting in a more generalized mapping from CSI signals to 17 human skeletal keypoints.

Experimental Evaluation

The framework was evaluated in a real-world 10 kV power distribution room. Six participants performed various maintenance tasks, such as operating cabinet doors and moving handcarts. Ground truth skeletal coordinates were captured using a Kinect V2.0 camera. The resulting dataset comprised over 30,000 samples.

Key Results

PowerSkel demonstrates state-of-the-art performance in CSI-based pose estimation:

  • High Accuracy: The model achieved a 96.27% PCK@50, outperforming standard architectures like ResNet50 (92.45%) and ShuffleNet (89.99%).
  • Operational Efficiency: The system operates effectively at a sampling rate of 30 Hz, making it suitable for real-time deployment on low-power IoT hardware.
  • Cost-Effectiveness: By using ESP32-based nodes, the hardware cost is reduced to approximately $3 per node, significantly lower than industrial-grade alternatives.
  • Environmental Robustness: Unlike vision-based systems, PowerSkel maintains high precision in pitch-black conditions, as WiFi signals are independent of the visible spectrum.

Conclusion and Future Work

PowerSkel provides a robust, low-cost solution for device-free human pose estimation in complex industrial environments. While highly effective, the authors note that the system's reliance on Kinect for training labels introduces potential biases due to Kinect's own line-of-sight limitations. Future research will focus on improving label accuracy through multi-view setups and developing cross-domain adaptation techniques to allow the model to generalize to new environments without extensive retraining.

Summary updated

Abstract

Safety monitoring of power operations in power stations is crucial for preventing accidents and ensuring stable power supply. However, conventional methods such as wearable devices and video surveillance have limitations, such as high cost, dependence on light, and visual blind spots. WiFi-based human pose estimation is a suitable method for monitoring power operations due to its low cost, device-free, and robustness to various illumination conditions. In this article, a novel channel state information (CSI)-based pose estimation framework, namely, PowerSkel, is developed to address these challenges. PowerSkel utilizes self-developed CSI sensors to form a mutual sensing network and constructs a CSI acquisition scheme specialized for power scenarios. It significantly reduces the deployment cost and complexity compared to the existing solutions. To reduce interference with CSI in the electricity scenario, a sparse adaptive filtering algorithm is designed to preprocess the CSI. CKDformer, a knowledge distillation network based on collaborative learning and self-attention, is proposed to extract the features from CSI and establish the mapping relationship between CSI and keypoints. The experiments are conducted in a real-world power station, and the results show that the PowerSkel achieves high performance with a PCK@50 of 96.27% and realizes a significant visualization on pose estimation, even in dark environments. Our work provides a novel low-cost and high-precision pose estimation solution for power operation.
BibTeX
@article{yin2024powerskel,
  author = {Cunyi Yin and Xiren Miao and Jing Chen and Hao Jiang and Jianfei Yang and Yunjiao Zhou and Min Wu and Zhenghua Chen},
  title = {{PowerSkel: A Device-Free Framework Using CSI Signal for Human Skeleton Estimation in Power Station}},
  journal = {IEEE Internet of Things Journal},
  year = {2024},
  doi = {10.1109/jiot.2024.3369856},
}
Figure