HelmetPoser: A Helmet-Mounted IMU Dataset for Data-Driven Estimation of Human Head Motion in Diverse Conditions

Jianping Li, Qiutong Leng, Jinxing Liu, Xinhang Xu, Tongxin Jin, Muqing Cao, Thien-Minh Nguyen, Shenghai Yuan, Kun Cao, Lihua Xie

TL;DR

The HelmetPoser dataset provides high-frequency, head-mounted IMU data with millimeter-level ground truth to solve the problem of localization in "blind" environments like smoke-filled buildings. By using LSTM and Transformer networks to predict and correct IMU biases, the researchers achieved a staggering 90% reduction in integration error, even across different motion patterns and sensor types.

What Problem Does This Paper Address?

In emergency rescue, industrial construction, or mining, traditional localization methods like LiDAR-Inertial Odometry (LIO) and Visual-Inertial Odometry (VIO) often fail. Smoke, dust, and low-light conditions scatter LiDAR signals and obscure visual features, leaving the system "blind."

In these scenarios, the Inertial Measurement Unit (IMU) is the only reliable sensor because it doesn't depend on the environment. However, IMUs suffer from drift—small measurement errors that accumulate over time, leading to massive inaccuracies in position and orientation. While data-driven methods have been used to correct drift for robots and vehicles, human head motion is uniquely challenging: it is highly non-linear, high-frequency, and unpredictable. The authors address the lack of specialized datasets and robust models for this specific use case.

Fig. 1: HelmetPoser dataset for data-driven pose estimation of human head motion using IMU, especially for emergency conditions. The dataset is collected using the helmet plat- form with multiple IMUs with diverse motions and diverse persons. The millimeter-level ground truth is obtained using the VICON system.

Methods

The researchers developed a helmet-based platform equipped with two different IMUs (a low-cost ICM40609 and an industrial-grade VectorNav VN-100) and a Livox Mid 360 LiDAR.

To create a "ground truth" for IMU bias, they used a VICON motion capture system to track the helmet with millimeter precision. The core technical approach involves:

  1. Hand-Eye Calibration: Using Singular Value Decomposition (SVD) to align the helmet's coordinate system with the IMUs.
  2. Pre-integration for GT Bias: They integrated raw IMU measurements and compared them against the VICON ground truth to derive the exact bias values at every time step.
  3. Neural Network Correction: They trained two types of architectures—Long Short-Term Memory (LSTM) and Transformers—to ingest windows of raw IMU data and predict the current bias. These predicted biases are then used to correct the IMU integration in real-time.
Fig. 2: Sensor setup for the helmet system. (a) Side view; (b) Top view of the helmet including two IMUs at different levels.

Datasets

The authors introduced the HelmetPoser Dataset, which includes:

  • Participants: 10 individuals (5 male, 5 female) with varying heights and weights.
  • Activities: Walking, running, and stair climbing—chosen to represent common but distinct gait and head-motion patterns.
  • Format: ROSbag files containing data from three topics: /livox/imu, /vectorNAV/IMU, and /vicon/helmet.
  • Scale: Each participant completed three sessions, each lasting approximately five minutes.

Key Insights and Ideas

  • Bias vs. Pose: Instead of trying to predict the user's position directly (which is extremely difficult for a network to generalize), the models predict the IMU bias. This allows the system to leverage the physics of IMU integration while using AI to clean up the "noise."
  • Cross-Motion Generalization: One of the most significant findings was that a model trained only on "walking" data could still effectively reduce errors for "running" or "stair climbing." This suggests that head-motion noise patterns share underlying characteristics across different activities.
  • Cross-Sensor Adaptability: The models showed they could be trained on one IMU and still provide significant (though slightly reduced) benefits when applied to a completely different sensor model. This is crucial for hardware-agnostic deployment.
Fig. 3: LSTM architecture. An IMU data input Imj of size w (with m = j −w) and the previous bias bi are passed to the LSTM. The hidden state is preserved for the next inference step and the output is passed through a fully connected layer to predict a bias.

Key Results

  • Error Reduction: Both LSTM and Transformer models reduced the final integration error ($\Delta\alpha$) by over 90% on the primary test sets.
  • Window Flexibility: The models remained effective even when the input window was shortened from 16 seconds down to just 3 seconds, proving they can learn movement patterns very quickly.
  • Cross-Sensor Performance: When a model trained on the Livox IMU was tested on the VectorNav IMU, it still achieved an error reduction of over 50%, demonstrating impressive robustness.

Limitations and Future Work

While the results are promising, the authors note a performance drop when switching between different IMU hardware (from 90% to ~50-60% error reduction). This suggests that while the motion patterns generalize well, the sensor-specific noise profiles still play a significant role.

Future work could involve:

  • Expanding the dataset to include more extreme motions (e.g., crawling or jumping).
  • Developing "universal" models that require less fine-tuning when moving to new sensor hardware.
  • Integrating these corrected IMU streams back into full SLAM systems to see how much they improve overall trajectory estimation in zero-visibility environments.

Summary updated

Abstract

Helmet-mounted wearable positioning systems are crucial for enhancing safety and facilitating coordination in industrial, construction, and emergency rescue environments. These systems, including LiDAR-Inertial Odometry (LIO) and Visual-Inertial Odometry (VIO), often face challenges in localization due to adverse environmental conditions such as dust, smoke, and limited visual features. To address these limitations, we propose a novel head-mounted Inertial Measurement Unit (IMU) dataset with ground truth, aimed at advancing data-driven IMU pose estimation. Our dataset captures human head motion patterns using a helmet-mounted system, with data from ten participants performing various activities. We explore the application of neural networks, specifically Long Short-Term Memory (LSTM) and Transformer networks, to correct IMU biases and improve localization accuracy. Additionally, we evaluate the performance of these methods across different IMU data window dimensions, motion patterns, and sensor types. We release a publicly available dataset, demonstrate the feasibility of advanced neural network approaches for helmet-based localization, and provide evaluation metrics to establish a baseline for future studies in this field. Data and code can be found at https://lqiutong.github.io/HelmetPoser.github.io/.
BibTeX
@inproceedings{li2024helmetposer,
  author = {Jianping Li and Qiutong Leng and Jinxing Liu and Xinhang Xu and Tongxin Jin and Muqing Cao and Thien-Minh Nguyen and Shenghai Yuan and Kun Cao and Lihua Xie},
  title = {{HelmetPoser: A Helmet-Mounted IMU Dataset for Data-Driven Estimation of Human Head Motion in Diverse Conditions}},
  booktitle = {IEEE International Conference on Robotics and Automation},
  year = {2024},
  doi = {10.1109/icra55743.2025.11128564},
}
Figure