HeadIO: Body-Frame Heading Decomposition for Neural Inertial Odometry on Head-Mounted Devices

Taeyoung Yeon, Yiquan Li, Chenfeng Gao, Vasco Xu, Karan AhujaarXiv 2026 · arXiv

TL;DR

HeadIO is a lightweight neural inertial odometry (IO) framework designed specifically for head-mounted devices like VR headsets and smart glasses. By using a novel analytical "body-frame heading decomposition," it achieves state-of-the-art tracking accuracy with 8x fewer parameters and 3x less compute than previous leading methods.

What Problem Does This Paper Address?

Tracking a user's position using only an Inertial Measurement Unit (IMU)—accelerometers and gyroscopes—is a "holy grail" for lightweight wearables like AR glasses or earbuds where cameras are too power-hungry or privacy-invasive. However, neural IO faces two major hurdles:

  1. Heading Ambiguity: IMUs cannot "see" the world, making the absolute heading (yaw) unobservable. Humans can walk forward while looking sideways, decoupling motion from gaze.
  2. Tilt Variance: In a device-centric (body) frame, gravity "leaks" into different sensor axes as the user tilts their head. The same physical motion produces different signal patterns at different head angles, forcing neural networks to waste capacity learning these variations.

Prior SOTA methods like EqNIO use expensive "Vector Neuron" layers to learn these invariances. HeadIO argues that we don't need heavy neural machinery if we fix the input representation first.

Methods

The core of HeadIO is a Body-Frame Heading Decomposition. Instead of letting a network learn to handle tilts, the authors use a lightweight analytical preprocessing step:

  • Gravity-Horizontal Separation: Using the device's estimated tilt, the raw IMU signals are projected into a gravity-aligned vertical component and a horizontal remainder.
  • Heading-Invariant Basis: They project the wearer's gaze direction onto the horizontal plane to create a stable coordinate system that moves with the head but stays aligned with gravity.

This makes the input data both heading-invariant (the same regardless of which way you face) and tilt-invariant (the same regardless of head pitch/roll).

Fig. 1: Invariance properties of the body-frame heading decomposition. (a) Body-frame IMU inputs are heading-invariant: the same walking motion produces identical IMU readings regardless of which direction the user faces. (b) Our heading decomposition additionally achieves tilt invariance: as the head pitches or rolls, the gravity-aligned basis adapts so that the forward, lateral, and vertical components remain consistent across head orientations.

For the "brain" of the system, they pair this decomposition with a bidirectional Mamba backbone. Mamba is a modern state-space model that handles long sequences efficiently. Interestingly, the authors found Mamba performed worse than standard ResNets on traditional inputs, but became SOTA once paired with their new decomposition.

Datasets

The authors evaluated HeadIO on four diverse head-mounted datasets:

  • Nymeria: The largest benchmark, featuring 300 hours of diverse daily activities (athletic motion, cooking, etc.).
  • Aria Everyday Activities (AEA): Household tasks recorded with Project Aria glasses.
  • LaMAria: Long-duration (up to 30 min) city-scale recordings.
  • TLIO Dataset: A standard pedestrian walking dataset using a custom headset.

Key Insights and Ideas

  • Representation > Model Capacity: The "aha moment" here is that a sequence model's capacity amplifies the quality of the representation rather than compensating for its flaws. By mathematically removing "nuisance variables" like tilt, the Mamba backbone can focus entirely on motion dynamics.
  • Analytical vs. Learned Invariance: You don't need complex, compute-heavy equivariant architectures if you can define the invariant frame analytically. This allows HeadIO to run in real-time on low-power wearable hardware.
  • Faster Convergence: Because the network doesn't have to "unlearn" tilt variations, it converges to a low-error state up to 5x faster than alternative representations.
Fig. 4: Validation MSE versus training epoch for the four input representations on both backbones (Nymeria, 3s win- dow).

Key Results

  • SOTA Accuracy: On the massive Nymeria dataset, HeadIO improved the 5-second Relative Translational Error (RTE-5s) by 8.1% (0.260m → 0.239m) over world-frame methods.
  • Extreme Efficiency: HeadIO uses only 0.97M parameters, compared to 7.0M for TLIO and 7.6M for EqNIO. It also requires 2.8x less compute (FLOPs) than EqNIO.
  • Robustness to Drift: In realistic IMU-only deployments, the authors showed that a simple single-coefficient correction for gyroscope scale-factor error removes 11.6% of yaw error. Furthermore, just one external yaw fix every 30 seconds (e.g., from a compass or map relocalization) brings performance close to ground-truth orientation levels.

Limitations and Future Work

The main limitation noted is performance on the TLIO dataset, where HeadIO lagged slightly behind EqNIO. The authors attribute this to the TLIO dataset lacking a well-defined "gaze axis" in its device frame, which HeadIO's analytical decomposition relies on.

Future work includes extending the method to non-rigid mountings (like earbuds that might shift in the ear) and exploring "intermittent anchoring," where the system occasionally uses visual cues to reset drift while remaining primarily inertial.

Summary updated

Abstract

Inertial odometry (IO) using only Inertial Measurement Units (IMUs) enables camera-free head tracking in head-mounted devices such as VR headsets, AR glasses, and earbuds. Prior IO methods operate in a gravity-aligned world frame, which is not yaw-equivariant. Yaw augmentation improves robustness but does not guarantee equivariance; learned equivariant layers achieve it, but EqNIO's full pipeline costs nearly 3$\times$ the FLOPs of ours. While raw body-frame IMU inputs are inherently yaw-invariant, head tilt redistributes both gravity and motion signals across device axes, making the representation tilt-variant. We propose HeadIO, which combines a body-frame heading decomposition with a bidirectional Mamba backbone for head-mounted inertial odometry. Our decomposition achieves tilt invariance by separating gravity-aligned and horizontal components using only the tilt component of device orientation. We evaluate on four head-mounted datasets and find that HeadIO improves RTE-5s by 8.1% (0.260 m $\to$ 0.239 m) over world-frame methods with learned equivariant layers on Nymeria, the largest benchmark dataset, at nearly 3$\times$ lower FLOPs and 8$\times$ fewer parameters. HeadIO achieves state-of-the-art performance on our primary metric, RTE-5s, on all Aria-glasses datasets, which natively provide body-frame semantics for our decomposition method. We further evaluate the IMU-only deployment scenario on Nymeria, where HeadIO remains state-of-the-art. We show that our method relies mainly on tilt accuracy, which can be obtained from the gravity signal; for yaw, a single-coefficient gyroscope correction removes 11.6% of the yaw error and improves RTE-5s by 2.5%, and sparse external yaw corrections (for example, one every 30 s) can improve RTE-5s by 12.0%. Our decomposition is lightweight, composes with any backbone, and is suitable for real-time deployment on head-mounted devices.
BibTeX
@misc{yeon2026headio,
  author = {Taeyoung Yeon and Yiquan Li and Chenfeng Gao and Vasco Xu and Karan Ahuja},
  title = {{HeadIO: Body-Frame Heading Decomposition for Neural Inertial Odometry on Head-Mounted Devices}},
  year = {2026},
  eprint = {2611.14895},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.14895},
}
Figure