A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks

Xinyi ShiarXiv 2026 · arXiv

The standard metric for measuring camera-motion accuracy, Absolute Trajectory Error (ATE), has a blind spot. In a new paper from Duke University, researcher Xinyi Shi demonstrates that on popular short-clip benchmarks like MPI Sintel, a simple "image-free" baseline—a constant-velocity straight line—outperforms 10 out of 11 recent state-of-the-art (SOTA) models.

TL;DR

The Absolute Trajectory Error (ATE) metric is flawed for short video clips because its position-only alignment ignores camera orientation and rewards simple motion priors. The authors propose Pose-anchored ATE (PA-ATE), a robust alternative that ties trajectory alignment to camera heading, effectively penalizing models that "guess" a straight path while ignoring visual evidence.

What Problem Does This Paper Address?

In fields like SLAM and feed-forward 3D reconstruction (e.g., DUSt3R, MonST3R), researchers use ATE to evaluate how well a model predicts a camera's path through space. To calculate ATE, the predicted trajectory is aligned to the ground truth using a similarity transform (Procrustes alignment).

The authors identify two critical failures in this process when applied to short clips:

  1. Regression to the Mean: Because short clips are often nearly linear, the alignment process maps any constant-velocity prediction onto the best-fitting line of the true path. The resulting "error" is merely the residual of the ground truth's deviation from a straight line, which is often smaller than the actual errors made by complex neural networks.
  2. Orientation Blindness: ATE only looks at positions. A model could predict a camera moving sideways while looking forward, or moving forward while looking forward—ATE might give them the same score if the positional path is the same. This ignores the geometric reality of how images are formed.
Figure 1. ATE does not see where the cameras look (Sintel alley 2). (a) With the orientations aligned, π3 (blue) follows the true path (grey; wedges: viewing directions). Its centres rotated by 30◦with the orientations kept (orange) move sideways to where the cameras look, yet ATE’s position-only alignment maps them back onto π3’s: both score 0.0075. (b) A frame and the crop of (c–e), where static points from 5 frames earlier are placed by each prediction (white ring: true position; dot and segment: predicted; 20 px bar). Above (c–e): ATE and the clip mean of the reprojection error (Sec. 5).

Methods

The paper introduces several diagnostic tools and a new metric:

  • The "Line" Baseline: An image-free reference that assumes constant velocity in a straight line.
  • Residual SNR: A criterion derived from the "logic of shrinkage" that predicts, per clip, whether "straightening" a model's prediction (moving it toward a constant-velocity fit) will artificially lower its ATE.
  • Pose-anchored ATE (PA-ATE): The proposed fix. Instead of fitting the alignment rotation to the positions of the camera, PA-ATE fits the rotation to the predicted orientations (the "anchor"). This ensures that if a model predicts a forward-moving camera but the trajectory moves sideways, the error reflects that inconsistency.
  • Reprojection Audit: The authors use ground-truth depth to project static points between frames. This serves as a "ground truth" for geometric consistency that ATE often fails to track.

Datasets

The audit covers a wide range of benchmarks:

  • MPI Sintel: The primary focus, where the "straight line" problem is most acute.
  • TUM-dynamics & ScanNet: Used to show where ATE remains a reliable metric (longer, more complex paths).
  • Bonn & Wild-SLAM: Additional dynamic scene datasets.
  • KITTI & 7-Scenes: Used as held-out data to validate the Residual SNR criterion.

Key Insights and Ideas

  • The Benchmark Lottery: On Sintel, the image-free line ranks 2nd out of 12 methods. This suggests that many SOTA models are being rewarded for having a "straightness" prior rather than superior visual perception.
  • Geometry vs. Score: A lower ATE does not necessarily mean better geometry. The authors show that "straightening" a trajectory often lowers the ATE score while simultaneously worsening the reprojection error of static scene points.
  • SNR as a Filter: The Residual SNR effectively separates datasets where motion priors dominate (Sintel, median SNR 0.86) from those where visual evidence is paramount (TUM/ScanNet, SNR 2.7 to 27).

Key Results

  • Metric Reliability: PA-ATE tracks reprojection error much more closely than standard ATE. On Sintel, the Spearman correlation with reprojection error improved from 0.32 (ATE) to 0.61 (PA-ATE).
  • Restoring the Ranking: Under PA-ATE, the image-free "line" baseline correctly falls from 2nd place to last on the Sintel benchmark.
  • Computational Efficiency: PA-ATE is a "one-function change" that adds negligible overhead (approx. 0.17 ms per clip).
  • Predictive Power: The Residual SNR criterion correctly predicted whether straightening would help or hurt ATE in 95% to 98% of tested model-clip pairs across various datasets.

Limitations and Future Work

The authors acknowledge that PA-ATE requires camera orientations, which are standard in most datasets but might not be available in all legacy benchmarks. Furthermore, the reprojection audit requires ground-truth depth, limiting its use to specific datasets.

Future work could involve extending these "pose-anchored" concepts to other metrics or developing benchmarks that explicitly penalize models for relying on motion priors when visual evidence is ambiguous.

For more details, see the full paper: "A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks" by Xinyi Shi.

Summary updated

Abstract

The absolute trajectory error (ATE) is the standard measure of camera-motion accuracy, from SLAM to feed-forward 3D reconstruction. On the common Sintel protocol, a constant-velocity straight line using no images has a lower mean ATE than 10 of 11 recent models re-run with official code. Two properties of ATE's alignment explain this. First, it maps any constant-velocity prediction onto the best-fitting line through the true path, so the line scores the path's regression residual. A residual signal-to-noise ratio (SNR) criterion predicts when moving a prediction towards its constant-velocity fit lowers ATE. It gives the outcome for 95% of 1056 model-clip pairs, 98% of 792 held-out pairs and 97% of 1034 ScanNet pairs, and it separates Sintel (median SNR 0.86) from TUM, ScanNet and full-length Bonn and Wild-SLAM (2.7 to 27), where straightening raises every model's mean ATE. Second, position-only alignment ignores where cameras look: rotating a trajectory by 30 degrees against its orientations leaves ATE unchanged, yet worsens the reprojection of static points for every model on Sintel, TUM and ScanNet in the main setting, and the line, second by mean ATE on Sintel, places them worst by geometric mean: a lower ATE need not mean better geometry. Fitting the alignment's rotation to the predicted orientations gives pose-anchored ATE, a one-function change in ATE's units costing 0.17 ms per clip (ATE: 0.11 ms). It ranks every image-free reference below every model on Sintel, tracks the reprojection error under rotation and straightening, where ATE does not (Spearman 0.61 vs. 0.32), largely preserves the models' order, and ties 10-frame translational relative pose error (RPE) and the discernible trajectory error (DTE) on our rotation and reference tests. Code, predictions and results will be released.
BibTeX
@misc{shi2026straight,
  author = {Xinyi Shi},
  title = {{A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks}},
  year = {2026},
  eprint = {2611.00482},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.00482},
}
Figure