Towards Rotation-Only Imaging Geometry: Multi-View Pose Estimation

Xinrui Li, Qi Cai, Yuanxin WuarXiv 2026 · arXiv

TL;DR

This paper introduces a robust and efficient framework for Global Structure-from-Motion (SfM) that estimates camera poses using "rotation-only" geometry. By unifying rotation initialization and refinement into a single stage and using analytical solvers for translation, the proposed method achieves up to an 80% reduction in error and a 16x speedup over state-of-the-art pipelines like GLOMAP.

What Problem Does This Paper Address?

Recovering camera positions and orientations from a set of images—a process known as Structure-from-Motion (SfM)—is a cornerstone of computer vision. Traditional "Global SfM" pipelines typically follow a rigid three-step sequence:

  1. Two-view geometry: Estimate relative poses for individual image pairs.
  2. Rotation averaging: Combine these relative rotations into a consistent global coordinate system.
  3. Translation estimation: Recover camera positions.

The authors identify a fundamental flaw in this design: decoupling. Pairwise refinement happens in a vacuum, ignoring multi-view consistency. Conversely, rotation averaging operates "blindly" on pre-computed relative rotations without ever looking back at the original feature matches. This leads to error propagation, especially when dealing with noisy data or degenerate configurations like "holoplane" scenes (where all points and cameras lie on or near a single plane).

Methods

The authors propose three core components to bridge this gap:

  • GRAM (Global Rotations from Aggregated Matches): Instead of refining pairs and then averaging, GRAM does both at once. It estimates global rotations directly from initial relative rotations and raw inlier matches by minimizing "rotation-only" algebraic residuals. This ensures that the global rotation is grounded in the actual image data from the start.
  • MORE (Multi-view Optimization with Rotation-only Reprojection Error): This extends rotation-only geometry to multiple views for non-linear refinement. It uses a novel reprojection error that lives entirely on the rotation manifold, bypassing the need to explicitly solve for 3D point positions during rotation refinement.
  • ART (Analytical Rotation-guided Translation): Once rotations are fixed, ART recovers translations. It breaks the problem down into local camera triplets, derives constraints analytically, and then solves a unified weighted linear system. This is significantly faster and more robust than traditional global translation solvers that couple all feature tracks into one massive, brittle system.

Datasets

The framework was evaluated on both synthetic and real-world benchmarks:

  • Synthetic Data: 10 cameras simulated in various challenging configurations, including spatial scatter, local pure rotation, and the notorious holoplane degeneracy.
  • Real-world Data: 19 scenes from the Strecha and ETH3D datasets, which provide high-accuracy ground truth for camera poses.

Key Insights and Ideas

  • Feature-Level Coupling: The "aha moment" is that global consistency should be enforced at the feature level during initialization, not as a post-processing step. By using "Aggregated Matches," GRAM suppresses errors that would otherwise derail a standard rotation averaging algorithm.
  • The Power of Rotation-Only Geometry: By formulating residuals that don't depend on 3D structure, the authors create a pipeline that is less sensitive to the "chicken-and-egg" problem of SfM (you need good poses for good points, and good points for good poses).
  • Handling Degeneracy: Standard methods often fail when cameras are nearly coplanar. As shown in Figure 1, the authors specifically tested for "holoplane" degeneracy, finding their method remains stable where others exhibit a "pronounced upper tail" of extreme errors.
Figure 1. Synthetic 3D point configurations: spatial points and holoplane degeneracy (all finite 3D points lie on the same plane as the corresponding cameras) [19].

Key Results

The quantitative improvements are substantial across the board:

  • Accuracy: In synthetic tests with high image noise (5-10 pixels), the GRAM+MORE pipeline reduced median rotation errors by 60% to 80% compared to GLOMAP.
  • Robustness: On real-world scenes, the proposed pipeline achieved lower rotation and translation errors on 15 out of 19 scenes. In one case ("kicker"), it reduced translation error by a staggering 98%.
  • Efficiency: The total pipeline is approximately 16x faster than GLOMAP. The individual GRAM and ART modules are each more than 100x faster than the traditional Sampson refinement and translation averaging steps they replace.
Figure 2. Two-view relative-rotation errors for PoseLib Samp- son [16] and GRAM (IQRs and medians, log scale).

Limitations and Future Work

While the paper demonstrates a major leap in pose estimation, a few areas remain for exploration:

  • Full SfM Integration: The current work focuses on pose estimation. While it provides a superior starting point, a full SfM system still requires subsequent triangulation and potentially a final "Global Bundle Adjustment" for sub-pixel map accuracy.
  • Parameter Sensitivity: The authors mention that certain parameter details (like thresholds for triplet screening) are deferred to the supplement, suggesting that the "robustness" might require some tuning for vastly different types of imagery.
  • Scaling: While the method is fast, the paper evaluates scenes with up to 76 cameras. Testing on "city-scale" datasets with thousands of images would be the ultimate stress test for the analytical triplet approach in ART.

Summary updated

Abstract

Global structure-from-motion (SfM) commonly refines relative poses on individual image pairs and then estimates global rotations by rotation averaging. Pairwise refinement does not explicitly combine feature-level constraints with multi-view consistency during rotation initialization. We introduce Global Rotations from Aggregated Matches (GRAM), which estimates global rotations directly from initial relative rotations and inlier matches by minimizing edge-wise rotation-only algebraic residuals. GRAM replaces two-view relative-pose optimization and rotation averaging with a single stage. We further extend rotation- only imaging geometry to multiple views and develop Multi-view Optimization with Rotation-only Reprojection Error (MORE) for nonlinear global rotation refinement. Analytical Rotation-guided Translation (ART) derives locally scaled triplet translations from Linear Global Translation (LiGT) constraints and recovers global translations using weighted least squares. Synthetic and real-world experiments demonstrate the accuracy, robustness, and efficiency of the proposed methods.
BibTeX
@misc{li2026towards,
  author = {Xinrui Li and Qi Cai and Yuanxin Wu},
  title = {{Towards Rotation-Only Imaging Geometry: Multi-View Pose Estimation}},
  year = {2026},
  eprint = {2611.11770},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.11770},
}
Figure