SVR-Based Jitter Reduction for Markerless Augmented Reality

Samuele Salti, Luigi Di Stefano

Abstract

Markerless Augmented Reality (AR) systems often suffer from visual instability, or "jitter," due to noise in camera pose estimation. This paper proposes a novel post-processing technique using Support Vector Regression (SVR) to stabilize virtual augmentations. By dynamically learning motion patterns from a sliding window of frames, the SVR filter effectively reduces high-frequency oscillations and spurious pose jumps without requiring a predefined motion model.

Introduction

In markerless AR, the system calculates the camera's pose by tracking natural features in the environment. While more flexible than marker-based approaches, this method is prone to two significant issues: pose jitter and spurious estimations. Jitter manifests as high-frequency oscillations of virtual objects, even when the camera is stationary, while spurious estimations cause jarring "jumps" in the object's position. Traditional solutions like Kalman filters often struggle with the unpredictable motion of handheld devices. This work introduces a "plug-and-play" SVR-based regression module to address these challenges.

Methodology

The proposed system inserts an $\epsilon$-Support Vector Regression module between the pose estimation and rendering engines.

SVR Configuration

The system utilizes $\epsilon$-SVR with a Gaussian Radial Basis Function (RBF) kernel. To avoid mathematical singularities, pose estimation is decomposed into seven independent SVRs: four for a unit quaternion (rotation) and three for the translation vector ($x, y, z$). The SVR is retrained on a small sliding window of recent frames to predict the smoothed pose for the current frame.

Latency Mitigation

To prevent lag during rapid camera movements, the authors implemented a "quick move detection" mechanism. By monitoring the centroid of extracted features, the system can detect sudden shifts, bypass the SVR filter to maintain responsiveness, and reset the training window.

Experimental Evaluation

The method was evaluated using a 1,870-frame video sequence of an aeronautical maintenance task. The sequence is characterized by low-texture surfaces and rapid camera motion, presenting a significant challenge for feature-based tracking. A high-quality reference baseline was established using SIFT features on full-resolution images with image doubling.

Visual comparison of pose estimation jitter across different tracking and filtering methods. The plots show how SVR (bottom-left) and Kalman (bottom-right) filters smooth the raw data.

Results and Discussion

The SVR approach was compared against raw SURF-based pose estimation and a standard Kalman filter. Quantitative results are summarized in the table below.

Method RMSE (mm) Max Error (mm)
SURF (Raw) 9.39 94.10
SURF + SVR 14.42 57.32
SURF + Kalman 18.99 63.53
Quantitative performance metrics for SIFT, SURF, and filtered SURF methods.

The results indicate that while any smoothing filter introduces a slight increase in Root Mean Square Error (RMSE) due to inherent delay, the SVR filter significantly reduces the Maximum Error compared to both raw estimation and the Kalman filter. This reduction in peak error is critical for maintaining the "illusion of mixture" in AR by eliminating the most distracting visual artifacts.

Conclusion

The SVR-based jitter reduction technique provides a robust, model-free solution for stabilizing markerless AR. By dynamically adapting to motion patterns, it outperforms traditional Kalman filters in suppressing high-frequency noise and spurious jumps. Future research will explore optimizing the computational cost of per-frame retraining and refining parameter selection for diverse environments.

Summary updated

Abstract

The ability to augment a video stream with consistent virtual contents is an attractive Computer Vision application. The first Augmented Reality (AR) proposals required the scene to be endowed with special markers. Recently, thanks to the developments in the field of natural invariant local features, similar results have been achieved in a markerless scenario. The computer vision community is now equipped with a set of relatively standard techniques to solve the underlying markerless camera pose estimation problem, at least for planar textured reference objects. The majority of proposals, however, does not exploit temporal consistency across frames in order to reduce some disturbing effects of per-frame estimation, namely visualization of short spurious estimations and jitter. We proposes a new method based on Support Vector Regression to mitigate these undesired effects while preserving the ability to work in real-time. Our proposal can be used as a post processing step independent of the chosen pose estimation method, thus providing an effective and easily integrable building block for AR applications.
BibTeX
@inproceedings{salti2009svr,
  author = {Samuele Salti and Luigi Di Stefano},
  title = {{SVR-Based Jitter Reduction for Markerless Augmented Reality}},
  booktitle = {ICIAP},
  year = {2009},
  doi = {10.1007/978-3-642-04146-4\_5},
}
Figure