Abstract
This paper presents a novel approach to visual localization by integrating classical Markov localization into a deep learning framework. By reformulating grid-based localization as a series of convolutional operations, the authors achieve a robust, multi-modal system capable of handling ambiguous environments. The proposed architecture includes a deep likelihood heatmap regressor and a convolutional odometry layer, enabling real-time, GPU-accelerated probabilistic filtering. Evaluations on the Cambridge Landmarks and a new Multi-Storey Carpark dataset demonstrate superior accuracy and trajectory smoothness compared to standard pose-regression methods.
Introduction
Visual localization is a fundamental task for autonomous systems, yet common deep learning approaches like direct pose regression (e.g., PoseNet) often struggle with overconfidence and uni-modality. These models typically provide a single point estimate, failing to represent uncertainty in self-similar environments like parking garages or uniform hallways where multiple locations may look identical.
Classical Markov localization addresses these issues by maintaining a probability distribution over a grid of possible states. However, the computational cost of updating large 3D grids ($x, y, \theta$) has historically limited its application on standard CPUs. This work bridges the gap by implementing the entire Markov localization pipeline within a Convolutional Neural Network (CNN), leveraging GPU acceleration to make grid-based filtering efficient and scalable.
Methodology
The proposed system consists of three primary components integrated into a single forward pass:
- Deep Likelihood Heatmap Regressor: Utilizing a ResNet-50 encoder and a custom decoder, the network predicts a "birds-eye-view" likelihood map. Localization is treated as a classification problem over discrete spatial bins, allowing the model to represent multiple hypotheses simultaneously.
- Convolutional Odometry Layer: The motion model update is formulated as a 2D convolution. By representing robot motion as a kernel, the probability distribution can be propagated across the grid using standard deep learning operations, significantly reducing computational overhead (approx. 0.25ms per update).
- Multi-Scale Supervision: To ensure accurate and smooth probability distributions, the network is trained with heatmaps at four different resolutions, providing a coarse-to-fine refinement of the pose estimate.
Experimental Setup
The architecture was evaluated on two distinct benchmarks:
- Cambridge Landmarks: A standard outdoor visual localization dataset.
- Multi-Storey Carpark Dataset: A challenging new dataset introduced by the authors, featuring a 6,500m trajectory across 12 floors of a parking garage. This environment is highly self-similar, providing a rigorous test for multi-modal localization capabilities.
Results and Discussion
The hybrid approach demonstrates significant improvements in both accuracy and robustness. On the Cambridge Landmarks dataset, the Heatmap Regressor outperformed various PoseNet baselines in 4 out of 6 scenarios. In the highly ambiguous Multi-Storey Carpark environment, the combined Heatmap and Odometry (H+O) system achieved an RMSE of 6.48m, significantly outperforming PoseNet (9.31m) and PoseLSTM (9.05m).
A key advantage of the Markov framework is temporal smoothing. By maintaining a prior distribution (memory of previous states), the system produces trajectories that are physically plausible and free from the erratic "jumps" common in frame-by-frame regression models when they encounter visual ambiguity.
Conclusion
By reimagining Markov localization as a convolutional process, this paper provides a robust solution for visual localization in complex environments. The system effectively handles uncertainty and multi-modality while remaining computationally efficient. Future work may involve extending the framework to 6-DoF localization and integrating it into full SLAM (Simultaneous Localization and Mapping) systems where the map itself is learned and updated dynamically.
Summary updated