Towards Interactive Global Geolocation Assistant

Zhiyang Dou, Zipeng Wang, Xumeng Han, Guorong Li, Zhenjun HanOpenReview 2025 · Submission to NeurIPS 2025 Datasets and Benchmarks Track · Rejected · OpenReview

Abstract

Global geolocation, the task of predicting the exact location of street-view images, is crucial for applications like security surveillance. Existing retrieval and classification methods, along with current Multimodal Large Language Models (MLLMs), suffer from limitations such as database dependence, lack of interpretability, and a significant gap in geographic knowledge due to insufficient datasets. To address these issues, we introduce MG-Geo, the first comprehensive, high-quality multimodal Global Geolocation dataset. Comprising five million instances of geographic dialogue data across 210 countries, MGGeo provides detailed geographic element cues (e.g., road markings, vegetation, language), significantly surpassing existing datasets like OSV-5M and Google Landmark V2 in richness and granularity. Leveraging MGGeo, we develop GaGA (Global Geolocation Assistant), a novel MLLM specifically designed for geolocation. Experimental results demonstrate that GaGA not only significantly outperforms existing MLLMs but also surpasses the state-of-the-art model OSV-5M-Baseline in administrative boundary prediction (achieving improvements of 4.57% at the country and 2.92% at the city levels). Furthermore, GaGA exhibits remarkable interactive refinement capabilities, improving localization accuracy with effective user guidance. This work highlights the critical role of the MGGeo dataset in fostering improved geographic understanding of MLLM. Our dataset is accessible via: https://huggingface.co/datasets/kendouvg/MG-Geo.
BibTeX
@misc{dou2025towards,
  author = {Zhiyang Dou and Zipeng Wang and Xumeng Han and Guorong Li and Zhenjun Han},
  title = {{Towards Interactive Global Geolocation Assistant}},
  year = {2025},
  url = {https://openreview.net/forum?id=PFBXbXpMdi},
  howpublished = {OpenReview},
  note = {Submitted to NeurIPS 2025 Datasets and Benchmarks Track},
}
Figure