OBSR: Open Benchmark for Spatial Representations

representation learning
benchmark
datasets
OpenStreetMap
data processing
geospatial
urban data
standardization
pipeline
This paper introduces a novel benchmark designed to assess the performance, accuracy, and efficiency of geospatial embedders. Our benchmark is modality-agnostic and comprises 7 distinct datasets from diverse cities across three continents, ensuring generalizability and mitigating demographic biases. It allows for the evaluation of GeoAI embedders on various phenomena that exhibit underlying geographic processes. Furthermore, we establish a simple and intuitive task-oriented model baselines, providing a crucial reference point for comparing more complex solutions. All related code is available in SRAI library.
Authors

Julia Moska

Oleksii Furman

Kacper Kozaczko

Szymon Leszkiewicz

Jakub Polczyk

Piotr Gramacki

Piotr Szymański

Published

November 3, 2025