Spatiotemporal data mining: a survey on challenges and open problems

Ali Hamdi, Khaled B. Shaban, Abdelkarim Erradi, Amr Mohamed, Shakila Khan Rumi, Flora D. Salim

TL;DR

This survey provides a comprehensive overview of the challenges and open problems in Spatiotemporal Data Mining (STDM). It aims to fill a gap by thoroughly discussing the difficulties in STDM, from fundamental issues like data characteristics and relationships to specific tasks and applications, offering a roadmap for future research.

What Problem Does This Paper Address?

Spatiotemporal Data Mining (STDM) is crucial for extracting insights from data that has both location and time components, like traffic patterns, climate data, or social media activity. While significant progress has been made, existing surveys often focus on advances rather than the inherent difficulties. This paper addresses the need for a consolidated understanding of the challenges and open research problems in STDM. It aims to provide a structured overview of these issues, covering general challenges, task-specific difficulties, and application-specific hurdles, thereby guiding future research efforts.

Methods

This paper is a survey and literature review. The authors systematically reviewed existing research to identify and categorize STDM challenges. They employed a taxonomy to structure their findings, categorizing challenges into three main perspectives: general issues (relationships, interdisciplinarity, discretization, data characteristics, research limitations), task-related challenges (prediction, clustering, pattern mining, outlier detection, visualization, visual analytics, computer vision), and application-related challenges (crime, traffic, environment, epidemiology, social media, IoT). They also used a cause-and-effect diagram to illustrate the relationships between these challenges.

Datasets

Not explicitly detailed as the paper is a survey. The authors mention that STDM utilizes various data sources including remote sensing, mobility data, wearable devices, social media, and medical sensory devices.

Key Insights and Ideas

  • Complexity of Relationships: Spatiotemporal data relationships are inherently complex and implicit, unlike the explicit relationships in traditional data mining. This complexity arises from the continuous nature of space and time being represented discretely, and from the influence of co-located objects.
  • Interdisciplinarity is a Double-Edged Sword: While STDM thrives on integrating knowledge from diverse domains (e.g., socio-economy, psychology for crime analysis), this interdisciplinarity also introduces significant challenges in data integration and methodological compatibility.
  • The Modifiable Areal Unit Problem (MAUP) is Pervasive: The way spatial data is aggregated (scale effect and zoning effect) significantly impacts STDM results, making it difficult to define optimal aggregation levels and generalize findings.
  • Data Characteristics are a Major Hurdle: Issues like specificity (models not generalizing across domains), vagueness (similar data having different interpretations), dynamicity (data evolving over time), social biases, networked data complexities, heterogeneity, privacy concerns, and poor data quality all pose significant challenges.
  • Open Problems in Core STDM Tasks: Key areas needing more research include developing better data representations, advanced modeling techniques (especially for real-time and sporadically observed data), comprehensive approaches that integrate multiple STDM tasks, and ensuring fairness, accountability, transparency, and ethics (FATE) in STDM systems.

Key Results

The paper doesn't present empirical results from new experiments but rather synthesizes findings from existing literature. It identifies and categorizes a wide range of STDM challenges and open problems. The survey highlights that while many STDM tasks (like prediction, clustering, hotspot detection, pattern mining, outlier detection, visualization, visual analytics, and computer vision) have dedicated research, they often suffer from the general challenges discussed. The paper provides a structured taxonomy of these challenges and their causes, supported by extensive citations, offering a comprehensive landscape of the field's current state and future research directions.

Limitations and Future Work

The authors acknowledge that STDM is a rapidly evolving field, necessitating continuous updates to surveys. They explicitly state that STDM challenges and problems are not thoroughly discussed and presented in articles of their own, which this survey aims to address. Future research directions are implicitly suggested throughout the paper by identifying open problems in areas such as:

  • Developing advanced data representations for spatiotemporal events and relationships.
  • Creating more robust and generalizable modeling techniques, especially for real-time and sporadically observed data.
  • Enhancing visualization methods to effectively handle big spatiotemporal datasets and dynamic processes.
  • Designing comprehensive STDM approaches that integrate multiple tasks and consider interdisciplinary data.
  • Addressing Fairness, Accountability, Transparency, and Ethics (FATE) in STDM systems, particularly concerning biases in data and algorithms.
  • Improving the integration of multiple STDM tasks to solve more complex scenarios.

Summary updated

Abstract

Spatiotemporal data mining (STDM) discovers useful patterns from the dynamic interplay between space and time. Several available surveys capture STDM advances and report a wealth of important progress in this field. However, STDM challenges and problems are not thoroughly discussed and presented in articles of their own. We attempt to fill this gap by providing a comprehensive literature survey on state-of-the-art advances in STDM. We describe the challenging issues and their causes and open gaps of multiple STDM directions and aspects. Specifically, we investigate the challenging issues in regards to spatiotemporal relationships, interdisciplinarity, discretisation, and data characteristics. Moreover, we discuss the limitations in the literature and open research problems related to spatiotemporal data representations, modelling and visualisation, and comprehensiveness of approaches. We explain issues related to STDM tasks of classification, clustering, hotspot detection, association and pattern mining, outlier detection, visualisation, visual analytics, and computer vision tasks. We also highlight STDM issues related to multiple applications including crime and public safety, traffic and transportation, earth and environment monitoring, epidemiology, social media, and Internet of Things.
BibTeX
@inproceedings{hamdi2022spatiotemporal,
  author = {Ali Hamdi and Khaled B. Shaban and Abdelkarim Erradi and Amr Mohamed and Shakila Khan Rumi and Flora D. Salim},
  title = {{Spatiotemporal data mining: a survey on challenges and open problems}},
  booktitle = {Artif. Intell. Rev},
  year = {2022},
  url = {https://openreview.net/forum?id=iDVce1oHCO3d},
}
Figure