Automatic snow type classification of snow micropenetrometer profiles with machine learning algorithms

Julia Kaltenborn, Amy R. Macfarlane, Viviane Clay, Martin SchneebeliGeoscientific 2023 · DOI

TL;DR

This paper introduces "snowdragon," a machine learning framework that automates the classification of snow types from high-resolution snow micropenetrometer (SMP) profiles. By training various models on a large Arctic dataset, they demonstrate that SMP data alone can accurately identify snow layers, significantly accelerating analysis and enabling large-scale cryospheric studies.

What Problem Does This Paper Address?

Accurately classifying snow types is crucial for understanding snowpack dynamics, climate modeling, and predicting avalanche risk. Traditionally, this involves manual analysis of snow pits, a labor-intensive and time-consuming process that limits the scale of research. While snow micropenetrometers (SMPs) provide detailed depth-force profiles, extracting snow type information from these profiles has historically required manual labeling by experts or additional, costly data like snow pit information. This creates a bottleneck for analyzing large SMP datasets, especially for researchers unfamiliar with snow science. This paper aims to bridge this gap by developing and evaluating machine learning models that can automatically segment and classify SMP profiles directly from field data.

Methods

The researchers explored 14 different machine learning models, including semi-supervised approaches and artificial neural networks (ANNs). They focused on two main tasks: segmentation (identifying the boundaries of snow layers) and classification (assigning a snow type to each layer). The models were trained to perform these tasks using only the SMP's force-depth profiles. They compared various algorithms, including:

  • Baseline: Majority vote classifier.
  • Semi-supervised: K-means, Gaussian Mixture Models (GMM), Bayesian Gaussian Mixture Models (BGMM), Self-trainer, and Label Propagation.
  • Supervised: Random Forest, Balanced Random Forest, Support Vector Machines (SVM), K-Nearest Neighbors (KNN), and Easy Ensemble.
  • Artificial Neural Networks (ANNs): Long Short-Term Memory (LSTM), Bidirectional LSTM (BLSTM), and Encoder-Decoder networks.

The study emphasizes that the ANNs, particularly LSTM and Encoder-Decoder, were evaluated for their ability to handle the sequential nature of SMP data, treating it as a "sequence labeling" task.

Datasets

The primary dataset used in this study is the MOSAiC SMP dataset. This extensive collection comprises 3680 SMP profiles collected during the MOSAiC expedition (October 2019–September 2020) on Arctic sea ice. For this study, 164 of these profiles were manually labeled by snow experts and used for training, validation, and testing. The paper also mentions that some unlabeled profiles were used for semi-supervised learning and out-of-distribution tests.

Key Insights and Ideas

  • SMP Data Alone is Sufficient: The most significant finding is that SMP profiles, when processed with appropriate ML models, can be automatically segmented and classified into snow types without requiring additional snow pit data or manual preparation beyond initial model training.
  • ANNs Excel at Sequential Data: Artificial Neural Networks, especially LSTMs and Encoder-Decoders, demonstrated superior performance due to their inherent ability to process sequential data, capturing the depth-dependent nature of SMP signals.
  • No Single "Best" Model: The study highlights that the optimal model depends on user needs, balancing factors like accuracy, explainability, computational resources, and the importance of classifying rare snow types.
  • "snowdragon" as a Practical Tool: The development of the "snowdragon" repository makes these advanced ML tools accessible to a wider audience, democratizing SMP data analysis.
  • Subjectivity in Snow Classification: The paper acknowledges that even expert labeling has inherent subjectivity, which limits the theoretical maximum accuracy achievable by any model.

Key Results

  • Accuracy: The best-performing models, particularly the ANNs, achieved accuracies up to 78% for automatic snow type classification. The LSTM model achieved an overall accuracy of 0.754, with a micro-averaged ROC AUC of 0.96.
  • Model Performance: ANNs (LSTM, BLSTM, Encoder-Decoder) generally outperformed other model categories. The LSTM was highlighted as a strong candidate for users due to its consistent performance even with moderate hyperparameter tuning.
  • Generalizability: The LSTM model showed good generalization capabilities on out-of-distribution data from different legs of the MOSAiC expedition, suggesting its potential for broader application after retraining.
  • Classification Difficulty: Certain snow types, like "rounded grains wind packed," were easier to classify, while others, such as "depth hoar indurated" and "depth hoar wind packed," proved more challenging, often due to their continuous nature and transformation into other types.

Limitations and Future Work

  • Expert Labeling Uncertainty: The inherent subjectivity in expert snow classification is a limitation. Future work could involve quantifying this uncertainty and developing probabilistic classification models.
  • "First Segment, Then Classify" Approach: The current study focused on a "classify-then-segment" approach. Exploring "segment-then-classify" methods using techniques like audio segmentation could potentially improve performance.
  • Model Adaptability: While ANNs are powerful, they are less explainable. Future work could explore adapting loss functions to incorporate similarity measurements and improve prediction performance.
  • Dataset Generalization: The models' generalization is limited to similar snow types and seasons. Training on more diverse, multi-regional, and multi-seasonal datasets is suggested to improve broad applicability. Alternatively, users can retrain models on their specific datasets.
  • Unlabeled Data Usage: The semi-supervised models' underperformance was partly attributed to unlabeled data from different seasons. Further investigation into leveraging unlabeled data from similar distributions is warranted.

Summary updated

Abstract

Snow-layer segmentation and classification are essential diagnostic tasks for various cryospheric applications. The SnowMicroPen (SMP) measures the snowpack's penetration force at submillimeter intervals in snow depth. The resulting depth–force profile can be parameterized for density and specific surface area. However, no information on traditional snow types is currently extracted automatically. The labeling of snow types is a time-intensive task that requires practice and becomes infeasible for large datasets. Previous work showed that automated segmentation and classification is, in theory, possible but cannot be applied to data straight from the field or needs additional time-costly information, such as from classified snow pits. We evaluate how well machine learning models can automatically segment and classify SMP profiles to address this gap. We trained 14 models, among them semi-supervised models and artificial neural networks (ANNs), on the MOSAiC SMP dataset, an extensive collection of snow profiles on Arctic sea ice. SMP profiles can be successfully segmented and classified into snow classes based solely on the SMP's signal. The model comparison provided in this study enables SMP users to choose a suitable model for their task and dataset. The findings presented will facilitate and accelerate snow type identification through SMP profiles. Anyone can access the tools and models needed to automate snow type identification via the software repository “snowdragon”. Overall, snowdragon creates a link between traditional snow classification and high-resolution force–depth profiles. Traditional snow profile observations can be compared to SMP profiles with such a tool.
BibTeX
@inproceedings{kaltenborn2023automatic,
  author = {Julia Kaltenborn and Amy R. Macfarlane and Viviane Clay and Martin Schneebeli},
  title = {{Automatic snow type classification of snow micropenetrometer profiles with machine learning algorithms}},
  booktitle = {Geoscientific},
  year = {2023},
  doi = {10.5194/gmd-16-4521-2023},
}
Figure