Fast and Interpretable Machine Learning Modelling of Atmospheric Molecular Clusters

Lauri Seppäläinen, Jakub Kubecka, Jonas Elm, Kai PuolamäkiarXiv 2025 · DOI · arXiv

Introduction

Aerosol particle formation in the atmosphere remains a significant source of uncertainty in climate science. These particles originate as tiny molecular clusters, the properties of which are traditionally calculated using high-level Quantum Chemistry (QC). While precise, QC methods are computationally expensive, often requiring days for a single large cluster. Machine Learning (ML) has emerged as a powerful alternative, with Kernel Ridge Regression (KRR) currently serving as the benchmark for accuracy. However, KRR faces severe scaling challenges as datasets grow toward hundreds of thousands of entries. This paper explores the potential of $k$-nearest neighbors ($k$-NN) regression, combined with metric learning, to provide a fast, scalable, and interpretable alternative for atmospheric modeling.

Methods

The researchers propose a $k$-NN regression framework that leverages "metric learning" to overcome the limitations of standard distance measures in high-dimensional chemical spaces.

Feature Representation and Metric Learning

To represent 3D atomic structures, the study employs FCHL19 descriptors, which translate molecular geometry into mathematical vectors. In high-dimensional chemical spaces, standard Euclidean distance often fails to capture meaningful similarities—a phenomenon known as the "curse of dimensionality." To address this, the authors use Metric Learning for Kernel Regression (MLKR). Instead of using standard Euclidean distance, MLKR learns a custom distance metric that effectively reshapes the chemical space. This ensures that molecules with similar physical properties (like energy) are positioned closer together, significantly improving the accuracy of the $k$-NN search.

$\Delta$-Learning Strategy

To achieve "chemical accuracy" (errors < 1 kcal/mol), the model utilizes a $\Delta$-learning approach. Rather than predicting total energy from scratch, the $k$-NN model learns to predict the correction (the "delta") between a computationally cheap, low-level quantum method and an expensive, high-level reference method.

The k-NN approach in chemical space: the red dot represents a target cluster, with yellow dots indicating its k-nearest neighbors used for prediction. The right panel shows the resulting step-like regression curve.

Results and Discussion

The performance of the MLKR-based $k$-NN model was evaluated across three distinct scales: QM9 (organic molecules), SA-W (sulphuric acid–water clusters), and the "Clusterome" (over 250,000 atmospheric acid-base clusters).

Speed and Scalability

One of the most significant findings is the computational efficiency of the $k$-NN approach. For large datasets like the Clusterome, $k$-NN with MLKR is approximately 100 times faster to train than KRR. During inference, it can be up to two orders of magnitude faster. While KRR becomes computationally intractable at the scale of 250,000 entries, $k$-NN handles the volume seamlessly, making it ideal for "big data" chemical applications.

Accuracy and Interpretability

The model achieved near-chemical accuracy, with a Mean Absolute Error (MAE) of approximately 1 kcal/mol in $\Delta$-learning tasks for atmospheric clusters. Even when tasked with extrapolation—predicting the properties of clusters larger than those seen during training—the $k$-NN model maintained acceptable performance with an MAE of ~1.6 kcal/mol.

Beyond accuracy, the $k$-NN model offers inherent interpretability. Unlike "black-box" neural networks, where predictions emerge from complex layers of weights, a $k$-NN prediction is a simple average of its neighbors. Researchers can inspect the specific molecular structures (the "neighbors") that contributed to a prediction to gain physical insights. Furthermore, the variance among these neighbors provides a natural and well-calibrated estimate of prediction uncertainty, which is crucial for scientific applications.

Conclusion

The humble $k$-NN algorithm, when enhanced with modern metric learning and sophisticated descriptors, proves to be a formidable tool for atmospheric chemistry. It offers a unique combination of speed, scalability, and interpretability that more complex models often lack. Future work will focus on incorporating explicit chemical rules into the metric learning layer and applying these models to large-scale molecular dynamics simulations to predict atomic forces.

Summary updated

Abstract

Understanding how atmospheric molecular clusters form and grow is key to resolving one of the biggest uncertainties in climate modelling: the formation of new aerosol particles. While quantum chemistry offers accurate insights into these early-stage clusters, its steep computational costs limit large-scale exploration. In this work, we present a fast, interpretable, and surprisingly powerful alternative: $k$-nearest neighbour ($k$-NN) regression model. By leveraging chemically informed distance metrics, including a kernel-induced metric and one learned via metric learning for kernel regression (MLKR), we show that simple $k$-NN models can rival more complex kernel ridge regression (KRR) models in accuracy, while reducing computational time by orders of magnitude. We perform this comparison with the well-established Faber-Christensen-Huang-Lilienfeld (FCHL19) molecular descriptor, but other descriptors (e.g., FCHL18, MBDF, and CM) can be shown to have similar performance. Applied to both simple organic molecules in the QM9 benchmark set and large datasets of atmospheric molecular clusters (sulphuric acid-water and sulphuric-multibase -base systems), our $k$-NN models achieve near-chemical accuracy, scale seamlessly to datasets with over 250,000 entries, and even appears to extrapolate to larger unseen clusters with minimal error (often nearing 1 kcal/mol). With built-in interpretability and straightforward uncertainty estimation, this work positions $k$-NN as a potent tool for accelerating discovery in atmospheric chemistry and beyond.
BibTeX
@misc{seppalainen2025fast,
  author = {Lauri Seppäläinen and Jakub Kubecka and Jonas Elm and Kai Puolamäki},
  title = {{Fast and Interpretable Machine Learning Modelling of Atmospheric Molecular Clusters}},
  year = {2025},
  eprint = {2509.11728},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2509.11728},
}
Figure