With the Right Representation, Classical Machine Learning Rivals Deep Models for Olfactory Mixture Similarity

Ze Dong, Yi Wang, Ambuj TewariarXiv 2026 · arXiv

TL;DR

In the battle for machine olfaction, bigger isn't always better. This paper demonstrates that by explicitly encoding the differences between odor mixtures using simple symmetric features, classical models like XGBoost can match or even outperform specialized deep learning architectures in predicting perceptual similarity.

What Problem Does This Paper Address?

Predicting how a mixture of molecules smells is a "grand challenge" in machine olfaction. Unlike single-molecule prediction, mixture similarity requires reasoning over sets of odorants. You have to account for how molecules within a mixture interact and, crucially, how two different mixtures relate to one another.

Recent breakthroughs like POMMIX used sophisticated deep learning (attention mechanisms and GNNs) to capture these relationships. Previous comparisons suggested that classical machine learning (ML) couldn't keep up. However, the authors of this paper noticed a flaw in those comparisons: the classical models were being fed "weak" representations. They were given descriptors for Mixture A and Mixture B separately, forcing the model to figure out the comparison logic (like "how much more of molecule X is in A vs B?") from scratch. In low-data environments—common in olfaction—this is a heavy lift for any model.

Methods

The authors revisit classical ML by focusing on feature engineering that respects the physics and logic of the task.

  1. Molecular Embeddings: They start with high-quality, pretrained "Principal Odor Map" (POM) embeddings for individual molecules.
  2. Aggregation: To handle mixtures of different sizes, they use PNA-style statistics (mean, variance, max, min) to create a fixed-length vector for each mixture.
  3. Explicit Comparison Features: This is the core innovation. Instead of just concatenating the vectors for Mixture A ($f_A$) and Mixture B ($f_B$), they create three symmetric feature maps:
  4. Sum: $f_A + f_B$
    • Product: $f_A \odot f_B$
    • Absolute Difference: $|f_A - f_B|$
  5. Models: They evaluate these features using XGBoost and Kernel Ridge Regression (KRR).

By design, these features are symmetric: swapping Mixture A and Mixture B results in the exact same input vector, baking the requirement of "exchange symmetry" directly into the data rather than forcing the model to learn it.

Datasets

The study uses a benchmark dataset of 865 labeled mixture pairs compiled from three landmark olfactory studies (Snitz et al., Bushdid et al., and Ravia et al.).

  • Training/Evaluation: 5-fold cross-validation (70% train, 10% validation, 20% test).
  • Pretraining: The underlying POM embeddings were trained on the GoodScents–Leffingwell (GS-LF) dataset, containing 4,814 molecules.

Key Insights and Ideas

  • The "Aha" Moment for Absolute Differences: Ablation studies revealed that coordinate-wise absolute differences ($|f_A - f_B|$) are the most powerful features. They provide a direct signal of "perceptual distance," which is exactly what the model is trying to predict.
  • Representation > Architecture: In low-data regimes, a "mixture-aware" representation is more important than a "mixture-aware" neural architecture. When the representation explicitly shows the model how two things differ, the need for complex deep learning layers diminishes.
  • Symmetry as a Prior: By using symmetric features, the authors eliminated the need for "pair-swap" data augmentation, which was required for previous classical baselines to understand that the order of mixtures doesn't matter.

Key Results

  • Competitive Performance: XGBoost with mixture-level comparison features achieved a mean Pearson correlation of 0.7861, slightly edging out the state-of-the-art deep model, POMMIX (0.7790).
  • Massive Baseline Improvement: Previous XGBoost baselines (using independent descriptors) only reached a Pearson correlation of ~0.50. Simply changing how the mixtures were compared nearly doubled the performance.
  • Feature Importance: Absolute differences accounted for over 52% of the model's gain importance, confirming that "how mixtures differ" is the most critical signal for the task.
  • KRR Gains: Even Kernel Ridge Regression, which performed poorly with standard kernels (0.45), jumped to 0.75 when given the explicit difference features.

Limitations and Future Work

  • Generalization Challenges: The current benchmark uses random splits. The authors note that future work should test these classical models on more difficult "out-of-distribution" tasks, such as predicting similarity for entirely unseen molecules or mixtures of vastly different sizes.
  • Interaction Modeling: While mixture-level features were dominant, the authors' attempt at molecule-to-molecule interaction features (cross-mixture statistics) provided negligible gains. They suggest that more expressive, yet still symmetric, ways to represent molecule-level interactions might be needed.
  • The "Low-Data" Caveat: The success of classical ML here may be partly due to the small size of the dataset (865 pairs). As olfactory datasets grow into the tens of thousands, the flexibility of deep learning might eventually pull ahead again.

Summary updated

Abstract

Modeling olfactory mixtures remains a critical challenge in machine olfaction because the task requires reasoning over relationships between sets of odorants rather than over individual molecules in isolation. However, prior comparisons between deep and classical approaches also varied how the relationship between the two mixtures was represented, since the classical baselines primarily relied on weak representations that described each mixture independently and provided little direct signal about how the mixtures differed. In this work, we revisit classical learning using explicit symmetric comparison features on unordered pairs of mixtures, evaluating these representations with XGBoost and kernel ridge regression (KRR). We find that XGBoost with explicit comparison features achieves performance competitive with specialized deep mixture models on the main benchmark. Ablation studies show that coordinate-wise absolute differences alone provide strong predictive performance, while combining them with sums and products yields further improvements. KRR also benefits substantially from explicit comparison features, with further gains from appropriate kernel choice and preprocessing. Overall, these results suggest that explicitly encoding how two mixtures differ is an important ingredient for classical machine learning in low-data olfactory mixture prediction.
BibTeX
@misc{dong2026with,
  author = {Ze Dong and Yi Wang and Ambuj Tewari},
  title = {{With the Right Representation, Classical Machine Learning Rivals Deep Models for Olfactory Mixture Similarity}},
  year = {2026},
  eprint = {2611.19650},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.19650},
}
Figure