Breath-Dx: A Time Series Classification Benchmark for Disease Screening with eNose

Ivan Poddiakov, Ivan Kruzhilov, Galina Zubkova, Svetlana Erofeeva, Andrey Savchenko, Pavel BlinovarXiv 2026 · arXiv

TL;DR

Breath-Dx is the first comprehensive open-source benchmark and the largest public clinical dataset (S-OH) for electronic nose (eNose) disease screening. By evaluating 10 machine learning methods across 1,234 patients, the authors demonstrate that "sensor drift" significantly inflates performance in traditional studies and provide a realistic, temporal-split framework to accelerate clinical breathomics.

What Problem Does This Paper Address?

Electronic nose (eNose) technology—which "smells" volatile organic compounds (VOCs) in exhaled breath—promises a non-invasive, portable way to screen for diseases like lung cancer or COPD. However, the field has been stuck in a "reproducibility crisis." Most studies rely on tiny, private datasets (often fewer than 100 samples) and inconsistent evaluation protocols.

The biggest hidden enemy in this field is sensor drift: the gradual change in sensor responses over time due to aging, contamination, or environmental factors. Most researchers use random cross-validation, which accidentally mixes samples from the same time period into both training and testing sets. This masks the drift, leading to overly optimistic results that fail when the device is actually deployed in a clinic months later.

Methods

The authors systematically evaluate 10 methods across four distinct families to see which handles high-dimensional, drifting time series best:

  1. Feature-based Tabular Learners: Models like CatBoost, XGBoost, and RandomForest trained on statistical summaries (min, max, mean) and kinetic features (fitting logistic growth curves to the sensor signals).
  2. Convolution-based Models: Treating the time series as an image to leverage 2D CNNs and ResNet18 (pre-trained on ImageNet), allowing for transfer learning on small medical datasets.
  3. Graph-based Methods: Using Graphormer, where each sensor channel is a node in a complete graph, to capture the relationships and ratios between different sensors.
  4. Specialized Time Series Architectures: Deep learning models designed for sequences, including LSTM (Long Short-Term Memory), InceptionTime, and TS2Vec (an unsupervised representation learning framework).

Crucially, they introduce a temporal validation protocol. Instead of random splits, they partition data by collection weeks, ensuring the model is tested on data collected after the training data, simulating real-world sensor degradation.

Datasets

The paper introduces the Scent of Health (S-OH) dataset, which is now the largest public clinical eNose collection.

  • Scale: 1,234 patients.
  • Diversity: Nine diagnostic groups, including healthy controls and eight diseases (Diabetes, Gastritis, Liver Disease, Hepatitis B/C, Lung Cancer, Chronic Renal Failure, COPD, and Tuberculosis).
  • Data: 17-channel multivariate time series, each roughly 15 minutes long.
  • Temporal Depth: Collected over 13 consecutive weeks across two clinical sites.
Fig. 1: Distribution of samples per week and diagnostic group. Each cell shows the number of samples. Weeks (W1-W13) are shown on the vertical axis, ICD-10 codes on the horizontal axis.

Key Insights and Ideas

  • Drift is a "Strong Signal": The authors found they could predict the day a measurement was taken (from day 1 to 71) with a median error of only 2-3 days just by looking at the raw sensor data. This proves that drift is a massive, non-stationary component of the signal that models can easily overfit to if not properly validated.
  • The "Drift Tax": Switching from random cross-validation to realistic temporal validation caused a performance drop of 0.05 to 0.12 AUC. This suggests that many previously published eNose results are likely over-optimistic.
  • Demographic Confounders: For some conditions like lung cancer and tuberculosis, age alone is a powerful predictor (AUC > 0.67). In these cases, the eNose signal adds surprisingly little value. However, for liver disease and gastritis, demographics fail (AUC ≈ 0.5), while the eNose achieves AUC > 0.65, proving the breath signal carries independent diagnostic value.
  • Stability vs. Peak Performance: No single model won every category. LSTM was the most consistent "all-rounder," while Graphormer and InceptionTime achieved the highest peak scores on specific diseases but were less stable across the board.
Fig. 2: Progressive sensor signal deterioration.

Key Results

  • Top Performers: The best results were achieved for COPD (AUC 0.767) using Graphormer and Lung Cancer (AUC 0.746) using InceptionTime.
  • Linear Baseline: A simple Logistic Regression on flattened raw signals proved surprisingly competitive, sometimes outperforming complex deep learning models. This highlights the importance of using strong baselines before claiming "algorithmic progress."
  • Hard Tasks: Diabetes and Tuberculosis remained near chance (AUC 0.45-0.55) for most models, likely due to the effects of ongoing treatment or specific clinical site conditions normalizing the breath profiles.

Limitations and Future Work

The authors acknowledge that while S-OH is a multi-site dataset, all data was collected using the same eNose device model. Future work needs to address cross-device generalization (how a model trained on Device A performs on Device B).

Additionally, this paper establishes a baseline without applying active drift correction techniques. The authors suggest that future research should use this benchmark to test domain adaptation and style transfer methods specifically designed to mitigate the 0.05-0.12 AUC "drift tax" identified here.

Summary updated

Abstract

Electronic nose (eNose) technology offers a portable, non-invasive route for disease screening via exhaled breath analysis. However, progress in the field is hindered by the lack of systematic benchmarks that compare machine learning methods under realistic conditions, particularly sensor drift, a known but rarely quantified failure mode. Most existing studies rely on small, private datasets with inconsistent protocols, rendering results non-comparable and slowing progress. We introduce Breath-Dx, the first comprehensive benchmark of time series classification methods for breath-based disease screening. Our work leverages the Scent of Health (S-OH) dataset, the largest public clinical eNose collection to date, comprising 1,234 patients across nine diagnostic groups, each providing a 17-channel multivariate time series with explicit temporal train/test splits that account for sensor drift. We systematically evaluate 10 methods spanning four families: feature-based tabular learners, convolution-based models, graph-based, and time series architectures. All methods degrade significantly under temporal validation (0.05-0.12 AUC drop compared to random cross-validation), confirming that drift embeds a strong temporal signal. Under this realistic evaluation, the best methods achieve ROC AUC of 0.74-0.76 for some lung conditions, though others remain near chance. Recurrent architectures show the most consistent performance across diseases, while specialized time series methods achieve the highest peak results. Demographic confounders matter: breath signals provide independent diagnostic value for some conditions but add little beyond age for others. We release the S-OH dataset, all temporal splits, evaluation protocols, and code to enable reproducible research and accelerate progress in clinical breathomics.
BibTeX
@misc{poddiakov2026breath,
  author = {Ivan Poddiakov and Ivan Kruzhilov and Galina Zubkova and Svetlana Erofeeva and Andrey Savchenko and Pavel Blinov},
  title = {{Breath-Dx: A Time Series Classification Benchmark for Disease Screening with eNose}},
  year = {2026},
  eprint = {2611.15348},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.15348},
}
Figure