TL;DR
Self-supervised contrastive learning can make heart-sound (phonocardiogram) classification models highly robust to new clinical environments, but its success hinges entirely on choosing the right data augmentations. By evaluating roughly 150 augmentation combinations across 4,000 models, this paper provides a definitive recipe for robust biosignal processing, showing that low-pass filtering and random flipping are crucial for learning generalizable audio representations.
What Problem Does This Paper Address?
Automating the detection of heart abnormalities using phonocardiograms (PCGs)—recordings of heart sounds—could revolutionize early cardiovascular care. However, deep learning models in this domain face a major hurdle: distribution shift. A model trained on data from one specific clinic often fails when deployed in another due to differences in microphones, ambient noise, patient body mass, or sensor placement.
While Self-Supervised Learning (SSL) via contrastive frameworks (like SimCLR) has proven excellent at learning robust, out-of-distribution (OOD) representations in computer vision, its application to 1D medical audio signals remains under-explored. Crucially, contrastive learning relies on data augmentations to create "views" of the data, but standard image augmentations (like cropping or color jittering) do not translate to audio waves. This paper systematically investigates which audio augmentations actually help or hinder a model's ability to generalize to unseen clinical environments.
Methods
The authors adapted the popular SimCLR contrastive learning framework for 1D PCG signals. The pipeline consists of a six-step process to pretrain a 5-layer 1D Convolutional Neural Network (CNN) backbone on unlabeled data before fine-tuning it on labeled datasets.
The core contribution is an exhaustive empirical evaluation of 6 distinct signal transformations, mixed and matched in various composition schemes (0vs1, 1vs1, 1vs2, 2vs2):
- Gaussian Noise: Adding zero-mean noise.
- Cut-off Filters: High-pass or low-pass filtering at 250, 500, or 750 Hz.
- Scale: Randomly scaling the signal amplitude.
- Reverse: Reversing the time sequence.
- Inversion: Multiplying the signal by -1.
- Random Flip: Concurrently applying reverse and inversion with a given probability.
To move beyond simple trial-and-error, the authors calculated the Cohen’s $d$ effect size for each transformation, statistically quantifying exactly how much an augmentation contributes to OOD generalization.
Datasets
The study leverages five distinct public PCG databases to rigorously test cross-dataset generalization:
- Unlabeled Pretraining: Ephnogram (multi-channel adult recordings during rest/exercise) and the Fetal PCG Database (FPCGDB).
- Labeled Downstream & OOD Evaluation: Pascal (832 signals, multi-class), PhysioNet2016 (3,126 signals, binary normal/abnormal), and PhysioNet2022 (3,163 signals, multi-class murmur detection).
Key Insights and Ideas
- Low-Pass Filters are Essential: Applying a low-pass filter (especially with a 500Hz or 250Hz cutoff) yielded a massive positive effect size ($d > 1.0$). This aligns with cardiac physiology: critical heart sound components reside in lower frequencies, while ambient environmental noise dominates higher frequencies. Low-pass filtering forces the network to focus on the invariant biological signal.
- Random Flip is a Secret Weapon: Combining sequence reversal and inversion (Random Flip with $p=0.5$) showed the highest overall positive effect size ($d \approx 1.8$).
- More Noise is Not Better: Adding artificial Gaussian noise or applying high-pass filters actively degraded performance ($d < 0$). Because clinical PCG data is already inherently noisy, adding more noise renders the signal meaningless, while high-pass filtering strips away the actual heart sounds.
Key Results
- Supervised Fragility vs. SSL Resilience: When evaluated on completely unseen, out-of-distribution datasets, fully-supervised models experienced up to a 32% drop in effectiveness. Conversely, SSL-pretrained models lost only around 10%, and in some cases, their performance actually improved on OOD data.
- OOD Superiority: On average, across all evaluation cycles, the proposed SSL framework outperformed fully-supervised baselines by 11.68% on OOD data, reaching a peak improvement of 21.04% on the PhysioNet2022 OOD task.
- Data Scarcity Mitigation: On the small and notoriously difficult Pascal dataset, the SSL model significantly outperformed the baseline even on in-distribution data, proving that SSL acts as an effective regularizer when labeled data is scarce.
Limitations and Future Work
While highly effective, the authors note that contrastive SSL comes with a steep computational constraint: it requires a massive corpus of unlabeled data to maximize representation learning and relies heavily on large training batch sizes (e.g., $B=256$, effectively $512$ after augmentation).
Moving forward, the research team plans to explore more complex, domain-specific audio transformations and extend this exact empirical benchmarking protocol to other critical 1D biosignals, such as Electrocardiograms (ECG), Electromyograms (EMG), and Electroencephalograms (EEG).
Summary updated