Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning

Jyotibdha Acharya, Arindam Basu

TL;DR

This paper introduces a hybrid CNN-RNN deep learning model for classifying respiratory sounds (wheeze, crackle) to aid in diagnosing pulmonary diseases. It proposes a novel patient-specific model tuning strategy that significantly improves accuracy by adapting a general model to individual patient data, and a weight quantization technique to enable deployment on memory-constrained wearable devices.

What Problem Does This Paper Address?

Diagnosing respiratory and pulmonary diseases often relies on auscultation, a process that requires trained medical professionals and can suffer from subjectivity. While automated methods exist, they often struggle with inter-patient variability, making them unreliable for long-term monitoring, especially in the context of wearable devices which have limited computational resources. Existing deep learning approaches require large datasets, which are scarce in the medical domain, and often focus on generalized models that don't account for individual patient differences.

Methods

The core of the proposed solution is a hybrid CNN-RNN model.

  • Feature Extraction: Respiratory sounds are converted into Mel-spectrograms, which are then treated as 2D images.
  • CNN Stage: A deep convolutional neural network (CNN) acts as a feature extractor, learning abstract representations from the Mel-spectrograms.
  • RNN Stage: A bidirectional Long Short-Term Memory (Bi-LSTM) layer processes these features to capture temporal dependencies and sequential patterns in the breathing sounds.
  • Classification Stage: Fully connected layers and a softmax function are used to predict the class probabilities (normal, wheeze, crackle, or both).

To address the limitations of generalized models, the authors introduce a patient-specific model tuning strategy:

  1. Screening: A pre-trained model is used to screen patients, identifying those likely to have respiratory anomalies.
  2. Re-training: For identified unhealthy patients, a portion of the pre-trained model (specifically, the last stage) is re-trained using limited patient-specific data. This leverages the domain-specific knowledge learned from a larger dataset while adapting to individual patient characteristics.

To enable deployment on resource-constrained wearable devices, a local log quantization strategy is employed. This technique reduces the memory footprint of the model weights by quantizing them in the log domain, aiming to achieve significant memory reduction without substantial loss in performance.

Datasets

The primary dataset used is the International Conference on Biomedical and Health Informatics (ICBHI'17) scientific challenge respiratory sound database. This is described as the largest publicly available respiratory sound database, containing 920 recordings from 126 patients. The recordings are annotated with four classes: normal, wheeze, crackle, and both (wheeze and crackle).

The authors also mention using the Tensorflow speech recognition challenge dataset and the UrbanSound8K dataset for benchmarking transfer learning capabilities.

Key Insights and Ideas

  • Patient-Specific Tuning is Crucial: The paper strongly emphasizes that inter-patient variability is a significant challenge for respiratory sound classification. Adapting models to individual patients, even with limited data, leads to substantially more reliable and accurate diagnoses.
  • Domain-Specific Pre-training Matters: The hybrid CNN-RNN model, when pre-trained on respiratory data, learns domain-specific features that are more effective than features learned from general image datasets (like ImageNet) or other audio datasets. This highlights the importance of training on relevant data for specialized tasks.
  • Hybrid CNN-RNN Architecture is Effective: The combination of CNNs for feature extraction and RNNs for temporal modeling proves to be a powerful approach for capturing the complex patterns in respiratory sounds.
  • Quantization for Wearables: The proposed local log quantization method offers a practical solution for deploying complex deep learning models on devices with limited memory, a critical step towards real-world wearable health monitoring.

Key Results

  • Generalized Model Performance: The proposed hybrid CNN-RNN model achieved a score of 66.31% on a 80-20 patient split for four-class classification, outperforming VGG-16 and MobileNet models.
  • Patient-Specific Model Performance: When re-trained with patient-specific data using a leave-one-out cross-validation strategy, the model achieved a significantly higher score of 71.81%.
  • Weight Quantization: The local log quantization technique achieved approximately a 4x reduction in total memory cost without a significant loss of performance. VGG-16 required the least bit precision to achieve full accuracy after quantization, while MobileNet required the most.
  • Computational Complexity vs. Memory: The paper shows a trade-off between computational complexity and memory footprint. MobileNet is computationally efficient but requires more memory than the hybrid CNN-RNN, which offers a good balance for wearable applications.

Limitations and Future Work

  • Data Scarcity: While data augmentation and patient-specific tuning help, the inherent scarcity of medical datasets remains a challenge for training deep learning models.
  • Transfer Learning Hypothesis: The authors hypothesize that image-trained models might transfer knowledge better than audio-trained models due to the larger scale of datasets like ImageNet. However, they acknowledge that this needs further investigation, especially with prohibitively long training times for audio models.
  • Future Work: The authors plan to explore transfer learning performance from both audio and image datasets in more detail. They also aim to create more patient-specific models with larger amounts of patient data and investigate embedded implementation for wearable devices, potentially using neuromorphic spike-based approaches for further computational complexity reduction.

Summary updated

Abstract

The primary objective of this paper is to build classification models and strategies to identify breathing sound anomalies (wheeze, crackle) for automated diagnosis of respiratory and pulmonary diseases. In this work we propose a deep CNN-RNN model that classifies respiratory sounds based on Mel-spectrograms. We also implement a patient specific model tuning strategy that first screens respiratory patients and then builds patient specific classification models using limited patient data for reliable anomaly detection. Moreover, we devise a local log quantization strategy for model weights to reduce the memory footprint for deployment in memory constrained systems such as wearable devices. The proposed hybrid CNN-RNN model achieves a score of 66.31% on four-class classification of breathing cycles for ICBHI'17 scientific challenge respiratory sound database. When the model is re-trained with patient specific data, it produces a score of 71.81% for leave-one-out validation. The proposed weight quantization technique achieves ~4X reduction in total memory cost without loss of performance. The main contribution of the paper is as follows: Firstly, the proposed model is able to achieve state of the art score on the ICBHI'17 dataset. Secondly, deep learning models are shown to successfully learn domain specific knowledge when pre-trained with breathing data and produce significantly superior performance compared to generalized models. Finally, local log quantization of trained weights is shown to be able to reduce the memory requirement significantly. This type of patient-specific re-training strategy can be very useful in developing reliable long-term automated patient monitoring systems particularly in wearable healthcare solutions.
BibTeX
@article{acharya2020deep,
  author = {Jyotibdha Acharya and Arindam Basu},
  title = {{Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning}},
  journal = {IEEE Trans. Biomed. Circuits Syst.},
  year = {2020},
  url = {https://openreview.net/forum?id=roJFKv1Wx4},
}
Figure