Development and clinical validation of Swaasa AI platform for screening and prioritization of pulmonary TB

Gayatri Devi Yellapu, Gowrisree Rudraraju, Narayana Rao Sripada, Baswaraj Mamidgi, Charan Jalukuru, Priyanka Firmal, Venkat Yechuri, Sowmya Varanasi, Venkata Sudhakar Peddireddi, Devi Madhavi Bhimarasetty, Sidharth Kanisetti, Niranjan Joshi, Prasant Mohapatra, Kiran Pamarthi

TL;DR

The Swaasa AI platform is a multimodal screening tool that uses a 10-second cough recording and basic symptomatic data to identify Pulmonary Tuberculosis (PTB) with over 90% sensitivity. By combining deep learning for acoustic analysis with traditional neural networks for clinical data, it offers a low-cost, smartphone-based "digital triage" for resource-poor regions where traditional diagnostics like molecular testing are inaccessible.

What Problem Does This Paper Address?

Tuberculosis remains the world’s second leading airborne infectious disease, yet the "gold standard" diagnostics—such as sputum GeneXpert (CB-NAAT) and chest X-rays—are expensive, time-consuming, and require specialized laboratory infrastructure and trained technicians. In many low-income countries, particularly in rural or tribal areas, patients face significant delays in diagnosis due to a lack of local facilities and social inhibitions.

There is a desperate need for a fast, inexpensive, and non-invasive screening method that can prioritize high-risk individuals for confirmatory testing. The authors tackle this by investigating whether the "signature" of a TB cough—captured via a standard smartphone microphone—contains enough information to distinguish it from other respiratory conditions like asthma, COPD, or pneumonia.

Methods

The researchers developed a multimodal AI architecture called the Swaasa AI platform. The system processes two distinct types of input:

  1. Acoustic Data (The CNN Path): The system records 10 seconds of voluntary coughing. It uses a noise-reduction algorithm and a "cough/non-cough" classifier to filter out background noise (like fans or speech). The valid cough events are converted into Mel spectrograms and fed into a Convolutional Neural Network (CNN) based on the ResNet-34 architecture.
  2. Clinical Data (The FFANN Path): Tabular data including age, gender, symptoms (via the St. George’s Respiratory Questionnaire), and cough duration are processed through a Feedforward Artificial Neural Network (FFANN).

The "secret sauce" is the Combined Logic: the final layers of both models are merged into a single fully connected layer to produce a final prediction. The model classifies results as "PTB Likely," "PTB Unlikely," or "Inconclusive." To ensure the model was interpretable, the authors used LIME (Local Interpretable Model-agnostic Explanations) to visualize which parts of the sound frequency spectrum the AI was actually "listening" to when making a decision.

Datasets

The study utilized data from 567 unique subjects collected at Andhra Medical College, India. The data was split across three phases:

  • Derivation Phase: 195 PTB-positive and 152 PTB-negative subjects were used to train the model.
  • Clinical Validation Phase: 220 presumptive PTB cases were used to test the model against gold-standard CB-NAAT results.
  • Pilot Phase (External Validation): 65 individuals at a peripheral healthcare center (RHC Simhachalam) were screened to test real-world effectiveness.
  • Controls: The negative cases included healthy individuals and those with other respiratory conditions (Asthma, COPD, ILD, and Pneumonia) to ensure the model wasn't just detecting "sickness" in general, but TB specifically.

Key Insights and Ideas

  • The TB "Signature": The authors found that PTB coughs have unique spectral characteristics. Specifically, TB coughs show "positive reactions" (high energy) in both high and low-frequency regions. This is likely due to the specific way mucus and fluid accumulate in the parenchyma of the lungs in TB patients.
  • Multimodal Superiority: The paper highlights that combining acoustic signatures with symptomatic tabular data yields significantly better results than using either method in isolation.
  • Interpretability via LIME: By using LIME, the researchers could confirm the model wasn't just "guessing." For example, they observed that while Asthma and ILD show negative reactions in high-frequency regions, TB does the opposite, providing a biological basis for the AI's classification.
  • Hardware Agnostic: The system was designed to work on various smartphones (Android and iPhone) and tablets, emphasizing its utility as a ubiquitous Point-of-Care (PoC) tool.

Key Results

The Swaasa AI platform demonstrated high diagnostic accuracy across all phases:

  • Sensitivity: In the clinical validation phase, the model achieved 90.36% sensitivity. This is critical for a screening tool, as it ensures very few actual TB cases are missed.
  • Specificity: The model showed 84.67% specificity, effectively filtering out those without the disease.
  • Overall Accuracy: The validation phase accuracy was 86.82%.
  • Area Under the Curve (AUC): The model achieved an AUC of 0.94 in validation and 0.90 in the real-world pilot phase, indicating strong discriminative power.
  • Pilot Success: In the peripheral health center pilot, the model achieved a Positive Predictive Value (PPV) of 75%, proving its effectiveness in a real-world primary care setting.

Limitations and Future Work

While the results are promising, the authors note several areas for further development:

  • Demographics: The current study focused on adults (age ≥ 18). Future work is needed to validate the platform for pediatric TB.
  • Environmental Factors: While noise reduction was used, a larger-scale study is required to test the model's reliability across even more diverse environmental conditions and genetic populations.
  • Screening vs. Diagnosis: The authors emphasize that this is a screening and prioritization tool. It is intended to fast-track high-risk patients for molecular testing, not to replace confirmatory laboratory diagnosis entirely.
  • Longitudinal Tracking: Future studies could explore if cough signatures change during the course of treatment, potentially offering a way to monitor patient recovery remotely.

Summary updated

Abstract

Acoustic signal analysis has been employed in various medical devices. However, studies involving cough sound analysis to screen the potential pulmonary tuberculosis (PTB) suspects are very few. The main objective of this cross-sectional validation study was to develop and validate the Swaasa AI platform to screen and prioritize at risk patients for PTB based on the signature cough sound as well as symptomatic information provided by the subjects. The voluntary cough sound data was collected at Andhra Medical College-India. An Algorithm based on multimodal convolutional neural network architecture and feedforward artificial neural network (tabular features) was built and validated on a total of 567 subjects, comprising 278 positive and 289 negative PTB cases. The output from these two models was combined to detect the likely presence (positive cases) of PTB. In the clinical validation phase, the AI-model was found to be 86.82% accurate in detecting the likely presence of PTB with 90.36% sensitivity and 84.67% specificity. The pilot testing of model was conducted at a peripheral health care centre, RHC Simhachalam-India on 65 presumptive PTB cases. Out of which, 15 subjects truly turned out to be PTB positive with a positive predictive value of 75%. The validation results obtained from the model are quite encouraging. This platform has the potential to fulfil the unmet need of a cost-effective PTB screening method. It works remotely, presents instantaneous results, and does not require a highly trained operator. Therefore, it could be implemented in various inaccessible, resource-poor parts of the world.
BibTeX
@inproceedings{yellapu2023development,
  author = {Gayatri Devi Yellapu and Gowrisree Rudraraju and Narayana Rao Sripada and Baswaraj Mamidgi and Charan Jalukuru and Priyanka Firmal and Venkat Yechuri and Sowmya Varanasi and Venkata Sudhakar Peddireddi and Devi Madhavi Bhimarasetty and Sidharth Kanisetti and Niranjan Joshi and Prasant Mohapatra and Kiran Pamarthi},
  title = {{Development and clinical validation of Swaasa AI platform for screening and prioritization of pulmonary TB}},
  booktitle = {Scientific},
  year = {2023},
  doi = {10.1038/s41598-023-31772-9},
}

Loading related content...

Figure