Abstract
Objective: Lung auscultation is critical for diagnosing pediatric pulmonary diseases. This study evaluates an artificial intelligence (AI) algorithm's performance in detecting breath sounds within a real-world clinical environment.
Method: Breath sounds from 112 children at Shanghai Children's Medical Center (SCMC) were recorded using an electronic stethoscope. A Gold Standard (GS) was established by expert consensus. The AI algorithm's performance was compared against six general pediatricians across various patient ages and recording locations.
Result: Of 672 recordings, 627 were analyzed. The AI algorithm achieved 77.7% accuracy, significantly higher than the 59.9% achieved by general pediatricians ($p < 0.001$). AI sensitivity and F1-scores for crackles and wheezes also surpassed human performance. Accuracy was highest in infants under 12 months (81.3%).
Conclusion: AI-assisted auscultation via electronic stethoscopes outperforms general pediatricians in identifying adventitious breath sounds, offering a robust tool for clinical and remote screening.
Introduction
Stethoscope auscultation remains a cornerstone of pediatric medicine, yet its effectiveness is often limited by the subjective nature of human hearing and varying levels of clinical experience. Distinguishing between normal breath sounds and adventitious sounds—such as crackles or wheezes—requires significant expertise, creating a diagnostic gap between specialized pulmonologists and general practitioners. Furthermore, traditional acoustic stethoscopes lack the capability for data storage or objective longitudinal monitoring.
This study investigates whether an AI-integrated electronic stethoscope can bridge this expertise gap. By utilizing machine learning to analyze recordings in noisy, real-world clinical settings, researchers aimed to provide an objective verification tool for pediatric respiratory health.
Methods
The study implemented a "record-upload-analyze" workflow to evaluate the AI's diagnostic capabilities.
Data Collection and Hardware
Nurses recorded 9-second clips from six specific chest locations on 112 hospitalized children at SCMC. The hardware setup included the Yunting model II electronic stethoscope connected to a mobile device for data transmission.
Auscultation Protocol
Six standardized locations on the chest and back were used to ensure comprehensive coverage of the lung fields. This protocol allowed for a systematic assessment of the respiratory system across different patient demographics.
The AI Pipeline
The AI system processed the audio through several stages:
- Pre-processing: Filtering ambient noise and identifying temporal characteristics (e.g., crackles as discontinuous signals <20ms).
- Feature Extraction: Utilizing Wavelet Packet Decomposition to extract spectral features from non-stationary breath signals.
- Classification: A Support Vector Machine (SVM), previously trained on over 12,000 real-world recordings, classified the sounds as normal, crackle, or wheeze.
Evaluation Baseline
A "Gold Standard" (GS) was established through the consensus of eight expert pulmonologists. To provide a clinical baseline, six general pediatricians also evaluated the recordings independently.
Results
A total of 627 high-quality recordings were analyzed, comprising crackles (23.1%), wheezes (38.4%), and normal sounds (38.4%).
AI vs. Human Performance
The AI algorithm demonstrated superior diagnostic accuracy across all primary metrics:
- Overall Accuracy: AI (77.7%) vs. General Pediatricians (59.9%), $p < 0.001$.
- Crackle Detection: The AI's F1-score was 80.9%, nearly doubling the pediatricians' score of 42.7%.
- Wheeze Detection: The AI achieved an F1-score of 80.9%, compared to 72.5% for the pediatricians.
Age and Location Factors
The AI's performance was notably robust in infants under 12 months, reaching an accuracy of 81.3%. This is likely due to thinner chest walls in younger patients providing clearer acoustic signals. Importantly, the algorithm maintained consistent accuracy across all six recording locations, suggesting that simplified screening protocols may be feasible.
Discussion
The findings highlight AI's potential as an "expertise leveler." By outperforming general pediatricians, the algorithm can elevate the diagnostic quality in primary care settings to a level closer to specialized centers. The system's resilience to "real-world" noise—including ambient ward sounds and patient movement—indicates its readiness for clinical integration.
Limitations
Despite its success, the algorithm currently cannot recognize "mixed" sounds (simultaneous crackles and wheezes). Additionally, the sample size for older children (>60 months) was relatively small, and the study was conducted at a single center.
Conclusion
AI-assisted auscultation provides a more accurate and objective assessment of pediatric breath sounds than general clinical evaluation. Integrating this technology into community health centers and telemedicine platforms could significantly improve respiratory screening and chronic disease management for children, especially in resource-limited areas.
Summary updated