Enhancing Lung Ultrasound Diagnostics: A Clinical Study on an Artificial Intelligence Tool for the Detection and Quantification of A-Lines and B-Lines

Mahdiar Nekoui, Seyed Ehsan Seyed Bolouri, Amir Forouzandeh, Masood Dehghan, Dornoosh Zonoobi, Jacob L. Jaremko, Brian Buchanan, Arun Nagdev, Jeevesh KapurDiagnostics 2024 · DOI

TL;DR

This paper introduces and evaluates ExoLungAI, an AI tool designed to automatically detect and quantify A-lines and B-lines in lung ultrasound images. The AI demonstrates strong performance, offering a more objective and efficient alternative to manual interpretation, which can significantly aid clinicians in diagnosing pulmonary conditions.

What Problem Does This Paper Address?

Lung ultrasound (LUS) is a valuable, low-cost, and non-invasive tool for assessing lung health at the point of care. Key indicators in LUS are A-lines (horizontal lines indicating normal or hyperinflated lungs) and B-lines (vertical artifacts associated with lung abnormalities like edema or pneumonia). However, manual interpretation of these lines is often subjective, leading to high inter-observer variability and being time-consuming. This variability can hinder accurate diagnosis and monitoring of disease severity. The paper addresses the need for a more objective, consistent, and efficient method for A-line and B-line assessment, particularly in critical care settings.

Methods

The study evaluates ExoLungAI, an AI tool utilizing convolutional neural networks. The AI processes lung ultrasound videos, visualizing A-lines (in green) and B-lines (in red) in real-time for each frame. Internally, it quantifies B-lines based on the percentage of rib space affected and classifies scans as "B-line cases" if the count exceeds a predefined threshold (initially 5, but adjustable). Similarly, A-line presence is determined by the frequency of A-line frames. The AI's workflow involves feeding raw LUS videos, visualizing findings, and providing a final classification. The tool's inference time per frame is under 16 milliseconds, allowing for real-time feedback during scanning.

Datasets

The study utilized a dataset of 692 lung ultrasound scans collected from 48 patients admitted to the University of Alberta Hospital between April 2021 and January 2022. These patients were experiencing COVID-19 symptoms, including respiratory failure and pneumonia. The scans were acquired using phased-array Philips Lumify and Clarius handheld probes. The ground truth for A-line and B-line assessment was established by two expert users who annotated the videos, reaching a consensus reading.

Key Insights and Ideas

  • Bridging the Subjectivity Gap: The core innovation is the development of an AI that tackles the inherent subjectivity of manual LUS interpretation, aiming for consistent and objective A-line and B-line analysis.
  • Real-time Explainability: ExoLungAI's ability to visualize A-lines and B-lines in real-time for each frame is crucial. This "explainable AI" approach allows clinicians to understand why the AI makes a certain classification, fostering trust and enabling them to override the AI if necessary.
  • Clinical Utility Beyond Diagnosis: The AI's potential extends beyond initial diagnosis; it can aid in monitoring disease progression and the effectiveness of treatments by providing quantitative data on B-line counts.
  • Accessibility and Training: The tool has the potential to democratize LUS expertise, making it more accessible in remote areas and serving as a valuable training aid for new practitioners by providing consistent examples.

Key Results

  • A-line Detection: ExoLungAI achieved a sensitivity of 91% and a specificity of 81% for A-line detection.
  • B-line Detection: For B-line detection, the AI attained a sensitivity of 84% and a specificity of 86% (using a threshold of 5).
  • B-line Quantification: The AI demonstrated substantial agreement with the ground truth for B-line counting, achieving a weighted kappa score of 0.77 and an intraclass correlation coefficient (ICC) of 0.87.
  • Error Distribution: The distribution of errors in B-line counting showed a mean error of -0.28 and a standard deviation of 1.4, with most cases exhibiting minimal error. The AI tended to slightly overestimate B-line counts to prioritize sensitivity.
  • Confusion Matrices: The confusion matrices indicated a strong agreement between the AI's predictions and the clinical ground truth for both A-line and B-line detection, with a lower rate of false negatives compared to false positives for B-line detection.

Limitations and Future Work

The authors acknowledge several limitations:

  • Single-Center Study: The entire study was conducted at a single institution (University of Alberta Hospital).
  • Limited Time Frame: Data was collected over a specific period (April 2021 to January 2022).
  • COVID-19 Focus: The study cohort was exclusively composed of patients admitted for COVID-19 symptoms.
  • Limited Scope: The AI currently focuses only on A-lines and B-lines, neglecting other important lung ultrasound features like consolidation, pleural effusion, and lung sliding.

Future work proposed by the authors includes:

  • Expanding to Other Lung Features: Enhancing the AI to evaluate additional lung conditions beyond A-lines and B-lines.
  • Larger and Diverse Datasets: Utilizing larger and more diverse datasets to further validate and improve the AI's performance.
  • Multi-center Validation: Conducting multi-center studies to confirm the tool's generalizability.

Summary updated

Abstract

<b>Background/Objective:</b> A-lines and B-lines are key ultrasound markers that differentiate normal from abnormal lung conditions. A-lines are horizontal lines usually seen in normal aerated lungs, while B-lines are linear vertical artifacts associated with lung abnormalities such as pulmonary edema, infection, and COVID-19, where a higher number of B-lines indicates more severe pathology. This paper aimed to evaluate the effectiveness of a newly released lung ultrasound AI tool (ExoLungAI) in the detection of A-lines and quantification/detection of B-lines to help clinicians in assessing pulmonary conditions. <b>Methods</b>: The algorithm is evaluated on 692 lung ultrasound scans collected from 48 patients (65% males, aged: 55 ± 12.9) following their admission to an Intensive Care Unit (ICU) for COVID-19 symptoms, including respiratory failure, pneumonia, and other complications. <b>Results</b>: ExoLungAI achieved a sensitivity of 91% and specificity of 81% for A-line detection. For B-line detection, it attained a sensitivity of 84% and specificity of 86%. In quantifying B-lines, the algorithm achieved a weighted kappa score of 0.77 (95% CI 0.74 to 0.80) and an ICC of 0.87 (95% CI 0.85 to 0.89), showing substantial agreement between the ground truth and predicted B-line counts. <b>Conclusions</b>: ExoLungAI demonstrates a reliable performance in A-line detection and B-line detection/quantification. This automated tool has greater objectivity, consistency, and efficiency compared to manual methods. Many healthcare professionals including intensivists, radiologists, sonographers, medical trainers, and nurse practitioners can benefit from such a tool, as it assists the diagnostic capabilities of lung ultrasound and delivers rapid responses.
BibTeX
@inproceedings{nekoui2024enhancing,
  author = {Mahdiar Nekoui and Seyed Ehsan Seyed Bolouri and Amir Forouzandeh and Masood Dehghan and Dornoosh Zonoobi and Jacob L. Jaremko and Brian Buchanan and Arun Nagdev and Jeevesh Kapur},
  title = {{Enhancing Lung Ultrasound Diagnostics: A Clinical Study on an Artificial Intelligence Tool for the Detection and Quantification of A-Lines and B-Lines}},
  booktitle = {Diagnostics},
  year = {2024},
  doi = {10.3390/diagnostics14222526},
}
Figure