Clinician Assessment of Laryngeal Disease with Auditory AI before Laryngoscopy: A Paired Reader Study

Siyuan Hou, Shuting Yang, Zengrui Jin, Liyu Cheng, Siyin Wang, Yunhan Shi, Xueyan Li, Rong Hu, Yuhong Lin, Qiyu Chen, Yanru Li, Ji Wu, Bowen Zhou, Mangsuo Zhao, Wen Xu, Chao ZhangarXiv 2026 · arXiv

TL;DR

Researchers developed an auditory large language model (LLM) to help clinicians categorize laryngeal diseases from voice recordings before performing a laryngoscopy. In a study with 32 clinicians, the AI "assessment card" improved diagnostic accuracy and significantly boosted the sensitivity for detecting precancerous or malignant lesions from 53.9% to 75.0%.

What Problem Does This Paper Address?

When a patient presents with hoarseness (dysphonia), clinicians must form a "provisional impression" of the cause before they ever look at the larynx with a scope. This initial judgment is critical: it determines how urgently a laryngoscopy is scheduled and whether specialized imaging is needed to rule out cancer.

The problem? Humans—even specialists—are surprisingly unreliable at this. Previous studies have shown that laryngologists reach the correct diagnosis using only history and physical exams in as few as 5% of cases. While voice is a rich data source, its manifestations often overlap across structural, functional, and neoplastic disorders. This paper investigates whether a voice-based AI can act as a clinical decision support tool to improve these early, pre-laryngoscopic judgments.

Methods

The authors developed an Auditory Large Language Model based on the Qwen3-Omni-30B-A3B-Thinking architecture (a sparse mixture-of-experts model). Unlike traditional acoustic classifiers that rely on hand-crafted features, this model accepts raw audio as direct input.

Key technical highlights include:

  • Multi-task Fine-tuning: The model was trained using Low-Rank Adaptation (LoRA) to perform seven-class disease categorization, perceptual voice rating (the GRBAS scale), and rationale generation.
  • The Assessment Card: Instead of a simple "black box" prediction, the AI generates a patient-level card containing a provisional category, voice-quality ratings, and a brief clinical rationale.
  • Malignancy Alert: A separate high-sensitivity alert was designed specifically to flag suspected cancer or precancerous lesions.
  • Paired Reader Study: To test real-world utility, 32 otolaryngology clinicians participated in a two-round study. They first categorized cases unaided, then re-evaluated the same cases 1–2 weeks later with the AI assessment card.

Datasets

The study primarily utilized a Mandarin clinical voice cohort from the Voice Center of Beijing Tongren Hospital (N=1,946).

  • Training/Validation/Test: Partitioned 8:1:1.
  • Temporal Validation: A separate cohort of 195 participants assessed later in time to test the model's robustness against "data drift."
  • Auxiliary Data: The model was also pre-trained on the Speech Accessibility Project (English dysarthria data) and QualiSpeech to improve its general auditory reasoning capabilities.

Key Insights and Ideas

  • The "Double-Edged Sword" of AI Assistance: The study highlights a phenomenon called "selective reliance." While the AI helped clinicians fix 99 incorrect initial guesses, it also led them to change 43 correct initial guesses to incorrect ones. Accuracy rose by 14.7 points when the model was right but fell by 8.7 points when the model was wrong.
  • Prioritizing Sensitivity for Cancer: In clinical practice, missing a malignancy is far worse than a false alarm. The AI's "Malignancy Alert" achieved ~86% sensitivity, outperforming the model’s own provisional categorization for high-risk cases.
  • Rationale as Context: By providing a rationale (e.g., "Irregular vocal fold vibration with aperiodic energy increase..."), the AI moves toward "explainable AI," helping clinicians integrate the tool into their own reasoning process rather than just following a prompt.

Key Results

  • Clinician Improvement: Overall reader accuracy increased from 49.8% to 56.8% after reviewing the AI card ($P < 0.001$).
  • Catching Cancer: The most dramatic gain was in the sensitivity for precancerous or malignant lesions, which jumped from 53.9% to 75.0% with AI assistance.
  • Standalone Performance: The AI alone achieved 72% accuracy in the held-out test set, significantly outperforming the unaided clinicians and traditional acoustic machine learning baselines (which hovered around 53%).
  • Consistency: The model maintained a 67% accuracy in temporal validation, suggesting the "locked" model is stable over time.

Limitations and Future Work

The authors are transparent about several hurdles:

  1. Sequential Bias: Because clinicians saw the AI card in a second round, the improvement might be partially due to "re-reviewing" the case rather than the AI itself (though the bidirectional change in accuracy suggests the AI had a specific influence).
  2. Single-Center Study: All data came from one hospital in Beijing. The model's performance on different dialects, languages, or recording environments remains unknown.
  3. The "Black Box" of Rationale: While the rationales look clinical, they were not independently audited for "faithfulness"—meaning the AI might provide a correct diagnosis with a "hallucinated" or logically flawed explanation.

Future Work: The team calls for randomized, multi-center trials and external evaluations to see if this "auditory ear" holds up across diverse global populations.

Summary updated

Abstract

Background: Before laryngoscopy, clinicians assess the likely cause of hoarseness and whether to suspect a precancerous or malignant lesion. Whether voice-based artificial intelligence (AI) supports pre-laryngoscopic categorization is unknown. Methods: We developed an auditory large language model that generates a patient-level assessment card (provisional category, voice-quality ratings, and rationale) and a prespecified malignancy alert from voice recordings, patient information, and acoustic measures obtained before laryngoscopy at one center. We evaluated both in a held-out test set and a later cohort. In a sequential reader study, 32 otolaryngology clinicians categorized held-out cases without AI and, 1 to 2 weeks later, reviewed their initial categories with the card (without the alert). Results: Across 800 paired assessments, reader accuracy was 49.8% before and 56.8% after review (difference, 7.0 percentage points; 95% CI, 1.7 to 13.5; P < 0.001); 99 categories changed from incorrect to correct and 43 from correct to incorrect (ratio, 2.30; 95% CI, 1.22 to 5.31). Accuracy rose 14.7 points when the model was correct and fell 8.7 when incorrect. Provisional-category accuracy was 72% in held-out testing and 67% in temporal validation. The malignancy alert flagged 85.7% and 86.8% of precancerous or malignant lesions. Sensitivity for precancerous or malignant lesions increased from 53.9% to 75.0% after AI-assisted review (difference, 21.1 percentage points; 95% CI, 4.3 to 42.0). Conclusions: In this single-center study, clinicians' pre-laryngoscopic categorization accuracy was higher after reviewing the AI assessment card, although the sequential design cannot fully separate AI assistance from reassessment; gains depended on model correctness without clearly selective adoption. Randomized and external evaluations, including of the malignancy alert, are needed.
BibTeX
@misc{hou2026clinician,
  author = {Siyuan Hou and Shuting Yang and Zengrui Jin and Liyu Cheng and Siyin Wang and Yunhan Shi and Xueyan Li and Rong Hu and Yuhong Lin and Qiyu Chen and Yanru Li and Ji Wu and Bowen Zhou and Mangsuo Zhao and Wen Xu and Chao Zhang},
  title = {{Clinician Assessment of Laryngeal Disease with Auditory AI before Laryngoscopy: A Paired Reader Study}},
  year = {2026},
  eprint = {2611.20050},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.20050},
}
Figure