A Non-Intrusive Approach to Assessing Dysarthria Severity: Advancing Clinical Diagnosis

Ganjun Liu, Xiaohui Hou, Meng Ge, Tao Zhang, Haizhou Li

Abstract

AI-driven severity assessment techniques for dysarthric disorders show promise in aiding speech-language pathologists with diagnostics and therapeutic follow-ups for patients. Existing solutions generally focus on the average intelligibility and hoarseness of the individual speaker's speech (i.e., speaker-level classification). This potentially ignores the slight variations in pronunciation attributed to the speaker's dysarthric disorders, e.g., /t/ and /d/. To address this issue, we rethink the inherent differences in the dysarthria speech, and propose a non-intrusive severity assessment approach called DysarNet. Specifically, we first design a prosodic emphasis module based on frame-level speech features to highlight the fine-grained temporal changes including pronunciation content, rhythm, and timing. Second, we design a multi-scale aggregation strategy to collect statistical cues on articulatory information at different scales, i.e., frame-level and utterance-level. By doing so, multi-scale prosody and articulatory cues are directly assist the prediction network for assessing dysarthria severity from multiple views, and naturally achieve speaker-independent generalization ability. Experimental results on VCC 2018 and TORGO datasets show that our DysarNet excels in assessing dysarthria severity.
BibTeX
@inproceedings{liu2024non,
  author = {Ganjun Liu and Xiaohui Hou and Meng Ge and Tao Zhang and Haizhou Li},
  title = {{A Non-Intrusive Approach to Assessing Dysarthria Severity: Advancing Clinical Diagnosis}},
  booktitle = {The Web Conference},
  year = {2024},
  doi = {10.1145/3589335.3651449},
}

Loading related content...

Figure