Abstract
Extracting structured clinical data from unstructured radiology reports is a critical task in medical AI. While specialized single-task models are common, they are computationally expensive and difficult to scale. This paper explores the use of Multi-Task Learning (MTL) to consolidate multiple pathology extraction tasks into a single efficient model. By analyzing internal representations via Central Kernel Alignment (CKA) and monitoring gradient alignment during training, we demonstrate that different spinal pathology tasks naturally converge on similar features. Our findings show that MTL models achieve performance parity with single-task baselines while providing a 3x inference speedup, offering a scalable solution for high-stakes medical NLP.
Introduction
In medical AI, the transition from unstructured radiologist notes to structured data is essential for downstream clinical decision support. Traditionally, practitioners deploy individual "single-task" models for every specific condition—such as disc herniation or spinal stenosis. However, this approach is resource-intensive, as large Transformer-based models like BERT require significant computational power for both training and deployment. Furthermore, medical data is often scarce and plagued by character-level noise from OCR errors. This study investigates whether Multi-Task Learning (MTL) can provide a more efficient alternative and seeks to explain the underlying mechanisms that allow diverse medical NLP tasks to share a single model backbone effectively.
Methodology
The researchers developed a modular pipeline designed to process complex spine MRI reports. The system first utilizes a "Report Segmenter" to isolate specific motion segments (e.g., L1-L2, L5-S1). These segments are then passed to classifier models to determine the severity of various pathologies.
To evaluate the synergy between tasks, the study employed two diagnostic tools:
- Central Kernel Alignment (CKA): A scalar similarity index used to compare hidden layer representations. High CKA scores indicate that different models are extracting similar features from the same input.
- Gradient Alignment: The authors tracked the Average Proportion of Aligned Gradients (APAG) during training to determine if different tasks were pushing the model's weights in consistent directions.
The experiments utilized PubMedBERT as the primary backbone, given its specialized pre-training on medical literature.
Key Insights: Why MTL Works
The study reveals that even when trained independently, models for different spinal pathologies develop remarkably similar internal representations. CKA scores across hidden layers were consistently high, typically exceeding 0.86. This suggests that the linguistic features required to identify "stenosis" are fundamentally similar to those needed for "disc herniation."
Furthermore, the researchers observed a "convergent evolution" in gradients. While tasks may initially conflict during early training epochs, the gradients for different tasks become increasingly aligned as the model matures. This alignment explains the success of MTL: forcing tasks to share a backbone does not cause conflict but rather provides a helpful regularization effect, as the tasks naturally move toward the same mathematical trajectory.
Results and Performance
The MTL approach demonstrated significant advantages in both accuracy and efficiency:
- Performance Parity: MTL models matched or slightly outperformed single-task baselines. In the Lumbar dataset, the MTL model achieved a Macro F1 of 0.84 for stenosis and 0.86 for nerve root impingement.
- Inference Efficiency: By consolidating tasks into a single forward pass, the team achieved a 3x improvement in latency per study. This efficiency is vital for production environments where cost and processing speed are paramount.
- Domain-Specific Vocabulary: PubMedBERT consistently outperformed general-purpose BERT models, confirming that a vocabulary tailored to medical literature is essential for handling the nuances of clinical text.
Conclusion
This research demonstrates that Multi-Task Learning is not only a viable alternative to specialized single-task models but is also scientifically supported by the natural alignment of medical NLP tasks. By sharing internal representations, MTL models achieve high performance with significantly lower computational overhead. Future work will explore whether these findings extend to other medical domains, such as oncology or cardiology, and investigate "gradient surgery" techniques to further optimize multi-task training.
Summary updated