Introduction
Deep Neural Networks (DNNs) have become indispensable tools for analyzing complex neuroimaging data. However, their "black box" nature remains a significant barrier to clinical adoption. Existing interpretability methods are primarily post-hoc, analyzing static, fully trained models. These methods often fail to capture the dynamic process of learning and can produce inconsistent saliency maps. To address these limitations, we introduce AutoSpec, an introspection framework that utilizes Singular Value Decomposition (SVD) to monitor the mathematical spectrum of gradients during the training process.
Methodology: The AutoSpec Framework
AutoSpec leverages the fundamental mechanics of backpropagation. In reverse-mode auto-differentiation, the gradient of a weight matrix ($\nabla W$) is decomposed into the product of input activations ($A$) and error signals (adjoint variables, $\Delta$). By performing SVD on these components in real-time, AutoSpec tracks the "spectrum" of singular values.
This approach allows for:
- Rank Monitoring: Quantifying the effective dimensionality of information utilized at each layer.
- Gradient Decomposition: Calculating group-specific gradients (e.g., patients vs. controls) to observe how different data cohorts drive the learning process without interrupting training.
Experimental Setup
The framework was validated across a wide range of data modalities and architectures, as summarized in the table below.
The study included baseline numerical data (MNIST), tabular neuroimaging (FreeSurfer), and functional neuroimaging (COBRE) for schizophrenia research.
Results and Discussion
Task-Specific Spectral Fingerprints
Our analysis revealed that gradient spectra serve as unique "fingerprints" for specific tasks. For instance, Autoencoders exhibit high-rank dynamics in early layers as they attempt to reconstruct complex inputs. In contrast, Classifiers quickly compress information, narrowing their spectral focus to task-relevant features.
Training Trajectories and Group Dynamics
Spectral plots illustrate how singular values evolve over time. In models like BERT and LSTMs, we observed a consistent trend of "spectral shrinking," indicating information compression as the model converges.
Crucially, AutoSpec identified significant differences in training dynamics between schizophrenia patients (SZ) and healthy controls (HC). Statistical tests on the gradient spectra pinpointed specific layers and training epochs where the model's perception of these groups diverged, suggesting that the model captures distinct features for different clinical populations during learning.
Conclusion and Future Work
AutoSpec provides a novel window into the training dynamics of DNNs, offering insights that post-hoc methods miss. While the computational cost of real-time SVD is a current limitation, future work will focus on analytic spectral updates and scaling the framework to larger architectures like foundation models for medical imaging. By identifying group-specific biases during training, AutoSpec paves the way for more transparent and equitable neuroimaging AI.
Summary updated