Abstract
While neural network-based methods are praised for their prediction performance, they are often criticized for their lack of interpretability. When dealing with multi-modal data, models must learn the independent and joint effects of heterogeneous views while yielding interpretable results. In this work, we demonstrate how multi-view variational autoencoders (VAEs) provide a convenient statistical framework to learn the input data joint distribution. We design a method that discovers relationships between views by generating "digital avatars"—synthetic brain representations corresponding to specific clinical statuses. By computing associations between cortical regions and behavioral scores in the Healthy Brain Network (HBN) cohort, we showcase that such digital avatars convey interpretable information for children experiencing mental health issues.
Introduction
In the study of complex conditions like Autism Spectrum Disorder (ASD), researchers manage multi-modal data from diverse sources, including MRI scans and clinical questionnaires. While deep learning models excel at pattern recognition, they are notoriously difficult to interpret. Traditional ASD research often attempts to force patients into rigid subgroups that fail to replicate across datasets. This paper argues for a "dimensional approach" that examines the entire spectrum of variability. The challenge lies in building a model that integrates diverse data types while remaining transparent enough for clinicians to understand underlying biological relationships.
Methodology: The Digital Avatar Framework
The proposed framework utilizes the MoPoe-VAE (Mixture-of-Product-of-Experts Variational Autoencoder) architecture. Unlike standard VAEs, this model handles multiple "views" (e.g., imaging and clinical scores) and remains robust even with missing data. It learns a joint latent space that captures the essence of both brain structure and behavior.
The core innovation is a three-step interpretability pipeline:
- Inference: The model maps a subject into the joint latent space.
- Simulation: Researchers "perturb" a specific clinical score (e.g., increasing an anxiety score) and use the model to generate what that child's brain would look like at that new status. This synthetic reconstruction is the "digital avatar."
- Association: By repeating this for many subjects and using hierarchical linear regressions, the authors statistically map which brain regions are most sensitive to changes in specific behaviors.
Experimental Setup and Datasets
The study utilizes the Healthy Brain Network (HBN) cohort, focusing on psychiatric disorders in children and adolescents. The dataset includes 2,991 samples, with 1,505 subjects providing both imaging and clinical data.
- Clinical View: Seven scores assessing social responsiveness (SRS), anxiety (SCARED), depression (ARI), and behavioral disorders (CBCL).
- Image View: Structural MRI data processed to extract cortical thickness, curvature, and area across the Destrieux parcellation.
Key Results and Discussion
The model successfully isolated biological signals from technical noise. Representational Similarity Analysis (RSA) revealed that while the "Image" latent space encoded clinical site effects, the "Joint" latent space was significantly less impacted.
The framework identified several significant associations aligning with ASD literature:
- Social Responsiveness (SRS): Higher challenges were associated with increased cortical thickness in the right insula and left temporal superior regions, but decreased thickness in the central sulcus.
- Anxiety and Seclusion: Distinct patterns were found; for instance, left and right temporal areas were linked to anxiety and seclusion scores through curvature and area measurements.
- Statistical Robustness: Results were validated using bootstrapping (reproducible in >70% of experiments) and Bonferroni correction.
Conclusion
By moving beyond rigid subtyping, this framework treats ASD as a continuous spectrum. While currently limited by one-at-a-time feature perturbation, future work will explore multi-feature interactions and longitudinal data to better reflect biological reality and track symptom evolution over time.
Summary updated