Mapping Many to Many Relationships in High Dimensional Data

59 concepts53 papers1 proposal

Consider a classic problem in cognitive neuroscience: how does the physical structure of the human brain relate to behavior? On one hand, we can extract thousands of features from neuroimaging data, such as cortical thickness or functional connectivity matrices. On the other hand, we can collect extensive behavioral batteries covering memory, impulsivity, and clinical symptoms.

If we try to connect these two domains using classical univariate statistics—such as correlating every single brain region with every single behavioral score independently—we run into a wall. First, we face a massive multiple-testing problem, requiring severe statistical corrections that destroy our power to detect subtle effects. Second, and more fundamentally, univariate methods assume that features act in isolation. In reality, the brain operates as an integrated network, and behaviors co-vary along complex psychological dimensions.

To capture these system-level interactions, researchers turn to multivariate latent variable modeling. Instead of asking how one brain region relates to one symptom, these methods look at entire systems at once, mapping many-to-many relationships between distinct high-dimensional datasets.

The Core Mechanism: Projecting for Alignment

The two primary mathematical workhorses for this alignment are Canonical Correlation Analysis (CCA) and Partial Least Squares (PLS).

Imagine two high-dimensional data matrices: $X$ (e.g., brain features) and $Y$ (e.g., behavioral traits). Each row represents a subject, and each column represents a feature. We want to find a way to compress the columns of $X$ into a single composite score $z_x$, and the columns of $Y$ into a single composite score $z_y$, such that $z_x$ and $z_y$ are as tightly linked as possible across all subjects.

Geometrically, this means finding a weight vector $w$ for $X$ and a weight vector $v$ for $Y$ to create linear combinations:

$$z_x = Xw \quad \text{and} \quad z_y = Yv$$

The latent variables $z_x$ and $z_y$ represent a shared "axis of variation" or a "latent dimension" across the two datasets. The difference between CCA and PLS lies entirely in what objective function they optimize:

Uncovering the Brain-Behavior Connectome

This framework has fundamentally shifted how we understand neuropsychiatric and cognitive phenotypes. Instead of relying on rigid diagnostic categories, multivariate alignment allows researchers to discover continuous, transdiagnostic dimensions of variation.

For instance, Valeria Kebets et al. applied multivariate latent variable modeling in Somatosensory-Motor Dysconnectivity Spans Multiple Transdiagnostic Dimensions of Psychopathology to map whole-brain functional connectivity maps against comprehensive behavioral batteries. They extracted underlying dimensions that span across healthy individuals and patients, revealing that networks like the somatosensory-motor network act as critical hubs linked to general psychopathology and cognitive dysfunction. Similarly, R. Nathan Spreng et al. used latent variable analysis in The default network of the human brain is associated with perceived social isolation to maximize the covariance between the entire connectome and behavioral measures, identifying a distinct global signature in the brain's default network associated with perceived loneliness.

The power of this approach is its ability to handle structural data as well. Tom Fletcher et al. combined high-dimensional "deformation momenta" (the mathematical forces needed to warp a standard brain model into an individual's anatomy) with PLS in Multivariate Statistical Analysis of Deformation Momenta Relating Anatomical Shape to Neuropsychological Measures to isolate specific patterns of structural change—like hippocampal shrinkage—that directly covary with clinical cognitive decline. By looking at the system holistically, Jingwei Li et al. used CCA in Topography and behavioral relevance of the global signal in the human brain to demonstrate that the spatial topography of the fMRI global signal—often dismissed as noise—is tightly aligned with an individual's cognitive abilities and life outcomes.

Cross-Domain Versatility

While brain-behavior mapping is a dominant application, the underlying mathematics of CCA and PLS are entirely domain-agnostic. Any problem characterized by two complex, interacting systems can be framed as a latent variable alignment problem.

Overcoming High-Dimensional Overfitting

When applying CCA or PLS to modern datasets, researchers frequently encounter the "curse of dimensionality." If the number of features in $X$ or $Y$ greatly exceeds the number of samples ($p > n$), standard CCA will overfit, finding spurious linear combinations that correlate perfectly in the training data but fail to replicate.

To maintain stability in high-dimensional spaces, Eliana Nicolaisen‐Sobesky et al. utilized regularized CCA in A cross-cohort replicable and heritable latent dimension linking behaviour to multi-featured brain structure, which adds a penalty term to the weights to prevent overfitting and ensure that the discovered latent dimensions are heritable and replicable across independent cohorts. Another strategy is to perform initial dimensionality reduction; Pablo Andrés-Camazón et al. combined principal component analysis (PCA) with CCA in Neurobiology-based cognitive biotypes using multi-scale intrinsic connectivity networks in psychotic disorders to reduce high-dimensional neural connectivity data before mapping it to cognitive performance.

Furthermore, real-world relationships are not always linear. To capture complex, non-linear interactions, researchers have extended this framework using deep learning. Myungjong Kim et al. introduced Deep CCA in Multiview Representation Learning via Deep CCA for Silent Speech Recognition, using deep neural networks to extract highly non-linear features from articulatory movements and acoustic signals before projecting them into a maximally correlated shared space. Finally, when data comes from more than two sources, multi-set canonical correlation analysis can be deployed. For instance, Bhaskar Ray et al. used a multi-set approach in Adolescent brain maturation associated with environmental factors: a multivariate analysis to extract shared variance across multiple independent domains simultaneously, linking environmental stressors, neighborhood demographics, and adolescent brain maturation.

History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_canonical_correlation_analysis_80642bbf,
  title = {canonical correlation analysis},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/canonical-correlation-analysis/rdr_80642bbfced44fa19da535f8c3fea1e0},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}

This exact version (version 1, frozen text):

@misc{lacuna_canonical_correlation_analysis_80642bbf_v1,
  title = {canonical correlation analysis},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/canonical-correlation-analysis/rdr_80642bbfced44fa19da535f8c3fea1e0/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake