Abstract
Natural sensory inputs in everyday situations induce unique experiences that vary between individuals, even when inputs are identical. This experiential uniqueness stems from the representations of sensory signals in each brain. We investigated whether genetic factors control individual differences in sensory representations in the brain by studying the brain representations of natural audiovisual signals in twin-pairs. We measured the brain response to natural movies in twins using functional magnetic resonance imaging (fMRI) and quantified the genetic influence on the multivoxel-pattern similarity of movie clip representations between each twin. The whole-brain analysis revealed a genetic influence on the multivoxel-pattern similarity in widespread brain regions, which included the occipitotemporal sensory cortices as well as the frontoparietal association cortices and subcortical structures. Our findings suggest that genetic factors exhibit an effect on natural audiovisual signaling by controlling audiovisual representations in the brain.
Introduction
Why do two people perceive the same event so differently? While neuroscientists have long recognized that "naturalistic" experiences—such as watching a film—induce highly diverse brain activity across individuals, the origin of this diversity has remained elusive. Specifically, it has been unclear how much of this representational uniqueness is "hardwired" by our genetic makeup versus shaped by environmental factors and individual life experiences.
Previous research into the genetics of brain function has largely relied on simplified, artificial stimuli, such as flashing checkerboards or basic auditory tones. While these studies established a baseline for heritability in primary sensory areas, they failed to capture the complexity of how the brain processes the multimodal, dynamic information encountered in daily life. This study bridges that gap by investigating the genetic basis of brain representations during complex audiovisual experiences.
Methodology
To isolate the role of genetics, the researchers employed a classic twin-study design. The cohort consisted of 39 pairs of Japanese twins from the Osaka University Twin Registry: 22 monozygotic (MZ) pairs, who share 100% of their genetic material, and 17 dizygotic (DZ) pairs, who share approximately 50%.
Participants viewed 236 unique movie clips (sourced from Vimeo) while undergoing functional magnetic resonance imaging (fMRI). To quantify the brain's "representation" of these clips, the researchers utilized Representational Similarity Analysis (RSA). They generated Clip-wise Representational Dissimilarity Matrices (CRDMs) for various brain regions. These CRDMs act as a "neural fingerprint," mapping how distinct the brain's activation patterns are for different moments within the audiovisual stream.
By comparing the similarity of these neural fingerprints between MZ and DZ twins, the team applied Falconer’s heritability formula to estimate the degree of genetic influence. Furthermore, UMAP (Uniform Manifold Approximation and Projection) was used to visualize how different brain regions clustered based on their representational styles and genetic heritability.
Key Findings
Widespread Genetic Influence
The study revealed that genetic influence is not confined to the brain's initial sensory "entry points." Instead, genetic factors significantly shape representations across widespread regions, including high-order association cortices in the frontoparietal network and various subcortical structures.
The Complexity Gradient
A distinct gradient of genetic control was observed. Heritability was found to be strongest in early sensory areas, such as the occipital (visual) and superior temporal (auditory) cortices. As the processing requirements became more complex and abstract—moving into category-selective areas—the genetic signal weakened. This suggests that while our basic sensory machinery is highly heritable, higher-level interpretation and expertise are more heavily influenced by environmental factors.
Emotional and Subcortical Anchors
One of the more striking findings was the high heritability in regions associated with emotional and social evaluation. Significant genetic effects were identified in the orbitofrontal cortex (OFC) and the anterior temporal cortex (ATC). These areas are critical for social cognition and emotional processing, suggesting that our biological makeup plays a major role in how we emotionally "digest" a scene. Additionally, subcortical structures like the accumbens (involved in reward) and the pallidum showed significant genetic influence, indicating that our internal valuation of sensory input has a strong hereditary component.
Discussion and Limitations
The results demonstrate that the CRDM is a robust and reproducible measure of brain function, showing consistency both within individuals and across twin pairs. The UMAP visualization further confirmed that functional groups (visual-heavy, auditory-heavy, and cognitive) all exhibit varying but significant degrees of genetic influence.
However, several limitations remain. While 39 twin pairs is a substantial sample for an fMRI study, it is relatively small for genetic research, which often requires larger cohorts for granular heritability estimates. Furthermore, the study focused exclusively on a Japanese population, and future research is needed to determine if these patterns are universal across different ethnicities. Finally, while the study identifies where genetics influence brain representations, it does not pinpoint the specific genes involved.
Conclusion
This research provides compelling evidence that our unique neural responses to the world are significantly shaped by our DNA. From the way we process basic visual motion to the way we emotionally evaluate a complex social scene, our genetic heritage provides the template upon which our individual experiences are built. Future work may explore how these genetically-driven representations correlate with specific behavioral traits, personality types, or susceptibility to psychiatric disorders.
Summary updated