Abstract
How is color represented by spatially distributed patterns of activity in the visual cortex? Functional magnetic resonance imaging (fMRI) responses to several stimulus colors were analyzed using multivariate techniques: conventional pattern classification, a forward model of idealized color tuning, and principal component analysis (PCA). Stimulus color was accurately decoded from activity in V1, V2, V3, V4, and VO1, but not in LO1, LO2, V3A/B, or MT+. While the conventional classifier and forward model yielded similar accuracies, the forward model uniquely reconstructed novel stimulus colors not used during training. Mean responses across voxels were not reliably distinguishable, suggesting each color is associated with a unique spatially distributed pattern. PCA revealed that in V4 and VO1, the first two principal component scores reflected a progression through perceptual color space. This was not observed in V1, despite it having the highest decoding accuracy, implying a transformation from cone-opponent representations in V1 to a perceptual color space in V4 and VO1.
Introduction
Human color vision begins with three types of cone receptors in the retina, whose signals are processed into "color-opponent" channels. However, the cortical mechanism that transforms these raw signals into the circular "color wheel" of our subjective experience has remained elusive. This study investigates how different regions of the visual cortex represent color, specifically seeking to identify where neural activity begins to reflect perceptual similarity—recognizing, for instance, that orange is more similar to red than to blue.
Methods and Materials
Researchers recorded fMRI activity in five healthy observers with normal color vision. Participants viewed concentric sinusoidal gratings modulating between a neutral gray point and eight distinct locations in the CIE Lab color space, which is designed to be perceptually uniform. These eight colors were equally spaced in hue at a fixed lightness (L) of 75 and a luminance of 8.8 cd/m².
Three multivariate approaches were employed to analyze the voxel activity:
- Pattern Classification: A "winner-take-all" classifier was used to identify which of the eight colors was being viewed based on spatial patterns of activity.
- Forward Modeling: An encoding model characterized each voxel as a weighted sum of six idealized color-tuning channels, allowing for the reconstruction of novel, "unseen" colors.
- Principal Component Analysis (PCA): This technique reduced high-dimensional voxel data into a 2D "neural color space" to visualize how each area organizes chromatic information.
Results
Decoding Performance and Regional Specialization
Stimulus color was accurately decoded in early visual areas (V1, V2, V3) and ventral areas (V4, VO1). V1 demonstrated the highest performance, with decoding accuracy reaching approximately 93% when data was aggregated across observers. Conversely, motion-sensitive (MT+) and object-related (LO1, LO2) areas showed accuracies near chance levels, indicating that color information is not uniformly distributed across the visual cortex.
Forward Modeling and Color Reconstruction
The forward model performed comparably to the standard classifier in identifying the eight training colors. However, its true strength lay in its ability to generalize; it successfully predicted brain responses to novel colors excluded from the training set. This suggests that the model captured fundamental properties of cortical color architecture rather than just memorizing a lookup table.
The V1 to V4 Transformation
A critical dissociation was found between decoding accuracy and perceptual representation. While V1 was the most efficient at identifying specific colors, its internal organization (as revealed by PCA) did not match the perceptual color wheel. Instead, V1 activity appeared driven by low-level cone-opponent signals.
In contrast, in areas V4 and VO1, the first two principal components formed a clear, non-self-intersecting circle that mirrored the order of the perceptual color wheel. This indicates a functional transformation: by the time chromatic information reaches V4, the brain has organized it into a space where perceptually similar colors evoke similar neural patterns.
Discussion
These findings demonstrate that the human visual cortex does not simply pass along raw chromatic signals. Instead, there is a clear hierarchy of representation. Early areas like V1 provide high-fidelity decoding based on retinal inputs, but higher-order areas like V4 and VO1 are responsible for constructing the perceptual color space that defines our visual experience. Future research may expand on these findings by exploring variations in saturation and luminance, as well as investigating the neural representation of "unique hues."
Summary updated