Object Categorization in Finer Levels Relies More on Higher Spatial Frequencies and Takes Longer

Matin N. Ashtiani, Saeed Reza Kheradpisheh, Timothée Masquelier, ‎Mohammad Ganjtabesh

Abstract

The human visual system recognizes objects at various levels of abstraction: superordinate (e.g., animal), basic (e.g., bird), and subordinate (e.g., pigeon). While the "basic level" was long considered the entry point for recognition, recent evidence suggests a "superordinate advantage." This study investigates the computational and biological reasons for this temporal gap. Using psychophysics and computational modeling with bandpass-filtered images, we demonstrate that superordinate categorization relies on low-frequency visual information processed rapidly by the brain. In contrast, finer-level categorization requires high-frequency details that take longer to process, explaining the observed delays in reaction time.

Introduction: The Hierarchy of Recognition

When encountering a visual stimulus, the brain must categorize it within a hierarchy. For decades, "Basic Level Theory" posited that humans first identify objects at a middle level of specificity (e.g., "dog") before generalizing to "animal" or specializing to "Beagle." However, recent research has challenged this, showing that broad superordinate categorization often occurs faster.

The core hypothesis of this work is that this temporal advantage is rooted in the physical properties of visual signals—specifically spatial frequencies. Low spatial frequencies (LSF) provide coarse "blobs" and general shapes, while high spatial frequencies (HSF) provide fine textures and sharp edges. The brain processes LSF via fast magnocellular pathways, whereas HSF travels through slower parvocellular pathways.

Experimental Design and Methodology

To test how spatial frequency affects categorization speed and accuracy, the researchers utilized a dataset of 1,000 images across five categories: ducks, pigeons, cats, dogs, and cars. These were organized into three hierarchical levels:

  • Superordinate: Animal vs. Car
  • Basic: Bird vs. Non-bird animal
  • Subordinate: Duck vs. Pigeon
Figure 1: (A) The hierarchical categorization levels used in the study. (B) Examples of image manipulations, showing the effects of different frequency bands (full-band, low, intermediate, high) and varying noise levels (0% to 50%).

The study employed two main approaches:

  1. Human Psychophysics: Participants viewed images for 12.5 ms, followed by a noise mask. Images were either intact or filtered into LSF, Intermediate (ISF), or HSF bands.
  2. Computational Modeling: Two models were tested—one biologically inspired (HMAX) using Gabor filters to mimic the visual cortex, and a simpler control model extracting raw pixel patches.
  3. Noise Robustness: To ensure results weren't due to a "ceiling effect" (tasks being too easy), varying levels of phase noise were added to the stimuli.

Key Results

The findings from both human subjects and computational models were highly consistent:

  • Accuracy and Frequency: Superordinate categorization remained highly accurate even with only LSF information. However, basic and subordinate tasks saw a significant drop in accuracy when HSF information was removed. This indicates that "is it an animal?" can be answered with blurry shapes, but "is it a duck?" requires fine detail.
  • Temporal Dynamics: Human reaction times (RT) were significantly shorter for superordinate tasks (~450ms) than for subordinate tasks (~550ms). Crucially, RTs increased as the required information moved from low to high frequency bands, confirming that the brain must "wait" for slower HSF signals to perform fine-grained recognition.
  • Robustness: Even at 50% noise, the performance trends held steady. While overall accuracy decreased and RT increased, the relative advantage of superordinate categorization remained, suggesting a fundamental constraint in signal processing rather than a task-specific artifact.

Conclusion and Future Directions

The "superordinate advantage" is not merely a cognitive preference but a result of computational constraints within the visual system. Finer levels of categorization are "expensive" because they depend on high-frequency information that is inherently slower to reach higher processing centers.

While the feed-forward models used here successfully identified that the necessary information is present in specific frequency bands, they do not account for the temporal integration of these signals. Future research using Recurrent Neural Networks (RNNs) could better simulate how the brain integrates these different frequency streams over time to build a complete visual representation.

Summary updated

Abstract

The human visual system contains a hierarchical sequence of modules that take part in visual perception at different levels of abstraction, i.e., superordinate, basic, and subordinate levels. One important question is to identify the "entry" level at which the visual representation is commenced in the process of object recognition. For a long time, it was believed that the basic level had a temporal advantage over two others. This claim has been challenged recently. Here we used a series of psychophysics experiments, based on a rapid presentation paradigm, as well as two computational models, with bandpass filtered images of five object classes to study the processing order of the categorization levels. In these experiments, we investigated the type of visual information required for categorizing objects in each level by varying the spatial frequency bands of the input image. The results of our psychophysics experiments and computational models are consistent. They indicate that the different spatial frequency information had different effects on object categorization in each level. In the absence of high frequency information, subordinate and basic level categorization are performed less accurately, while the superordinate level is performed well. This means that low frequency information is sufficient for superordinate level, but not for the basic and subordinate levels. These finer levels rely more on high frequency information, which appears to take longer to be processed, leading to longer reaction times. Finally, to avoid the ceiling effect, we evaluated the robustness of the results by adding different amounts of noise to the input images and repeating the experiments. As expected, the categorization accuracy decreased and the reaction time increased significantly, but the trends were the same. This shows that our results are not due to a ceiling effect. The compatibility between our psychophysical and computational results suggests that the temporal advantage of the superordinate (resp. basic) level to basic (resp. subordinate) level is mainly due to the computational constraints (the visual system processes higher spatial frequencies more slowly, and categorization in finer levels depends more on these higher spatial frequencies).
BibTeX
@inproceedings{ashtiani2017object,
  author = {Matin N. Ashtiani and Saeed Reza Kheradpisheh and Timothée Masquelier and ‎Mohammad Ganjtabesh},
  title = {{Object Categorization in Finer Levels Relies More on Higher Spatial Frequencies and Takes Longer}},
  booktitle = {Frontiers in Psychology},
  year = {2017},
  doi = {10.3389/fpsyg.2017.01261},
}
Figure