Get the Picture? Goodness of Image Organization Contributes to Image Memorability

Lore Goetschalckx, Pieter Moors, Steven Vanmarcke, Johan Wagemans

TL;DR

This study investigates how the "goodness" of an image's organization, a concept from Gestalt psychology, influences how memorable it is. The researchers found that images with better organization are indeed more memorable, but this relationship is partly masked by image distinctiveness.

What Problem Does This Paper Address?

In our visually saturated world, understanding what makes an image memorable is crucial. While previous research has identified image properties like popularity or aesthetics, the underlying factors contributing to memorability remain somewhat elusive. This paper delves into the concept of "goodness of organization," a Gestalt principle suggesting that well-organized stimuli are processed more efficiently and are more robust to transformations. The authors hypothesize that this "goodness" is a key, yet under-explored, contributor to image memorability.

Methods

The study employed a multi-pronged approach across three studies:

  • Study 1 (Categorizability): Assessed how quickly and accurately participants could categorize images in a rapid-scene categorization task. This measured "categorizability," a proxy for fast and efficient processing.
  • Study 2 (Shrinkability): Evaluated how well images retained their meaning when shrunk to thumbnail size using a thumbnail search task. Faster reaction times in this task indicated higher "shrinkability," reflecting robustness to transformation.
  • Study 3 (Distinctiveness): Quantified the "perceived distinctiveness" of images using a human rating scale. This was crucial for a post-hoc analysis to control for the influence of distinctiveness on the results of Studies 1 and 2.

Datasets

The study utilized a dataset of 44 real-life scene images, drawn from 14 semantic categories, originally from the FIGRIM-dataset (Bylinskii et al., 2015). Memorability scores for these images were also available from previous work (Bylinskii et al., 2015).

Key Insights and Ideas

  • Goodness Matters, But It's Complicated: The core idea that "good" organization leads to better memory is supported, but the relationship isn't straightforward.
  • Distinctiveness is a Masking Factor: A surprising finding was that distinctiveness (how much an image stands out) can obscure the link between an image's organization and its memorability. Distinctive images are easier to remember, but this effect can overshadow the contribution of good organization.
  • Two Faces of Goodness: The study explored two facets of "goodness": efficient processing (categorizability) and robustness to transformation (shrinkability). Both were hypothesized to relate to memorability.
  • Human Perception is Key: The study highlights the importance of human perception in understanding image properties, particularly for distinctiveness, where human ratings proved valuable.

Key Results

  • Categorizability and Memorability: Initially, Study 1 found no positive correlation between categorizability and memorability. However, after controlling for distinctiveness in Study 3, a weak but significant positive correlation emerged, supporting the hypothesis that more categorizable images are more memorable, given equal distinctiveness.
  • Shrinkability and Memorability: Study 2 found a significant negative correlation between memorability and shrinkability (meaning more memorable images were located faster in the thumbnail search task). This effect remained significant even after controlling for distinctiveness in Study 3, suggesting that memorable images are indeed more robust to shrinking.
  • Distinctiveness and Memorability: Perceived distinctiveness showed a strong positive correlation with memorability (r = .49), highlighting its significant role.
  • Consistency: Across all studies, measures like categorizability, shrinkability, and distinctiveness showed high consistency across participants, suggesting they are reliable image properties.

Limitations and Future Work

  • Operationalization Challenges: The authors acknowledge that translating abstract concepts like "goodness of organization" into concrete, extractable image features remains a challenge.
  • Contextual Influence: While the study focused on intrinsic image properties, the authors note that context also plays a role in memorability, as evidenced by the strong correlation between distinctiveness and memorability.
  • Future Research: The authors suggest further exploration of categorizability as a meaningful image property and the development of more robust theoretical frameworks for understanding the interplay between goodness, distinctiveness, and memorability. They also emphasize the need to translate these findings into practical applications for image feature extraction.

Summary updated

Abstract

According to Gestalt psychologists, goodness is a crucial variable for image organization. We hypothesized that these differences in goodness contribute to variability in image memorability. Building on this, we predicted that two characteristics of good organizations, (i) fast, efficient processing and (ii) robustness against transformations (e.g., shrinking), would be characteristic of memorable images. Two planned (Study 1, Study 2) and one follow-up (Study 3) study were conducted to test this. Study 1 operationalized fast processing as accuracy in a rapid-scene categorization task ("categorizability"). Study 2 operationalized robustness against shrinking as reaction time in a thumbnail search task ("shrinkability"). We used 44 real-life scene images of 14 semantic categories from a previous memorability study. Each image was assigned a categorizability and shrinkability score. The predicted positive relation between categorizability and memorability was not observed in Study 1. A post-hoc explanation attributed this null result to a masking role of image distinctiveness. Furthermore, memorable images were located faster in the thumbnail search task, as predicted, but Study 2 could not rule whether this was merely a result of their distinctiveness. To elucidate these results, Study 3 quantified the images on distinctiveness and statistically controlled for this variable in a reanalysis of Study 1 and Study 2. When distinctiveness was controlled for, categorizability and memorability did show a significant positive correlation. Moreover, the results also argued against the alternative explanation of the results of Study 2. Taken together, the results support the hypothesis that goodness of organization contributes to image memorability.
BibTeX
@article{goetschalckx2019get,
  author = {Lore Goetschalckx and Pieter Moors and Steven Vanmarcke and Johan Wagemans},
  title = {{Get the Picture? Goodness of Image Organization Contributes to Image Memorability}},
  journal = {Journal of Cognition},
  year = {2019},
  doi = {10.5334/joc.80},
}
Figure