Thinking in PolAR Pictures: Using Rotation-Friendly Mental Images to Solve Leiter-R Form Completion

Joshua H. Palmer, Maithilee KundaAAAI 2018 · DOI

Introduction

Researchers at Vanderbilt University have developed a computational model that solves visuospatial intelligence puzzles using a novel "Polar Augmented Resolution" (PolAR) image representation. By mimicking the way humans might use rotation-friendly mental imagery, the system can identify and place fragmented image "slices" into complex scenes, providing a new tool for studying nonverbal human cognition.

The Leiter-R Form Completion Task

The study focuses on the Leiter-R Form Completion (FC) subtest, a standard component of nonverbal IQ tests. In these puzzles, a subject is presented with a complete image (the "easel") and several fragmented pieces ("slices"). The objective is to determine the correct placement and orientation (rotation or flip) for each slice to complete the picture.

Examples of Leiter-R Form Completion problems, including single-easel and multi-slot variations.

While humans perform these tasks using mental imagery and rotation, standard AI approaches often struggle with digital rotation. In rectangular pixel grids, rotation typically introduces "aliasing" or blurring. Furthermore, there is a lack of computational models that simulate how humans actually process these specific neuropsychological tests. Understanding these "building blocks" of nonverbal cognition is crucial for researching typical and atypical development, such as in children with autism or dyslexia.

Methods: The PolAR Representation

The core innovation is the PolAR (Polar Augmented Resolution) Picture. Instead of the standard Cartesian (X, Y) grid, the PolAR representation uses a polar coordinate system consisting of wedges and concentric rings.

The PolAR representation applied to an image, showing the polar grid and foveal-like augmented resolution.

This approach offers two primary advantages:

  1. Rotation-Friendly: In polar space, rotating an image is mathematically equivalent to a simple shift of the "wedge" index. This allows for high-fidelity rotation without the degradation seen in rectangular grids.
  2. Augmented Resolution: Similar to human foveal vision, the representation features higher resolution toward the center and lower resolution toward the periphery.

The authors proposed three algorithmic approaches:

  • PolAR-S (Slice): Matches the entire image slice against potential easel locations.
  • PolAR-SS (Subslice): Identifies 2–3 high-variance sub-regions (like corners) within a slice to match first.
  • PolAR-H (Hybrid): Uses a primary sub-region to fix orientation, then confirms with the whole slice.

All models utilize a "MaxMin" pixel-based similarity metric to compare the mental image of the slice against the target easel.

Experimental Evaluation

The models were evaluated using items 03 through 14 from the Leiter-R Form Completion subtest. The dataset included both "single-easel" problems (matching slices to one large image) and "multi-slot" problems (matching slices to specific divided sections).

Key Results

  • High Accuracy on Structured Problems: On difficult "multi-slot" problems, all model variations achieved 100% accuracy in localizing slices.
  • Noise Sensitivity: Performance was mixed on some single-easel tasks. The pixel-sensitive similarity metric was occasionally confused by real-world "noise," such as differences in color or hue between printed slices and the easel caused by the scanning process.
  • Choice Localization: Even when perfect placement was elusive, the models were highly successful at identifying which card belonged to which slot.

Discussion and Future Work

The success of the PolAR model suggests that the format of mental representation is as critical as the processing algorithm. By switching to polar coordinates, a complex geometric transformation (rotation) becomes a trivial data shift. Additionally, the use of "variance-based subslice selection" mimics human attention by focusing on high-contrast features like edges and corners.

Future work will address current limitations, such as sensitivity to lighting and hue differences, by moving toward robust feature-based matching. The authors also plan to incorporate translation, zooming, and image composition to more fully simulate human visuospatial strategies, as well as explore "generative" approaches where slices are assembled into a complete object before searching the easel.

Summary updated

BibTeX
@inproceedings{palmer2018thinking,
  author = {Joshua H. Palmer and Maithilee Kunda},
  title = {{Thinking in PolAR Pictures: Using Rotation-Friendly Mental Images to Solve Leiter-R Form Completion}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2018},
  doi = {10.1609/aaai.v32i1.11318},
}
Figure