Analyzing human feature learning as nonparametric Bayesian inference

Joseph L. Austerweil, Thomas L. GriffithsNeurIPS 2008 · OpenReview

Introduction

In most machine learning algorithms and cognitive models, "features" (such as "has fur" or "is a horizontal line") are assumed to be fixed and pre-defined. However, human perception is remarkably flexible. An expert birdwatcher, for instance, sees distinct features in a wing that a novice perceives as a single, undifferentiated shape.

This paper addresses a fundamental question in cognitive science: How do we learn what the features are in the first place? Specifically, it provides a formal, "rational" account explaining why and when the human perceptual system chooses to represent objects as collections of parts (differentiation) versus holistic wholes (unitization), without knowing the number of features in advance. To solve this, the authors propose a rational model of human feature learning using the Indian Buffet Process (IBP), a nonparametric Bayesian approach.

The Computational Model

The authors employ Rational Analysis, defining an "ideal learner" to understand the computational constraints governing human behavior. The model is built on several key components:

  1. Nonparametric Bayesian Inference: To avoid pre-specifying a fixed number of features, the model uses the Indian Buffet Process (IBP) as a prior. The IBP allows for an unbounded number of potential features, though only a finite subset is active for any given set of observations.
  2. Generative Models: Two types of likelihood functions connect latent features to raw sensory data:
  3. Linear-Gaussian: Used for continuous data, where features are weighted and summed.
  4. Noisy-OR: Used for binary pixel data, where a pixel is "on" if at least one of its associated features is present, accounting for some noise.
  5. Inference Mechanism: The model uses Gibbs sampling (a Markov chain Monte Carlo method) to find the most probable feature ownership matrix given the observed objects.
  6. Category Integration: To model how labels affect learning, "category bits" are appended to the sensory data. This effectively treats labels as additional properties that the underlying features must explain.

Experimental Evidence and Datasets

Rather than relying on large-scale machine learning benchmarks, the paper evaluates the model against stimuli from classic psychological experiments to directly compare the model's behavior with human perception.

Stimuli from classic psychological experiments used to test the model. (a) Complex line-segment stimuli (Shiffrin and Lightfoot) demonstrating unitization. (b) Distorted dot-pattern objects (Pevtzow and Goldstone) demonstrating category-driven feature differentiation.
  • Shiffrin and Lightfoot (1997): Complex line-segment stimuli (seen in part 'a' of the figure) are used to demonstrate how humans "unitize" frequently co-occurring line segments into single, holistic features.
  • Pevtzow and Goldstone (1994): "Distorted" objects (seen in part 'b' of the figure) are used to show how different categorization tasks lead humans to perceive different underlying features.
  • Synthetic Distributional Sets: The authors also created artificial datasets where underlying components were either highly correlated (triggering unitization) or independent (triggering differentiation).

Key Insights and Results

Treating feature learning as a Bayesian structure induction problem yields several critical insights into human cognition:

  • Replicating Unitization and Differentiation: The model provides a formal statistical threshold for unitization. If parts almost always appear together, the Bayesian prior (which penalizes having too many features) encourages the model to treat them as one unit. The model successfully learned to represent Shiffrin and Lightfoot’s complex line drawings as single features, matching observed human performance. Conversely, if parts appear independently, the likelihood forces the model to differentiate them.
  • Category-Driven Perception: Category labels are not just outputs of learning; they serve as statistical evidence. In the Pevtzow and Goldstone simulation, the model inferred entirely different feature sets for the exact same objects depending on which category labels were provided. If two objects share a category, the model is more likely to find a feature representation highlighting their commonalities.
  • Flexibility of the IBP: Because the IBP does not rely on a fixed number of features, it can dynamically "grow" its representation as it encounters more complex or novel objects, closely mirroring the development of human expertise.

Limitations and Future Work

While the model successfully captures key phenomena in human feature learning, the authors note a few limitations. First, appending category bits to sensory data is a functional but somewhat artificial "hack." They suggest that a hierarchical nonparametric Bayesian model (such as a Hierarchical Beta Process) would offer a more mathematically elegant way to capture how top-down knowledge affects bottom-up perception.

Additionally, Gibbs sampling is computationally expensive and is unlikely to represent the exact real-time mechanism used by the human brain. Finally, while the model fits existing historical data well, the authors emphasize the need for new human experiments specifically designed to test the model's quantitative predictions regarding how varying statistical evidence dynamically alters feature discovery.

Summary updated

Abstract

Almost all successful machine learning algorithms and cognitive models require powerful representations capturing the features that are relevant to a particular problem. We draw on recent work in nonparametric Bayesian statistics to define a rational model of human feature learning that forms a featural representation from raw sensory data without pre-specifying the number of features. By comparing how the human perceptual system and our rational model use distributional and category information to infer feature representations, we seek to identify some of the forces that govern the process by which people separate and combine sensory primitives to form features.
BibTeX
@inproceedings{austerweil2008analyzing,
  author = {Joseph L. Austerweil and Thomas L. Griffiths},
  title = {{Analyzing human feature learning as nonparametric Bayesian inference}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2008},
  url = {https://openreview.net/forum?id=rybdgY-_bB},
}
Figure