A Grounded Cognitive Model for Metaphor Acquisition

Sushobhan Nayak, Amitabha MukerjeeAAAI 2012 · DOI

Introduction

In cognitive linguistics, metaphors are more than stylistic devices; they are fundamental mechanisms for understanding the world. We often speak of "wasting time" or being "in a state of shock," treating abstract concepts like time and emotional states as physical resources or containers. Traditional Natural Language Processing (NLP) has struggled to capture this, relying either on non-scalable hand-coded rules or purely statistical corpus-driven methods that lack semantic grounding.

Researchers at IIT Kanpur have developed a "grounded" cognitive model that addresses this gap by mimicking human developmental stages: grounding basic concepts in physical experience before extending them to abstract ideas through language.

Methodology: A Two-Stage Learning Process

The architecture of the model integrates visual perception with linguistic structure to build a lexicon and grammar rooted in sensorimotor experience.

Figure 1: The model architecture showing the flow from visual sequences and text narratives to the formation of a grounded lexicon and grammar.

Stage 1: Initial Grounding (The "Infant" Phase)

The system begins by processing a 2D geometric video (based on the Heider-Simmel "Chase" experiment). Through unsupervised clustering, it identifies image-schemas—recurring patterns of experience like "containment" or "path." By analyzing co-occurring descriptive narratives, the model learns to associate specific language labels (e.g., "square," "in," "chase") with these physical realities.

Figure 4: Association levels between linguistic labels and visual entities (Circle, Big Square, Little Square, Door) during the grounding phase.

Stage 2: Extension Through Language (The "Learner" Phase)

Once a "seed" of grounded concepts is established, the system analyzes the Brown Corpus. It utilizes the ADIOS algorithm for syntactic discovery and Selectional Preference (SP) to measure how words interact. If a preposition like "in" is grounded as a physical container and frequently appears with abstract nouns like "mind" or "poverty," the system infers a metaphorical extension: these abstract concepts are being conceptualized as containers.

Datasets and Knowledge Integration

The research utilizes three primary data sources:

  • Visual/Narrative Data: An 81-second 2D geometric "Chase" video accompanied by 36 descriptive narratives.
  • Text Corpus: The Brown Corpus, providing a broad sample of English text for linguistic pattern discovery.
  • Semantic Knowledge: WordNet lexical files are used to categorize nouns into high-level semantic groups (e.g., "state," "attribute") for calculating selectional associations.

Key Insights: Metaphor as "Property Leakage"

A central finding is that meaning is rooted in the physical world. The model demonstrates that once a word is grounded in a physical schema, the properties of that schema "leak" onto abstract nouns sharing the same grammatical neighborhood. This allows for the unsupervised discovery of metaphors; the system notices that abstract nouns occupy the same linguistic slots as the physical objects it already understands.

Results and Discussion

The system successfully acquired several foundational ontological metaphors without human intervention:

  • TIME IS POSSESSION/MONEY: By grounding "spend" and observing its usage with "time" and "money," the system identified time as a resource.
  • CONTAINER Metaphors: The model identified that states (e.g., "in shock"), locations (e.g., "in the area"), and life stages (e.g., "in this life") are treated as containers.

Quantitatively, the system showed high selectional association (SA) scores. For instance, the association of "IN" with the category "STATE" reached 0.093, confirming a strong metaphorical link.

Limitations and Future Directions

While promising, the model's initial grounding is limited to a very short video, whereas human learners benefit from years of multi-modal exposure. Additionally, noise in automated dependency parsing required some manual intervention. Future work aims to scale the model to more diverse "world ontologies" and address more complex structural metaphors, such as "ARGUMENT IS WAR," which involve social rather than just physical interactions.

Summary updated

BibTeX
@inproceedings{nayak2012grounded,
  author = {Sushobhan Nayak and Amitabha Mukerjee},
  title = {{A Grounded Cognitive Model for Metaphor Acquisition}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2012},
  doi = {10.1609/aaai.v26i1.8155},
}
Figure