Introduction
Distinguishing between truth and fiction is a foundational challenge in both psychology and computer science. Human memory is not a perfect video recording; it relies on episodic memory (specific, personal experiences). In contrast, imagination draws more heavily on semantic memory (general world knowledge and "commonsense"). While psychologists have studied these differences in small-scale lab settings, large-scale quantification of these "cognitive traces" in natural language has remained elusive. This research, presented at ACL 2020, bridges this gap by using modern NLP tools to analyze how the human brain constructs narratives differently when remembering versus inventing.
The Hippocorpus Dataset
To facilitate this study, the researchers introduced HIPPOCORPUS, a dataset of 6,854 diary-like stories. The collection process involved three categories:
- Recalled: Authors wrote about a memorable event from the last six months.
- Imagined: A different set of authors was given a brief summary of a recalled story and asked to imagine a story based on that prompt, ensuring differences are due to cognitive processes rather than topic.
- Retold: Original authors retold their real memories months later to observe temporal changes.
Quantifying Cognitive Traces
The authors developed three primary measures to analyze storytelling:
1. Narrative Flow (Linearity)
Using OpenAI’s GPT, the researchers compared a "bag" model (sentences are independent) against a "chain" model (sentences follow logically). The difference in predictability defines the "linearity" of the story.
2. Episodic vs. Semantic Knowledge
The study distinguished between concrete factual events and general world knowledge:
- Episodic traces: Identified using a BERT-based "realis" event detector to find concrete events that actually occurred in the narrative.
- Semantic traces: Measured using the ATOMIC knowledge graph to track reliance on general commonsense inferences (e.g., "getting married causes happiness").
3. Lexical Analysis
Standard LIWC (Linguistic Inquiry and Word Count) tools measured emotional tone and the frequency of "I-words."
Key Findings
The analysis revealed several counter-intuitive insights into human cognition:
- Imagination is more "logical" than reality: Imagined stories flow more linearly ($d = 0.52$). When inventing, humans follow predictable "A leads to B" scripts. Real memories are "holistic" and messy, with less predictable sentence transitions as the brain jumps between fragmented details.
- The "Narrativization" of Memory: As memories age or are retold, they begin to resemble imagined stories. They become more linear ($d = 0.17$), less concrete, and rely more on general commonsense. We essentially "edit" our memories into better stories over time.
- Imagination is Self-Centered and Emotional: Imagined stories contained significantly more "I-words" and emotional language than real recollections.
Conclusion and Limitations
While the study provides a powerful framework for detecting cognitive fingerprints, the authors acknowledge a potential "domain bias": GPT is trained on fiction, which may make it naturally better at predicting "imagined" stories. Future work could explore these traces across different cultures or apply these tools to assist in studying memory-related disorders and deceptive text detection.
Summary updated