Persistent Memory Architectures for Multi-Session Dialogue

74 concepts70 papers1 proposal

When you talk to a friend after a week apart, you don't need to reintroduce yourself, restate your preferences, or recap your life history. Human relationships rely on a shared, continuous narrative that spans days, months, or years.

Modern conversational agents, however, suffer from a profound "goldfish memory." Because they are fundamentally constrained by their context windows, they treat every new conversation session as an isolated event. As noted by Kurt Shuster 0001 et al. in The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents, standard architectures lack the mechanisms required to maintain consistency and recall information across conversations spanning hours or days. When a session ends, or when a conversation outgrows its immediate context window, the agent loses its history, leading to self-contradictions and a total loss of personalization.

To bridge this gap, a major research direction focuses on persistent memory architectures. By decoupling immediate working memory from long-term episodic storage, these systems allow agents to retain context across multiple sessions without becoming computationally prohibitive.

Decoupling Working Memory from Long-Term Storage

The core intuition behind long-term dialogue coherence is that an agent does not need every past utterance active in its immediate attention window. Instead, it needs a way to compress, store, and selectively retrieve historical context.

To achieve this, the authors of History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue System (Tong Zhang et al.) introduced a hierarchical encoding structure. Instead of treating dialogue as a flat sequence of tokens, the architecture separates the current session's context from a dedicated long-term history memory. A switching mechanism then determines when the response generator should rely on immediate context versus when it should pull from past sessions.

However, storing every single detail forever causes external databases to bloat and introduces irrelevant noise. To make long-term memory truly scalable, Wanjun Zhong et al. proposed MemoryBank: Enhancing Large Language Models with Long-Term Memory. Inspired by human psychology, MemoryBank implements a forgetting mechanism based on the Ebbinghaus Forgetting Curve. This allows the system to dynamically update memory strength over time: frequently reinforced user facts are preserved, while transient or low-utility details naturally decay. This ensures that the agent's memory remains compact, relevant, and computationally efficient over weeks or months.

Tracking Evolving Personas and Preferences

Long-term memory is not merely a passive text log; it must capture how users and relationships change over time. In high-stakes domains like longitudinal mental health support, education, or personalized digital assistants, tracking this evolution is critical.

As argued by Adam S. Miner et al. in their analysis of conversational AI in psychotherapy, persistent digital memory can maintain a continuous, longitudinal record of interactions that bypasses human cognitive limits, enabling the tracking of long-term behavioral patterns. Yet, standard large language models (LLMs) struggle to maintain this alignment natively. Siyan Zhao et al. demonstrated in Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMs that even advanced models see their personalization accuracy plummet rapidly when user preferences are interspersed with unrelated conversational turns.

True comprehension requires tracking how narratives unfold. In a single-author study, Mo Yu introduced the Personality Understanding of Fictional Characters during Book Reading dataset, demonstrating that tracking an evolving personality requires a cumulative history of actions and dialogue. Without explicit architectures to synthesize this long-term narrative history, models fail to maintain a consistent understanding of the entities they interact with.

Benchmarking the Long-Term Horizon

Evaluating an agent's long-term memory requires moving away from traditional, short-term reasoning benchmarks toward frameworks that simulate extended timelines and temporal gaps.

Several recent benchmarks target different facets of this problem:

By shifting from static, single-turn prompt engineering to dynamic, multi-session memory layers, these architectures allow conversational agents to move past the limits of the immediate context window—transforming them from short-term text generators into persistent, context-aware companions.

Key Foundational Work

Modelling rapport in embodied conversational agents (2008) — contributed 1 concept elements to this direction.
Architecting Real-Time Crowd-Powered Systems (2014) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_long_term_dialogue_coherence_5335cfc3,
  title = {long-term dialogue coherence},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/long-term-dialogue-coherence/rdr_5335cfc3f500460e9f9c16ddab9e00f4},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_long_term_dialogue_coherence_5335cfc3_v1,
  title = {long-term dialogue coherence},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/long-term-dialogue-coherence/rdr_5335cfc3f500460e9f9c16ddab9e00f4/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake