Persona Authentication through Generative Dialogue

Fengyi Tang, Lifan Zeng, Fei Wang, Jiayu ZhouarXiv 2021 · arXiv

Abstract

As conversational AI agents are increasingly deployed with specific "personas" to enhance engagement and consistency, verifying their adherence to these identities becomes a critical challenge. This paper introduces persona authentication, a novel framework designed to evaluate whether an AI remains consistent with its assigned facts. By leveraging reinforcement learning and mutual information maximization, the researchers developed an "authenticator" system that adaptively interrogates chatbots. Experimental results demonstrate that this approach is more efficient at eliciting persona facts than random or human-led dialogues, with the identifier model achieving a Prec@1 of 86.2%.

Introduction

Modern AI agents are often assigned detailed personas—collections of facts such as "I am a construction worker" or "I have five cats"—to ensure they provide consistent and engaging user experiences. However, ensuring that an agent actually adheres to these traits throughout a conversation is difficult. Current evaluation methods rely heavily on expensive, time-consuming human interactions. Furthermore, identifying the optimal sequence of questions to "test" a model's consistency is non-trivial.

This research addresses the need for an automated, computationally tractable method to elicit and verify persona information through generative dialogue. The goal is to move beyond passive observation to an active "interrogation" strategy that efficiently maps dialogue trajectories back to underlying persona facts.

Methods

The authors decompose persona authentication into two primary sub-tasks: Persona Identification (inferring features from dialogue) and Persona Verification (learning a policy to generate eliciting prompts).

System architecture of the PersonaGPT framework, featuring the Decoder, Verifier Network, and Identifier Model.

Technical Framework

The system architecture integrates several key innovations:

  • Authentication Loss: A triplet-based loss function is employed, which the authors prove is equivalent to maximizing the mutual information between the dialogue history and the persona.
  • PersonaGPT: The model adapts the GPT-2 architecture using specific "control codes" (e.g., <|act|> ask about pets) to steer the questioning strategy while maintaining natural conversational flow.
  • Deep Q-Learning (DQN): To navigate the vast space of possible sentences, the authors define a discrete action space of 11 question types (e.g., "talk about work," "ask about hobbies"). A DQN trains the verifier to select the most informative action at each turn.
  • Active Learning: To refine the decoder, an active learning loop with human feedback was used to fine-tune the model on a high-quality dataset of 1,200 conversations.

Datasets and Experimental Setup

The framework was evaluated using the PersonaChat benchmark, which contains over 1,400 unique personas and 6,735 facts. Additionally, the researchers collected the Human-PersonaGPT Dataset, consisting of 1,200 8-turn conversations, to facilitate fine-tuning and evaluation.

The "authenticator" operates by treating conversation as an information-theoretic search. It aims to reduce the entropy of the agent's identity by adaptively pruning potential questions based on previous responses. For instance, if an agent mentions a pet, the model might pivot to lifestyle-related questions to verify the depth of the persona.

Key Results

The proposed system significantly outperforms baseline models in both identification and verification tasks.

Performance comparison of the Identifier model against various baselines across precision and recall metrics.
  • Identifier Performance: The identifier model achieved a Prec@1 of 86.2%, far exceeding standard architectures like BERT (37.6%) or LSTMs (42.7%). This indicates a high degree of accuracy in mapping dialogue back to specific persona facts.
  • Character Coverage: In human evaluations, PersonaGPT correctly exhibited over 60% of its persona traits, whereas the popular DialoGPT model only managed 20-40%.
  • Policy Efficiency: The learned authentication policy reached a Rec@10 of 80.9, outperforming both random sampling (70.2) and human interrogators, who often struggled to cover multiple traits within the 8-turn limit.

Discussion and Future Work

A key insight from the study is that "polite," non-goal-oriented conversation often masks inconsistencies. In contrast, an interrogative approach—even a simple random policy of forcing topic switches—is far more effective at exposing whether a model truly "knows" its persona.

Limitations

Despite its success, the framework has limitations. It currently assumes the agent is acting in "good faith" and is not designed for adversarial bots intentionally hiding their identity. Furthermore, the system focuses on explicit facts rather than indirect personality traits (e.g., humor or tone).

Ethical Considerations

The authors highlight potential social risks, such as "persona mining," where optimized questioning strategies could be used to extract sensitive information from human users. Future research must prioritize developing countermeasures against such privacy-invasive applications.

Summary updated

Abstract

In this paper we define and investigate the problem of \emph{persona authentication}: learning a conversational policy to verify the consistency of persona models. We propose a learning objective and prove (under some mild assumptions) that local density estimators trained under this objective maximize the mutual information between persona information and dialog trajectory. Based on the proposed objective, we develop a method of learning an authentication model that adaptively outputs personalized questions to reveal the underlying persona of its partner throughout the course of multi-turn conversation. Experiments show that our authentication method discovers effective question sequences that generalize to unseen persona profiles.
BibTeX
@misc{tang2021persona,
  author = {Fengyi Tang and Lifan Zeng and Fei Wang and Jiayu Zhou},
  title = {{Persona Authentication through Generative Dialogue}},
  year = {2021},
  eprint = {2110.12949},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2110.12949},
}
Figure