Persona Prompting as a Lens on LLM Social Reasoning

Jing Yang, Moritz Hechtbauer, Elisabeth Khalilov, Evelyn Luise Brinkmann, Vera Schmitt, Nils Feldhus

TL;DR

Can "role-playing" an LLM actually change its social reasoning, or is it just a coat of paint? This paper demonstrates that while persona prompting can slightly improve classification in subjective tasks like hate speech detection, it often degrades the quality of the model's explanations and fails to truly align with the perspectives of real-world demographic groups.

What Problem Does This Paper Address?

As LLMs are increasingly used for content moderation and social media recommendations, a "one-size-fits-all" approach to safety and sentiment often fails to account for the diverse perspectives of a global user base. Researchers and engineers have turned to Persona Prompting (PP)—instructing a model to act as a specific demographic (e.g., "a 25-year-old Caucasian male")—to steer models toward more personalized or context-aware outputs.

However, we don't fully understand how these personas affect the model's internal "reasoning." Does a model acting as a specific persona actually adopt that group's logic, or does it just change its final answer while relying on the same underlying biases? The authors investigate this by looking at token-level rationales (the specific words a model highlights to justify its decision) to see if the "why" changes along with the "what."

Methods

The researchers employed a multi-faceted evaluation pipeline across three distinct LLM families: Mistral-Medium, Qwen3-32B, and GPT-OSS-120B.

Key methodological components included:

  • Persona Construction: They designed 21 single-attribute personas (covering age, gender, education, race, religion, politics, and loneliness) and 12 composite personas.
  • Chain-of-Thought (CoT) Prompting: Models were instructed to "think out loud" in character before providing a final label and a JSON-formatted list of rationale tokens.
  • Multi-dimensional Evaluation: They didn't just measure accuracy. They used Krippendorff’s alpha to measure agreement between personas and compared model rationales against human-annotated ground truths using Token-F1 and IOU-F1 scores.

Datasets

The study utilized three primary datasets representing different levels of subjectivity:

  1. HateXplain: A benchmark for hate speech detection featuring social media posts with word-level rationales.
  2. CoS-E (Commonsense Explanations): A dataset for everyday logic and reasoning.
  3. SST-2 (Stanford Sentiment Treebank): A classic sentiment analysis dataset.
  4. BRWRR: A specialized version of CoS-E and SST-2 re-annotated by six different human demographic groups, allowing for a direct comparison between "simulated" personas and "real" human perspectives.

Key Insights and Ideas

  • The Steering Paradox: Persona prompting is a "double-edged sword." It can improve label accuracy in highly subjective tasks (like hate speech), but this often comes at the cost of rationale quality. The model might get the "right" answer for the "wrong" reasons.
  • Rigid Internal Templates: Despite the persona prompts, models showed high inter-persona agreement. This suggests that LLMs have a "rigid reasoning template" baked in during pre-training and alignment that is resistant to surface-level steering.
  • Stereotypes vs. Reality: When simulating personas, models often fall back on linguistic stereotypes (e.g., using simpler language for a "no formal education" persona) rather than capturing the actual social nuances of that group.
  • The "Safety" Over-correction: All tested models exhibited a strong tendency to over-flag content as offensive or hateful, regardless of the persona. This suggests that safety guardrails are more influential than persona instructions.

Key Results

  • HateXplain Performance: For Mistral-Medium, 11 out of 21 personas showed statistically significant improvements in label accuracy over the baseline. However, none of the models showed significant improvements in rationale quality; in fact, several personas caused rationale quality to degrade.
  • Demographic Bias: Models consistently performed better when aligned with "Old" and "Caucasian" demographic groups, regardless of whether a persona prompt was used. This indicates deep-seated biases in the underlying models.
  • Agreement Levels: GPT-OSS and Mistral showed high agreement across personas ($\alpha \geq 0.80$), while Qwen3 was more "steerable" but also more unstable, showing much lower agreement and higher disagreement rates (up to 56.4% on political views).
  • Over-flagging: GPT-OSS had the highest over-flagging rate, moving "Offensive" labels to "Hate Speech" nearly 50% of the time.

Limitations and Future Work

The authors acknowledge several limitations:

  • Rationale Generation: The rationales were generated via prompting rather than internal feature attribution (like attention maps), meaning they might not perfectly reflect the model's internal activations.
  • Human Ground Truth: HateXplain rationales are based on a majority vote of only three annotators, which may not capture the full spectrum of human interpretation.
  • Model Selection: While representative, the study only looked at three model families.

Future Work: The authors suggest that "true alignment" likely requires more than just clever prompting. Future research should focus on developing methods that can steer a model's underlying reasoning process without sacrificing performance or reinforcing existing biases.

Summary updated

Abstract

For socially sensitive tasks like hate speech detection, the quality of explanations from Large Language Models (LLMs) is crucial for factors like user trust and model alignment. While Persona prompting (PP) is increasingly used as a way to steer model towards user-specific generation, its effect on model rationales remains underexplored. We investigate how LLM-generated rationales vary when conditioned on different simulated demographic personas. Using datasets annotated with word-level rationales, we measure agreement with human annotations from different demographic groups, and assess the impact of PP on model bias and human alignment. Our evaluation across three LLMs results reveals three key findings: (1) PP improving classification on the most subjective task (hate speech) but degrading rationale quality. (2) Simulated personas fail to align with their real-world demographic counterparts, and high inter-persona agreement shows models are resistant to significant steering. (3) Models exhibit consistent demographic biases and a strong tendency to over-flag content as harmful, regardless of PP. Our findings reveal a critical trade-off: while PP can improve classification in socially-sensitive tasks, it often comes at the cost of rationale quality and fails to mitigate underlying biases, urging caution in its application.
BibTeX
@inproceedings{yang2026persona,
  author = {Jing Yang and Moritz Hechtbauer and Elisabeth Khalilov and Evelyn Luise Brinkmann and Vera Schmitt and Nils Feldhus},
  title = {{Persona Prompting as a Lens on LLM Social Reasoning}},
  booktitle = {EACL (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.eacl-long.52},
}

Loading related content...

Figure