Simple Role Assignment is Extraordinarily Effective for Safety Alignment

Ziheng Zhou, Jiakun Ding, Zhaowei Zhang, Ruosen Gao, Yingnian Wu, Demetri Terzopoulos, Yipeng Kang, Fangwei Zhong, Junqi WangarXiv 2026 · arXiv · OpenReview

TL;DR

This paper introduces "role conditioning" as a surprisingly effective and simple method for aligning large language models (LLMs) with human values. By assigning LLMs specific social roles (like "mother" or "principal"), the models implicitly adopt relevant values and reasoning schemas, leading to significantly improved safety and reduced harmful outputs across various benchmarks, outperforming traditional principle-based methods.

What Problem Does This Paper Address?

Ensuring that LLMs behave in accordance with human preferences and values, a challenge known as the "value alignment problem," is crucial. Current methods often rely on explicitly listing principles or values, but these lists are inherently incomplete and lack the nuance to guide LLMs on how to apply these values in specific contexts. This can lead to brittle and inconsistent alignment. The authors propose that human reasoning, informed by Theory of Mind (ToM), involves not just values but also cognitive models that interpret context. They aim to find a more compact and effective way to imbue LLMs with this contextual understanding for alignment.

Methods

The core of the proposed method is role conditioning. Instead of providing explicit, potentially incomplete, lists of principles, the LLM is prompted with a specific social role. The authors hypothesize that these roles implicitly encode both relevant values (e.g., "care" for a mother) and the cognitive schemas for applying them (e.g., "protecting children").

Their pipeline is training-free and consists of two main components:

  1. Role-conditioned Generator: A base LLM is prompted with a role specification.
  2. Iterative Role-Based Critics: A set of critics, also guided by specific roles, evaluate the generator's output. If a critic disagrees, it provides feedback, and the generator iteratively refines its response until all critics approve or a maximum number of iterations is reached.

The authors formalize this by showing that in an ideal scenario, role conditioning strictly dominates fixed principle lists because roles inherently capture both values and context-sensitive cognition.

Datasets

The paper evaluates its approach on several existing safety benchmarks:

  • WildJailbreak: Used to demonstrate significant reduction in unsafe outputs.
  • SaladBench: Another safety benchmark.
  • SafeEdit: Used for extensive ablation studies and role selection experiments.
  • HarmfulQA: Used for evaluation.
  • GSM-Danger: Used for evaluation.
  • Anthropic's Agentic AI blackmailing human benchmark: Used for an exploratory experiment on agentic safety.

The authors do not introduce new datasets but rather leverage existing ones to showcase the effectiveness of their role-based approach.

Key Insights and Ideas

  • Roles as Compact Value Carriers: Social roles are surprisingly effective at implicitly encoding complex value systems and reasoning strategies, making them a more robust and generalizable alignment signal than explicit principle lists.
  • Theory of Mind Inspiration: The approach is grounded in the idea that human reasoning involves both "what" (values) and "how" (cognition/contextual understanding), which roles naturally capture.
  • "Mother" and "Principal" as Strong Roles: Concrete guardian roles, particularly "mother" and "principal," consistently perform well, suggesting that specific, relatable roles are more effective than abstract ones. This aligns with the intuition that "safe for children" is a strong proxy for general safety.
  • Iterative Refinement is Crucial: While role conditioning alone provides benefits, adding iterative feedback from role-based critics significantly boosts performance, with most gains occurring in the first few rounds.
  • Synergy with Existing Methods: The role-based approach can complement and improve existing methods like Chain-of-Thought (CoT) and URIAL, suggesting a path towards more powerful hybrid alignment strategies.

Key Results

  • Dramatic Reduction in Unsafe Outputs: On the WildJailbreak benchmark, the approach reduced unsafe outputs from 81.4% to 3.6% for DeepSeek-V3. For Gemma3-12B-IT, it reduced unsafe generations from 78.4% to 11%.
  • State-of-the-Art Performance: Across five different model families (Qwen3-8B, Gemma3-12B-IT, DeepSeek-V3, Gemini-2.5-Flash, and Qwen3-235B), the role-conditioned approach consistently outperformed principle-based, CoT, and other baselines.
  • Agentic Safety Improvement: In an agentic safety task (AI blackmailing), the "principal" role reduced blackmail rates from 65% to 11% in one scenario, and a "principal + mother" combination reduced rates from 36% to 8% in another.
  • Minimal Latency Overhead: Adding role conditioning and up to two critic iterations introduced only a modest latency increase (around 0.7 seconds on average) compared to the base model, while yielding substantial safety improvements.
  • Role Combinations Matter: While single roles are effective, combining roles (e.g., "mother" and "principal") further enhances performance, suggesting synergistic effects.

Limitations and Future Work

  • Model Dependency: The method's effectiveness is constrained by the underlying LLM's reasoning capabilities; weaker models show performance degradation.
  • Long-Context Reasoning: Current LLMs' struggles with long-context reasoning may limit the effectiveness of role-based alignment in extended interactions.
  • Role Candidate Generation and Selection: While the current approach is effective, modules for generating, selecting, and refining roles could be further improved.
  • Dynamic Role Rewriting: Exploratory experiments showed that dynamically rewriting role descriptions per query significantly boosts performance, indicating a promising avenue for future work.
  • Malicious Role Detection: The authors acknowledge the risk of users specifying malicious roles but demonstrate that LLMs can effectively detect such roles, mitigating this risk.

Summary updated

Abstract

Principle-based alignment often lacks context sensitivity and completeness. Grounded in Theory of Mind, we propose role conditioning as a compact alternative: social roles (e.g., mother, judge) implicitly encode both values and the cognitive schemas required to apply them. We introduce a training-free pipeline featuring a role-conditioned generator and iterative role-based critics for refinement. Across five model families, our approach consistently outperforms principle-based, Chain-of-Thought (CoT) and other baselines across benchmarks. Notably, it reduces unsafe outputs on the WildJailbreak benchmark from 81.4\% to 3.6\% with DeepSeek-V3. Not only for common safety benchmarks, it consistently applies for agentic safety tasks. These results establish role assignment as a powerful, interpretable paradigm for AI alignment and LLM-as-a-Judge construction.
BibTeX
@misc{zhou2026simple,
  author = {Ziheng Zhou and Jiakun Ding and Zhaowei Zhang and Ruosen Gao and Yingnian Wu and Demetri Terzopoulos and Yipeng Kang and Fangwei Zhong and Junqi Wang},
  title = {{Simple Role Assignment is Extraordinarily Effective for Safety Alignment}},
  year = {2026},
  eprint = {2602.00061},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.00061},
}
Figure