Crisis-Bench: Benchmarking Strategic Ambiguity and Reputation Management in Large Language Models

Cooper Lin, Maohao Ran, Yanting Zhang, Zhenglin Wan, Hongwei Fan, Yibo Xu, Yike Guo, Wei Xue, Jun SongarXiv 2026 · arXiv

TL;DR

Current Large Language Model (LLM) safety alignment instills a rigid "Boy Scout" morality that prioritizes absolute honesty, creating a "transparency tax" in professional domains like public relations, law, and negotiation. To bridge this gap, researchers introduce Crisis-Bench, a multi-agent framework that simulates high-stakes corporate crises to evaluate an LLM's capacity for strategic ambiguity and reputation management. The benchmark reveals that while some models collapse under radical transparency or refuse the task entirely, top-tier models can successfully navigate information asymmetry to stabilize a simulated corporate stock price.

What Problem Does This Paper Address?

Standard post-training alignment techniques, such as Reinforcement Learning from Human Feedback (RLHF), optimize LLMs to be universally helpful, honest, and harmless. While ideal for everyday chatbots, this one-size-fits-all ethical framework fails in adversarial professional environments where total immediate disclosure is a liability. For example, a crisis manager who immediately reveals every damaging corporate secret isn't being "safe"—they are being professionally incompetent.

Existing benchmarks evaluate LLMs in a vacuum, treating truth as a static, binary objective. They fail to assess Theory of Mind in professional contexts: the ability of an AI agent to distinguish between what it knows privately versus what the public knows, and to strategically manage that information asymmetry. This paper addresses the lack of a standardized, quantitative framework to evaluate LLMs on reputation management and legitimate strategic information withholding.

Methods

The authors model crisis communication as a multi-turn, multi-agent Partially Observable Markov Decision Process (POMDP) executed over a simulated 7-day corporate crisis. The architecture relies on three primary components:

  1. Dual-Knowledge Architecture: The system strictly separates information into a Private Knowledge Base ($K_{priv}$, confidential company secrets) and a Public Knowledge Base ($K_{pub}$, what the public and media know), tracking parallel narrative states to enforce information asymmetry.
  2. Three-Agent System:
  3. Router Agent: An LLM-based controller that logically selects the next crisis event from a fixed pool to maintain narrative consistency without introducing uncontrolled generative variance.
  4. PR Agent (The Evaluated Model): Granted full executive authority to issue public statements or execute operational decisions (e.g., product recalls, financial compensation, firing executives). It follows a strict Chain-of-Thought (CoT) process: Situation Analysis $\rightarrow$ Strategic Intent $\rightarrow$ Action $\rightarrow$ Strategic Disclosure.
  5. Adjudicator Agent: An LLM evaluator that scores the PR Agent's public statements across four dimensions: Accountability, Transparency, Empathy, and Cost Signaling.
  6. Adjudicator-Market Loop: Rather than using static ground truths, qualitative PR responses are translated into quantitative economic impacts. The Adjudicator's scores drive a simulated stock price fluctuation ($\Delta P$) calculated via market forces, including Crisis Drag, Market Sentiment (incorporating a "Liar's Penalty"), Financial Hit, and an Uncertainty Penalty.
Figure 1: The Crisis-Bench workflow. The Router selects an event which updates the Private (Kpriv) and Public (Kpub) knowledge bases. The PR Agent responds to these events, and the Adjudicator’s score drives a simulated stock price, which the agent must stabilize to maximize shareholder value.

Datasets

The paper introduces Crisis-Bench, a new dynamic benchmark featuring:

  • 80 unique corporate crisis storylines evenly distributed across 8 distinct industries (Pharmaceuticals, Insurance, IT, Food & Beverage, Appliances, Automotive, Finance, and Entertainment).
  • Ground Truth Dossiers: Each scenario is initialized with 6–7 atomic facts mapping the objective reality of the crisis.
  • Event Pools: Each storyline contains a finite pool of 15 scenario-specific events categorized into Internal Discovery (Type I), Information Leak (Type II), and External Reaction (Type III) to drive state transitions.
Figure 2: Simulation assets. The Dossier (D) contains the immutable ground truth. Kpriv and Kpub maintain dynamic information asymmetry between the firm and the public, while the Event Pool (E) drives state transitions between them.

Key Insights and Ideas

  • The Transparency Paradox: Indiscriminate honesty can actively harm crisis resolution. Models exhibiting "radical transparency" prematurely leak private information. Instead of fostering trust, this triggers public panic, spikes crisis severity, and traps the AI in a costly "panic loop" of expensive remedial actions that collapse the stock price.
  • The "Morality Tax" and Refusals: Rigid safety alignment can render models non-functional in professional settings. Notably, the Claude-4.5 family consistently refused to execute the duties of the PR Agent entirely, viewing strategic information management as an ethical violation.
  • Strategic Reasoning Scales with Size: The capability to successfully exploit information asymmetry is an emergent property of model scale. Larger models (e.g., GPT-5.1, Qwen3-235b) successfully balance public trust against operational costs, whereas smaller models default to flawed, binary heuristics like total denial or total admission.
  • Corporate Coldness: Alignment can sometimes result in an unnatural lack of empathy. The flagship Gemini-3-Pro model underperformed its lighter Flash variant due to a collapse in empathy and accountability scores, adopting a defensive, litigious tone that alienated the public adjudicator.

Key Results

The authors evaluated 12 state-of-the-art closed and open-weights LLMs:

  • GPT-5.1 achieved the best overall performance, hitting the highest average final stock price ($68.442$). It demonstrated a superior "Machiavellian equilibrium," maintaining acceptable trust while exercising financial restraint and achieving the lowest final crisis severity ($0.8840$).
  • GPT-5-mini proved to be a "people-pleaser." It achieved the highest public trust score ($74.163$) but finished with a lower stock price ($64.206$) because it aggressively defaulted to highly expensive remedies (Cost Signal: $7.541$).
  • Qwen3-235b-a22b led the open-source models, performing competitively with the closed-source giants by achieving a final stock price of $64.000$. Conversely, lighter models like Llama-4-Scout failed to prevent stock prices from plummeting.
Overall performance metrics of the 12 evaluated LLMs.
Average final simulated stock price across different crisis industries.

Limitations and Future Work

  • Simulation Fidelity: The framework simplifies real-world corporate governance by abstracting away chaotic variables like multi-channel media cycles, regulatory interventions, and irrational investor exuberance into a deterministic loop.
  • Economic Simplification: The stock price function serves as a proxy for reputational health rather than a literal macroeconomic financial forecasting tool.
  • Future Directions: The authors call on the AI community to move away from rigid moral absolutism in alignment. They advocate for Context-Aware Alignment paradigms capable of distinguishing between general public safety and professional fiduciary responsibilities.

Summary updated

Abstract

Standard safety alignment optimizes Large Language Models (LLMs) for universal helpfulness and honesty, effectively instilling a rigid "Boy Scout" morality. While robust for general-purpose assistants, this one-size-fits-all ethical framework imposes a "transparency tax" on professional domains requiring strategic ambiguity and information withholding, such as public relations, negotiation, and crisis management. To measure this gap between general safety and professional utility, we introduce Crisis-Bench, a multi-agent Partially Observable Markov Decision Process (POMDP) that evaluates LLMs in high-stakes corporate crises. Spanning 80 diverse storylines across 8 industries, Crisis-Bench tasks an LLM-based Public Relations (PR) Agent with navigating a dynamic 7-day corporate crisis simulation while managing strictly separated Private and Public narrative states to enforce rigorous information asymmetry. Unlike traditional benchmarks that rely on static ground truths, we introduce the Adjudicator-Market Loop: a novel evaluation metric where public sentiment is adjudicated and translated into a simulated stock price, creating a realistic economic incentive structure. Our results expose a critical dichotomy: while some models capitulate to ethical concerns, others demonstrate the capacity for Machiavellian, legitimate strategic withholding in order to stabilize the simulated stock price. Crisis-Bench provides the first quantitative framework for assessing "Reputation Management" capabilities, arguing for a shift from rigid moral absolutism to context-aware professional alignment.
BibTeX
@misc{lin2026crisis,
  author = {Cooper Lin and Maohao Ran and Yanting Zhang and Zhenglin Wan and Hongwei Fan and Yibo Xu and Yike Guo and Wei Xue and Jun Song},
  title = {{Crisis-Bench: Benchmarking Strategic Ambiguity and Reputation Management in Large Language Models}},
  year = {2026},
  eprint = {2601.05570},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2601.05570},
}
Figure