When Models Refuse: Political Steerability and Feature Richness as Measures of Ideological Depth

Shariar KabirarXiv 2025 · DOI · arXiv

TL;DR

This paper proposes "ideological depth" as a new metric for understanding LLM behavior, combining steerability and the richness of internal political representations. They find that LLM refusals on political prompts might signal a capability deficit rather than just safety guardrails, with models possessing richer feature spaces being more steerable and less prone to refusal.

What Problem Does This Paper Address?

Large Language Models (LLMs) are increasingly used for tasks involving political discourse, but their behavior can be inconsistent. Sometimes they refuse to adopt a political stance or persona, which is often attributed to safety alignment. However, this paper questions whether these refusals might instead indicate a lack of internal capability – a deficit in the model's ability to represent and reason from the instructed perspective. The authors aim to quantify this "ideological depth" to better predict when models might refuse and understand the underlying reasons.

Methods

The researchers introduce "ideological depth" as a property of LLMs, measured by two components:

  1. Steerability: How reliably a model can adopt instructed political personas (liberal or conservative) without refusing. This was tested using prompt engineering (varying persona and arguments) and activation steering (modifying internal model activations).
  2. Feature Richness: The breadth and coherence of political features encoded in the model's internal representations. This was analyzed using Sparse Autoencoders (SAEs), a technique for disentangling complex features within LLMs.

They also performed causal ablation studies, removing specific political features to observe their impact on refusal behavior.

Datasets

  • Prompt Dataset: A curated set of 1000 prompts from a politically liberal subset of Perez et al. (2023), categorized into 12 topics. 126 prompts were selected for evaluation, with the rest used for training steering vectors.
  • SAE Training Data: Publicly available SAEs for the base models of Llama-3.1-8B-Instruct and Gemma-2-9B-IT were used.
  • Argument Generation: Llama-3.3-70B-Instruct was used to generate supporting and counter-arguments for evaluation statements.

Key Insights and Ideas

  • Refusals as Capability Deficits: The core insight is that LLM refusals on benign political prompts may not solely be safety guardrails but can signal a fundamental inability to process or represent the requested viewpoint.
  • Ideological Depth as a Predictor: The proposed metric of "ideological depth," combining steerability and feature richness, appears to be a strong predictor of a model's propensity to refuse.
  • Feature Richness Matters: Models with a richer set of internal political features are more steerable and less likely to refuse, suggesting that a more complex internal representation enables more flexible reasoning.
  • Gemma vs. Llama: A stark contrast was found between Gemma-2-9B-IT and Llama-3.1-8B-IT, with Gemma exhibiting significantly higher ideological depth, leading to better steerability and fewer refusals.

Key Results

  • Feature Richness Difference: Gemma-2-9B-IT activated approximately 7.3 times more distinct political features than Llama-3.1-8B-IT.
  • Steerability: Gemma could be steered across a wide range of liberal to conservative viewpoints, while Llama's steerability was confined to a narrow band, often resulting in refusals.
  • Causal Link: Ablating a small set of salient political features in Gemma significantly increased its refusal rate, providing causal evidence that feature deficits lead to refusals.
  • SAE Feature Quality: Gemma's SAE features were found to have higher thematic coherence and stronger predictive validity for political classification compared to Llama's.
  • Confusion Matrices: Gemma's features allowed for accurate topic classification, while Llama's features failed to distinguish between categories.

Limitations and Future Work

  • SAE Limitations: The study acknowledges that SAEs have limitations and depend on training data, which could influence comparisons. Future work might use complementary methods like probing.
  • Model Size: The study focused on two models of similar size. Generalizing findings to larger models or different training paradigms is an open question.
  • Cultural Specificity: The analysis used US-centric political categories. Future work could explore non-Western political frameworks to assess generalizability.
  • Future Research Directions:
    • Investigating the mechanistic origins of response instability.
  • Developing real-time monitoring tools for political features.
  • Exploring training interventions to deliberately shape ideological depth.

Summary updated

Abstract

Large language models (LLMs) sometimes refuse to follow benign instructions, such as declining to argue a political position or adopt a stated persona, and such refusals are commonly read as safety guardrails at work. We ask whether they can instead signal a **capability deficit**: a shortage of the internal representations a model needs to reason from the instructed perspective. To investigate, we introduce **ideological depth**, a property with two components: (i) a model's ability to follow political instructions without *failure* (steerability), and (ii) the **feature richness** of its internal political representations, measured with sparse autoencoders (SAEs). Using two widely used openweight LLMs as candidates, we compare interventions based on prompts and activation-steering, and probe political features with publicly available SAEs. We find large, systematic differences: a model that is more steerable in both ideological directions activates **~7.3x** more distinct political features, while the other model instead responds with increased refusals. Causally ablating a small, targeted set of political features from the former model reproduces the same feature-poor behavior and drives up refusals. Together, these results indicate that refusals on benign prompts can arise from **capability deficits** rather than fixed safety rules, and that ideological depth is a measurable property of LLMs that helps predict when a model will refuse.
BibTeX
@misc{kabir2025when,
  author = {Shariar Kabir},
  title = {{When Models Refuse: Political Steerability and Feature Richness as Measures of Ideological Depth}},
  year = {2025},
  eprint = {2508.21448},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2508.21448},
}
Figure