Can Activation Steering Substitute for Prompt-Based Affective Priming in LLM Digital Twins?

Junyi FanarXiv 2026 · arXiv

TL;DR

This paper investigates whether activation steering—directly modifying an LLM's internal hidden states—can replace traditional affective priming (asking a model to write about an emotional memory) in "digital twin" simulations. While steering can successfully induce a target emotional state in a dose-dependent manner, it often overshoots or fails to replicate the nuanced "spillover" effects of real-world psychological manipulations, suggesting that internal steering is not yet a perfect substitute for prompt-based interaction.

What Problem Does This Paper Address?

In social science, researchers use affective priming to shift a participant's emotional state (e.g., making them feel grateful) before measuring how that state influences subsequent judgments. As we move toward using LLMs as "digital twins" to simulate human survey responses, replicating these state-level shifts is crucial.

However, traditional priming requires the LLM to generate a full essay, which is computationally expensive and introduces "pipeline" noise—is the effect coming from the content of the writing or the act of writing itself? The authors ask if we can skip the writing task entirely and use activation steering (adding a specific "direction vector" to the model's activations) to achieve the same psychological effect more efficiently and with finer control.

Methods

The researchers used Llama-3.1-8B-Instruct to simulate 100 distinct human personas. They compared two primary approaches across two domains: Gratitude and Lack-of-Control.

  1. Real-Prompt Path: The model follows the standard psychological protocol: it recalls and writes about an event (e.g., a time it felt grateful) and then answers survey questions.
  2. Injection Path: The writing task is skipped. Instead, a "direction vector" (extracted from human writing samples using a mean-difference method) is injected into the model's residual stream at layers 16–18 during the question-answering phase.

The injection was tested at four "dose" strengths ($\beta$). To isolate the effect of the vector from the effect of skipping the writing task, they included a No-Injection baseline ($\beta=0$).

Figure 1: Two-phase vector injection pipeline: direction vectors are extracted once per domain from real writing corpora (Phase 1), then injected into a small multi-layer window during generation, skipping the writing task entirely (Phase 2).

Datasets

  • Twin-2K-500 Mega Study (J2 sub-study): Used as the ground truth for human and GPT-4 "digital twin" responses to affective priming.
  • Human Writing Corpus: 506 examples for gratitude and 492 for lack-of-control, used to extract the steering vectors.
  • Personas: 100 detailed persona profiles (demographics + psychometrics) from the Twin-2K-500 dataset.

Key Insights and Ideas

  • The "Pipeline" Matters: Simply removing the writing task (the No-Injection baseline) shifted the model's responses. For example, skipping the writing task actually increased reported fatigue. This suggests that the structure of the interaction itself is a hidden variable in LLM simulations.
  • Dose-Response is Real but Risky: Activation steering is highly sensitive to the injection strength ($\beta$). While a specific strength (around $\beta \approx 2.7$ for gratitude) could match the "real" prompt effect on a manipulation check, higher strengths caused the model to "overshoot" and eventually led to a breakdown in the model's ability to produce parseable output.
  • Amplification vs. Reconstruction: Steering doesn't just "reconstruct" the state induced by writing; it seems to amplify specific properties. The steering vector sometimes moved "distal" measures (unrelated judgments) that the real-prompt priming left untouched, indicating that steering might be "blunter" than natural language priming.
  • Asymmetry in Control: Steering the model toward "feeling in control" had a much weaker effect than steering it toward "lack of control," suggesting that LLM internal manifolds may not be perfectly symmetric for opposing concepts.

Key Results

The study first confirmed that their Llama-3.1-8B setup successfully replicated the "over-responsiveness" seen in larger models like GPT-4 when using real prompts.

Table 2: Priming effect (prime minus control) on each measure for this study’s real-prompt path and for the original study’s human participants and digital twins.

When comparing steering to prompts:

  • Gratitude: Steering matched the real-prompt effect on the manipulation check at $\beta \approx 2.7$. However, at this same strength, it significantly overshot the "proximal" measure (Elevation).
  • Lack-of-Control: Steering was even more aggressive; even at the "Low" dose, it exceeded the effect of the real-prompt prime.
  • Reliability: As steering strength increased, the "parsing success rate" (the model's ability to provide valid JSON answers) dropped from ~100% to as low as 72%.
Figure 2: Dose-response curves for the gratitude domain across the three measures. Dotted lines indicate the real-prompt reference conditions (± SEM band), the dashed line the No-Injection baseline; the dose injection arm is a connected curve, the active-control injection arm an unconnected marker.

Limitations and Future Work

  • Model Specificity: The study focused on a single 8B model. Larger models might exhibit different steering dynamics.
  • Vector Extraction: The authors used a simple "Mean Difference" between prime and control writing. More sophisticated methods (like SAEs or contrastive pairs that strip out topical wording) might produce "cleaner" affective directions.
  • Fixed Window: Injections were limited to layers 16–18. Exploring different layer depths or wider windows might improve the "fidelity" of the induced state.
  • Neutral Controls: Future work should include a "neutral writing" control to better separate the cognitive load of writing from the emotional content of the prime.

Summary updated

Abstract

Affective priming -- asking participants to write about a recalled event, such as a time they felt grateful or lacked control, and then measuring the induced state and its spillover onto related judgments -- is a standard way to manipulate emotion in the social sciences, and it also shifts the responses of LLM-based digital twins. The writing task, however, requires generating a full text. We test whether activation steering can replace it. Using Llama-3.1-8B-Instruct on 100 personas in two domains (gratitude, lack of control), we compare a real-prompt path replicating the original Twin-2K-500 Mega Study (J2) with an injection path that skips the writing and adds a mean-difference direction, extracted from human writing, to the residual stream at varying strengths. The real-prompt effects fall between the original human and digital-twin effects in 5 of 6 comparisons. Injection shifts the manipulation check in a dose-dependent way and matches the real-prompt effect at one strength in the gratitude domain (beta ~ 2.7), but overshoots beyond it, on the proximal measure as well, and asymmetrically across the two directions. A structure-matched No-Injection baseline separates two sources of difference: omitting the writing task raises the proximal measure in both domains, whereas the injected direction itself moves a distal measure in the lack-of-control domain. Substitution is therefore measure-dependent: validity established for one way of inducing a state does not carry over uniformly to another.
BibTeX
@misc{fan2026can,
  author = {Junyi Fan},
  title = {{Can Activation Steering Substitute for Prompt-Based Affective Priming in LLM Digital Twins?}},
  year = {2026},
  eprint = {2611.22738},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.22738},
}
Figure