Circe: Training-Free LLM Self-Evaluation via Component Interaction Consistency

Shuyi Miao, Zheng Li, Xu Xie, Linrui Xu, Fei Shen, Xiaoyu Du, Tat-Seng Chua

TL;DR

Circe is a training-free framework that evaluates the correctness of LLM responses without needing reference answers or multiple samples. By fusing internal signals—specifically how attention and feed-forward components interact across layers—with external likelihood signals, it identifies "confident hallucinations" that traditional metrics often miss.

What Problem Does This Paper Address?

Large Language Models (LLMs) are notorious for their ability to generate fluent, plausible, and highly confident responses that are, unfortunately, completely wrong. Evaluating these responses is difficult in real-world applications where reference answers aren't available.

Existing reference-free methods typically rely on output signals, such as token likelihood, verbalized confidence ("I am 95% sure..."), or agreement across multiple sampled responses. However, as shown in Figure 1, these signals can be deceptive: a model might assign high probability to an incorrect answer or consistently repeat the same error across multiple runs.

Figure 1: Evaluating LLM response correctness with inter- nal signals. (a) Real-world questions often lack reference answers. (b) Output likelihood, verbal confidence, and re- sponse agreement can remain high for incorrect answers. (c) Circe incorporates internal computational signals, yielding a low correctness score for the illustrated incorrect answer.

While some researchers have turned to the model's internal states (hidden-state trajectories), these methods often treat the Transformer block as a black box, overlooking the specific interactions between its two primary engines: the Attention mechanism and the Feed-Forward Network (FFN).

Methods

The authors introduce Circe, a method that scores response correctness by combining three distinct signals:

  1. Component Interaction Consistency (CIC): This is the paper's core innovation. It measures the directional alignment between attention updates in earlier layers and the changes those updates induce in FFN outputs in later layers. The intuition is that coherent, correct reasoning involves a "consistent" internal dialogue between these components across the depth of the model.
  2. Representation Geometry (RG): This characterizes the "path" a response takes through the model's layers by measuring normalized displacement and angular changes in the hidden states.
  3. Likelihood Confidence (LC): An external signal derived from the mean negative log-likelihood (NLL) of the generated tokens, transformed into a bounded score.

These signals are fused into a single Circe Score. The process is "training-free" because it doesn't require optimizing the LLM's parameters or training a complex external classifier; it simply uses a few fusion weights tuned on a small development set.

Figure 2: Overview of Circe. (1) Component interaction consistency: cross-layer directional alignment between attention updates and attention-induced FFN changes. (2) Representation geometry: normalized displacement and angular change along the layerwise hidden state trajectory. (3) Likelihood confidence: a bounded transformation of the mean NLL of the generated tokens. Internal signals are fused into an internal score, which is combined with the output signal to yield the final Circe score.

Datasets

The authors evaluated Circe across five different LLMs (including Qwen2, Llama3, and Mistral variants) and six benchmarks covering four domains:

  • Mathematics: GSM8K and MATH.
  • Reasoning: CommonsenseQA and TheoremQA.
  • Knowledge: MMLU.
  • Understanding: Belebele.

They also tested its generalization capabilities using MGSM (multilingual math) and Geometry3K (multimodal geometry problems involving diagrams).

Key Insights and Ideas

  • The "Internal Dialogue" Matters: The most significant finding is that correct responses exhibit higher directional consistency between early attention updates and later FFN changes. If the FFNs in later layers "disagree" with the directions established by earlier attention layers, the response is much more likely to be incorrect.
  • Harder Tasks, Stronger Signals: Interestingly, Circe’s performance margin over baselines actually increases on more difficult benchmarks (like MATH vs. GSM8K). The authors suggest that difficult questions elicit more complex internal computations, making the patterns of interaction consistency more pronounced and easier to detect.
  • Complementarity is Key: The ablation studies show that while CIC, RG, and LC are all useful, they capture different types of evidence. Fusing them provides a much more robust evaluation than any single signal could achieve alone.
Figure 3: Correct responses have higher mean CIC, RG, and LC scores. Curves show smoothed score distributions for Qwen2- 7B-Instruct on MATH, and dots below the curves represent individual responses. Vertical dotted lines and short bars mark the class means, with arrows pointing from the incorrect-response mean to the correct-response mean. Grey shading indicates overlap between the distributions of the two classes.

Key Results

  • Superior Discrimination: Circe outperformed 12 reference-free baselines across all four domains. It improved the AUROC (Area Under the Receiver Operating Characteristic curve) by an average of 7.37% in math and over 5% in knowledge and understanding tasks compared to the strongest baselines.
  • Efficiency: Unlike sampling-based methods (like Self-Consistency) that require generating multiple responses, Circe works with a single generation. Its computational overhead is roughly 18% of the base inference time, making it significantly cheaper than multi-pass methods.
  • Robustness: The method proved robust to "data ratio" shifts (varying proportions of correct vs. incorrect answers) and generalized effectively to 11 different languages and multimodal (vision-text) inputs without any additional training.

Limitations and Future Work

  • White-Box Requirement: Because Circe relies on internal activations (attention updates and FFN outputs), it cannot be used with black-box API models like GPT-4 or Claude 3.5 unless the providers expose these internal signals.
  • Domain-Specific Fusion: While the fusion weights are shared across different models, they are currently domain-specific (e.g., different weights for math vs. general knowledge). Future work could explore more universal fusion strategies.
  • Linear Approximation: The theoretical justification for CIC relies on a local linear approximation of FFN maps. While this holds well for smooth activations like SiLU, exploring higher-order interactions could potentially yield even stronger signals.

Summary updated

Abstract

As large language models (LLMs) are increasingly deployed in real-world applications, evaluating the correctness of their responses is crucial for reliable use. However, such evaluation is challenging because reference answers are rarely available in practice. Existing reference-free methods mainly rely on output signals, which may assign high scores to incorrect responses and thus do not necessarily reflect correctness. This motivates exploring the model's internal computation for complementary correctness signals. Recent studies exploit internal states, but they mainly analyze hidden-state trajectories across layers, which record only the combined updates of attention and feed-forward networks (FFNs) and overlook how these components interact. We therefore propose Circe, a training-free self-evaluation method that assesses a response using both internal and external signals, without reference answers or repeated sampling. For internal signals, we first introduce component interaction consistency (CIC), which measures the directional alignment between attention updates in earlier layers and attention-induced FFN output changes in later layers. We further incorporate representation geometry (RG) to characterize normalized displacement and angular changes along layerwise hidden-state trajectories. For the external signal, we convert the mean negative log-likelihood of generated tokens into a bounded likelihood confidence (LC) score. Finally, we fuse CIC, RG, and LC into a unified correctness score. Experiments on five LLMs and six benchmarks across four domains show that our method distinguishes correct from incorrect responses more effectively than existing baselines, and generalizes to multilingual, multimodal, and open-world settings.
BibTeX
@misc{miao2026circe,
  author = {Shuyi Miao and Zheng Li and Xu Xie and Linrui Xu and Fei Shen and Xiaoyu Du and Tat-Seng Chua},
  title = {{Circe: Training-Free LLM Self-Evaluation via Component Interaction Consistency}},
  year = {2026},
  eprint = {2611.07948},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.07948},
}
Figure