EigenTrack: Spectral Activation Feature Tracking for Hallucination and Out-of-Distribution Detection in LLMs and VLMs
Lists
Only you see this
Abstract
Large language models (LLMs) offer broad utility but remain prone to hallucination and out-of-distribution (OOD) errors. We propose EigenTrack, an interpretable real-time detector that uses the spectral geometry of hidden activations, a compact global signature of model dynamics. By streaming covariance-spectrum statistics such as entropy, eigenvalue gaps, and KL divergence from random baselines into a lightweight recurrent classifier, EigenTrack tracks temporal shifts in representation structure that signal hallucination and OOD drift before surface errors appear. Unlike black- and grey-box methods, it needs only a single forward pass without resampling. Unlike existing white-box detectors, it preserves temporal context, aggregates global signals, and offers interpretable accuracy-latency trade-offs.
BibTeX
@misc{ettori2025eigentrack,
author = {Davide Ettori and Nastaran Darabi and Sina Tayebati and Ranganath Krishnan and Mahesh Subedar and Omesh Tickoo and Amit Ranjan Trivedi},
title = {{EigenTrack: Spectral Activation Feature Tracking for Hallucination and Out-of-Distribution Detection in LLMs and VLMs}},
year = {2025},
eprint = {2509.15735},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2509.15735},
}Loading related content...