Reasoning Models Reason Inefficiently
Lists
Only you see this
Abstract
Large language models (LLMs) produce long, structured reasoning traces that can inflate latency and cost. Our results suggest that while backtracking can help models arrive to the correct answer, they are not a faithful picture of the minimal computation required to solve a task—they can be compressed or restructured. In this paper, we show how to build more efficient and interpretable reasoning processes by identifying and targeting internal directions associated with inefficiency.
BibTeX
@inproceedings{khullar2025reasoning,
author = {Dipika Khullar and Ashwinee Panda},
title = {{Reasoning Models Reason Inefficiently}},
booktitle = {ER @ NeurIPS},
year = {2025},
url = {https://openreview.net/forum?id=6kzrMumI1d},
}Loading related content...