SMRC: Aligning Large Language Models with Student Reasoning for Mathematical Error Correction

Biaojie Zeng, Min Zhang, Juan Zhou, Fengrui Liu, Ruiyang Huang, Xin LinarXiv 2025 · arXiv · OpenReview

TL;DR

This paper introduces SMRC, a novel framework that aligns Large Language Models (LLMs) with student reasoning for mathematical error correction. Unlike existing self-correction methods, SMRC acts like a "teacher," guiding students through their own problem-solving process to correct errors while preserving their original thought patterns. This is achieved through a combination of Monte Carlo Tree Search and a specialized reward model, leading to significant improvements in both accuracy and educational applicability.

What Problem Does This Paper Address?

Large Language Models (LLMs) have shown impressive capabilities in mathematical reasoning, but they still struggle with logical inconsistencies and computational errors. While current research has focused on LLMs correcting their own errors (self-correction), this approach is insufficient for educational settings. In education, the goal is to provide "teacher-style" correction that guides a student's existing reasoning process, rather than simply generating a correct answer from scratch. Existing methods often fail to preserve the student's original thought process, which can hinder comprehension and pedagogical effectiveness. Furthermore, current benchmarks often rely on synthetically generated student errors, which don't capture the nuances of real student misconceptions. This paper addresses the need for a method that can accurately correct mathematical errors while respecting and building upon a student's unique reasoning trajectory.

Methods

The core of SMRC is a Student-Aware Mathematical Reasoning Correction (SAMRC) framework. It frames student problem-solving as a sequential decision-making task.

  • Monte Carlo Tree Search (MCTS): SMRC employs MCTS to explore potential correction paths. MCTS is a search algorithm that balances exploration (trying new paths) and exploitation (following promising paths) to find optimal solutions. In SMRC, MCTS helps navigate the complex space of possible reasoning steps to identify the best correction strategy.
  • Reward Model: To guide the MCTS, SMRC uses a specialized reward model. This model is trained to provide "process-level" rewards, evaluating not just the final answer but also the quality of intermediate reasoning steps. To overcome the scarcity of labeled process data, the reward model is trained using a combination of LLM-guided breadth-first search (BFS) and final-answer evaluation. This process involves constructing a reasoning tree, assigning values to leaf nodes based on answer correctness (+1 for correct, -1 for incorrect), and then backpropagating these rewards to assign values to intermediate nodes. This allows for fine-grained supervision.
  • Dual Objective: The correction process is optimized for two objectives: maximizing solution accuracy and maximizing correct-step retention. This ensures that corrections are not only mathematically sound but also align with the student's original, correct reasoning steps.

Datasets

  • ProcessBench: An existing dataset used for evaluation.
  • MR-GSM8K: Another existing dataset used for evaluation.
  • MSEB (Multi-Solution Error Benchmark): A newly introduced dataset created by the authors. MSEB consists of 158 instances of real high school student solutions to mathematical problems. It includes problem statements, student answers, and crucially, the correct reasoning steps within the student's original solution. This dataset is designed to capture authentic student reasoning patterns and common error types, differentiating it from synthetically generated datasets.

Key Insights and Ideas

  • Teacher-Style Correction is Crucial: The paper strongly emphasizes that for educational applications, LLMs need to act as "teachers" who guide and correct student reasoning, rather than just providing correct answers. Preserving the student's thought process is as important as accuracy.
  • MCTS for Structured Exploration: Using MCTS provides a principled way to explore the vast space of possible reasoning paths, allowing the model to systematically identify and correct errors while considering the student's original approach.
  • Process-Level Rewards are Key: Simply rewarding the final answer is insufficient. The development of a reward model that assigns value to intermediate reasoning steps is critical for achieving fine-grained supervision and aligning with student thought processes.
  • Authentic Data Matters: The creation of the MSEB dataset highlights the limitations of relying on synthetic data. Real student data is essential for developing models that can generalize to actual educational scenarios.

Key Results

SMRC significantly outperforms existing methods on the ProcessBench, MR-GSM8K, and the newly introduced MSEB datasets.

  • Overall Performance: SMRC achieved the best results across multiple metrics, including Accuracy (ACC), Correct Step Retention Rate (CSRR), and Harmonic Mean (HM). For instance, on the MSEB dataset, SMRC achieved an ACC of 40.1%, CSRR of 73.7%, and HM of 51.8%, outperforming baselines.
  • Robustness and Versatility: The framework demonstrated strong performance across different datasets with varying focuses (complex reasoning, fundamental error correction, multiple solution paths), indicating its generalizability.
  • Fine-tuned Reward Models: The study showed that fine-tuning LLMs as reward models (specifically the 14B SMRC model) leads to significantly better performance compared to using off-the-shelf base models.
  • MCTS Effectiveness: Experiments comparing MCTS with BFS and DFS showed that while BFS/DFS excel at CSRR, MCTS provides a better balance, achieving higher accuracy and overall performance.

Limitations and Future Work

  • Reward Allocation Uniformity: The current reward model uses a uniform distribution for allocating rewards across reasoning steps. The authors suggest that future work could explore more nuanced value distribution models to better capture the varying contributions of individual steps.
  • Hyperparameter Sensitivity: While the framework is generally robust, there's some sensitivity to the MCTS exploration parameter 'c', particularly on the MSEB dataset. Further research could explore more adaptive or automated ways to set this parameter.
  • Generalization to Other Domains: While SMRC shows promise in mathematics, its applicability to other complex reasoning domains could be explored.

Summary updated

Abstract

Large language models (LLMs) often make reasoning errors when solving mathematical problems, and how to automatically detect and correct these errors has become an important research direction. However, existing approaches \textit{mainly focus on self-correction within the model}, which falls short of the ``teacher-style`` correction required in educational settings, \textit{i.e.}, systematically guiding and revising a student's problem-solving process. To address this gap, we propose \texttt{SMRC} (\textit{\underline{S}tudent \underline{M}athematical \underline{R}easoning \underline{C}orrection}), a novel method that aligns LLMs with student reasoning. Specifically, \texttt{SMRC} formulates student reasoning as a multi-step sequential decision problem and introduces Monte Carlo Tree Search (MCTS) to explore optimal correction paths. To reduce the cost of the annotating process-level rewards, we leverage breadth-first search (BFS) guided by LLMs and final-answer evaluation to generate reward signals, which are then distributed across intermediate reasoning steps via a back-propagation mechanism, enabling fine-grained process supervision. Additionally, we construct a benchmark for high school mathematics, MSEB (Multi-Solution Error Benchmark), consisting of 158 instances that include problem statements, student solutions, and correct reasoning steps. We further propose a dual evaluation protocol centered on \textbf{solution accuracy} and \textbf{correct-step retention}, offering a comprehensive measure of educational applicability. Experiments demonstrate that \texttt{SMRC} significantly outperforms existing methods on two public datasets (ProcessBench and MR-GSM8K) and our MSEB in terms of effectiveness and overall performance. The code and data are available at https://github.com/Mind-Lab-ECNU/SMRC.
BibTeX
@misc{zeng2025smrc,
  author = {Biaojie Zeng and Min Zhang and Juan Zhou and Fengrui Liu and Ruiyang Huang and Xin Lin},
  title = {{SMRC: Aligning Large Language Models with Student Reasoning for Mathematical Error Correction}},
  year = {2025},
  eprint = {2511.14684},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2511.14684},
}
Figure