"My Grade is Wrong!": A Contestable AI Framework for Interactive Feedback in Evaluating Student Essays

Shengxin Hong, Chang Cai, Sixuan Du, Haiyue Feng, Siyuan Liu, Xiuyi Fan

TL;DR

Researchers have developed CAELF, a framework that uses multi-agent "debates" and formal logic to provide interactive essay feedback. Unlike standard LLMs that often "fold" when a student challenges a grade, CAELF uses computational argumentation to maintain evaluative consistency while allowing students to meaningfully contest their results.

What Problem Does This Paper Address?

In education, "interactive feedback"—where students can query and challenge their evaluations—is far more effective than a one-way grade. However, it is incredibly time-consuming for human instructors. While Large Language Models (LLMs) seem like a natural fit for automating this, they suffer from two major flaws in a pedagogical setting:

  1. Reasoning Gaps: They often struggle with the subtle nuances required for high-level critical thinking assessment.
  2. Over-reliance on User Input: LLMs are notorious "people-pleasers." If a student aggressively argues "My grade is wrong!", a standard LLM will often hallucinate a justification to agree with the student, even if the original grade was correct. This undermines the integrity of the assessment.

Methods

The authors introduce the Contestable AI Empowered LLM Framework (CAELF), which moves away from single-prompt grading in favor of a structured, three-stage pipeline:

  1. LLM Discussion (Multi-Agent): Multiple "Teaching Assistant" (TA) agents (powered by GPT-4o-mini) discuss the essay. To ensure a breadth of perspective, agents are assigned different "personality biases"—one leaning toward positive reinforcement and another toward critical rigor.
  2. Formal Reasoning (The Teacher Agent): Instead of just averaging the TAs' opinions, a "Teacher Agent" maps their arguments into an Abstract Argumentation Framework (AF). This is a symbolic logic structure where arguments are nodes and "attacks" (rebuttals) are edges. The system uses "completeness semantics" to identify the most logically consistent set of arguments to form the final grade and feedback.
  3. Interactive Feedback Loop: When a student challenges the feedback, their argument is treated as a new node in the argumentation framework. The TA agents hold a new round of discussion to see if the student’s point "defeats" the previous logic or if the original grade should stand.

Datasets

The study utilized a dataset of 500 critical thinking essays sourced from Hugging Face. These essays were evaluated based on a four-dimensional rubric:

  • Issue: Identification and clarity of the problem.
  • Evidence: Quality and interpretation of sources.
  • Position: Nuance and complexity of the thesis.
  • Conclusion: Logical flow and synthesis of ideas.

The ground truth was established by four human coders who independently labeled 2,000 data points (500 essays × 4 dimensions).

Key Insights and Ideas

  • The "Maintain Truth" Metric: The authors highlight a critical failure in current AI: standard LLMs lose accuracy rapidly when challenged. CAELF introduces "Maintain Truth" as a key performance indicator—measuring how often a model stays correct when a user tries to mislead it.
  • Symbolic Logic as a Guardrail: By wrapping the LLM's creative output in a formal argumentation framework, the researchers created a "logical filter." This prevents the model from making arbitrary concessions to students.
  • Diversity of Thought via Bias: Intentionally prompting agents to be "harsh" or "lenient" actually improved the final accuracy, as it forced the Teacher Agent to resolve genuine conflicts in the rubric application.

Key Results

CAELF significantly outperformed baseline models (GPT-4o, GPT-4o-mini, and Llama-3.1-8B) in interactive scenarios:

  • Robustness: While standard GPT-4o's accuracy dropped by roughly 30% after one round of student interaction (due to "folding"), CAELF’s accuracy remained stable or even improved.
  • Interaction Accuracy: In the "Evidence" dimension, CAELF’s accuracy after interaction was 44.6% higher than GPT-4o-mini.
  • Consistency: CAELF achieved a "Maintain Truth" rate of 80%–90% across all dimensions, whereas baselines often fell below 40%, frequently retracting correct grades in the face of invalid student complaints.
  • Human Preference: In a blind study, human evaluators rated CAELF’s feedback significantly higher for Factuality, Self-Regulation (helping students reflect), and Future Improvement.

Limitations and Future Work

The authors acknowledge that CAELF is still susceptible to the "garbage in, garbage out" problem; if the underlying LLM has a fundamental factual hallucination that all agents agree on, the formal logic will simply reinforce that error.

Additionally, the system is currently vulnerable to jailbreaking. A student could potentially embed "ignore previous instructions" prompts within their essay to force the TA agents into awarding an A. Future work aims to integrate Retrieval-Augmented Generation (RAG) to ground the agents in external facts and develop defenses against adversarial prompt injections.

Summary updated

Abstract

Interactive feedback, where feedback flows in both directions between teacher and student, is more effective than traditional one-way feedback. However, it is often too time-consuming for widespread use in educational practice. While Large Language Models (LLMs) have potential for automating feedback, they struggle with reasoning and interaction in an interactive setting. This paper introduces CAELF, a Contestable AI Empowered LLM Framework for automating interactive feedback. CAELF allows students to query, challenge, and clarify their feedback by integrating a multi-agent system with computational argumentation. Essays are first assessed by multiple Teaching-Assistant Agents (TA Agents), and then a Teacher Agent aggregates the evaluations through formal reasoning to generate feedback and grades. Students can further engage with the feedback to refine their understanding. A case study on 500 critical thinking essays with user studies demonstrates that CAELF significantly improves interactive feedback, enhancing the reasoning and interaction capabilities of LLMs. This approach offers a promising solution to overcoming the time and resource barriers that have limited the adoption of interactive feedback in educational settings.
BibTeX
@inproceedings{hong2025my,
  author = {Shengxin Hong and Chang Cai and Sixuan Du and Haiyue Feng and Siyuan Liu and Xiuyi Fan},
  title = {{"My Grade is Wrong!": A Contestable AI Framework for Interactive Feedback in Evaluating Student Essays}},
  booktitle = {Aied},
  year = {2025},
  doi = {10.1007/978-3-031-98462-4\_4},
}

Loading related content...

Figure