DNA-DetectLLM: Unveiling AI-Generated Text via a DNA-Inspired Mutation-Repair Paradigm

Xiaowei Zhu, Yubing Ren, Fang Fang, Qingfeng Tan, Shi Wang, Yanan Cao

TL;DR: DNA-DetectLLM introduces a biological twist to AI text detection by treating the problem as a "mutation-repair" process. By measuring the computational effort required to "repair" a text into its most probable AI-generated form, this zero-shot method achieves state-of-the-art accuracy and remains remarkably robust against paraphrasing and editing attacks.

The Blurring Line Between Human and AI Text

As Large Language Models (LLMs) evolve, the gap between human-written and AI-generated text is shrinking rapidly. Traditional detection methods are struggling because the statistical distributions of these two types of text now overlap significantly.

Comparison of traditional detection paradigms versus the proposed Mutation-Repair Paradigm.

Existing approaches generally fall into two camps: training-based (which require massive labeled datasets and often fail to generalize to new models) and training-free/zero-shot (which use statistical quirks like "log-probability curvature"). However, even zero-shot methods can be easily fooled by minor edits or paraphrasing. The authors identify a "blurred boundary" problem where current tools cannot reliably distinguish a highly creative human from a slightly randomized AI.

The Mutation-Repair Methodology

To address these challenges, the authors propose the Mutation-Repair Paradigm, inspired by how cells repair damaged DNA. Instead of relying on a black-box probability score, the detection signal is grounded in a physical analogy: how far has this text strayed from the "path of least resistance" (the greedy AI path)?

The complete pipeline of the DNA-DetectLLM framework.

The framework operates in four main conceptual steps:

  1. The Template Strand (Ideal AI Sequence): For any input text, the system uses a reference LLM to construct an "ideal" AI version. This is done by greedily selecting the most probable token at every single position.
  2. The Mutated Strand: The actual input text is treated as a "mutated" version of that ideal AI sequence. Human writing naturally "mutates" away from the most probable AI path.
  3. The Repair Process: The algorithm iteratively replaces "non-optimal" tokens in the input with the "ideal" tokens from the template.
  4. The Repair Score: The core detection signal is the cumulative "effort" or difficulty of this repair. Human text, being fundamentally different in structure and word choice from greedy AI generation, requires significantly more effort to fix.

The Optimization: Initially, calculating this score required expensive, iterative re-processing of the text. However, the authors mathematically derived a simplified version: the repair score is essentially the average of the text's initial score and its "fully repaired" score. This allows for a massive speedup without sacrificing accuracy.

Evaluation and Key Results

The researchers evaluated DNA-DetectLLM across a wide array of scenarios, including custom diverse tasks (news, stories, academic writing), advanced generators (GPT-4 Turbo, Gemini-2.0 Flash, Claude-3.7 Sonnet), and public benchmarks (M4, DetectRL, RealDet). Falcon-7B-Instruct was used as the standard reference model to ensure fair comparisons.

  • State-of-the-Art Performance: DNA-DetectLLM achieved a relative improvement of 5.55% in AUROC and 2.08% in F1 score over existing SOTA methods like Binoculars and Fast-DetectGPT.
  • Cross-Domain Mastery: It maintained an average AUROC of 98.30% across news, stories, and academic papers.
  • Adversarial Resilience: Under heavy paraphrasing (using the DIPPER tool) or random token edits, the method maintained an AUROC of 97.23%, while other methods saw significant performance drops. This is because the "ideal" template strand is relatively stable; small token-level edits don't drastically change the overall repair score.
  • Short Text Detection: One of the biggest hurdles in AI detection is short snippets (under 50 tokens). DNA-DetectLLM excels here by extracting more discriminative features from limited input through direct comparison to a reconstructed ideal.
  • Efficiency: Thanks to the optimized formula, the system processes a sample in roughly 0.8 seconds, making it viable for real-world applications.

Limitations and Future Work

While highly effective, the method has limitations. Due to memory constraints, high-volume batch processing (necessary for massive-scale real-time monitoring) remains a challenge. Additionally, performance is linked to the quality of the reference model; if the reference model is significantly weaker or architecturally different from the generator, the "ideal" strand might not serve as a perfect benchmark.

Future work will explore more complex repair mechanisms beyond simple greedy token replacement to catch increasingly sophisticated, human-mimicking AI.

Summary updated

Abstract

The rapid advancement of large language models (LLMs) has blurred the line between AI-generated and human-written text. This progress brings societal risks such as misinformation, authorship ambiguity, and intellectual property concerns, highlighting the urgent need for reliable AI-generated text detection methods. However, recent advances in generative language modeling have resulted in significant overlap between the feature distributions of human-written and AI-generated text, blurring classification boundaries and making accurate detection increasingly challenging. To address the above challenges, we propose a DNA-inspired perspective, leveraging a repair-based process to directly and interpretably capture the intrinsic differences between human-written and AI-generated text. Building on this perspective, we introduce **DNA-DetectLLM**, a zero-shot detection method for distinguishing AI-generated and human-written text. The method constructs an ideal AI-generated sequence for each input, iteratively repairs non-optimal tokens, and quantifies the cumulative repair effort as an interpretable detection signal. Empirical evaluations demonstrate that our method achieves state-of-the-art detection performance and exhibits strong robustness against various adversarial attacks and input lengths. Specifically, DNA-DetectLLM achieves relative improvements of **5.55\%** in AUROC and **2.08\%** in F1 score across multiple public benchmark datasets. Code and data are available at https://github.com/Xiaoweizhu57/DNA-DetectLLM.
BibTeX
@inproceedings{zhu2025dna,
  author = {Xiaowei Zhu and Yubing Ren and Fang Fang and Qingfeng Tan and Shi Wang and Yanan Cao},
  title = {{DNA-DetectLLM: Unveiling AI-Generated Text via a DNA-Inspired Mutation-Repair Paradigm}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2025},
  url = {https://openreview.net/forum?id=yQoHUijSHx},
}
Figure