Abstract
Reliable detection of AI-generated text remains a challenge due to the stylistic diversity of human writing across different domains. Traditional detectors typically apply a static threshold to a discrimination score, leading to significant errors when encountering out-of-distribution styles. We propose MoSEs (Mixture of Stylistics Experts), a novel framework that replaces static thresholds with dynamic, conditional ones. By leveraging a Stylistics-Aware Router and a Conditional Threshold Estimator, MoSEs adapts to the linguistic nuances of the input text. Our evaluation across eight diverse datasets demonstrates an average performance boost of 11.34%, with improvements reaching 39.15% in data-scarce environments.
Introduction
The rapid proliferation of Large Language Models (LLMs) has necessitated robust detection mechanisms. Most existing solutions produce a "discrimination score" and apply a fixed threshold (e.g., 0.5) to classify text as human or machine-written. However, human writing styles—or habitus—vary significantly by domain; the concise style of a news report differs fundamentally from the technical depth of a medical paper.
As illustrated in Figure 2, the distribution of discrimination scores for human versus machine text shifts markedly across datasets like CNN and PubMedQA. This shift confirms that a "one-size-fits-all" threshold is inherently insufficient for accurate cross-domain detection.
Methodology: The MoSEs Framework
The MoSEs framework addresses the limitations of static thresholds through three core components:
- Stylistics Reference Repository (SRR): A comprehensive library containing human and AI-generated texts annotated with linguistic features (e.g., n-gram repetition, type-token ratios) and semantic embeddings.
- Stylistics-Aware Router (SAR): Upon receiving a new text, the SAR employs prototype-based clustering to identify stylistically similar samples within the SRR, thereby "activating" the most relevant stylistic experts.
- Conditional Threshold Estimator (CTE): The CTE models the input's linguistic and semantic features to calculate a custom, optimal threshold. Two variants were tested: MoSEs-lr (Logistic Regression) and MoSEs-xg (XGBoost).
The complete system architecture is depicted in Figure 1.
Experimental Results
MoSEs was evaluated on eight datasets, including high-resource (e.g., XSum, SciXGen) and low-resource (e.g., DialogSum, PubMedQA) scenarios.
Performance Gains
MoSEs-xg consistently outperformed baseline methods across all tested score models (RoBERTa, Fast-DetectGPT, and Lastde). On average, the framework improved detection performance by 11.34%.
Robustness in Low-Resource Settings
A key strength of MoSEs is its efficiency in "cold start" scenarios. With only 200 reference samples, MoSEs-xg outperformed standard methods by nearly 40%, indicating a superior ability to learn stylistic boundaries from minimal data.
Stylistic Insights
The inclusion of conditional features, such as text length and log-probability variance, effectively reduces the overlap between human and machine score distributions. These linguistic cues allow the model to identify machine-generated text more reliably by conditioning the decision on the specific style of the input.
Conclusion
MoSEs represents a significant step toward uncertainty-aware AI detection. By moving from static to conditional thresholds, the framework achieves state-of-the-art performance and demonstrates remarkable robustness across domains and model types. Future work will explore extending the framework to multi-class classification to identify specific source LLMs and optimizing inference latency for real-time applications.
Summary updated