Trigger Where It Hurts: Unveiling Hidden Backdoors through Sensitivity with Sensitron

Gejian Zhao, Hanzhou Wu, Xinpeng ZhangarXiv 2025 · DOI · arXiv

Abstract

Backdoor attacks in Natural Language Processing (NLP) typically rely on heuristics for trigger placement, often leading to a trade-off between stealth and effectiveness. This paper introduces Sensitron, a novel framework that weaponizes explainable AI (XAI) to systematically identify and exploit model vulnerabilities. By employing Dynamic Meta-Sensitivity Analysis (DMSA) and Hierarchical SHAP (H-SHAP), Sensitron pinpoints tokens where perturbations most significantly impact model behavior. Our results demonstrate that Sensitron achieves state-of-the-art attack success rates (97.8%) with extremely low poisoning rates (0.1%) while evading modern defenses.

Introduction

Backdoor attacks involve maliciously altering training data so that a model behaves normally on clean inputs but fails when a specific "trigger" is present. Existing methods face significant hurdles: a lack of explainability in trigger placement, a rigid trade-off between stealth and controllability, and task-specific limitations. Sensitron addresses these by asking whether model explainability tools—traditionally used for defense and debugging—can be inverted to find a model's "weak spots" and plant triggers exactly where they will be most effective.

Methodology

Sensitron utilizes a modular three-step pipeline to weaponize model sensitivity, acting as a heat-seeking missile for vulnerabilities:

  1. Dynamic Meta-Sensitivity Analysis (DMSA): Instead of static heuristics, DMSA uses a lightweight meta-model to predict which tokens are most "sensitive" based on perplexity changes and semantic drift during masking.
  2. Hierarchical SHAP Estimation (H-SHAP): To overcome the $O(n^2)$ computational complexity of standard SHAP, H-SHAP uses DMSA's output to segment text. It applies precise Integrated Gradients only to high-sensitivity regions and cheaper Attention Rollout to low-sensitivity ones, reducing compute costs to $O(k \log n)$.
  3. Plug-and-Rank Trigger Generation: Once vulnerable positions are identified, Sensitron uses a masked language model to generate candidate triggers that fit the context naturally. These are ranked using a "soft reward" that balances attack success with linguistic stealth.
The Sensitron pipeline: DMSA identifies sensitive regions, H-SHAP refines attribution, and Plug-and-Rank generates context-aware triggers.

Key Results and Insights

Sensitron was evaluated across diverse NLP tasks, including sentiment analysis (SST-2), topic categorization (AG News), and summarization (CNN/Daily Mail).

Attack Effectiveness and Stealth

Sensitron achieved a 97.8% Attack Success Rate (ASR), outperforming previous state-of-the-art methods by 5.8%. It demonstrated extreme data efficiency, reaching an 85.4% ASR with only a 0.1% poisoning rate—a tenfold improvement over baseline requirements. Furthermore, triggers maintained high stealthiness (AS score of 0.83), successfully evading defenses like ONION and Neural Cleanse 75% to 82% of the time.

Weaponized Explainability

The framework established a strong mathematical link—a Sensitivity Ranking Correlation (SRC) of 0.83—between explainability scores and actual attack success. This proves that XAI tools can be dual-use: helping defenders understand models while giving attackers a roadmap for exploitation.

Selective refinement of token sensitivity scores and comparison of H-SHAP against other attribution methods. H-SHAP achieves a superior Sensitivity Ranking Correlation (SRC).

Computational Efficiency

By using a coarse-to-fine approach, H-SHAP required only 30% of the time and 45% of the memory compared to Vanilla SHAP, making real-time, context-aware attacks feasible for long sequences.

Conclusion

Sensitron demonstrates that targeting specific syntactic roles—particularly adjectives, adverbs, and connectives—yields far more reliable backdoors than targeting nouns. While highly effective, the authors suggest that defenders can adopt this methodology for self-supervised vulnerability assessments, effectively "red-teaming" their own models to build more robust AI systems. Future work will explore extending this framework to multimodal architectures.

Summary updated

Abstract

Backdoor attacks pose a significant security threat to natural language processing (NLP) systems, but existing methods lack explainable trigger mechanisms and fail to quantitatively model vulnerability patterns. This work pioneers the quantitative connection between explainable artificial intelligence (XAI) and backdoor attacks, introducing Sensitron, a novel modular framework for crafting stealthy and robust backdoor triggers. Sensitron employs a progressive refinement approach where Dynamic Meta-Sensitivity Analysis (DMSA) first identifies potentially vulnerable input tokens, Hierarchical SHAP Estimation (H-SHAP) then provides explainable attribution to precisely pinpoint the most influential tokens, and finally a Plug-and-Rank mechanism that generates contextually appropriate triggers. We establish the first mathematical correlation (Sensitivity Ranking Correlation, SRC=0.83) between explainability scores and empirical attack success, enabling precise targeting of model vulnerabilities. Sensitron achieves 97.8% Attack Success Rate (ASR) (+5.8% over state-of-the-art (SOTA)) with 85.4% ASR at 0.1% poisoning rate, demonstrating robust resistance against multiple SOTA defenses. This work reveals fundamental NLP vulnerabilities and provides new attack vectors through weaponized explainability.
BibTeX
@misc{zhao2025trigger,
  author = {Gejian Zhao and Hanzhou Wu and Xinpeng Zhang},
  title = {{Trigger Where It Hurts: Unveiling Hidden Backdoors through Sensitivity with Sensitron}},
  year = {2025},
  eprint = {2509.19101},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2509.19101},
}
Figure