The Sensitivity of Word Embeddings-based Author Detection Models to Semantic-preserving Adversarial Perturbations

Jeremiah Duncan, Fabian Fallas, Chris Gropp, Emily Herron, Maria Mahbub, Paula Olaya, Eduardo Ponce, Tabitha K. Samuel, Daniel Schultz, Sudarshan Srinivasan, Maofeng Tang, Viktor Zenkov, Quan Zhou, Edmon Begoli

Abstract

Authorship analysis is an important subject in the field of natural language processing. It allows the detection of the most likely writer of articles, news, books, or messages. This technique has multiple uses in tasks related to authorship attribution, detection of plagiarism, style analysis, sources of misinformation, etc. The focus of this paper is to explore the limitations and sensitiveness of established approaches to adversarial manipulations of inputs. To this end, and using those established techniques, we first developed an experimental frame-work for author detection and input perturbations. Next, we experimentally evaluated the performance of the authorship detection model to a collection of semantic-preserving adversarial perturbations of input narratives. Finally, we compare and analyze the effects of different perturbation strategies, input and model configurations, and the effects of these on the author detection model.
BibTeX
@misc{duncan2021sensitivity,
  author = {Jeremiah Duncan and Fabian Fallas and Chris Gropp and Emily Herron and Maria Mahbub and Paula Olaya and Eduardo Ponce and Tabitha K. Samuel and Daniel Schultz and Sudarshan Srinivasan and Maofeng Tang and Viktor Zenkov and Quan Zhou and Edmon Begoli},
  title = {{The Sensitivity of Word Embeddings-based Author Detection Models to Semantic-preserving Adversarial Perturbations}},
  year = {2021},
  eprint = {2102.11917},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2102.11917},
}

Loading related content...

Figure