The Deception Archive as a repository of standardized datasets for large-scale verbal deception detection research

Caterina Borgese, Riccardo Loconte, Lucca Pfründer, Bennett KleinbergarXiv 2026 · arXiv

TL;DR

The Deception Archive is a new, open-source repository that standardizes 41 disparate verbal deception datasets into a single, machine-learning-ready resource. By harmonizing nearly 388,000 truthful and deceptive statements, this project addresses the fragmentation that has long hindered reproducible research and large-scale model validation in automated lie detection.

What Problem Does This Paper Address?

Detecting lies through language is a high-stakes challenge, relevant to everything from forensic investigations to preventing financial fraud. While computational advances in NLP and machine learning have made automated detection possible, the field suffers from a "data fragmentation" problem.

Existing datasets are scattered across psychology, linguistics, and computer science journals. They often use different file formats, inconsistent labeling schemes, and varying levels of documentation. This makes it incredibly difficult for researchers to perform cross-dataset validation—a crucial step to ensure a model that detects lies in "fake hotel reviews" can also work on "forensic interviews." The authors created the Deception Archive to provide a centralized, standardized "living resource" to solve these accessibility and reproducibility hurdles.

Methods

The researchers followed a rigorous four-phase workflow to build the archive, moving from a massive pool of potential studies to a curated set of usable data.

  1. Selection: They started with a systematic review of 29,023 publications, narrowing them down to 246 eligible records that used computational methods for deception detection.
  2. Retrieval: They identified 134 unique datasets. 46 were found in public repositories (like GitHub or OSF), and the team contacted 82 authors to request private data, successfully retrieving three more.
  3. Curation & Standardization: This was the heavy lifting. Each dataset was manually inspected and mapped to a common data structure. They standardized veracity labels into a simple binary (0 = truthful, 1 = deceptive) while preserving the original labels for nuance.
  4. Repository Construction: The final data was integrated into an interactive dashboard and hosted on Zenodo and OSF for public access.
Figure 1. Overview of the Deception Archive development workflow

Datasets

The archive currently consists of 41 standardized datasets containing a total of 387,995 statements.

To make the data useful for downstream tasks, the authors extracted specific metadata for every entry. As shown in the table below, this includes "Core variables" (the text and labels) and "Dataset-level variables" (the context of the study).

Table 1. Metadata fields included in the Deception Archive

Notably, the authors excluded two extremely large datasets (Amazon and Yelp reviews) because their scale was incompatible with the manual curation workflow, though they remain important benchmarks in the wider field.

Key Insights and Ideas

  • The Ground-Truth Spectrum: One of the most important contributions is the classification of "ground truth." Not all "lies" in research are created equal. The archive distinguishes between statements that are verifiable (e.g., a proven false alibi), experimentally assigned (e.g., a participant told to lie), or inferred (e.g., a review flagged by an algorithm).
  • Heterogeneity is a Feature: The archive reveals the massive diversity in deception research. It spans nine languages and includes everything from "Box of Lies" game transcripts to phishing emails and Italian court statements.
  • The "Participant ID" is Crucial: By including participant identifiers, the archive allows researchers to avoid "data leakage." In within-subject studies, a model might accidentally "learn" a specific person's writing style rather than the cues of deception if that person's truthful and deceptive statements are split across training and testing sets.

Key Results

  • Scale: 387,995 total statements across 41 datasets.
  • Diversity: While 70.7% of the datasets are in English, the archive includes Dutch, Italian, German, Chinese, Polish, Urdu, and Arabic.
  • Format: The majority of the data (75.6%) is typed text, with the remainder being transcriptions of spoken word.
  • Deception Type: "Fabrication" (making things up entirely) is the most common type of deception represented (73.2% of datasets).

Limitations and Future Work

The authors acknowledge that the archive is a "living resource" rather than a finished product.

  • English Bias: Despite efforts to include multiple languages, English-language material accounts for 95.5% of all individual statements in the archive.
  • Retrieval Challenges: Many datasets described in the literature were simply gone—authors didn't respond, or the data was lost to time. This highlights the urgent need for the very repository the authors have built.
  • Scope: The current version focuses on datasets from the automated detection literature. Future versions could expand to include datasets from traditional psychology that rely on manual coding of verbal cues.

Researchers are encouraged to contribute their own datasets to the archive via the project's website to help the repository grow.

Summary updated

Abstract

Computational advances in natural language processing and machine learning have substantially expanded the use of automated approaches in verbal deception research. However, existing verbal deception datasets remain fragmented across disciplines, as they are often difficult to identify, access, and reuse, limiting cross-study comparisons and the development of robust computational models. We present the Deception Archive, a curated and standardized repository of publicly available verbal deception datasets built upon a large-scale systematic review. Eligible datasets were retrieved, manually inspected, and standardized following a structured data curation workflow. The current repository comprises 41 publicly available datasets containing 387,995 truthful or deceptive statements. The archive represents a heterogeneous repository (e.g., in data size, topic of investigation, ground-truth, etc.) and a living resource for integrating newly available deception datasets over time. By providing centralized access to standardized datasets and accompanying metadata, the Deception Archive facilitates dataset discovery, cross-dataset validation, and reproducible evaluation of computational models.
BibTeX
@misc{borgese2026deception,
  author = {Caterina Borgese and Riccardo Loconte and Lucca Pfründer and Bennett Kleinberg},
  title = {{The Deception Archive as a repository of standardized datasets for large-scale verbal deception detection research}},
  year = {2026},
  eprint = {2611.12196},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.12196},
}
Figure