Through the Lens: Benchmarking Deepfake Detectors Against Moiré-Induced Distortions

Razaib Tariq, Minji Heo, Simon S. Woo, Shahroz Tariq

TL;DR

This paper exposes a critical real-world vulnerability in state-of-the-art deepfake detectors: their inability to handle Moiré patterns introduced when filming digital screens with smartphones. By introducing the DeepMoiréFake (DMF) dataset, the authors demonstrate that these common distortions degrade detector performance by up to 25.4%, and surprisingly, standard "demoiréing" cleanup methods actually make detection significantly worse.

What Problem Does This Paper Address?

Most deepfake detection algorithms are developed and evaluated in pristine, controlled laboratory environments using clean digital video files. In the real world, however, malicious actors or casual users often share media by recording a digital screen (such as a TV or computer monitor) using a smartphone camera—frequently to bypass Digital Rights Management (DRM) or simply for quick sharing.

This screen-recapture process introduces Moiré patterns—wavy, colorful, and distorted visual artifacts caused by spatial interference between the display's pixel grid and the camera's image sensor. While often subtle to the human eye, these patterns severely disrupt the pixel-level and frequency-domain cues that deepfake detectors rely on. This paper systematically benchmarks how both authentic and synthetic Moiré distortions impair current state-of-the-art (SOTA) deepfake detection systems.

Figure 1: Original vs. Moiré pattern

Methods

The authors evaluate deepfake detection performance across three distinct real-world distortion scenarios:

  1. Captured Moiré Pattern Attack (CMPA): The authors physically recorded deepfake videos displayed on various monitors using smartphones, systematically altering camera angles, lighting, and hardware configurations.
  2. Synthetic Moiré Pattern Attacks (SMPA): To simulate these effects algorithmically without physical re-recording, they employed two synthetic generation frameworks: SMPA-MA (which applies scaling, resampling, and random rotations) and SMPA-SPS (which modulates skew, contrast, and introduces non-linear sine waves).
  3. Compression Attacks (CA): They combined Moiré distortions with standard H.264 video compression (at C23 and C40 levels) to mimic the quality degradation typical of social media uploads.

Additionally, the authors tested two defense strategies: applying state-of-the-art demoiréing, denoising, and deblurring algorithms as a preprocessing step, and fine-tuning/retraining detectors directly on Moiré-affected data.

Figure 3: Synthetic Moiré Generation

Datasets

The authors introduced the DeepMoiréFake (DMF) dataset, the first public deepfake dataset specifically designed to evaluate Moiré-induced distortions.

To construct it, they subsampled 802 core videos from five prominent benchmark datasets: FaceForensics++ (FF++), DeepFake Detection (DFD), Deepfake Detection Challenge (DFDC), Celeb-DF, and UADFV. They then manually re-recorded these videos to generate 12,832 total videos (spanning 35.64 hours of footage) under a wide variety of environmental and hardware conditions:

  • 4 Monitors: LG (LED), BenQ (LED), Samsung (QHD-IPS), and Lenovo (UHD-IPS).
  • 2 Smartphones: iPhone 13 and Samsung S22 Plus.
  • 2 Lighting Conditions: Ambient lights completely on vs. off.
  • 4 Camera Angles: Center, 45° left, 45° right, and a dynamically moving handheld view.
Figure 2: Our manual Moiré pattern collection pipeline.

Key Insights and Ideas

  • The Demoiréing Paradox: Intuitively, one would expect that running a demoiréing algorithm to clean up the wavy lines would help deepfake detectors. Instead, it worsened the problem, dropping accuracy by an additional 17.2% in severe cases. This happens because demoiréing models act as smoothing filters; while they successfully erase the Moiré lines, they simultaneously destroy the subtle, high-frequency deepfake artifacts that detectors need to see.
  • Hardware Properties Dictate Vulnerability: Displays with lower pixel densities and traditional RGB stripe subpixel layouts (like the tested LG and BenQ LED monitors) amplify aliasing effects, causing much harsher performance drops for detectors than high-resolution screens.
  • Robustness vs. Practicality Trade-off: Some older or simpler detectors (like Capsule and LRNet) showed minor performance drops under Moiré attacks (only 2-3%), but their baseline accuracy was already too low (mid-60s AUC) to be practically useful in the real world.
  • Retraining Trumps Preprocessing: While image restoration techniques (demoiréing, denoising) fail, explicitly fine-tuning or retraining detection models on Moiré-affected data successfully closes the performance gap, allowing models to learn to look "through" the distortion.

Key Results

  • Performance Degradation: Across 15 top deepfake detectors, authentic Moiré artifacts caused an average performance decline of 10.7%, with the worst-case drops reaching 25.4%. Algorithmic, synthetic Moiré patterns caused a 21.4% drop in accuracy.
  • Top Performer: CCViT emerged as the most robust model overall, maintaining the highest average AUC (84.5%) across all screen environments, despite dropping from its clean baseline of 95.0%.
  • Fine-Tuning Success: When models like MAT were retrained or fine-tuned on the DMF dataset combined with compression attacks, their accuracy surged back up to 99.2%, proving that the vulnerability can be mitigated with targeted training data.
Figure 4: Different Capturing Devices: AUC performance of detectors dropped by 9.5 and 12.0 percentage points on average for videos with Moiré patterns captured by iPhone 13 and Samsung S22 Plus, with a maximum drop of 25.4 percentage points in the worst case.

Limitations and Future Work

  • Display Technology Gaps: The DMF dataset primarily features standard LCD, LED, and IPS monitors. Modern high-end consumer devices increasingly use OLED displays and 8K resolutions, where Moiré patterns behave differently due to tighter pixel pitches and alternative subpixel layouts. The authors note these should be included in future iterations.
  • In-the-Wild Social Media Artifacts: While the authors simulated compression, real-world platforms like TikTok or Instagram apply complex, dynamic combinations of motion blur, beautification filters, and aggressive variable-bitrate encoding that warrant deeper study.
  • Invariance by Design: The study highlights a critical need to develop new deepfake detection architectures that are inherently invariant to screen-recapture distortions, rather than relying on destructive preprocessing steps.

Summary updated

Abstract

Deepfake detection remains a pressing challenge, particularly in real-world settings where smartphone-captured media from digital screens often introduces Moiré artifacts that can distort detection outcomes. This study systematically evaluates state-of-the-art (SOTA) deepfake detectors on Moiré-affected videos, an issue that has received little attention. We collected a dataset of 12,832 videos, spanning 35.64 hours, from the Celeb-DF, DFD, DFDC, UADFV, and FF++ datasets, capturing footage under diverse real-world conditions, including varying screens, smartphones, lighting setups, and camera angles. To further examine the influence of Moiré patterns on deepfake detection, we conducted additional experiments using our DeepMoiréFake, referred to as (DMF) dataset and two synthetic Moiré generation techniques. Across 15 top-performing detectors, our results show that Moiré artifacts degrade performance by as much as 25.4%, while synthetically generated Moiré patterns lead to a 21.4% drop in accuracy. Surprisingly, demoiréing methods, intended as a mitigation approach, instead worsened the problem, reducing accuracy by up to 17.2%. These findings underscore the urgent need for detection models that can robustly handle Moiré distortions alongside other realworld challenges, such as compression, sharpening, and blurring. By introducing the DMF dataset, we aim to drive future research toward closing the gap between controlled experiments and practical deepfake detection.
BibTeX
@inproceedings{tariq2025through,
  author = {Razaib Tariq and Minji Heo and Simon S. Woo and Shahroz Tariq},
  title = {{Through the Lens: Benchmarking Deepfake Detectors Against Moiré-Induced Distortions}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2025},
  url = {https://openreview.net/forum?id=HtGOaraQEH},
}
Figure