Abstract
As deepfake technology advances, distinguishing between authentic and forged media becomes increasingly difficult. Existing detection methods often focus on either spatial or frequency artifacts, leading to poor generalization across diverse manipulation techniques. This paper introduces D²Fusion, a framework that leverages dual-domain information through a unique feature superposition strategy. By treating image features as wave-like tokens, the model utilizes constructive and destructive interference to amplify forgery signals. D²Fusion demonstrates superior performance across multiple benchmarks, including FaceForensics++ and Celeb-DF, particularly in cross-dataset and multi-source detection scenarios.
1. Introduction
The rapid evolution of AI-generated content has made deepfakes a significant threat to digital integrity. While early detection methods could rely on obvious visual glitches, modern forgeries are often indistinguishable to the human eye. The core challenge in the field is no longer just detecting a specific type of fake, but developing models that generalize across various manipulation methods and environmental conditions.
2. The Generalization Challenge
Current deepfake detection research is broadly categorized into methods focusing on visual artifacts, object detection, and deep learning-based feature extraction. As shown in the comparison of existing methods, many current approaches suffer from over-reliance on specific domain artifacts or limited generalization capabilities.
Most models fall into two traps: focusing exclusively on spatial artifacts (like blending boundaries) or frequency artifacts (like abnormal textures). D²Fusion addresses this by integrating both domains, moving beyond "coarse" feature processing to capture the subtle interactions between local organs and global textures.
3. Methodology: The D²Fusion Framework
The D²Fusion architecture employs a three-pronged strategy to refine feature extraction and fusion:
3.1 Bi-directional Attention Module (Spatial Domain)
To capture local positional information, this module utilizes horizontal and vertical average pooling. This allows the model to precisely localize forgery indicators, such as inconsistencies around the eyes or mouth, which are common in face-swapping and reenactment.
3.2 Fine-grained Spectral Attention Module (Frequency Domain)
Global clues like unnatural skin textures are often better captured in the frequency domain. D²Fusion uses a Discrete Cosine Transform (DCT) to partition features into multi-spectral components. This preserves high-frequency information that standard convolutional layers often discard, which is crucial for identifying high-quality forgeries.
3.3 Feature Superposition Strategy
The "secret sauce" of D²Fusion is its feature superposition strategy. Inspired by signal processing, the authors treat features as wave-like tokens. Using Euler’s formula, each token is assigned an amplitude (representing the feature value) and a phase (representing positional or semantic information).
- Constructive Interference: Tokens with similar attributes (e.g., authentic features) have similar phases, amplifying their signal.
- Destructive Interference: Tokens with differing attributes (e.g., authentic vs. artifact) undergo destructive interference, sharpening the boundary between real and fake content for the classifier.
4. Experimental Results
D²Fusion was evaluated on five major benchmarks: FaceForensics++ (FF++), Celeb-DF (v1 and v2), Deepfake Detection Challenge (DFDC), and DeeperForensics-1.0 (DFR). The model consistently outperformed state-of-the-art (SOTA) methods:
- Intra-dataset Performance: On FF++, D²Fusion improved accuracy by nearly 2.5% over the baseline.
- Cross-manipulation Robustness: When tested on unseen forgery types, the model achieved up to a 6.15% improvement in AUC.
- Multi-source Detection: In complex scenarios with multiple forgery types, it surpassed SOTA methods by 14.62% in Precision and 10.26% in F1-score.
- Cross-dataset Generalization: Training on FF++ and testing on DFR resulted in a 6.25% AUC improvement over the baseline, demonstrating its superior ability to handle real-world variations.
5. Conclusion and Future Work
D²Fusion represents a significant step forward in robust deepfake detection by effectively fusing spatial and frequency information through wave-like feature superposition. While the model shows exceptional performance on high-quality data, video compression remains a challenge, as it tends to "smear" high-frequency forgery clues. Future research will focus on more robust frequency transforms, such as wavelets, to maintain detection efficacy in highly compressed social media environments.
Summary updated