Forgery-aware and Edge-guided Diffusion Model for General and Robust Image Forgery Localization
Lists
Only you see this
Abstract
Image forgery localization, which aims to find suspicious tampered regions by splicing, copy-move, or removal manipulations, has attracted increasing attention. Although considerable progress has been made, most of the existing methods are still far from satisfactory in terms of generalization, e.g., cross-dataset evaluation, and show less robustness against lossy distortion, e.g., post-processing attacks or transmission over online social networks. To address these challenges, a general and robust image forgery localization framework using a diffusion probabilistic model is proposed in this paper. First, a <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D</b>iffusion-driven <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F</b>orgery-aware <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">L</b>ocalization network (<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DFL</b>) is presented. In specific, the task of image forgery localization is formulated as the one of mask reconstruction with the forgery-aware features as conditional prior, which introduces forgery-related knowledge into the diffusion process to gradually recover the ground-truth mask from the noisy one. An <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">E</b>dge-guided <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D</b>iffusion <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">R</b>estoration network (<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">EDR</b>) is then developed and integrated into the DFL network, leading to the <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">EDR-DFL</b> model, boosting the performance against various post-processing attacks. With EDR-DFL, the distorted forged images could be restored using the EDR model in an edge feature preserving way, which allows the DFL model to localize the tampered regions in the restored images effectively. Extensive experimental results demonstrate that the proposed method significantly outperforms other state-of-the-art methods for cross-dataset evaluation and exhibits superior robustness against various challenging post-processing attacks.
BibTeX
@article{xu2026forgery,
author = {Ping Xu and Jiangqun Ni and Jian Zhang},
title = {{Forgery-aware and Edge-guided Diffusion Model for General and Robust Image Forgery Localization}},
journal = {IEEE Transactions on Multimedia},
year = {2026},
doi = {10.1109/tmm.2026.3655475},
}Loading related content...