Attention-based fusion network for image forgery localization

Wenhui Gong; Yan Chen; Mohammad S. Alam; Jun Sang

doi:10.1117/12.3021676

7 June 2024 Attention-based fusion network for image forgery localization

Wenhui Gong, Yan Chen, Mohammad S. Alam, Jun Sang

Proceedings Volume 13040, Pattern Recognition and Prediction XXXV; 130400I (2024) https://doi.org/10.1117/12.3021676
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Conference Poster

Abstract

With the trustworthiness of multimedia data has been challenged by editing tools, image forgery localization aims to identify regions in images that have been modified. Although the existing techniques provide reasonably good results for image forgery localization, with emerging new editing techniques, such models must be retrained and it is highly dependent on the real tampering localization maps. In this paper, we propose an attention-based fusion network that combines the RGB image and noise residual yielding excellent results. Noise residual is commonly regarded as camera model fingerprint, and forgery localization can be detected as deviations from the expected regular pattern. The model consists of three parts: feature extraction, attentional feature fusion, and feature output. The feature extraction module is used to extract RGB image features and noise residuals separately, and the attentional feature fusion module is used to suppress the high frequency components, supplement and enhance model-related artifacts by combining the aforementioned features. Finally, the last module generates images with one channel as the camera model fingerprint. In order to avoid dependence on tampering localization maps, the model is trained with pairs of image patches coming from the same or different camera sensors by means of Siamese network. Experiment results obtained from several datasets show that the proposed technique successfully identifies modified regions, improves the quality of camera model fingerprints, and achieves significantly better performance when compared to the existing techniques.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Wenhui Gong, Yan Chen, Mohammad S. Alam, and Jun Sang "Attention-based fusion network for image forgery localization", Proc. SPIE 13040, Pattern Recognition and Prediction XXXV, 130400I (7 June 2024); https://doi.org/10.1117/12.3021676

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available