PRNU-based Image Forgery Localization with Deep Multi-scale Fusion

  • Yushu Zhang
  • , Qing Tan
  • , Shuren Qi*
  • , Mingfu Xue
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

17 Scopus citations

Abstract

Photo-response non-uniformity (PRNU), as a class of device fingerprint, plays a key role in the forgery detection/localization for visual media. The state-of-The-Art PRNU-based forensics methods generally rely on the multi-scale trace analysis and result fusion, with Markov random field model. However, such hand-crafted strategies are difficult to provide satisfactory multi-scale decision, exhibiting a high false-positive rate. Motivated by this, we propose an end-To-end multi-scale decision fusion strategy, where a mapping from multi-scale forgery probabilities to binary decision is achieved by a supervised deep fully connected neural network. As the first time, the deep learning technology is employed in PRNU-based forensics for more flexible and reliable integration of multi-scale information. The benchmark experiments exhibit the state-of-The-Art accuracy performance of our method in both pixel-level and image-level, especially for false positives. Additional robustness experiments also demonstrate the benefits of the proposed method in resisting noise and compression attacks.

Original languageEnglish
Article number67
JournalACM Transactions on Multimedia Computing, Communications and Applications
Volume19
Issue number2
DOIs
StatePublished - 6 Feb 2023
Externally publishedYes

Keywords

  • Image forgery localization
  • deep learning
  • multi-scale analysis
  • photo-response non-uniformity

Fingerprint

Dive into the research topics of 'PRNU-based Image Forgery Localization with Deep Multi-scale Fusion'. Together they form a unique fingerprint.

Cite this