PS-Net: A Learning Strategy for Accurately Exposing the Professional Photoshop Inpainting

  • Yushu Zhang
  • , Zhibin Fu
  • , Shuren Qi*
  • , Mingfu Xue
  • , Xiaochun Cao
  • , Yong Xiang
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

Restoring missing areas without leaving visible traces has become a trivial task with Photoshop inpainting tools. However, such tools have potentially illegal or unethical uses, such as removing specific objects in images to deceive the public. Despite the emergence of many forensics methods of image inpainting, their detection ability is still insufficient when attending to professional Photoshop inpainting. Motivated by this, we propose a novel method termed primary-secondary network (PS-Net) to localize the Photoshop inpainted regions in images. To the best of our knowledge, this is the first forensic method devoted specifically to Photoshop inpainting. The PS-Net is designed to deal with the problems of delicate and professional inpainted images. It consists of two subnetworks: the primary network (P-Net) and the secondary network (S-Net). The P-Net aims at mining the frequency clues of subtle inpainting features through the convolutional network and further identifying the tampered region. The S-Net enables the model to mitigate compression and noise attacks to some extent by increasing the co-occurring feature weights and providing features that are not captured by the P-Net. Furthermore, the dense connection, Ghost modules, and channel attention blocks (C-A blocks) are adopted to further strengthen the localization ability of PS-Net. Extensive experimental results illustrate that PS-Net can successfully distinguish forged regions in elaborate inpainted images, outperforming several state-of-the-art solutions. The proposed PS-Net is also robust against some postprocessing operations commonly used in Photoshop.

Original languageEnglish
Pages (from-to)13874-13886
Number of pages13
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume35
Issue number10
DOIs
StatePublished - 2024
Externally publishedYes

Keywords

  • Dense connectivity
  • Photoshop inpainting
  • forensics
  • forgery localization
  • primary-secondary network (PSNet).

Fingerprint

Dive into the research topics of 'PS-Net: A Learning Strategy for Accurately Exposing the Professional Photoshop Inpainting'. Together they form a unique fingerprint.

Cite this