Skip to main navigation Skip to search Skip to main content

Face Manipulation Detection via Auxiliary Supervision

  • Xinyao Wang
  • , Taiping Yao
  • , Shouhong Ding
  • , Lizhuang Ma*
  • *Corresponding author for this work
  • Shanghai Jiao Tong University
  • Tencent

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The rapid progress of face manipulation technology has attracted people’s attention. At present, a reliable edit detection algorithm is urgently needed to identify real and fake faces to ensure social credibility. Previous deep learning approaches formulate face manipulation detection as a binary classification problem. Many works struggle to focus on specific artifacts and generalize poorly. In this paper, we design reasonable auxiliary supervision to guide the network to learn discriminative and generalizable cues. A multi-scale framework is proposed to estimate the manipulation probability with texture map and blending boundary as auxiliary supervisions. These supervisions will guide the network to focus on the underlying texture information and blending boundary, making the learned features more generalized. Experiments on FaceForensics and FaceForensics++ datasets have demonstrated the effectiveness and generalization of our method.

Original languageEnglish
Title of host publicationNeural Information Processing - 27th International Conference, ICONIP 2020, Proceedings
EditorsHaiqin Yang, Kitsuchart Pasupa, Andrew Chi-Sing Leung, James T. Kwok, Jonathan H. Chan, Irwin King
PublisherSpringer Science and Business Media Deutschland GmbH
Pages313-324
Number of pages12
ISBN (Print)9783030638290
DOIs
StatePublished - 2020
Externally publishedYes
Event27th International Conference on Neural Information Processing, ICONIP 2020 - Bangkok, Thailand
Duration: 18 Nov 202022 Nov 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12532 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference27th International Conference on Neural Information Processing, ICONIP 2020
Country/TerritoryThailand
CityBangkok
Period18/11/2022/11/20

Keywords

  • Artifacts
  • Deepfake
  • Forgery detection

Fingerprint

Dive into the research topics of 'Face Manipulation Detection via Auxiliary Supervision'. Together they form a unique fingerprint.

Cite this