Skip to main navigation Skip to search Skip to main content

Explore and Enhance the Generalization of Anomaly DeepFake Detection

  • East China Normal University
  • Tencent

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In recent years, Anomaly DeepFake Detection (ADFD) has made significant breakthroughs in terms of generalization when meeting various unknown tampers. These detection methods primarily enhance generalization by constructing pseudo-fake samples, which involve three main steps: mask generation, source-target preprocessing, and blending. In this paper, we conducted a systematic analysis of some core factors in these steps. Based on the aforementioned observations at the mask generation step, we find that previous ADFD methods have limitations as they only consider specific tampering types, which is not representative of real-world scenarios, and generate noise samples that closely resemble real samples, causing confusion and hindering generalization. To alleviate these issues, we propose our new method, which consists of the Boundary Blur Mask Generator (BBMG) and the Noise Refinement Strategy (NRS) modules. BBMG leverages the inherent characteristics of boundary blur to simulate a comprehensive range of tampering techniques, enabling a more realistic representation of real-world scenarios. In conjunction with BBMG, the NRS module effectively mitigates the influence of noise samples. Extensive ablation experiments and comparative evaluations demonstrate the effectiveness of our method.

Original languageEnglish
Title of host publicationComputational Visual Media - 12th International Conference, CVM 2024, Proceedings
EditorsFang-Lue Zhang, Andrei Sharf
PublisherSpringer Science and Business Media Deutschland GmbH
Pages27-47
Number of pages21
ISBN (Print)9789819720910
DOIs
StatePublished - 2024
Event12th International Conference on Computational Visual Media, CVM 2024 - Wellington, New Zealand
Duration: 10 Apr 202412 Apr 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14593 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th International Conference on Computational Visual Media, CVM 2024
Country/TerritoryNew Zealand
CityWellington
Period10/04/2412/04/24

Keywords

  • Anormaly DeepFake Detection
  • DeepFake Detection
  • Noise Strategy
  • Pseudo-fake

Fingerprint

Dive into the research topics of 'Explore and Enhance the Generalization of Anomaly DeepFake Detection'. Together they form a unique fingerprint.

Cite this