TY - GEN
T1 - Explore and Enhance the Generalization of Anomaly DeepFake Detection
AU - Wang, Yiting
AU - Chen, Shen
AU - Yao, Taiping
AU - Ma, Lizhuang
AU - Zhang, Zhizhong
AU - Tan, Xin
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.
PY - 2024
Y1 - 2024
N2 - In recent years, Anomaly DeepFake Detection (ADFD) has made significant breakthroughs in terms of generalization when meeting various unknown tampers. These detection methods primarily enhance generalization by constructing pseudo-fake samples, which involve three main steps: mask generation, source-target preprocessing, and blending. In this paper, we conducted a systematic analysis of some core factors in these steps. Based on the aforementioned observations at the mask generation step, we find that previous ADFD methods have limitations as they only consider specific tampering types, which is not representative of real-world scenarios, and generate noise samples that closely resemble real samples, causing confusion and hindering generalization. To alleviate these issues, we propose our new method, which consists of the Boundary Blur Mask Generator (BBMG) and the Noise Refinement Strategy (NRS) modules. BBMG leverages the inherent characteristics of boundary blur to simulate a comprehensive range of tampering techniques, enabling a more realistic representation of real-world scenarios. In conjunction with BBMG, the NRS module effectively mitigates the influence of noise samples. Extensive ablation experiments and comparative evaluations demonstrate the effectiveness of our method.
AB - In recent years, Anomaly DeepFake Detection (ADFD) has made significant breakthroughs in terms of generalization when meeting various unknown tampers. These detection methods primarily enhance generalization by constructing pseudo-fake samples, which involve three main steps: mask generation, source-target preprocessing, and blending. In this paper, we conducted a systematic analysis of some core factors in these steps. Based on the aforementioned observations at the mask generation step, we find that previous ADFD methods have limitations as they only consider specific tampering types, which is not representative of real-world scenarios, and generate noise samples that closely resemble real samples, causing confusion and hindering generalization. To alleviate these issues, we propose our new method, which consists of the Boundary Blur Mask Generator (BBMG) and the Noise Refinement Strategy (NRS) modules. BBMG leverages the inherent characteristics of boundary blur to simulate a comprehensive range of tampering techniques, enabling a more realistic representation of real-world scenarios. In conjunction with BBMG, the NRS module effectively mitigates the influence of noise samples. Extensive ablation experiments and comparative evaluations demonstrate the effectiveness of our method.
KW - Anormaly DeepFake Detection
KW - DeepFake Detection
KW - Noise Strategy
KW - Pseudo-fake
UR - https://www.scopus.com/pages/publications/85190459254
U2 - 10.1007/978-981-97-2092-7_2
DO - 10.1007/978-981-97-2092-7_2
M3 - 会议稿件
AN - SCOPUS:85190459254
SN - 9789819720910
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 27
EP - 47
BT - Computational Visual Media - 12th International Conference, CVM 2024, Proceedings
A2 - Zhang, Fang-Lue
A2 - Sharf, Andrei
PB - Springer Science and Business Media Deutschland GmbH
T2 - 12th International Conference on Computational Visual Media, CVM 2024
Y2 - 10 April 2024 through 12 April 2024
ER -