Article ; Online: Contrastive learning-based general Deepfake detection with multi-scale RGB frequency clues
Journal of King Saud University: Computer and Information Sciences, Vol 35, Iss 4, Pp 90-
2023 Volume 99
Abstract: Deepfake is a type of image and video face manipulation methods which could cause security and society threats. Although some related databases and detection models have been proposed for detecting face forgery media, achieving a generalizable detector ... ...
Abstract | Deepfake is a type of image and video face manipulation methods which could cause security and society threats. Although some related databases and detection models have been proposed for detecting face forgery media, achieving a generalizable detector for both known and unknown manipulations remains challenging. In this study, a novel deepfake detection model with high generalizability is proposed to tackle this issue. We employ supervised contrastive learning to enhance the generalizability to unknown manipulations and datasets. In addition, we design a cross-modality data augmentation method by combining SRM and RGB features to extract detection clues comprehensively. Furthermore, we propose a multi-scale feature enhancement module to enhance textural and semantic information. Extensive experiments have demonstrated that our method improves model generalization in both intra- and cross- dataset scenarios. |
---|---|
Keywords | Face forgery detection ; Deepfake detection ; Contrastive learning ; Data augmentation ; Multi-modality feature learning ; Electronic computers. Computer science ; QA75.5-76.95 |
Subject code | 006 |
Language | English |
Publishing date | 2023-04-01T00:00:00Z |
Publisher | Elsevier |
Document type | Article ; Online |
Database | BASE - Bielefeld Academic Search Engine (life sciences selection) |
Full text online
More links
Kategorien
Inter-library loan at ZB MED
Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.