| 引用本文: | 张军,于淼淼,杨佳鑫.结合多视角学习与一致性表征的人脸伪造检测.[J].国防科技大学学报,2023,45(4):28-36.[点击复制] |
| ZHANG Jun,YU Miaomiao,YANG Jiaxin.Combining multi-view learning and consistent representation for face forgery detection[J].Journal of National University of Defense Technology,2023,45(4):28-36[点击复制] |
|
| |
|
|
| 本文已被：浏览 4387次 下载 3223次 |
| 结合多视角学习与一致性表征的人脸伪造检测 |
| 张军,于淼淼,杨佳鑫 |
|
(国防科技大学 大数据与决策实验室, 湖南 长沙 410073)
|
| 摘要: |
| 现有的人脸伪造检测方法通常在已知域上表现较好,但面临过拟合的风险,在应对未知场景时无法保持良好的检测能力。为解决此问题,提出一种结合多视角学习与一致性表征的人脸伪造检测框架。为捕获更全面的伪造痕迹,将输入图像转换为两种互补视角并采用双流骨干网络进行多视角特征学习。引入一致性度量,以补丁级监督的方式明确约束不同视角输出的局部特征的相似度。为提高检测精度,采用特征分解策略进一步优化伪造特征,减少不相关因素的干扰,并以伪造特征空间的决策作为最终的预测结果。在基准数据集上进行的大量实验表明,所提出的方法优于现有的主流模型,具备良好的跨域泛化能力。 |
| 关键词: 人脸伪造 频域特征 多视角学习 一致性度量 |
| DOI：10.11887/j.cn.202304004 |
| 投稿日期：2023-02-17 |
| 基金项目:国家自然科学基金资助项目(62101571)；湖南省研究生科研创新资助项目(CX20210058)；湖南省自然科学基金资助项目(2021JJ40685) |
|
| Combining multi-view learning and consistent representation for face forgery detection |
| ZHANG Jun, YU Miaomiao, YANG Jiaxin |
|
(Laboratory for Big Data and Decision, National University of Defense Technology, Changsha 410073, China)
|
| Abstract: |
| Most of the existing face forgery detection methods usually achieve acceptable detection performance on known attacks, but still face the risk of overfitting and fail to maintain good detection capability when dealing with unknown scenes. To solve this problem, an effective face forgery detection framework based on multi-view learning and consistent representation was proposed. To capture more comprehensive forgery traces, the input image was transformed into two complementary views and a dual-stream backbone network was used for multi-view feature learning. The consistency metric was introduced to explicitly constrain the similarity of local features output from different viewpoints in a patch-level supervised manner. To improve the detection accuracy of the model, the feature decomposition strategy further optimized the forgery-relevant feature to reduce the interference of irrelevant factors, and the decision made from the forgery-relevant feature space was used as the final prediction. Extensive experiments on benchmark datasets show that the proposed method outperforms the existing mainstream approaches with good cross-domain generalization capability. |
| Keywords: face forgery frequency features multi-view learning consistency metric |
|
|
|
|
|
