Could Human Gaze Augment Detectors of Synthetic Images?

DSP(2023)

引用 0|浏览16
暂无评分
摘要
Recent advances in generative adversarial networks (GANs) allow for the synthesis of extremely photo-realistic face images, deceiving even the most experienced observers, let alone the unsuspecting internet user. Due to this, there has been a considerable effort by the image forensics community to design appropriate tools for the detection of these images. This paper first implements one such detection technique based on spatial and cross-band co-occurrence matrices and convolutional neural networks (CNNs), and then attempts to improve it by introducing additional information obtained from the human gaze. We show that in cases where human observers correctly decide whether an image is real or fake, eye movement information in combination with spatial and cross-band co-occurrence matrices derived from observation regions can be informative towards the task of detecting fake images. However, only a limited increase in the detection accuracy is achieved.
更多
查看译文
关键词
synthetic / fake images,eye tracking,gaze,image forensics,co-occurrence matrix,Generative Adversarial Networks
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要