Towards high-fidelity facial UV map generation in real-world

PATTERN RECOGNITION LETTERS(2024)

引用 0|浏览6
暂无评分
摘要
We present a framework for completing high-fidelity 3D facial UV maps from single -face image. Despite the success of Generative Adversarial Networks (GANs) in this area, generating accurate UV maps from inthe -wild images remains challenging. Our approach involves a novel network called "Map and Edit"that combines a 2D generative model and a 3D prior to explicitly control the generation of multi -view faces. We use an indirect method to address domain gap issues between rendered and real images, which improves the identity consistency of the generated multi -view facial images. We also leverage synthesized multi -view images and predicted 3D information to produce texture -rich and high -resolution facial UV maps. Our model is self -supervised and does not require manual annotations or datasets. Experimental results demonstrate the effectiveness of our framework in reconstructing high-fidelity UV maps with accurate, fine details. Overall, our approach provides a promising solution to the challenges of 3D facial UV map completion from in -the -wild images.
更多
查看译文
关键词
3D face reconstruction,UV map,Multi-view face image,3DMM
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要