Blendshapes GHUM: Real-time Monocular Facial Blendshape Prediction

CoRR(2023)

引用 0|浏览12
暂无评分
摘要
We present Blendshapes GHUM, an on-device ML pipeline that predicts 52 facial blendshape coefficients at 30+ FPS on modern mobile phones, from a single monocular RGB image and enables facial motion capture applications like virtual avatars. Our main contributions are: i) an annotation-free offline method for obtaining blendshape coefficients from real-world human scans, ii) a lightweight real-time model that predicts blendshape coefficients based on facial landmarks.
更多
查看译文
关键词
blendshapes ghum,prediction,real-time
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络