DualLip: A System for Joint Lip Reading and Generation
MM '20: The 28th ACM International Conference on Multimedia Seattle WA USA October, 2020, pp. 1985-1993, 2020.
Lip reading aims to recognize text from talking lip, while lip generation aims to synthesize talking lip according to text, which is a key component in talking face generation and is a dual task of lip reading. Both tasks require a large amount of paired lip video and text training data, and perform poorly in low-resource scenarios with l...More
PPT (Upload PPT)