Continuous Audio-Visual Speech Recognition

Abstract: We address the problem of robust lip tracking, visual speechfeature extraction, and sensor integration for audio-visual speech recognitionapplications. An appearance based model of the articulators, whichrepresents linguistically important features, is learned from example imagesand is used to locate, track, and recover visual speech information.