Interactive Error Resolution Strategies for Speech-to-Speech Translation Systems

In this demonstration, we will showcase BBN’s Speech-to-Speech (S2S) translation system that employs novel interaction strategies to resolve errors through user-friendly dialog with the speaker. The system performs a series of analysis on input utterances to detect out-ofvocabulary (OOV) named-entities and terms, sense ambiguities, homophones, idioms and ill-formed inputs. This analysis is used to identify potential errors and select an appropriate resolution strategy. Our evaluation shows a 34% (absolute) improvement in cross-lingual transfer of erroneous concepts in our English to Iraqi-Arabic S2S system.