Self-training and Pre-training are Complementary for Speech Recognition

Tatiana Likhomanenko
Tatiana Likhomanenko
Paden Tomasello
Paden Tomasello
Alexis Conneau
Alexis Conneau
Cited by: 2|Views33

Abstract:

Self-training and unsupervised pre-training have emerged as effective approaches to improve speech recognition systems using unlabeled data. However, it is not clear whether they learn similar patterns or if they can be effectively combined. In this paper, we show that pseudo-labeling and pre-training with wav2vec 2.0 are complementary ...More

Code:

Data:

Full Text
Bibtex
Your rating :
0

 

Tags
Comments