HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, et al.
HuBERT uses offline clustering to provide aligned targets for masked prediction, matching or improving wav2vec 2.0 on speech benchmarks.