LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT

LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT
| Github | Huggingface | SUPERB Leaderboard |
The authors’ PyTorch implementation and pretrained models of LightHuBERT.