k2SSL: A Faster and Better Framework for Self-Supervised Speech Representation Learning

[yfyeung]

Paper link: https://arxiv.org/abs/2411.17100v1

[yfyeung]

Part of the resources have been released:

Zipformer Base pre-trained with cross entropy loss: Checkpoints, logs, and scripts
Zipformer Base fine-tuned with pruned RNN-T loss: Checkpoints, logs, and scripts
Zipformer Base fine-tuned with letter-level CTC loss: Checkpoints, logs, and scripts
Zipformer Base pre-trained manifests including kmeans labels: Dataset

With these resources, I believe anyone with 8 V100 32G GPUs can easily reproduce our experiments.