New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

如何利用领域数据对预训练模型继续预训练呢？ #884

Open

TyrionZK opened this issue Sep 8, 2020 · 2 comments

Assignees

Labels

feature

TyrionZK commented Sep 8, 2020

paddlehub可以利用领域数据对预训练模型继续预训练吗？如果可以，能否提供参考资料呢
paddlehub如果不可以的花，直接利用paddlepaddle能否实现呢？如果可以，能否提供参考资料呢

Steffy-zxf added the feature label

Contributor

Steffy-zxf commented Sep 9, 2020

你好！目前PaddleHub暂时还不支持继续预训练。请问你的任务领域是什么呢？

预训练可以参考 PaddlePaddle/models https://github.com/PaddlePaddle/models/tree/release/1.8/PaddleNLP 提供的教程

Steffy-zxf assigned nepeplwu

Author

TyrionZK commented Sep 10, 2020

文本分类领域。PaddlePaddle/models中只有bert的继续预训练说明，也不太友好，没有其他像roberta的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment