Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

微调roberta模型问题 #540

Closed
Antlerkeke opened this issue Apr 23, 2020 · 6 comments
Closed

微调roberta模型问题 #540

Antlerkeke opened this issue Apr 23, 2020 · 6 comments
Assignees
@Steffy-zxf

Comments

@Antlerkeke
Copy link

Antlerkeke commented Apr 23, 2020 •
edited
Loading

在paddlepaddle1.6.2下
module = hub.Module(name="roberta_wwm_ext_chinese_L-24_H-1024_A-16")
微调时总是自动重启页面环境，无法微调。
@Steffy-zxf
Copy link
Contributor

你好，页面重启是在什么样的背景下发生的呢？是AIStudio吗？麻烦把背景和问题说的详细些，方便排查问题。

@Antlerkeke
Copy link
Author

您好，重启是在每次进行任务进行finetune_and_eval()时输出PaddleHub finetune start后页面右上角就会提示自动重启中，AI studio项目地址https://aistudio.baidu.com/aistudio/projectdetail/389985，感谢！

@Steffy-zxf
Copy link
Contributor

@Antlerkeke 你好，你的项目还需要公开，现在是私密状态，无法查看。

@Antlerkeke
Copy link
Author

已公开。麻烦您再次查看

@Steffy-zxf
Copy link
Contributor

@Antlerkeke 建议你的batch_size设置小一些。batch_size和max_seq_len会影响占用的运行内存。另外由于roberta-large/ERNIE等模型参数量级较大，建议使用GPU环境运行。

@Steffy-zxf Steffy-zxf self-assigned this Apr 28, 2020
@Antlerkeke
Copy link
Author

谢谢，确实是因为batchsize太大了，已经解决了

@Steffy-zxf Steffy-zxf mentioned this issue May 11, 2020
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Steffy-zxf Steffy-zxf

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Antlerkeke @Steffy-zxf