New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix pipeline's context overflow #87

Merged

Dahoas merged 2 commits into master from fix-sentiments

Nov 10, 2022

Collaborator

maxreciprocate commented Nov 10, 2022

This PR

truncates input into pipeline to bert's context length (512)
puts pipeline on processes' local gpus for 2x speedup in training on single gpu (1:02 v 2:19 for 128 gradient steps), a bit more on multigpu (1:07 v 9:26 on 8 gpus) at cost of 0.5G extra VRAM
removes depreciation warning of return_all_scores usage in pipeline, on transformers version 4.24.0

maxreciprocate added 2 commits

November 10, 2022 15:08


          fix(sentiments): context overflow

01888ee


          feat(sentiments): use batch_size option

5f5cb71

maxreciprocate requested a review from Dahoas

November 10, 2022 13:58

Dahoas approved these changes

View reviewed changes

Dahoas merged commit f552561 into master

maxreciprocate deleted the fix-sentiments branch

November 10, 2022 16:24

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet