Update the repo with changes brought by Transformers 4.19.1#50
Conversation
libinta
left a comment
libinta
left a comment
There was a problem hiding this comment.
Regis, what's the test result? can we have sth like shared document to track test result for each release?
I'm going to launch the regression tests manually on this branch to be sure that we keep the same performance. You'll be able to see if these tests have passed here (in the "Actions" tab). |
The CI run of Saturday skipped all regression tests since examples are not up to date in the main branch (checking if examples are up to date is the first test and if it fails all the following tests are skipped). But I ran it manually and it gave me the exact same results as before. Actually you can check it in the log files I sent you on Slack. |
Add disk_offload flag that controls device_map=auto. Setting this flag enbales weights offload to disk when cpu memory runs OOM. Add const serialization path flag that gets a path for where to serialize const sections, so if there is no space on device to save all const sections they will be offloaded to disk.
Add disk_offload flag that controls device_map=auto. Setting this flag enbales weights offload to disk when cpu memory runs OOM. Add const serialization path flag that gets a path for where to serialize const sections, so if there is no space on device to save all const sections they will be offloaded to disk.
2 participants
What does this PR do?
Make the repo up to date with Transformers 4.19.1.
Before submitting