You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Jan 15, 2024. It is now read-only.
The large word language model scripts produces > 100GB checkpoints. We want to add some logic to automatically keep the past K checkpoints and remove the previous ones so that it doesn't exceed disk capacity.
The text was updated successfully, but these errors were encountered:
The large word language model scripts produces > 100GB checkpoints. We want to add some logic to automatically keep the past K checkpoints and remove the previous ones so that it doesn't exceed disk capacity.
The text was updated successfully, but these errors were encountered: