Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft storage on disk option #155

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

JoseLuisC99
Copy link
Contributor

This is an idea of how to add an option to use disk storage for the replay buffer. It is not advisable to rely on temporary paths for this purpose, as some operating systems impose limitations on their storage capacity.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 31, 2024
@matteobettini
Copy link
Collaborator

matteobettini commented Jan 7, 2025

This is great thanks a ton!

Insetad of introducing a new arg (which you have to pass to experiments, benchmarks, etc) I would just use the existing "buffer_device" and check when it is == disk

Another question I have is if you could check this works with chackpointing. Aka I see that when the experiment ends you delete the file, but if it the experiment had checkpointed, did it store it correctly in the checkpoint folder?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants