Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature request] Remove erroneous episode from replay buffer #1197

Open
WreckItTim opened this issue Oct 4, 2024 · 0 comments
Open

[feature request] Remove erroneous episode from replay buffer #1197

WreckItTim opened this issue Oct 4, 2024 · 0 comments

Comments

@WreckItTim
Copy link

Hello, I am using SB3 with a third party simulation environment that is a bit unstable. If running for a few hours, it will crash at some point. I made a crash handler that will automatically reboot the simulation on crash, however it requires resetting the environment to the beginning of the episode because I can not access the full state of the simulation on a step-by-step basis. I would like to remove the impartial episode, that resulted from the crash, from the replay buffer. I can't seem to find a way to handle this natively with SB3, so would like to submit a feature request for this. Perhaps something in the state returned at step? Or maybe this already exists and I just couldn't find it. Or maybe it would be better to have a general method for removing specific episodes from the buffer?

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant