Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No heartbeat for components #285

Open
DHrobotman opened this issue Sep 19, 2023 · 1 comment
Open

No heartbeat for components #285

DHrobotman opened this issue Sep 19, 2023 · 1 comment

Comments

@DHrobotman
Copy link

[2023-09-18 21:35:46,519][196071] No heartbeat for components :InferenceWorker_p0-w0 (337 seconds)
[2023-09-18 21:35:46,519][196071] Stopping training due to lack of heartbeats from <class 'sample_factory.algo.sampling.inference_worker.InferenceWorker‘>

When I start train.py, an error will occur. So how can I solve the problem and why does it happen? I hope you can help me answer this question

@alex-petrenko
Copy link
Owner

Hi @DHrobotman

This error typically means something happened earlier, i.e. one of the system components crashed. Possible reasons: bug in the code, OOM, etc.
Try to look at the entire log file and search for Exceptions and errors.

It would also help if you could attach your log file and configuration here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants