-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feature: add asynchronous cycle which can deal with long-running evaluations #238
Comments
Our current approach relies on the ⛔️ However, we still don't have robust SLURM dispatch, which is a standard problem for data processing pipelines. It turns out that this is hard. We should switch gears and look at pipeline tools. Can we set up the cycle to run under:
|
We have a working version of the workflow module which does this. Open:
|
This is implemented with autora-workflow version 0.5.0 with the |
This is now possible using cylc and the workflow package. Hurrah! |
... and if everything crashes, doesn't completely lose its data.
It could be:
It needs to be able to:
The text was updated successfully, but these errors were encountered: