Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace Argo #218

Closed
deliahu opened this issue Jul 8, 2019 · 0 comments · Fixed by #235
Closed

Replace Argo #218

deliahu opened this issue Jul 8, 2019 · 0 comments · Fixed by #235
Assignees
Labels
refactor Improve code quality

Comments

@deliahu
Copy link
Member

deliahu commented Jul 8, 2019

Description

Replace Argo with a custom DAG manager in the Cortex operator.

Motivation

Argo isn't primarily designed for our use case. For example, creating two k8s resources in one Argo job required hacking (and still has issues, e.g. readiness checks). Also, spinning up one pod per k8s resource is wasteful.

Also, this would dramatically help with EKS pod limits (see #219)

Notes

  • The DAG is already implicitly stored in the context (it can be re-calculated at any time)
  • The DAG should survive mid-deployment operator restart
@deliahu deliahu added the enhancement New feature or request label Jul 8, 2019
@deliahu deliahu added refactor Improve code quality v0.7 and removed enhancement New feature or request labels Jul 9, 2019
@deliahu deliahu self-assigned this Jul 12, 2019
@deliahu deliahu changed the title Replace Argo? Replace Argo Jul 18, 2019
@deliahu deliahu mentioned this issue Jul 20, 2019
9 tasks
@deliahu deliahu closed this as completed Jul 20, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
refactor Improve code quality
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant