Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Standalone job processors #5

Open
SIMULATAN opened this issue May 20, 2024 · 0 comments
Open

Standalone job processors #5

SIMULATAN opened this issue May 20, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@SIMULATAN
Copy link
Contributor

SIMULATAN commented May 20, 2024

Rather than using a monolith, we could split up the backend into multiple smaller parts. The most prominent use case would be to start a standalone job processor that just handles some jobs, possibly even with lower capacity. This way, we can host a lightweight distribution on multiple servers, possibly even around the world, to distribute fetching load (and circumvent rate limits :P)

@SIMULATAN SIMULATAN added the enhancement New feature or request label May 20, 2024
@SIMULATAN SIMULATAN changed the title Extract fetchers from backend Standalone job processors Sep 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant