Skip to content
This repository has been archived by the owner on Apr 18, 2018. It is now read-only.

Better handling of heterogenous server/task pairings #17

Open
josharian opened this issue Jan 20, 2012 · 1 comment
Open

Better handling of heterogenous server/task pairings #17

josharian opened this issue Jan 20, 2012 · 1 comment

Comments

@josharian
Copy link

The following (simplified) setup goes awry:

  • Start two gearmand instances A and B (say, on different ports).
  • Start one worker for task T that connects to A.
  • Have a client submit a job T to servers A and B.

The outcome is based on a race condition: Whichever server (A or B) replies first gets the task. If it is A, the task succeeds; if it is B, the task fails.

In general, unless all servers have the exact same set of worker tasks available, clients can't rely on requests succeeding.

This makes it difficult to rely on multiple gearmand servers for load balancing and redundancy, even if the general intent is to have all workers connect to all servers (config errors, connection flukes, etc. can get in the way -- exactly what the redundancy is there to help with).

@josharian
Copy link
Author

I'd be happy to take a crack at fixing this, but before I start, I just wanted to make sure that I wasn't Doing It Wrong, and that there wasn't a different intended way to use multiple gearmand servers for redundancy.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant