Repository navigation
fix(auto): rate-limit empty-pool AUTO warnings - #10344
diegosouzapw merged 1 commit into
Conversation
|
Implements / pairs with #10346 (rate-limit the AUTO empty-pool warn). Does not change empty-pool routing. |
|
Thanks for this — the debounce logic itself is clean and well-tested. I cherry-picked just your One thing to fix before merge, though: the PR branch looks like it was cut from Could you reset your branch to the current |
af88f6a to
8bed9d8
Compare
Babysit summary
|
Family resolves like auto/zai with no connected models logged a warn on every call (about once a minute per poll). Keep the empty-pool behavior; emit the warn at most once per label per 60s. Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com>
8bed9d8 to
613b54d
Compare
231b16e
into
cheaper-inference:release/v3.8.50
Family resolves like auto/zai with no connected models logged a warn on every call (about once a minute per poll). Keep the empty-pool behavior; emit the warn at most once per label per 60s. Co-authored-by: Ravi Tharuma <RaviTharuma@users.noreply.github.com> Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com>
Summary
virtualFactorylog.warnsauto/<family> matched no connected models; returning an empty poolon every resolve.auto/<family>) has zero connected models — including when nothing user-facing needs that family (suspicion: health/catalog tick).Related Issues
Validation
No secrets or private hostnames.