Skip to content

Feat conditional rpc healthcheck#12

Merged
overcuriousity merged 6 commits intonew-featuresfrom
feat--conditional-rpc-healthcheck
Jan 31, 2026
Merged

Feat conditional rpc healthcheck#12
overcuriousity merged 6 commits intonew-featuresfrom
feat--conditional-rpc-healthcheck

Conversation

@overcuriousity
Copy link
Copy Markdown
Owner

No description provided.

overcuriousity and others added 6 commits January 30, 2026 16:10
Fix parseEndpointList to handle single and double quotes that are
treated as literal characters on Windows.

- Strip surrounding quotes before parsing comma-separated endpoints
- Fixes test failures on Windows CI

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
RPC health checking now runs continuously from process creation until
proxy shutdown, completely independent of whether the model is loaded,
starting, stopped, or in any other state.

- Start health checker in NewProcess when rpcHealthCheck is enabled
- Remove stopRPCHealthChecker - only stops on proxy shutdown
- Remove state checks from health checker goroutine
- Health status always reflects current RPC endpoint availability

Previously, the health checker only ran while a process was in StateReady,
causing stale health data when processes stopped. Now /v1/models always
shows accurate RPC health regardless of model state.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@overcuriousity overcuriousity merged commit 7187493 into new-features Jan 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant