Skip to content

[DRAFT] client type config - #1846

Closed
willccbb wants to merge 1 commit into
mainfrom
will/client-type-config
Closed

willccbb wants to merge 1 commit into
mainfrom
will/client-type-config

Conversation

@willccbb

@willccbb willccbb commented Feb 21, 2026

Copy link
Copy Markdown
Member

Allows setting verifiers client type + overriding sampling / extra_body args to support multiple interleaving strategies.


Note

Medium Risk
Moderate risk because it changes how all generation requests are constructed and routed (client type + request parameter overrides), which could alter rollout/eval behavior if misconfigured.

Overview
Adds a configurable ClientConfig.client_type (instead of a hardcoded verifiers client type) and propagates it through both static and elastic inference pool client creation.

Introduces ClientConfig.sampling_overrides and ClientConfig.extra_body_overrides, applies them to both training and eval sampling arg construction via apply_client_sampling_overrides, while still forcing token-level outputs (logprobs + return_token_ids) required for rollout-to-training conversion. Includes unit tests covering override behavior and client_type wiring.

Written by Cursor Bugbot for commit fe5c90d. This will update automatically on new commits. Configure here.

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.

'extra_body fields to hardcode/override on generation requests (e.g. {"return_token_ids": true}).'
),
),
] = {}

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing CHANGELOG entry for new config fields

Low Severity

This PR adds three new config fields to ClientConfig in src/prime_rl/utils/config.pyclient_type, sampling_overrides, and extra_body_overrides — but the diff does not include a corresponding CHANGELOG.md update. Per project rules, any PR that modifies configuration structures (including added fields) in src/prime_rl/utils/config.py must update the changelog.

Fix in Cursor Fix in Web

Triggered by project rule: BugBot Instructions

cursor Bot pushed a commit that referenced this pull request Feb 21, 2026
…_overrides (#1846)

Co-authored-by: will brown <willccbb@users.noreply.github.com>
@willccbb
willccbb marked this pull request as draft February 21, 2026 06:29
@willccbb willccbb changed the title client type config [DRAFT] client type config Feb 21, 2026
@mikasenghaas

Copy link
Copy Markdown
Member

done in #1847

mikasenghaas added a commit that referenced this pull request Jun 23, 2026
…etup)

51701f4c (#1846).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@mikasenghaas
mikasenghaas deleted the will/client-type-config branch August 5, 2026 04:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants