Skip to content

fix(registry): update grok-cli model context lengths - #5913

Merged
diegosouzapw merged 1 commit into
cheaper-inference:release/v3.8.44from
Chewji9875:fix/grok-cli-context-length
Jul 3, 2026
Merged

diegosouzapw merged 1 commit into
cheaper-inference:release/v3.8.44from
Chewji9875:fix/grok-cli-context-length

Conversation

@Chewji9875

@Chewji9875 Chewji9875 commented Jul 2, 2026 •

Copy link
Copy Markdown
Contributor

This pull request increases the maximum context length for two Grok CLI provider models in the grok_cliProvider registry entry. These changes allow the models to handle larger input contexts.

Model configuration updates:

  • Increased the contextLength for the grok-build model from 128,000 to 256,000 tokens in open-sse/config/providers/registry/grok-cli/index.ts.
  • Increased the contextLength for the grok-composer-2.5-fast model from 128,000 to 200,000 tokens in open-sse/config/providers/registry/grok-cli/index.ts.Update grok-cli registry context lengths to match the actual Grok CLI /context values:\n\n- grok-build: 128000 → 256000\n- grok-composer-2.5-fast: 128000 → 200000\n\n## Why\nOmniRoute's context-aware routing was filtering out grok-build for larger requests because the registry value was too low.\n\n## Notes\n- No runtime logic changes; this is a registry-only fix.\n- Based on .

@Chewji9875
Chewji9875 requested a review from diegosouzapw as a code owner July 2, 2026 09:20

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the context length limits for Grok models in the grok-cli provider registry, increasing the context length for grok-build to 256,000 and for grok-composer-2.5-fast to 200,000. There are no review comments, and I have no feedback to provide.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

@diegosouzapw
diegosouzapw changed the base branch from release/v3.8.43 to release/v3.8.44 July 2, 2026 16:18
@diegosouzapw

Copy link
Copy Markdown
Collaborator

Thanks for the grok-cli context-length work, @janeza2! 🙏 But like #5915, this PR can't be reviewed/merged as-is: it's +41,808/−11,961 across 100+ files — CI workflows, README, CLAUDE.md, all the quality baselines (config/quality/*baseline*.json, allowlists), .env.example, bin/cli/*, and CHANGELOG + i18n for ~40 languages. That churn almost certainly came from a stale base/rebase, and contributors shouldn't be moving the quality ratchets.

Could you please rebase onto the current release/v3.8.44 and de-scope to just the grok-cli registry context-length change (the open-sse/config/providers/registry/... model entries)? Once it's a focused diff we can review and merge it quickly. 🙌

@diegosouzapw

Copy link
Copy Markdown
Collaborator

Thanks @Chewji9875! The actual change is tiny and reasonable (two grok-cli context lengths: grok-build 128000→256000, grok-composer-2.5-fast 128000→200000), but the branch has drifted badly — it's ~176 commits ahead / merges unrelated history, so it shows as +41k/-11k and is unmergeable. Could you re-cut a clean branch off release/v3.8.44 with just those two lines (plus, ideally, a one-line assertion in the catalog test)? Also, could you confirm the 256000/200000 values against xAI's official grok docs so we don't ship a guessed number? Happy to merge once it's a clean 2-line diff. 🙏

@diegosouzapw
diegosouzapw force-pushed the fix/grok-cli-context-length branch from 23d1342 to e5c55e3 Compare July 3, 2026 15:50
Match the registry contextLength values to the actual Grok CLI /context
capacities so context-aware routing stops filtering these models out for
larger requests:

- grok-build: 128000 → 256000 (xAI-published 256k context window)
- grok-composer-2.5-fast: 128000 → 200000 (Grok CLI /context value)

Registry-only change; no runtime logic touched.

Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com>
@diegosouzapw
diegosouzapw force-pushed the fix/grok-cli-context-length branch from ac9050a to 874818c Compare July 3, 2026 15:52
@diegosouzapw
diegosouzapw merged commit 9c6a364 into cheaper-inference:release/v3.8.44 Jul 3, 2026
2 of 3 checks passed
@diegosouzapw diegosouzapw mentioned this pull request Jul 4, 2026
tkgo11 pushed a commit to tkgo11/OmniRoute that referenced this pull request Sep 23, 2026
…ce#5913)

grok-build 128k→256k, grok-composer-2.5-fast 128k→200k to match actual Grok CLI /context capacities so context-aware routing stops filtering these models out. Registry-only.

Co-authored-by: diegosouzapw <diegosouza.pw@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants