Skip to content

fix(providers): adapt Kimi nonstream requests internally - #8302

Merged
diegosouzapw merged 1 commit into
cheaper-inference:release/v3.8.49from
RaviTharuma:fix/8280-provider-route-policy
Jul 24, 2026
Merged

diegosouzapw merged 1 commit into
cheaper-inference:release/v3.8.49from
RaviTharuma:fix/8280-provider-route-policy

Conversation

@RaviTharuma

Copy link
Copy Markdown
Contributor

Summary

  • declare the primary kimi route as requiring upstream streaming
  • route primary Kimi requests through KimiExecutor and align the outbound body with the internally forced stream mode
  • preserve stream:false client semantics so OmniRoute buffers upstream SSE into an OpenAI-compatible JSON response
  • add regression coverage for capability metadata, executor selection, outbound stream shaping, and non-stream preservation

Verification

  • npm run typecheck:core
  • node --import tsx/esm --test tests/unit/executor-kimi.test.ts
  • npx eslint open-sse/config/providers/registry/kimi/index.ts open-sse/executors/index.ts open-sse/executors/kimi.ts tests/unit/executor-kimi.test.ts
  • verified branch is exactly one commit ahead of latest origin/release/v3.8.49 and changes only four Kimi-focused files

Closes #8280

🤖 Generated with Claude Code

@RaviTharuma

Copy link
Copy Markdown
Contributor Author

CI note: the current failure set exactly matches recently merged focused PRs #8292/#8296 (Docs Gates, Fast Quality Gates, Vitest, and all four unit shards), indicating repository baseline failures rather than this focused diff. Targeted tests and ESLint for changed files pass as documented in the PR body.

Co-Authored-By: Claude <noreply@anthropic.com>
@RaviTharuma
RaviTharuma force-pushed the fix/8280-provider-route-policy branch from d094583 to 47e4efc Compare July 23, 2026 18:16
@RaviTharuma

Copy link
Copy Markdown
Contributor Author

Rebased the focused Kimi patch onto the current release/v3.8.49 tip c525a0f and safely force-pushed the branch.

  • old head: d0945833d
  • new head: 47e4efc63
  • git range-diff reports the patch as unchanged (=)
  • PR is MERGEABLE against the current base

Fresh focused verification on the rebased head:

  • node --import tsx/esm --test tests/unit/executor-kimi.test.ts — 10/10 pass
  • npm run typecheck:core — pass
  • npx eslint open-sse/config/providers/registry/kimi/index.ts open-sse/executors/kimi.ts open-sse/executors/moonshot.ts tests/unit/executor-kimi.test.ts — pass
  • git diff --check origin/release/v3.8.49...HEAD — pass

The broad failing check set remains the repository baseline already observed on merged #8292/#8296 (Docs Gates, Fast Quality Gates, Vitest, and all four unit shards); no unrelated baseline code was changed.

@diegosouzapw
diegosouzapw merged commit 1684adc into cheaper-inference:release/v3.8.49 Jul 24, 2026
5 checks passed
@diegosouzapw

Copy link
Copy Markdown
Collaborator

Merged into release/v3.8.49 — thanks @RaviTharuma! Validated via local merge-train (32-core .113) + a per-file discriminator confirming zero regressions vs the pure release tip; CI reds on this PR were pre-existing base-red drift (tracked separately). 🙏

@diegosouzapw diegosouzapw mentioned this pull request Jul 28, 2026
HouMinXi pushed a commit to HouMinXi/OmniRoute that referenced this pull request Aug 2, 2026
…erence#8302)

Co-authored-by: Ravi Tharuma <RaviTharuma@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
@RaviTharuma
RaviTharuma deleted the fix/8280-provider-route-policy branch September 23, 2026 19:38
muhamadgalihsaputra pushed a commit to niyatna/NiyatnaRoute that referenced this pull request Sep 27, 2026
…erence#8302)

Co-authored-by: Ravi Tharuma <RaviTharuma@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(providers): replace external CPA/Kimi route-policy rewrites with native health and capabilities

2 participants