Use Mistral SDK in MistralHandler.streamFim#5660
Conversation
|
Reviews #1-22 covering PRs across tiers 1-3. Includes review.md (machine-parseable), journal.md (human narrative), and status.json for each PR. Combined integration test: PRs Kilo-Org#5370 + Kilo-Org#5660 + Kilo-Org#5704 merged and tested together — 7,932 tests passed, 4 pre-existing failures (mistral-fim mocks). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Tests now mock this.client.fim.stream() (Mistral SDK) instead of global.fetch + streamSse, matching the PR Kilo-Org#5660 refactor. - yields chunks correctly: mocks SDK async iterable - handles errors correctly: mocks SDK rejection + TelemetryService - uses correct endpoint: verifies Mistral constructor args - uses custom codestral URL: verifies constructor with custom URL All 8 tests pass (4 fimSupport + 4 streamFim).
Integration test: PRs Kilo-Org#5370 + Kilo-Org#5660 + Kilo-Org#5704 merged together
|
Hi! Recently we made the decision to start working hard on a ground-up rebuild of this extension using the new Kilo CLI as the backend. Because of this we made the decision to start temporarily limiting the size and type of features we're still accepting into the current extension. If you think this functionality is still important could please add a feature request or submit a PR to the new repository? Regardless, we really appreciate the effort you made. Please reach out to me on Discord (Kevin) with the email address you used to sign up for Kilo so I can grant you some credits! |
2 participants
Context
While debugging
401 Unauthorizederror during autocompletion (see #5658), I've also analyzedMistralHandler.streamFimfunction.It surprised me that it is implemented manually instead of using functions from Mistral SDK (which is used in the rest of
MistralHandlerclass).As I suspected that the
401 Unauthorizederror results from wrong implementation ofstreamFim, I've rewritten it to use Mistral SDK.Now we know that the bug was somewhere else, but I think it is still valuable to merge the refactor I've done.
Implementation
Use Mistral SDK for FIM streaming instead of manual implementation.
Screenshots
How to Test
Get in Touch
My Discord handle is
wkordalski