fix: remove forced context compression for volces.com#5364
fix: remove forced context compression for volces.com#5364chrarnoldus merged 4 commits intoKilo-Org:mainfrom
Conversation
🦋 Changeset detectedLatest commit: b9dac5f The changes in this PR will be included in the next version bump. This PR includes changesets to release 1 package
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
Code Review SummaryStatus: No Issues Found | Recommendation: Merge OverviewThis PR removes special-case handling for The changes are minimal and well-documented with Files Reviewed (2 files)
Minor ObservationThe changeset description mentions "context compression" but the actual code change is about message format conversion (legacy format vs OpenAI format). This is a minor documentation detail and doesn't affect functionality. |
Context
This PR removes the forced context compression logic for
volces.com(Ark) endpoints.Previously, requests to
volces.comwere automatically converted to a simplified text format usingconvertToSimpleMessages. This was likely a workaround for older limitations. However,volces.comnow fully supports multi-turn tool calling. The forced compression strips away structured information (like tool calls and results), causing the model to hallucinate or fail to understand previous tool interactions.Implementation
arkvariable which detectedvolces.comin the model URL insrc/api/providers/openai.ts.ark ||from the logic that triggersconvertToSimpleMessages.volces.comendpoints will use the standard OpenAI message format (includingconvertToOpenAiMessages) unlessenabledLegacyFormatis explicitly enabled by the user.Screenshots
How to Test
volces.comBase URL.Get in Touch