Skip to content

fix(inference): use vLLM runtime max_model_len for context window - #4689

Merged
cv merged 2 commits into
mainfrom
fix/vllm-runtime-context-window
Jun 3, 2026
Merged

fix(inference): use vLLM runtime max_model_len for context window#4689
cv merged 2 commits into
mainfrom
fix/vllm-runtime-context-window