Skip to content

[Spec Decode] Add kv_cache_dtype to speculative_config to control separately from target - #48787

Merged
mgoin merged 3 commits into
vllm-project:mainfrom
neuralmagic:drafter-kv-cache-dtype
Jul 16, 2026
Merged

[Spec Decode] Add kv_cache_dtype to speculative_config to control separately from target#48787
mgoin merged 3 commits into
vllm-project:mainfrom
neuralmagic:drafter-kv-cache-dtype

Wire spec kv-cache-dtype into MRV2 AR path; normalize dotted CLI keys

9fdf4ba
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar