Skip to content

[Spec Decode] Add kv_cache_dtype to speculative_config to control separately from target - #48787

Merged
mgoin merged 3 commits into
vllm-project:mainfrom
neuralmagic:drafter-kv-cache-dtype
Jul 16, 2026
Merged

[Spec Decode] Add kv_cache_dtype to speculative_config to control separately from target#48787
mgoin merged 3 commits into
vllm-project:mainfrom
neuralmagic:drafter-kv-cache-dtype

Wire spec kv-cache-dtype into MRV2 AR path; normalize dotted CLI keys

9fdf4ba
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Jul 16, 2026 in 0s

There is no internal Diff connected, this can be merged now

View more details on Meta CodeSync