Skip to content

[Spec Decode] Judge draft KV groups with the draft model's config (vllm-project/vllm#62964) - #1

Open
seyfal wants to merge 4 commits into
eagle/v0.1.5from
v015/1-draft-kv-groups
Open

[Spec Decode] Judge draft KV groups with the draft model's config (vllm-project/vllm#62964)#1
seyfal wants to merge 4 commits into
eagle/v0.1.5from
v015/1-draft-kv-groups

[Bugfix][Spec Decode] Tag EAGLE KV groups before the V1 profiling pass

72eb0ca
Select commit
Loading
Failed to load commit list.

There are no checks for this commit