Skip to content

[Fix] kv_cache: Drop fp8 scales when using nvfp4 KV cache - #42419

Open
devtyagi3909 wants to merge 2 commits into
sgl-project:mainfrom
devtyagi3909:fix-nvfp4-kv-scale
Open

devtyagi3909 wants to merge 2 commits into
sgl-project:mainfrom
devtyagi3909:fix-nvfp4-kv-scale

fix(kv_cache): resolve auto kv_cache_dtype to fp8 pool on compressed-…

6e1a8d7
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
Check PR title
succeeded Oct 21, 2026 in 3s