kv: nvfp4_ds_mla — 4-bit NVFP4 KV cache for B12X sparse MLA (SM120) - #82

kv: nvfp4_ds_mla — 4-bit NVFP4 KV cache for B12X sparse MLA (SM120)#82

lukealonso merged 2 commits into

local-inference-lab:dev/eldritch-enlightenmentlocal-inference-lab/vllm:dev/eldritch-enlightenmentfrom

davidsyoung:nvfp4-ds-mla-kvdavidsyoung/vllm:nvfp4-ds-mla-kvCopy head branch name to clipboard