Skip to content

fix(mla): support BF16 and FP8 DeepSeek V4 dual-cache prefill - #301

Merged
lukealonso merged 9 commits into
local-inference-lab:masterfrom
notoken:fix/dsv4-fp8-dual-cache-prefill
Sep 7, 2026
Merged

fix(mla): support BF16 and FP8 DeepSeek V4 dual-cache prefill#301
lukealonso merged 9 commits into
local-inference-lab:masterfrom
notoken:fix/dsv4-fp8-dual-cache-prefill

test(mla): qualify BF16 windows alongside FP8 dual-cache prefill

914927c
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs