Skip to content

[II] feat(kvarn): reconcile KVarN MLA physical cache ownership across scheduler and spec-decode - #426

Open
JMPSequeira wants to merge 5 commits into
local-inference-lab:dev/infernal-invocationfrom
JMPSequeira:pr-ii/kvarn-mla-ownership
Open

[II] feat(kvarn): reconcile KVarN MLA physical cache ownership across scheduler and spec-decode#426
JMPSequeira wants to merge 5 commits into
local-inference-lab:dev/infernal-invocationfrom
JMPSequeira:pr-ii/kvarn-mla-ownership

fix(kvarn): keep the shared FP8 staging view out of the CKV prefetch …

e82e464
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs