Skip to content

[Feature][Model][Kernel] Inkling: fp8 e4m3 KV cache with per-tensor scales on SM100 - #54705

Draft
drkm-eng wants to merge 5 commits into
vllm-project:mainfrom
drkm-hq:drkm/inkling-fp8-kv-main
Draft

drkm-eng wants to merge 5 commits into
vllm-project:mainfrom
drkm-hq:drkm/inkling-fp8-kv-main

Commits

  1. Commits on Sep 7, 2026

  2. Commits on Sep 17, 2026

  3. Commits on Oct 9, 2026

  4. Commits on Oct 11, 2026