Skip to content

[None][fix] Fix compute token accounting for KV cache reuse with context chunking - #12682

Merged
lancelly merged 2 commits into
NVIDIA:feat/bench_yfrom
lancelly:reuse-budget-fix-on-feat-bench-y
Apr 2, 2026
Merged

[None][fix] Fix compute token accounting for KV cache reuse with context chunking#12682
lancelly merged 2 commits into
NVIDIA:feat/bench_yfrom
lancelly:reuse-budget-fix-on-feat-bench-y

fix pre-commit

d8a32c5
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Apr 2, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO