upstream backports: hicache/SWA picks + #35017 + ports of open PRs #33988/#22615 (reorg 1/9) - #1

Open

mike-char wants to merge 12 commits into

cai-base-v0.5.17from

cai-pr1-upstream-backports

Commits on Aug 26, 2026

fix(gemma4): load vision tower unquantized under compressed-tensors

mike-char
and
claude
committed
212b2a3
fix(triton): dequantize shared-layer KV pulled from a quantized cache

mike-char
and
claude
committed
e036402
[Unified Radix Cache] Complete the tree-core interface boundary (#33580)

Jialin
authored and
mike-char
committed
3b7d2b8
[HiCache] write_back: reclaim duplicated host copy first under host pressure (#33777)

xiezhq-hermann
authored and
mike-char
committed
0789a8b
Retain SWA down to the last state checkpoint (#34729)

ispobock
authored and
mike-char
committed
55eaf83
Skip oow slot freeing under eagle (#34823)

ispobock
authored and
mike-char
committed
81d9020
Fix swa eviction frontier for bigram keys (#34870)

ispobock
authored and
mike-char
committed
2cde519
[HiCache] Optimize LogicalHostPool free-list release (#33998)

wangwenmingaa
authored and
mike-char
committed
0e51034
Observability enhancement for HiCache (#32388)

xiezhq-hermann
authored and
mike-char
committed
fabf7c2
[Fix] Snapshot `req.prefix_indices` when the prefix cache is disabled (#34644)

hnyls2002
authored and
mike-char
committed
70f3127
Add bit-exact unified radix cache KL test for hybrid SWA + mamba (#34607)

ispobock
authored and
mike-char
committed
7d42fa1
[Scheduler] Add configurable decode interval after prefill (#35017)

nvpohanh
authored and
mike-char
committed
1b131d1