[EXL3] Route prefill batches through the planned Trellis MoE (+58-64% prefill, stacked on #139) - #163

Closed

davidsyoung wants to merge 17 commits into

local-inference-lab:dev/gilded-gnosisfrom

davidsyoung:exl3-prefill-trellis-plan

Commits on Jul 21, 2026

[Quant] EXL3 (exllamav3 trellis) quantization backend

authored and
Brandon Music
committed
90bb4a4
exl3: select the b12x fused trellis kernel as the primary compute path

Brandon Music
and
claude
committed
893191a
exl3: collapse leading wrapper segments in storage-entry lookup

Brandon Music
and
claude
committed
a41d8dd
exl3: resolve the shimmed extension before importing b12x

Brandon Music
and
claude
committed
71534d7
exl3: detect MoE prefixes via the layer's checkpoint projection names

Brandon Music
and
claude
committed
6ac372c
exl3: serve rank-sliced Trellis experts with Sparkinfer
brandonmmusic-max
committed
6b8466d
build: allow skipping unavailable FlashInfer JIT cache
Brandon Music
committed
e4c92b6

Commits on Jul 22, 2026

exl3: avoid redundant routed-output copies
Brandon Music
committed
d41fa76
exl3: normalize rank-sliced DeepSeek weights
Brandon Music
committed
60c82d9
fix(pcie): isolate target and draft graph channels

voipmonitor
authored and
Brandon Music
committed
fdc2a33
fix(mtp): preserve DCP draft cache correctness
Brandon Music
committed
207973e
fix(workspace): isolate speculative execution buffers

voipmonitor
authored and
Brandon Music
committed
1043999
spec+structured-output: fix reasoning-boundary grammar + GLM-5.2 DSA MTP crash

brandonmmusic-max
and
claude
committed
424f224
style: ruff-format structured_output (pre-commit ruff 0.14.0)

brandonmmusic-max
and
claude
committed
aa870cb
docs: Google-style Args/Raises for use_workspace_lane

brandonmmusic-max
and
claude
committed
2fdc6d3
[EXL3] Route prefill batches through the planned Trellis MoE
David Young
committed
d57d775
[EXL3] Add CPU contract tests for the dual-plan prefill dispatch
David Young
committed
f80a56d