Bs invar moe - #4871

Merged

wdykas merged 17 commits into

NVIDIA:mainfrom

wdykas:bs-invar-moe

Jul 31, 2026

Commits on Jul 22, 2026

Add batch-invariant MoE and Mamba inference
wdykas
committed
923e33d

Commits on Jul 23, 2026

Preserve FP32 Mamba state across decode chunks

root
authored and
root
committed
11c78df
Clarify batch-invariant decoder accessor

root
authored and
root
committed
79df664

Commits on Jul 28, 2026

Merge main and finalize batch-invariant RL path

root
authored and
root
committed
f8799b3
Fix batch-invariant RL verification issues

root
authored and
root
committed
3892c39
Finalize exact batch-invariant Mamba and MoE execution

root
authored and
root
committed
5285806
Drop batch-invariant Mamba prefix caching

root
authored and
root
committed
44533ee
Isolate batch-invariant inference kernels

root
authored and
root
committed
365547f
Merge main into bs-invar-moe

root
authored and
root
committed
7f7ca48

Commits on Jul 29, 2026

Merge remote-tracking branch 'autoformatter-remote/main' into bs-invar-moe

root
authored and
root
committed
4489148
Adapt Mamba BIK tests to raw-state scan API

root
authored and
root
committed
75230ec
lint

root
authored and
root
committed
356eaea

Commits on Jul 30, 2026

Update lockfile for batch-invariant dependencies

root
authored and
root
committed
0ed0d9a
Fix batch-invariant test formatting

root
authored and
root
committed
7aee3eb
Fix hybrid MoE batch-invariant test config

root
authored and
root
committed
8e5e1f5
Fix hybrid MoE FlashAttention test setup

root
authored and
root
committed
1a48fcb

Commits on Jul 31, 2026

Skip BIK attention test without FA3 or FA4

root
authored and
root
committed
641d239