Skip to content

[Fix] mamba: Retry queued prefills when cache capacity may have recovered - #37612

Open
ormandj wants to merge 3 commits into
sgl-project:mainfrom
ormandj:pr/hybrid-ssm-admission-latch
Open

[Fix] mamba: Retry queued prefills when cache capacity may have recovered#37612
ormandj wants to merge 3 commits into
sgl-project:mainfrom
ormandj:pr/hybrid-ssm-admission-latch

Keep requests queued when a Mamba state copy cannot be allocated

2dd9bc5
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
update-pr-body
succeeded Oct 10, 2026 in 7s