Skip to content

[Bugfix] Fix MoE model load OOM in FlashInfer_TRTLLM backend with sleep mode - #45589

Merged
ywang96 merged 2 commits into
vllm-project:mainfrom
andakai:fix/moe-load-oom
Jun 17, 2026
Merged

[Bugfix] Fix MoE model load OOM in FlashInfer_TRTLLM backend with sleep mode#45589
ywang96 merged 2 commits into
vllm-project:mainfrom
andakai:fix/moe-load-oom

Merge branch 'main' into fix/moe-load-oom

3f97198
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jun 17, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO