Skip to content

[Bugfix] Stream Llama4 weight loading to avoid host-OOM with copy-returning loaders#44645

Open
noa-neria wants to merge 3 commits into
vllm-project:mainfrom
noa-neria:runai-streamer
Open

[Bugfix] Stream Llama4 weight loading to avoid host-OOM with copy-returning loaders#44645
noa-neria wants to merge 3 commits into
vllm-project:mainfrom
noa-neria:runai-streamer

Commits

Commits on Jun 11, 2026