[Feat]add cpu-offload/layerwise-offload for stable-audio-open & fix output inconsistency with same seed#2909

Merged

linyueqian merged 19 commits into

vllm-project:mainfrom

sphinxkkkbc:feature/add-cpu-offloading

May 5, 2026

Commits on Apr 19, 2026

add cpu-offload/layerwise-offload for stable-audio-open
sphinxkkkbc
committed

Commits on Apr 25, 2026

Merge upstream/main into feature/add-cpu-offloading
sphinxkkkbc
committed
fix output mismatch with same seed
sphinxkkkbc
committed

Commits on May 3, 2026

add e2e test
sphinxkkkbc
committed

Commits on May 4, 2026

fix e2e offline inference tests for cpu/layerwise offload
sphinxkkkbc
committed
fix pre-commit
sphinxkkkbc
committed
add device_type for memory move
sphinxkkkbc
committed
fix pre-commit
sphinxkkkbc
committed
Merge branch 'main' into feature/add-cpu-offloading
sphinxkkkbc
authored

Commits on May 5, 2026

fix param and weight shape mismatch
sphinxkkkbc
committed
fix pre-commit
sphinxkkkbc
committed
Merge branch 'main' into feature/add-cpu-offloading
sphinxkkkbc
authored
add schedulerwrapper for numeric overflow in dummy run and normal inference
sphinxkkkbc
committed
Merge branch 'feature/add-cpu-offloading' of github.com:sphinxkkkbc/vllm-omni into feature/add-cpu-offloading
sphinxkkkbc
committed
pre-commit
sphinxkkkbc
committed
add/change offload threshold
sphinxkkkbc
committed
change monitor start after runner init
sphinxkkkbc
committed
reset change and set amd cpu offload threshold to none
sphinxkkkbc
committed
Merge branch 'main' into feature/add-cpu-offloading
sphinxkkkbc
authored