Reduce memory usage for granite_speech.#42933

DarkLight1337 merged 7 commits into

vllm-project:mainvllm-project/vllm:mainfrom

Yihuki:patch-1Yihuki/vllm:patch-1Copy head branch name to clipboard