[MoE][Offload] Run MoE models exceeding VRAM via expert CPU offloading with GPU cache (--moe-expert-cache-size)#37190

e1n00r wants to merge 3 commits intovllm-project:mainvllm-project/vllm:mainfrom

e1n00r:feature/moe-expert-lru-cachee1n00r/vllm:feature/moe-expert-lru-cacheCopy head branch name to clipboard