[Model][Perf] Fuse Beam's TP all-reduce with its sandwich norms and MoE finalize - #62366

[Model][Perf] Fuse Beam's TP all-reduce with its sandwich norms and MoE finalize#62366

WoosukKwon merged 6 commits into

mainvllm-project/vllm:mainfrom

woosuk/beam-fused-allreducevllm-project/vllm:woosuk/beam-fused-allreduceCopy head branch name to clipboard