[Core] Add Ring Attention Primitives for Context Parallelism#39875

knitcapcat-amd wants to merge 2 commits intovllm-project:mainvllm-project/vllm:mainfrom

knitcapcat-amd:ring-attnknitcapcat-amd/vllm-dev:ring-attnCopy head branch name to clipboard