[Attention] Support distinguishing between short extends and decodes#37303

LucasWilkinson merged 4 commits intovllm-project:mainvllm-project/vllm:mainfrom

neuralmagic:nemotron-h-mtp-4way-batch-splitneuralmagic/vllm:nemotron-h-mtp-4way-batch-splitCopy head branch name to clipboard