[OPTIMIZATION] Optimizes the single_query_cached_kv_attention kernel#420

zhuohan123 merged 3 commits intovllm-project:mainvllm-project/vllm:mainfrom

naed90:optimization/single_query_cached_kv_attention_kernelnaed90/vllm-fast:optimization/single_query_cached_kv_attention_kernelCopy head branch name to clipboard