[Performance] Change the shape of kv_cache to avoid view of k_cache and v_cache.#204

wangxiyuan merged 1 commit into

vllm-project:mainvllm-project/vllm-ascend:mainfrom

whx-sjtu:change_kv_cache_shapewhx-sjtu/vllm-ascend:change_kv_cache_shapeCopy head branch name to clipboard