llama : use n_embd_head_v instead of n_embd_head_k when reshaping kqv#7327

Merged

ggerganov merged 2 commits intoggml-org:masterfrom

fairydreaming:llm_build_kqv_fix

May 17, 2024

Commits on May 16, 2024

llama : use n_embd_head_v instead of n_embd_head_k when reshaping kqv
sszymczy
committed

Commits on May 17, 2024

llama : use n_embd_v_gqa and n_embd_head_v instead of n_embd_k_gqa and n_embd_head_k when making a view of cached value vectors.
sszymczy
committed