Skip to content

Commit dc5bd7c

Browse files
committed
fix conflict
Signed-off-by: fsx950223 <[email protected]>
1 parent ee7fa4a commit dc5bd7c

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/v1/attention/backends/rocm_aiter_fa.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -591,7 +591,8 @@ def forward(
591591
alibi_slopes=self.alibi_slopes,
592592
window_size=self.sliding_window,
593593
block_table=block_table,
594-
cu_seqlens_k=cu_seq_lens,
594+
cu_seqlens_k=(cu_seq_lens if not use_local_attn else
595+
local_metadata.local_cu_seq_lens),
595596
k_scale=layer._k_scale,
596597
v_scale=layer._v_scale,
597598
)

0 commit comments

Comments
 (0)