Skip to content

Commit ccbfb6e

Browse files
committed
fix
1 parent fd4d6b4 commit ccbfb6e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/python/run_llama_batched_vllm.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -277,7 +277,7 @@ def _prepare_eval_queries(
277277
if sliding_window:
278278
seq_lens.append(min(num_past_tokens + num_queries, sliding_window))
279279
num_past = min(num_past_tokens, sliding_window)
280-
past_slot_mapping += all_slot_mappings[request_id][num_past:]
280+
past_slot_mapping += all_slot_mappings[request_id][:num_past]
281281
slot_mapping += all_slot_mappings[request_id][num_past: num_past + num_queries]
282282
else:
283283
seq_lens.append(num_past_tokens + num_queries)

0 commit comments

Comments
 (0)