Skip to content

Commit 6514f00

Browse files
fix
1 parent a379256 commit 6514f00

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

fastdeploy/engine/common_engine.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -882,8 +882,8 @@ def _zmq_send_generated_tokens(self):
882882
content.outputs.token_ids = token_ids
883883
content.outputs.text = delta_text
884884
new_contents.append(content)
885-
# if content.finished:
886-
# new_contents.append(content)
885+
elif content.finished:
886+
new_contents.append(content)
887887
else:
888888
llm_logger.warning(
889889
f"current tokens need to accumulate, req_id: {request_id} {content.outputs.token_ids}"

0 commit comments

Comments
 (0)