Skip to content

Commit 3e3f63e

Browse files
authored
fix(request): make sure to extend full_response (#536)
Signed-off-by: Max Wittig <[email protected]>
1 parent 32319c3 commit 3e3f63e

File tree

1 file changed

+3
-3
lines changed
  • src/vllm_router/services/request_service

1 file changed

+3
-3
lines changed

src/vllm_router/services/request_service/request.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -124,9 +124,9 @@ async def process_request(
124124
request.app.state.request_stats_monitor.on_request_response(
125125
backend_url, request_id, time.time()
126126
)
127-
# For non-streaming requests, collect the full response
128-
if full_response is not None:
129-
full_response.extend(chunk)
127+
# For non-streaming requests, collect the full response
128+
if full_response is not None:
129+
full_response.extend(chunk)
130130
yield chunk
131131

132132
request.app.state.request_stats_monitor.on_request_complete(

0 commit comments

Comments
 (0)