Skip to content

server: add SSE ping interval#24013

Merged
ngxson merged 1 commit into
ggml-org:masterfrom
ngxson:xsn/server_sse_ping
Jun 2, 2026
Merged

server: add SSE ping interval#24013
ngxson merged 1 commit into
ggml-org:masterfrom
ngxson:xsn/server_sse_ping

Conversation

@ngxson
Copy link
Copy Markdown
Contributor

@ngxson ngxson commented Jun 2, 2026

Overview

Supersede #23994

Refer to my investigation earendil-works/pi#5089 (comment) for more info

Add SSE ping (otherwise known as keepalive or comment)

Tested with:

Also remove the client-side message from #23842 , because this will (hopefully) make most clients happy now.

Requirements

@ngxson ngxson requested review from a team as code owners June 2, 2026 08:29
Copy link
Copy Markdown
Contributor

@aldehir aldehir left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems to work!

:

:

:

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"role":"assistant","content":null}}],"created":1780390177,"id":"chatcmpl-uI7JNfldkYifvjYLehw5OnRid3v0JxBC","model":"Qwen3.6-27B-Q4_0.gguf","system_fingerprint":"b9465-23e6dab86","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"Here"}}],"created":1780390177,"id":"chatcmpl-uI7JNfldkYifvjYLehw5OnRid3v0JxBC","model":"Qwen3.6-27B-Q4_0.gguf","system_fingerprint":"b9465-23e6dab86","object":"chat.completion.chunk"}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants