feat(completions): add Completion API streaming support to gRPC router - #978

Merged

slin1237 merged 11 commits into

mainfrom

Apr 1, 2026

Commits on Mar 31, 2026

feat(completions): add Completion API streaming support to gRPC router

vschandramourya
authored and
slin1237
committed
39bb602
fix(completions): emit suffix before stop chunk and propagate send errors in streaming
vschandramourya
committed
a0cd339
fix(completions): remove misleading array prompt echo in streaming
vschandramourya
committed
e3ff1d5
Merge branch 'main' into mourya/cmp-5
vschandramourya
authored
6b24900
fix(completions): add stream_options.include_usage support, perf and docs fixes
vschandramourya
committed
bc92aab
fix(completions): address remaining Claude review nits in streaming
vschandramourya
committed
787ae04
Merge branch 'main' into mourya/cmp-5
vschandramourya
authored
6bbb8d3
fix(completions): address remaining Claude review nits in streaming
vschandramourya
committed
a66f514
fix(completions): address Claude nits — HashSet, avoid clones, narrow visibility
vschandramourya
committed
48415f9

Commits on Apr 1, 2026