fix(sglang): use incremental streaming output for completions#7752

Merged

ishandhanani merged 5 commits intoai-dynamo:mainfrom

weireweire:fix/sglang-incremental-completions-usage

Apr 6, 2026

Commits on Apr 3, 2026

fix(sglang): compat old and new streaming field
Weiliangl User
committed
fix(llm): preserve completion token details
Weiliangl User
committed
fix(llm): restore backend completion token usage
Weiliangl User
committed
fix(llm): keep aggregated completion token usage
Weiliangl User
committed
style(sglang): sort args imports
Weiliangl User
committed