feat(load-reporter): add push-based engine load reporting - #32523

Open

Bakerjc-bgner wants to merge 52 commits into

sgl-project:mainfrom

Bakerjc-bgner:feature/load-reporter

Commits on Jul 30, 2026

feat(load-reporter): define protocol and configuration
Bakerjc-bgner
committed
db98464
feat(load-reporter): validate and build load snapshots
Bakerjc-bgner
committed
6959d2e
feat(load-reporter): sample rank-aware engine loads
Bakerjc-bgner
committed
5609e20
feat(load-reporter): manage resilient report streams
Bakerjc-bgner
committed
e193267
feat(load-reporter): orchestrate reporter lifecycle
Bakerjc-bgner
committed
ee8af54
feat(load-reporter): add tokenizer IPC contracts
Bakerjc-bgner
committed
4b89f63
feat(load-reporter): proxy control and refresh events
Bakerjc-bgner
committed
f5de56b
feat(load-reporter): integrate tokenizer processes
Bakerjc-bgner
committed
df41a9e
test(load-reporter): cover reporting and IPC lifecycle
Bakerjc-bgner
committed
f8b8123
test(load-reporter): cover multi-worker ownership
Bakerjc-bgner
committed
b63a922
docs(load-reporter): document architecture and lifecycle
Bakerjc-bgner
committed
1dad6ec

Commits on Jul 31, 2026

Merge branch 'main' into feature/load-reporter
Bakerjc-bgner
authored
970e027

Commits on Aug 6, 2026

feat(load-reporter): inbound Router bidi load reporting for all serving modes

SSunsh1ne
and
claude
committed
2738c95
test(load-reporter): cover bidi service, sessions, and serving modes

SSunsh1ne
and
claude
committed
45ec399
docs(load-reporter): rewrite README for router-dials-in architecture

SSunsh1ne
and
claude
committed
844a691
refactor: revert diffs
Bakerjc-bgner
committed
5641bed
refactor(load-reporter): rename files and simplify comments

SSunsh1ne
and
claude
committed
8ba9ebd

Commits on Aug 7, 2026

Commits on Aug 10, 2026

ci: pin smg-grpc-servicer==0.8.0 for standalone SMG reporter test
Bakerjc-bgner
committed
41df383

Commits on Aug 11, 2026

Merge branch 'main' into feature/load-reporter
Bakerjc-bgner
committed
06268dd
Merge branch 'main' into feature/load-reporter
whybeyoung
authored
143f3b5

Commits on Aug 12, 2026

refactor(load-reporter): remove artificial 50ms coalesce delay in multi-tokenizer notifier

SSunsh1ne
and
claude
committed
4c173e1

Commits on Aug 13, 2026

test(load-reporter): cover the fire loop, validation, and reporter contracts

SSunsh1ne
and
claude
committed
8b51d72
feat(load-reporter): broadcast shared pulls from one fire loop

SSunsh1ne
and
claude
committed
ae39a4c
docs(load-reporter): describe the fire-loop push channel and schedule

SSunsh1ne
and
claude
committed
2090b7b

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Merge branch 'main' into feature/load-reporter
hzh0425
authored
c8c4eaa
fix(load-reporter): read resolved dp size
SSunsh1ne
committed
f9da5a4
test(load-reporter): skip incompatible optional SMG
SSunsh1ne
committed
2712329

Commits on Aug 23, 2026

Merge branch 'main' into feature/load-reporter
Bakerjc-bgner
authored
7d9ef40
test(load-reporter): remove obsolete standalone request E2E
Bakerjc-bgner
committed
7a57ce2
chore(load-reporter): merge upstream main
SSunsh1ne
committed
4d8c4c1

Commits on Aug 25, 2026

Merge remote-tracking branch 'upstream/main' into feature/load-reporter
SSunsh1ne
committed
fe9bd15

Commits on Aug 26, 2026

chore(load-reporter): merge upstream main
SSunsh1ne
committed
2377fc4

Commits on Sep 5, 2026

docs: document AIgate SGLang error normalization implementation
SSunsh1ne
committed
ed12aa6

Commits on Sep 6, 2026

docs: move AIgate error mapping implementation to AIgate
SSunsh1ne
committed
c219487

Commits on Sep 10, 2026