feat: Priority-based scheduling optimization (including default priority, preemption toggle, priority-based metrics, etc.)#17026

Merged

hnyls2002 merged 51 commits into

sgl-project:mainfrom

zhuxinjie-nz:priority_metrics_dev

Mar 4, 2026

Commits on Jan 13, 2026

feat: Add metrics based on priority-based scheduling.
nanzhi.zxj
committed
[fix] Incorrect parameter naming
nanzhi.zxj
committed

Commits on Jan 15, 2026

Commits on Jan 20, 2026

Merge branch 'main' into priority_metrics_dev
huangtingwei9988
authored

Commits on Jan 22, 2026

[fix] Logic issue in the num_running_reqs_by_priority tracking record.
nanzhi.zxj
committed
Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed

Commits on Jan 26, 2026

Merge branch 'main' into priority_metrics_dev
huangtingwei9988
authored

Commits on Feb 4, 2026

[fix] Optimize priority scheduling logic.
nanzhi.zxj
committed
Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed
[fix] Optimize priority scheduling logic.
nanzhi.zxj
committed

Commits on Feb 8, 2026

[fix] Code formatting issues
nanzhi.zxj
committed
Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed

Commits on Feb 11, 2026

Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed

Commits on Feb 12, 2026

Commits on Feb 21, 2026

Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed

Commits on Feb 22, 2026

[fix] Optimize the logic of the log_prefill_stats interface
nanzhi.zxj
committed
Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed

Commits on Feb 23, 2026

Commits on Feb 24, 2026

[PD-Disagg] Support query dp rank from bootstrap server. (#19168)

authored and
nanzhi.zxj
committed
[CI] fix the teardown output of disaggregation test (#19193)

authored and
nanzhi.zxj
committed
add new ci user (#19133)

narutolhy
authored and
nanzhi.zxj
committed
[CI] Tiny enhance the dp attention load blance benchmark (#19194)

hnyls2002
authored and
nanzhi.zxj
committed
[PD-Disagg] Unify prefill info data transition flow, all with `PrefillServerInfo` (#19195)

hnyls2002
authored and
nanzhi.zxj
committed
fix: patch docker image fixes (#19100)

dougyster
authored and
nanzhi.zxj
committed
Whisper model support & `/v1/audio/transcriptions` endpoint & benchmark (#16983)

authored and
nanzhi.zxj
committed
fix: add missing blank line after docstring in serving_transcription.py (#19206)

authored and
nanzhi.zxj
committed
[PD-Disagg] Deduplicate common KVManager methods into CommonKVManager (#19205)

authored and
nanzhi.zxj
committed
fix(docker): migrate ROCm Dockerfiles from setuptools-rust to maturin (#19210)

slin1237
authored and
nanzhi.zxj
committed
Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed
Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed
[fix] Optimize the preempt logic
nanzhi.zxj
committed
[fix] Optimize the preemption logic
nanzhi.zxj
committed

Commits on Feb 25, 2026

Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed
Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed

Commits on Mar 1, 2026

Merge remote-tracking branch 'origin/main' into priority_metrics_dev
nanzhi.zxj
committed

Commits on Mar 4, 2026