Add structured comment explaining the three runtime_max_tokens_per_ra…

4120149

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Mintlify

Mintlify Deployment

Auto Label PRs on: pull_request_target 1

label

PR States on: pull_request_target

update-pr-body

PR Test (sgl-router) on: pull_request 1

gate

tier-1 — lint

tier-2 — build + test

tier-3 — docker (placeholder)

tier-3 — k8s integration

tier-3 — e2e

finish

Lint on: pull_request 2

lint

PR Test (NPU) on: pull_request 16

check-changes

set-image-config

pr-gate / pr-gate

stage-b-test-1-npu-a2 (0)

stage-b-test-1-npu-a2 (1)

stage-b-test-2-npu-a2 (0)

stage-b-test-2-npu-a2 (1)

stage-b-test-4-npu-a3

stage-b-test-16-npu-a3

multimodal-gen-test-1-npu-a3

multimodal-gen-test-2-npu-a3

pr-test-npu-finish

PR Test (MUSA) on: pull_request 1

check-changes

pr-gate / pr-gate

multimodal-gen-test-1-gpu-musa

multimodal-gen-test-2-gpu-musa

multimodal-gen-layer-unit-test-musa

sgl-kernel-unit-test-musa

pr-test-musa-finish

PR Test Extra (AMD) on: pull_request 2

call-gate / pr-gate

extra-a-test-1-gpu-small-amd${{ ((inputs.rocm_version && format('-{0}', inputs.rocm_version)) || '') }} (linux-${{ (inputs.runner_arch || 'mi325') }}-1gpu-sglang)

extra-a-test-1-gpu-large-amd${{ ((inputs.rocm_version && format('-{0}', inputs.rocm_version)) || '') }} (linux-${{ (inputs.runner_arch || 'mi325') }}-1gpu-sglang)

extra-a-test-2-gpu-large-amd${{ ((inputs.rocm_version && format('-{0}', inputs.rocm_version)) || '') }} (linux-${{ (inputs.runner_arch || 'mi325') }}-2gpu-sglang)

pr-test-amd-extra-finish

PR Test (Arm64) on: pull_request 2

check-changes

pr-gate / pr-gate

build-test

PR Test Extra on: pull_request 3

check-changes / check-changes

call-gate / pr-gate

sgl-kernel-build-wheels

extra-a-test-1-gpu-small

extra-a-test-1-gpu-large

extra-a-test-2-gpu-large

extra-b-test-4-gpu-h100

extra-b-test-4-gpu-b200

extra-b-test-8-gpu-h200

extra-b-test-deepep-4-gpu-b200

extra-b-test-deepep-8-gpu-h200

pr-test-extra-finish

notify-pr-states

PR Test (Xeon) on: pull_request 2

check-changes

pr-gate / pr-gate

build-test (xeon-gnr, base-b-test-cpu)

PR Test (XPU) on: pull_request 5

check-changes

pr-gate / pr-gate

stage-a-test-1-gpu-xpu

wait-for-stage-a

stage-b-test-1-gpu-xpu

finish

PR Test (AMD) on: pull_request 29

call-gate / pr-gate

call-pr-test-amd-extra

check-changes

sgl-kernel-unit-test-amd (linux-${{ (inputs.runner_arch || 'mi325') }}-1gpu-sglang)

sgl-kernel-unit-test-2-gpu-amd (linux-${{ (inputs.runner_arch || 'mi325') }}-2gpu-sglang)

stage-a-test-1-gpu-small-amd (linux-mi325-1gpu-sglang)

jit-kernel-unit-test-amd (linux-${{ (inputs.runner_arch || 'mi325') }}-1gpu-sglang)

wait-for-stage-a-amd

multimodal-gen-test-1-gpu-amd (linux-${{ (inputs.runner_arch || 'mi325') }}-1gpu-sglang, ${{ matrix.part }})

multimodal-gen-test-2-gpu-amd (linux-${{ (inputs.runner_arch || 'mi325') }}-2gpu-sglang, ${{ matrix.part }})

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 0)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 1)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 2)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 3)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 4)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 5)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 6)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 7)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 8)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 9)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 10)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 11)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 12)

stage-b-test-1-gpu-small-amd (linux-mi325-1gpu-sglang, 13)

stage-b-test-1-gpu-small-amd-nondeterministic (linux-mi325-1gpu-sglang)

stage-b-test-1-gpu-small-amd-mi35x (linux-mi35x-gpu-1)

stage-b-test-1-gpu-large-amd (linux-mi325-1gpu-sglang, 0)

stage-b-test-1-gpu-large-amd (linux-mi325-1gpu-sglang, 1)

stage-b-test-1-gpu-large-amd (linux-mi325-1gpu-sglang, 2)

stage-b-test-2-gpu-large-amd (linux-mi325-2gpu-sglang, 0)

stage-b-test-2-gpu-large-amd (linux-mi325-2gpu-sglang, 1)

wait-for-stage-b-amd

stage-b-test-large-8-gpu-mi35x-disaggregation-amd (linux-mi35x-gpu-8.fabric)

stage-c-test-4-gpu-amd (linux-${{ (inputs.runner_arch || 'mi325') }}-4gpu-sglang, ${{ matrix.part }})

stage-c-test-large-8-gpu-amd (linux-${{ (inputs.runner_arch || 'mi325') }}-8gpu-sglang, ${{ matrix.part }})

stage-c-test-large-8-gpu-amd-mi35x

pr-test-amd-finish

PR Test Base on: pull_request 51

check-changes / check-changes

call-pr-test-extra

call-gate / pr-gate

wait-for-base-a

sgl-kernel-build-wheels

sgl-kernel-build-wheels-arm

base-a-test-cpu (0)

base-a-test-cpu (1)

base-a-test-cpu (2)

base-a-test-cpu (3)

base-a-test-cpu (4)

base-a-test-cpu (5)

base-a-test-cpu (6)

base-a-test-cpu (7)

wait-for-base-b

call-sgl-kernel-tests

call-jit-kernel-tests

base-a-test-1-gpu-small / base-a-test-1-gpu-small (0)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (0)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (1)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (2)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (3)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (4)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (5)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (6)

base-b-test-1-gpu-small / base-b-test-1-gpu-small (7)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (0)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (1)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (2)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (3)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (4)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (5)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (6)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (7)

base-b-test-1-gpu-large / base-b-test-1-gpu-large (8)

base-b-test-2-gpu-large / base-b-test-2-gpu-large (0)

base-b-test-2-gpu-large / base-b-test-2-gpu-large (1)

base-b-test-2-gpu-large / base-b-test-2-gpu-large (2)

base-b-test-2-gpu-large / base-b-test-2-gpu-large (3)

base-b-test-4-gpu-b200 / base-b-test-4-gpu-b200 (0)

call-multimodal-gen-tests

base-c-test-4-gpu-h100 / base-c-test-4-gpu-h100 (0)

base-c-test-4-gpu-h100 / base-c-test-4-gpu-h100 (1)

base-c-test-4-gpu-h100 / base-c-test-4-gpu-h100 (2)

base-c-test-8-gpu-h200 / base-c-test-8-gpu-h200 (0)

base-c-test-8-gpu-h200 / base-c-test-8-gpu-h200 (1)

base-c-test-8-gpu-h200 / base-c-test-8-gpu-h200 (2)

base-c-test-8-gpu-h20 / base-c-test-8-gpu-h20 (0)

base-c-test-8-gpu-h20 / base-c-test-8-gpu-h20 (1)

base-c-test-deepep-4-gpu-h100 / base-c-test-deepep-4-gpu-h100 (0)

base-c-test-deepep-4-gpu-b200 / base-c-test-deepep-4-gpu-b200 (0)

base-c-test-deepep-8-gpu-h200 / base-c-test-deepep-8-gpu-h200 (0)

base-c-test-4-gpu-b200 / base-c-test-4-gpu-b200 (0)

base-c-test-4-gpu-b200 / base-c-test-4-gpu-b200 (1)

base-c-test-4-gpu-b200 / base-c-test-4-gpu-b200 (2)

base-c-test-4-gpu-b200 / base-c-test-4-gpu-b200 (3)

base-c-test-4-gpu-b200 / base-c-test-4-gpu-b200 (4)

base-c-test-4-gpu-gb300 / base-c-test-4-gpu-gb300 (0)

pr-test-finish

notify-pr-states

PR Test ROCm 7.2 (AMD) on: pull_request 1

call-gate / pr-gate

call-pr-test-amd-extra-rocm720

check-changes

dsv4-flash-fp4-fp8-amd-rocm720

dsv4-pro-fp4-amd-rocm720

sgl-kernel-unit-test-amd-rocm720

sgl-kernel-unit-test-2-gpu-amd-rocm720

stage-a-test-1-gpu-small-amd-rocm720

jit-kernel-unit-test-amd-rocm720

stage-b-test-1-gpu-small-amd-rocm720

stage-b-test-1-gpu-small-amd-nondeterministic-rocm720

stage-b-test-1-gpu-small-amd-mi35x-rocm720

stage-b-test-1-gpu-large-amd-rocm720

stage-b-test-2-gpu-large-amd-rocm720

multimodal-gen-test-1-gpu-amd-rocm720

multimodal-gen-test-2-gpu-amd-rocm720

stage-c-test-large-8-gpu-amd-rocm720

stage-c-test-large-8-gpu-amd-mi35x-rocm720

stage-b-test-large-8-gpu-mi35x-disaggregation-amd-rocm720

stage-c-test-4-gpu-amd-rocm720

pr-test-amd-rocm720-finish

Cancel PR Workflows on Close on: pull_request_target

cancel

Add structured comment explaining the three runtime_max_tokens_per_ra…

Uh oh!

Select a check to view from the sidebar