Pass uniform_q_len to the FlashInfer prefill plan

8215990

Select commit

Loading

Failed to load commit list.

Uh oh!

There was an error while loading. Please reload this page.

Mintlify

Mintlify Deployment

Lint on: pull_request 2

lint

PR States on: pull_request_target

update-pr-body

Auto Label PRs on: pull_request_target 1

label

PR Test Extra on: pull_request 3

check-changes / check-changes

call-gate / pr-gate

sgl-kernel-build-wheels

rust-ext-build

extra-a-test-1-gpu-small

extra-a-test-1-gpu-large

extra-a-test-2-gpu-large

extra-b-test-4-gpu-h100

extra-b-test-4-gpu-b200

extra-b-test-8-gpu-h200

extra-b-test-deepep-4-gpu-h100

extra-b-test-deepep-4-gpu-b200

extra-b-test-deepep-8-gpu-h200

pr-test-extra-finish

notify-pr-states

PR Test Extra (AMD) on: pull_request 2

call-gate / pr-gate

extra-a-test-1-gpu-small-amd${{ ((inputs.rocm_version && format('-{0}', inputs.rocm_version)) || '') }} (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

extra-a-test-1-gpu-large-amd${{ ((inputs.rocm_version && format('-{0}', inputs.rocm_version)) || '') }} (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

extra-a-test-2-gpu-large-amd${{ ((inputs.rocm_version && format('-{0}', inputs.rocm_version)) || '') }} (linux-${{ (inputs.runner_arch || 'mi300') }}-2gpu-sglang)

pr-test-amd-extra-finish

PR Test (NPU) on: pull_request 2

check-changes

set-image-config

pr-gate / pr-gate

stage-a-unit-test-npu

stage-b-test-1-npu-a3

stage-b-test-2-npu-a3

stage-b-test-4-npu-a3

stage-b-test-8-npu-a3

stage-b-test-16-npu-a3

multimodal-gen-test-1-npu-a3

multimodal-gen-test-2-npu-a3

single-node-poc

pr-test-npu-finish

PR Test Base on: pull_request 3

check-changes / check-changes

call-pr-test-extra

call-gate / pr-gate

wait-for-base-a

sgl-kernel-build-wheels

sgl-kernel-build-wheels-arm

rust-ext-build

wait-for-base-b

call-sgl-kernel-tests

call-jit-kernel-tests

base-a-test-1-gpu-small

base-a-test-cpu

base-b-test-1-gpu-small

base-b-test-1-gpu-large

base-b-test-2-gpu-large

base-b-test-4-gpu-b200

call-multimodal-gen-tests

base-c-test-4-gpu-h100

base-c-test-8-gpu-h200

base-c-test-8-gpu-h20

base-c-test-deepep-4-gpu-h100

base-c-test-deepep-4-gpu-b200

base-c-test-deepep-8-gpu-h200

base-c-test-4-gpu-b200

base-c-test-4-gpu-gb300

base-c-test-8-gpu-b300

pr-test-finish

notify-pr-states

PR Test (AMD) on: pull_request 3

call-gate / pr-gate

call-pr-test-amd-extra

check-changes

sgl-kernel-unit-test-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

sgl-kernel-unit-test-2-gpu-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-2gpu-sglang)

stage-a-test-1-gpu-small-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

jit-kernel-unit-test-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

jit-kernel-benchmark-test-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

wait-for-stage-a-amd

multimodal-gen-test-1-gpu-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang, ${{ matrix.part }})

multimodal-gen-test-2-gpu-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-2gpu-sglang, ${{ matrix.part }})

multimodal-gen-unit-test-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

stage-b-test-1-gpu-small-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang, ${{ matrix.part }})

stage-b-test-1-gpu-small-amd-nondeterministic (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang)

stage-b-test-1-gpu-small-amd-mi35x

stage-b-test-1-gpu-large-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-1gpu-sglang, ${{ matrix.part }})

stage-b-test-2-gpu-large-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-2gpu-sglang, ${{ matrix.part }})

wait-for-stage-b-amd

stage-b-test-large-8-gpu-mi35x-disaggregation-amd

stage-c-test-4-gpu-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-4gpu-sglang, ${{ matrix.part }})

stage-c-test-large-8-gpu-amd (linux-${{ (inputs.runner_arch || 'mi300') }}-8gpu-sglang, ${{ matrix.part }})

stage-c-test-large-8-gpu-amd-mi35x

pr-test-amd-finish

Cancel PR Workflows on Close on: pull_request_target

cancel

Pass uniform_q_len to the FlashInfer prefill plan

Uh oh!

Select a check to view from the sidebar