Skip to content

docs(cli): correct removed vLLM prefill-worker flag reference #12581

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
alec-flowers merged 3 commits into from
Aug 4, 2026
Merged

docs(cli): correct removed vLLM prefill-worker flag reference #12581

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
50dab50
docs(cli): correct removed vLLM prefill-worker flag reference
dagil-nvidia Aug 3, 2026
8589e25
Merge branch 'main' into dagil-nvidia/docs-dyn3726-flag-removal
alec-flowers Aug 3, 2026
27b8d75
Merge branch 'main' into dagil-nvidia/docs-dyn3726-flag-removal
dagil-nvidia Aug 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/fern/pages/cli/kv-cache-offloading/overview.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -185,8 +185,8 @@ cd examples/backends/vllm

The script starts the decode worker with `NixlConnector` and the prefill worker with `PdConnector`,
which combines `FlexKVConnectorV1` for offloading with `NixlConnector` for prefill/decode transfer.
It selects the prefill role with `--disaggregation-mode prefill`; do not use the deprecated
`--is-prefill-worker` flag.
It selects the prefill role with `--disaggregation-mode prefill`. The `--is-prefill-worker` flag
it replaced was removed in v1.4.0.
Comment thread
alec-flowers marked this conversation as resolved.
Resolved

For SSD and distributed-cache configuration, see the
[FlexKV documentation](https://github.com/taco-project/FlexKV/tree/main/docs).
Expand Down
Loading