Skip to content

[Doc] fix DSV3.1 PD configs #7187

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
MengqingCao merged 1 commit into from
Mar 12, 2026
Merged

[Doc] fix DSV3.1 PD configs #7187

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/source/tutorials/models/DeepSeek-V3.1.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -554,8 +554,8 @@ vllm serve /weights/DeepSeek-V3.1-w8a8-mtp-QuaRot \
--kv-transfer-config \
'{"kv_connector": "MooncakeConnectorV1",
"kv_role": "kv_consumer",
"kv_port": "30300",
"engine_id": "3",
"kv_port": "30200",
"engine_id": "2",
Comment on lines +557 to +558
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot Mar 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

This change correctly makes the engine_id consistent for the logical decoder engine. However, the kv_port values used throughout this document appear to conflict with the guidance in pd_disaggregation_mooncake_multi_node.md.

For 16-NPU nodes like the Atlas 800 A3, that guide recommends kv_port >= 36000 to avoid port conflicts with AscendDirectTransport, which can cause zmq.error.ZMQError: Address already in use. The ports 30000, 30100, and 30200 used in this document are within the reserved range.

I recommend updating all kv_port values in this file to follow that guidance. For example, you could use 36000 and 36100 for the prefill nodes, and 36200 for the decode nodes.

Here is a suggested change for this block. Please apply similar changes to the other nodes' configurations in this file.

Suggested change
"kv_port": "30200",
"engine_id": "2",
"kv_port": "36200",
"engine_id": "2",

"kv_connector_extra_config": {
"prefill": {
"dp_size": 2,
Expand Down
Loading