Skip to content

lower log level in PD Disaggregation #7589

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
wangxiyuan merged 3 commits into from
Mar 24, 2026
Merged

lower log level in PD Disaggregation #7589

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
eedfd8b
optimize log level
zouyida2052 Mar 24, 2026
fd6190a
optimize log level
zouyida2052 Mar 24, 2026
29af40f
fix bug in mooncake
zouyida2052 Mar 24, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion vllm_ascend/distributed/kv_transfer/kv_p2p/mooncake_layerwise_connector.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -766,14 +766,14 @@ def get_num_new_matched_tokens(self, request: "Request", num_computed_tokens: in

def update_state_after_alloc(self, request: "Request", blocks: "KVCacheBlocks", num_external_tokens: int):
params = request.kv_transfer_params
do_virtual = params.get("do_virtual")
logger.debug(
"MooncakeLayerwiseConnector update_state_after_alloc: num_external_tokens=%s, kv_transfer_params=%s",

@liziyu179 liziyu179 Mar 24, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do not delete the params parameter.

num_external_tokens,
params,
)

if params is not None and params.get("do_remote_prefill"):
do_virtual = params.get("do_virtual", False)
local_block_ids = (blocks.get_block_ids()) if num_external_tokens > 0 else []
remote_cached_tokens = request.num_computed_tokens
# Get unhashed blocks to pull from remote.
Expand Down
2 changes: 1 addition & 1 deletion vllm_ascend/distributed/kv_transfer/kv_pool/ascend_store/pool_scheduler.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -336,7 +336,7 @@ def request_finished(
return False, None
delay_free_blocks = len(block_ids) > 0
if delay_free_blocks:
logger.info("Delaying free of %d blocks for request %s", len(block_ids), request.request_id)
logger.debug("Delaying free of %d blocks for request %s", len(block_ids), request.request_id)
return delay_free_blocks, None


Expand Down
Loading