Skip to content

Fix prefer_cross_layers check#33231

Closed
liranschour wants to merge 1 commit intovllm-project:mainfrom
liranschour:nixl_cross_fix
Closed

Fix prefer_cross_layers check#33231
liranschour wants to merge 1 commit intovllm-project:mainfrom
liranschour:nixl_cross_fix

Conversation

@liranschour
Copy link
Copy Markdown
Contributor

@liranschour liranschour commented Jan 28, 2026

Fix of PR #30207
By default disable this feature

Purpose

Test Plan

Test Result


Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: Liran Schour <lirans@il.ibm.com>
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request fixes a bug in how a boolean configuration option was being parsed. The original implementation using bool(str(value)) would incorrectly evaluate to True even for the string "False". The fix corrects this by explicitly checking if the lowercased string value is equal to "true", which correctly handles the intended logic and ensures the feature is disabled by default. I've added one suggestion to make this boolean parsing even more robust by accounting for other common affirmative values like "1" or "yes".

Comment on lines +315 to +316
str(extra_config.get("enable_cross_layers_blocks", "False")).lower()
== "true"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

While this correctly fixes the original bug where bool("False") evaluates to True, the boolean conversion could be more robust. The current implementation only considers "true" (case-insensitive) as affirmative. It would be better to handle other common boolean string representations like "1", "t", "y", "yes" to prevent unexpected behavior if a user configures it differently. This would make the configuration parsing more resilient, especially since kv_connector_extra_config values can be of Any type.

Suggested change
str(extra_config.get("enable_cross_layers_blocks", "False")).lower()
== "true"
str(extra_config.get("enable_cross_layers_blocks", "False")).lower()
in ("true", "1", "t", "y", "yes")

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can be done later, let's make sure the feature is off by default in the release first

Comment on lines +315 to +316
str(extra_config.get("enable_cross_layers_blocks", "False")).lower()
== "true"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can be done later, let's make sure the feature is off by default in the release first

@markmc markmc added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 28, 2026
@markmc markmc enabled auto-merge (squash) January 28, 2026 09:09
auto-merge was automatically disabled January 28, 2026 09:30

Pull request was closed

@liranschour
Copy link
Copy Markdown
Contributor Author

Will revert the PR

@liranschour
Copy link
Copy Markdown
Contributor Author

Revert this PR for now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kv-connector ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants