Skip to content

[EC Connector] Call to EC Connector update_connector_output from scheduler - #49579

Merged
Isotr0py merged 13 commits into
vllm-project:mainfrom
omerpaz95:worktree-ec_connector_update_connector_output
Aug 10, 2026
Merged

Isotr0py merged 13 commits into
vllm-project:mainfrom
omerpaz95:worktree-ec_connector_update_connector_output

Conversation

@omerpaz95

@omerpaz95 omerpaz95 commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Purpose

The scheduler builds EC (Encoder Cache) connector metadata and calls update_state_after_alloc, request_finished, etc. on the EC Connector, but update_connector_output — the hook that lets an EC connector consume worker-side ECConnectorOutput — was never invoked from anywhere. This wires it into Scheduler.update_from_output, mirroring the existing KV connector call (self.connector.update_connector_output(kv_connector_output)).

This is currently a no-op for both shipped EC connectors (ECCPUConnector, ECExampleConnector), which don't override the base-class hook — this PR only completes the plumbing so a connector implementation can rely on it.

Test Plan

python pytest tests/v1/core/test_scheduler.py -k test_ec_connector_update_connector_output_called
Added test_ec_connector_update_connector_output_called in tests/v1/core/test_scheduler.py, mirroring the existing KV connector coverage (test_scheduler_kv_connector_stats): mocks scheduler.ec_connector.update_connector_output, drives a ModelRunnerOutput carrying an ECConnectorOutput, and asserts the mock is called with it.

Signed-off-by: omerpaz95 <omerpaz95@gmail.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@mergify mergify Bot added the v1 label Jul 23, 2026
@orozery orozery added the ready ONLY add when PR is ready to merge/full CI is needed label Jul 27, 2026
Comment thread vllm/v1/core/sched/scheduler.py Outdated
@NickLucche
NickLucche enabled auto-merge (squash) July 27, 2026 12:44
omerpaz95 and others added 2 commits July 27, 2026 19:17
auto-merge was automatically disabled July 28, 2026 08:35

Head branch was pushed to by a user without write access

@mergify

mergify Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @omerpaz95.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@mergify mergify Bot added the needs-rebase label Aug 5, 2026
@mergify

mergify Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Hi @omerpaz95, the pre-commit checks have failed. Please run:

uv pip install pre-commit>=4.5.1
pre-commit install
pre-commit run --all-files

Then, commit the changes and push to your branch.

For future commits, pre-commit will run automatically on changed files before each commit.

@mergify mergify Bot removed the needs-rebase label Aug 5, 2026
@gty111

gty111 commented Aug 7, 2026

Copy link
Copy Markdown
Collaborator

/ci run

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #82759 for commit 77f5e2aa6b08.

@gty111

gty111 commented Aug 7, 2026

Copy link
Copy Markdown
Collaborator

@orozery @NickLucche CI is pass, maybe we can merge it?

@gty111

gty111 commented Aug 9, 2026

Copy link
Copy Markdown
Collaborator

/ci run

@github-actions

github-actions Bot commented Aug 9, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #83072 for commit 25b951cd8380.

@Isotr0py
Isotr0py merged commit 61c1dd0 into vllm-project:main Aug 10, 2026
85 checks passed
@omerpaz95

omerpaz95 commented Aug 10, 2026

Copy link
Copy Markdown
Contributor Author

Thanks @Isotr0py @gty111 @yewentao256

zyp2014 pushed a commit to zyp2014/vllm that referenced this pull request Aug 21, 2026
…duler (vllm-project#49579)

Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Signed-off-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed v1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants