Skip to content

Transformer hw agnostic p3 - #7

Open
bohnstingl wants to merge 5 commits into
transformer_hw-agnostic_oot-rebindingfrom
transformer_hw-agnostic_p3
Open

Transformer hw agnostic p3#7
bohnstingl wants to merge 5 commits into
transformer_hw-agnostic_oot-rebindingfrom
transformer_hw-agnostic_p3

Conversation

@bohnstingl

@bohnstingl bohnstingl commented Oct 2, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Owner

Purpose

This PR is a temporarily stacked on top of vllm-project#57715. See description there.

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

bohnstingl and others added 5 commits October 1, 2026 17:42
@bohnstingl
Initial commit for embedding and lm_head
a5fe27a 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
@bohnstingl
Simplified the instance check
73b8387 
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
@bohnstingl Kilo
Apply pydocstyle fix from main's new ruff rules
d60651e 
Co-authored-by: Kilo <kilo@kilo.ai>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
@bohnstingl Kilo
Follow batch_invariant move to vllm.model_executor.determinism (vllm-…
f8032be 
…project#53619)

Co-authored-by: Kilo <kilo@kilo.ai>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
@bohnstingl Kilo
Mirror embedding and logits-processor layers for OOT rebinding
4fca0d2 
Add logits_processor and vocab_parallel_embedding to _MIRRORED_MODULES so
plugin overrides registered against the in-tree names reach the hw-agnostic
VocabParallelEmbedding, ParallelLMHead and LogitsProcessor, and extend the
override-reachability tests to cover them.

Co-authored-by: Kilo <kilo@kilo.ai>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@bohnstingl