Skip to content

[kernel] Fused embedding kernel - #53677

Merged
jeejeelee merged 12 commits into
mainfrom
fused-embedding-kernel
Aug 31, 2026
Merged

[kernel] Fused embedding kernel #53677
jeejeelee merged 12 commits into
mainfrom
fused-embedding-kernel

Conversation

@jeejeelee

@jeejeelee jeejeelee commented Aug 25, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Purpose

before
image
after
image

Test Plan

  • Perf comparsion
image

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.

@jeejeelee
Init
f981cfd 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
@jeejeelee
Done
a8bc081 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
claude[bot]
claude Bot reviewed Aug 25, 2026
View reviewed changes

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

Tip: disable this comment in your organization's Code Review settings.

@jeejeelee
jeejeelee marked this pull request as draft August 25, 2026 05:14
@mergify mergify Bot added ci/build performance Performance-related issues labels Aug 25, 2026
@jeejeelee
jeejeelee marked this pull request as ready for review August 25, 2026 15:21
@jeejeelee

jeejeelee commented Aug 27, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #85797 for commit c8a3962c0f2c.

@jeejeelee

jeejeelee commented Aug 28, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 28, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #85919 for commit e9fa786e477d.

@jeejeelee

jeejeelee commented Aug 28, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 28, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #85947 for commit d1f7f58be496.

@jeejeelee

jeejeelee commented Aug 28, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 28, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #85971 for commit 11b71e33025a.

@jeejeelee

jeejeelee commented Aug 30, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 30, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #86177 for commit d9351d33b954.

@jeejeelee

jeejeelee commented Aug 30, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 30, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #86228 for commit 670b7c6c2d6d.

@jeejeelee

jeejeelee commented Aug 31, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 31, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #86264 for commit 8b58ff450f89.

@jeejeelee jeejeelee changed the title [kernel]Fused embedding kernel [kernel] Fused embedding kernel Aug 31, 2026
@jeejeelee
Address conflict
761782a 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
@jeejeelee

jeejeelee commented Aug 31, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

github-actions Bot commented Aug 31, 2026

Copy link
Copy Markdown

✅ Triggered Buildkite CI #86305 for commit 761782a84318.

@jeejeelee
jeejeelee enabled auto-merge (squash) August 31, 2026 09:11
@github-actions github-actions Bot added the ready ONLY add when PR is ready to merge/full CI is needed label Aug 31, 2026
@jeejeelee
jeejeelee merged commit e2c8eea into main Aug 31, 2026
281 checks passed
@jeejeelee
jeejeelee deleted the fused-embedding-kernel branch August 31, 2026 11:34
am-cohere pushed a commit to am-cohere/vllm that referenced this pull request Sep 1, 2026
@jeejeelee
[kernel] Fused embedding kernel (vllm-project#53677)
b947d7d 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
mylibrar pushed a commit to tanyuqian/vllm that referenced this pull request Sep 3, 2026
@jeejeelee suqisun
[kernel] Fused embedding kernel (vllm-project#53677)
b0d4588 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
sheralskumar pushed a commit to sheralskumar/vllm that referenced this pull request Sep 8, 2026
@jeejeelee @sheralskumar
[kernel] Fused embedding kernel (vllm-project#53677)
27b6005 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
@hmellor hmellor mentioned this pull request Sep 10, 2026
Closed
5 tasks
This was referenced Sep 15, 2026
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@claude claude[bot] claude[bot] left review comments
@zyongye zyongye zyongye approved these changes
@mgoin mgoin Awaiting requested review from mgoin mgoin is a code owner
@tlrmchlsmth tlrmchlsmth Awaiting requested review from tlrmchlsmth tlrmchlsmth is a code owner
@WoosukKwon WoosukKwon Awaiting requested review from WoosukKwon WoosukKwon is a code owner
@yewentao256 yewentao256 Awaiting requested review from yewentao256 yewentao256 is a code owner
@AndreasKaratzas AndreasKaratzas Awaiting requested review from AndreasKaratzas AndreasKaratzas is a code owner
@LucasWilkinson LucasWilkinson Awaiting requested review from LucasWilkinson LucasWilkinson is a code owner
@Harry-Chen Harry-Chen Awaiting requested review from Harry-Chen Harry-Chen is a code owner

Assignees

No one assigned

Labels

ci/build performance Performance-related issues ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@jeejeelee @zyongye