[K3] Allow tpu to import kimi_k3.common - #51529
Merged
Merged
Conversation
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
ZJY0516
approved these changes
Aug 9, 2026
Member
|
/ci run |
|
✅ Triggered Buildkite CI #83045 for commit |
khluu
pushed a commit
that referenced
this pull request
Aug 9, 2026
Signed-off-by: Jeff Ma <jeffjma@umich.edu> (cherry picked from commit 04d13b5)
1 task
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
TPU platform plugins reuse Kimi K3's shared multimodal preprocessing while
registering their own model implementations. Avoid eagerly importing a GPU
implementation when the active platform's device type is TPU.
CUDA and ROCm model selection remains unchanged.
Not a duplicate
PR #51196 disables dynamic
torch.compilefor the Kimi vision encoder on TPU;it does not address eager GPU model imports from the Kimi K3 package. Searches
for open PRs covering Kimi K3 TPU package imports found no duplicate.
Testing
A TPU import smoke test confirmed that shared Kimi K3 preprocessing can be
imported without loading the NVIDIA or AMD model packages.
AI assistance
AI assistance was used to review the change and prepare this description. I
reviewed every changed line and can explain and defend the change end-to-end.