Repository navigation
Conversation
Introduce the runtime-neutral object model, connector facade, scheduler and worker lifecycle, transfer metadata, block ownership, and runtime adapter contracts. Signed-off-by: CharlesWu <Charles.Wu@amd.com> Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Cover object identity, layout planning, scheduler and worker lifecycle, metadata serialization, load and store planning, request tracking, and store barriers with the reusable in-memory runtime. Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Add compact whole-block planning, transfer cancellation contracts, asynchronous lookup, hybrid and Mamba coordination, partial hash hits, KV events, metrics, and the post-review event correctness fixes. Signed-off-by: CharlesWu <Charles.Wu@amd.com> Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Add focused coverage for asynchronous lookup lifecycle, multi-group and Mamba coordination, partial hash hits, worker-quorum KV events, failed object reporting, and transfer statistics. Signed-off-by: CharlesWu <Charles.Wu@amd.com> Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Add the embedded MORI adapter, GPU buffer registration, bulk and ranged transfers, timeout and cancellation handling, eviction retry and reporting, lookup sockets, and DRAM configuration. Signed-off-by: CharlesWu <Charles.Wu@amd.com> Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Add embedded runtime contract tests, MORI GPU integration, token-level restore coverage, reusable test helpers, user documentation, and AMD CI wiring. Signed-off-by: CharlesWu <Charles.Wu@amd.com> Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Add the external node-local UMBP server adapter, endpoint and startup validation, shared-pool failure behavior, DP-aware embedded endpoint isolation, and synchronized blocked-store handling. Signed-off-by: CharlesWu <Charles.Wu@amd.com> Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Cover standalone configuration, cross-engine sharing, server failure behavior, blocked-store synchronization, and real multi-GPU server transfers. Signed-off-by: CharlesWu <Charles.Wu@amd.com> Co-authored-by: Yichao Zhu <Yichao.Zhu@amd.com>
Select reusable prefix blocks from the GPU free queue, close full-attention prefix chains, recheck authoritative residency, and retry transient lookup failures without crashing the scheduler. Signed-off-by: CharlesWu <Charles.Wu@amd.com>
Add lazy free-queue unit coverage and validate eager and lazy token-level MORI restore with a bounded GPU memory budget. Signed-off-by: CharlesWu <Charles.Wu@amd.com>
Record the shared-base and runtime split, commit ordering, validation gates, and merge decisions used for the combined UMBP series. Signed-off-by: CharlesWu <Charles.Wu@amd.com>
Document the direct-node MI355X validation environment and the passing embedded, standalone, eager, and lazy MORI test coverage. Signed-off-by: CharlesWu <Charles.Wu@amd.com>
charxwu
requested review from
ApostaC,
Harry-Chen,
NickLucche,
ivanium,
khluu,
orozery,
wzhao18 and
xuechendi
as code owners
October 13, 2026 06:43
![claude[bot]](https://avatars.githubusercontent.com/in/1236702?s=60&v=4){kind=small}
Contributor
|
Documentation preview: https://vllm--61351.org.readthedocs.build/en/61351/ |
mergify
Bot
added
documentation
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in PRs do not trigger a full CI run by default. Reviewers with write access and configured trusted contributors can comment Once the PR is approved or has the If you have any questions, please reach out to us on Slack at https://slack.vllm.ai. Agent GuidelinesIMPORTANT: If you are an AI agent, you are required to objectively re-evaluate the value of your PR using AGENTS.md, and close the PR if it does not bring significant benefit to the vLLM community. Failure to do so may result in an immediate ban. 🚀 |
This was referenced Oct 14, 2026
Draft
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
Claims
Validation
Details
Pull Request Checklist
I used vLLM's
/pr-checklistskill. (Mandatory for agents, optional for humans).AI assistance was used during the creation of this PR.
Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.
Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.
Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.
Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.