Conversation
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
…ensor Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
gty111
requested review from
ApostaC,
DarkLight1337,
ProExpertProg,
WoosukKwon,
alexm-redhat,
heheda12345,
hmellor,
houseroad,
ivanium,
mgoin,
njhill,
orozery,
robertgshaw2-redhat,
russellb,
tlrmchlsmth,
yewentao256,
youkaichao and
ywang96
as code owners
August 28, 2026 07:50
![claude[bot]](https://avatars.githubusercontent.com/in/1236702?s=60&v=4){kind=small}
Contributor
|
Documentation preview: https://vllm--54176.org.readthedocs.build/en/54176/ |
mergify
Bot
added
documentation
gty111
changed the title
gty111
changed the title
Contributor
|
This pull request has merge conflicts that must be resolved before it can be |
# Conflicts: # examples/disaggregated/disaggregated_encoder/disagg_epd_proxy.py Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Contributor
|
This pull request has merge conflicts that must be resolved before it can be |
Preserve dynamic registration and reconcile current EC metadata and transfer handles. Assisted-by: OpenAI Codex <codex@openai.com> Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Isotr0py
requested review from
Isotr0py
and removed request for
WoosukKwon,
alexm-redhat,
robertgshaw2-redhat and
ywang96
September 11, 2026 02:57
Keep explicit embedding input flags in the dynamic proxy examples. Assisted-by: OpenAI Codex <codex@openai.com> Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Assisted-by: OpenAI Codex <codex@openai.com> Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Assisted-by: OpenAI Codex <codex@openai.com> Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Assisted-by: OpenAI Codex <codex@openai.com> Signed-off-by: Tianyu Guo <guoty@inferact.ai>
Contributor
|
This pull request has merge conflicts that must be resolved before it can be |
Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: Tianyu Guo <guoty@inferact.ai>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
Support dynamic E and P/PD registration in the existing EPD example proxy; standalone D instances remain statically configured.
Set
"proxy_registry_addr": "tcp://proxy-host:14580"in each E or P/PD instance'sec_connector_extra_config. HTTP addresses are derived from the serving CLI options. For E+P+D, pass standalone D addresses via--decode-servers-urls.Validation
Earlier revision:
CONCURRENCY=1 REPEAT=1 MAX_MODEL_LEN=16384 bash tests/v1/ec_connector/integration/run_epd_mooncake_ec_full_pipeline.sh— Qwen2.5-VL-3B, Mooncake TCP, CUDA graphs enabled; single-image, two-image and repeated-image responses matched the colocated baseline (3/3). E2E has not been rerun on the current revision.This extends discovery and registration for existing EC transports rather than adding a competing connector. AI assistance was used.