Skip to content

feat(workflow): add integrated encoder ensemble - #13315

Closed
furionw wants to merge 40 commits into
qiwa/vllm-workflow-componentsfrom
qiwa/workflow-integrated-encoder
Closed

furionw wants to merge 40 commits into
qiwa/vllm-workflow-componentsfrom
qiwa/workflow-integrated-encoder

Conversation

@furionw

@furionw furionw commented Aug 15, 2026 •

Copy link
Copy Markdown
Contributor

Based on #13293.

Why

The integrated-encoder workflow keeps multimodal encoding inside stock vLLM while composing an independent classifier. Its application-owned response join normally belongs beside the orchestrator, but deployments may isolate that final composition through discovery. Both placements should use one authored graph and the same response-stage implementation.

What Change

  • Fan the opaque request value to stock vLLM and a remote classifier.
  • Bind response composition inline or through a discovered endpoint.
  • Launch the response worker only for remote placement.
classDiagram
    WorkflowOrchestrator --> StageDispatcher : executes plan
    StageDispatcher ..> GenerateEndpointInvoker : calls stock vLLM
    StageDispatcher ..> RemoteStageClient : calls remote stages
    RemoteStageClient --> DummyClassifier : classifies request
    StageDispatcher --> EnsembleResponseStage : joins inline or remotely

    note for WorkflowOrchestrator "Coordinates generator, classifier, and join"
    note for EnsembleResponseStage "Shapes the frontend token chunk"
    note for RemoteStageClient "Discovers classifier and optional response worker"
Loading

Test Plan

  • 49 cumulative workflow tests pass; two environment-specific tests skip locally.
  • CPU coverage includes graph fan-out, exact name wiring, and both response placements.
  • pre-commit passes for the PR diff.

@github-actions github-actions Bot added feat documentation Improvements or additions to documentation labels Aug 15, 2026
@github-actions

github-actions Bot commented Aug 15, 2026 •

Copy link
Copy Markdown
Contributor

@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from f42d16b to 8e8332e Compare August 17, 2026 23:30
@furionw
furionw force-pushed the qiwa/workflow-integrated-encoder branch from ebe5809 to a323118 Compare August 17, 2026 23:31
@datadog-official

This comment has been minimized.

@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from 8e8332e to 24b3084 Compare August 18, 2026 02:49
@furionw
furionw force-pushed the qiwa/workflow-integrated-encoder branch from cd61516 to 9ed18bf Compare August 18, 2026 02:49
@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from 24b3084 to c4dbac5 Compare August 20, 2026 08:05
@furionw
furionw force-pushed the qiwa/workflow-integrated-encoder branch from 9ed18bf to 3c7cfcd Compare August 20, 2026 08:05
@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from c4dbac5 to 7f5b03c Compare August 21, 2026 04:44
@furionw
furionw force-pushed the qiwa/workflow-integrated-encoder branch from 3c7cfcd to 0b15bef Compare August 21, 2026 04:44
@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from 7f5b03c to 1a0f101 Compare August 21, 2026 04:54
@furionw
furionw force-pushed the qiwa/workflow-integrated-encoder branch from 0b15bef to 2026466 Compare August 21, 2026 04:54
@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from 1a0f101 to 27737cb Compare August 22, 2026 00:31
@furionw
furionw force-pushed the qiwa/workflow-integrated-encoder branch from 2026466 to aac10ce Compare August 22, 2026 00:31
@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from 27737cb to 0b2adae Compare August 22, 2026 00:47
@furionw
furionw force-pushed the qiwa/workflow-integrated-encoder branch from aac10ce to 1172d3f Compare August 22, 2026 00:47
@furionw
furionw force-pushed the qiwa/vllm-workflow-components branch from 0b2adae to f604836 Compare August 23, 2026 18:31
@furionw furionw closed this Aug 23, 2026
@furionw
furionw deleted the qiwa/workflow-integrated-encoder branch August 29, 2026 00:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation feat size/XL

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant