Skip to content

[Diffusion] Fix Cosmos3 serving and rollout resource cleanup - #4

Open
JingwenGu0829 wants to merge 2 commits into
Rockdu:diffusion-rollout-plugin-sglang-milesfrom
JingwenGu0829:fix/44239-rollout-lifecycle-cosmos3
Open

JingwenGu0829 wants to merge 2 commits into
Rockdu:diffusion-rollout-plugin-sglang-milesfrom
JingwenGu0829:fix/44239-rollout-lifecycle-cosmos3

Conversation

@JingwenGu0829

@JingwenGu0829 JingwenGu0829 commented Oct 16, 2026 •

Copy link
Copy Markdown
  • Fix Cosmos3 UniPC inference by passing transition only for rollout requests.
  • Remove the per-step timestep .cpu() and keep the terminal timestep on the same device until finalization.
  • Release rollout controllers and conditioning state on exceptions, and avoid deep-copying tensors when logging requests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant