Repository navigation

[LingBot World] Eleven bit-identical removals of repeated work in the realtime path - #7648

Merged

princepride merged 23 commits into

vllm-project:mainfrom

tzhouam:lingbot/exact-realtime-optimizations

Sep 21, 2026

Merged

[LingBot World] Eleven bit-identical removals of repeated work in the realtime path#7648
princepride merged 23 commits into
vllm-project:mainfrom
tzhouam:lingbot/exact-realtime-optimizations

Commits on Sep 18, 2026
- [LingBot-World] Cut launch/collective count under Ulysses + CUDA graphs
  
  tzhouam
  and
  claude
  committed
  ab7c5f0
- [AR-Diffusion] Allocate the flat K/V slot pools as the base tensors
  
  tzhouam
  and
  claude
  committed
  6eb4e82
- [LingBot World] Decode a repeated source image once
  
  tzhouam
  and
  claude
  committed
  0ee38d3
- [LingBot World] Build the camera modulation once per AR block
  
  tzhouam
  and
  claude
  committed
  d528c1e
- [LingBot World] Drop both cross-attention all-to-alls under Ulysses
  
  tzhouam
  and
  claude
  committed
  e2fafa9
- [AR-Diffusion] Restage only the K/V that moved within an AR block
  
  tzhouam
  and
  claude
  committed
  711b6d6
- [AR-Diffusion] Copy the block-table metadata to the device asynchronously
  
  tzhouam
  and
  claude
  committed
  d564562
- [LingBot World] Deliver realtime chunks as uint8 frames straight from the device
  
  tzhouam
  and
  claude
  committed
  3aa7d43
- [LingBot World] Stop re-encoding the condition once the encoder is at a fixed point
  
  tzhouam
  and
  claude
  committed
  3c37bce
- [LingBot World] Open the camera reuse window across a stepwise block too
  
  tzhouam
  and
  claude
  committed
  cf7c8bd
- [Diffusion] Let a streaming request run a whole chunk per stepwise call
  
  tzhouam
  and
  claude
  committed
  d521d85
- [LingBot World] Reword a comment the typos hook rejects
  
  tzhouam
  and
  claude
  committed
  efb134b
- [LingBot World] Stage the timestep projection in one static buffer per shape
  
  tzhouam
  and
  claude
  committed
  43a63d7
- [Diffusion] Assemble the sharded Wan causal conv input in one pass
  
  tzhouam
  and
  claude
  committed
  04c6afc
- [Diffusion] Rebuild the step batch between the steps of a whole-chunk call
  
  tzhouam
  and
  claude
  committed
  9f6c36a
- [AR-Diffusion] Restage current K/V at its live offset; budget and gate the staging buffers
  
  tzhouam
  and
  claude
  committed
  76582ba
- [Diffusion] Make step grouping a pipeline capability and a runner policy
  
  tzhouam
  and
  claude
  committed
  f7f59f4
- [Diffusion] Keep the shared runner single-step; the AR runner drives a chunk
  
  tzhouam
  and
  claude
  committed
  54381a0
- [Diffusion] Build the step batch's identity index mapping without a device read-back
  
  tzhouam
  and
  claude
  committed
  4a00dbb
- [LingBot World] Address review: one mechanism each for camera reuse, staging and the gather switch
  
  tzhouam
  and
  claude
  committed
  13eba73
- [LingBot World] Size the cross-attention K/V spec from num_local_heads
  
  tzhouam
  and
  claude
  committed
  917715e
Commits on Sep 21, 2026
- Merge main and address LingBot realtime review feedback
  tzhouam
  committed
  72d6719
- Fix AR diffusion custom-op dispatch and environment inventory CI
  tzhouam
  committed
  4caf8bb

Commits

Commits on Sep 18, 2026

Commits on Sep 21, 2026