Skip to content

lingbot: add 1-step speed presets, 2.2x speed up inspired by PDD - #434

Open
wenqingw-nv wants to merge 1 commit into
NVIDIA:mainfrom
wenqingw-nv:lingbot-1step-presets
Open

lingbot: add 1-step speed presets, 2.2x speed up inspired by PDD#434
wenqingw-nv wants to merge 1 commit into
NVIDIA:mainfrom
wenqingw-nv:lingbot-1step-presets

Conversation

@wenqingw-nv

@wenqingw-nv wenqingw-nv commented Aug 9, 2026

Copy link
Copy Markdown
Collaborator

Adds single-solver-step speed presets for the LingBot-World distilled checkpoints. The distilled schedule is front-loaded (all four solver steps sit at sigma >= 0.83; at identity the first step's flow matches the 4-step integrated mean velocity to ~97%), so a single step reaches quality parity at ~2.2-2.6x lower chunk latency. Found while evaluating PDD-style mean-velocity distillation (Parallel Decoding Distillation, arXiv 2607.26004) on this host: the first step's flow already captures ~97% of the 4-step trajectory's mean velocity, so the speedup needs no distillation — a config-only preset suffices.

Contents

  • lingbot-world-fast-1step — 1-step preset on the Wan-VAE decoder slug.
  • lingbot-world-fast-taehv-window15-sink3-1step — 1-step mode on the LightTAE window=15 + sink=3 interactive preset.
  • Config-only (derive_config scheduler override: num_inference_steps=1, denoising_timesteps=[1000]); registered entry points; README slug-table rows.
  • ci_cpu test asserting the 1-step schedule equals the 4-step schedule's first (t, sigma) for both presets.

Measured (464x832, 40-chunk ≈30 s held-out rollouts, GB300; 18 cells)

config MUSIQ late-20% MUSIQ Delta-drift per-chunk
4-step (lingbot-world-fast) 58.84 54.52 +8.27 1.80 s
1-step 58.86 54.42 +8.01 0.81 s (2.2x)

Interactive preset (taehv window15/sink3, 21-block runs): ~1.2 s -> ~0.45 s per chunk (~2.6x, ~30 fps effective at 464x832).

Deploy notes

  • Drift behavior is unchanged vs 4-step (Delta +8.01 vs +8.27) — this is a latency preset, not a quality change; the 4-step slugs remain the defaults.
  • No new weights, no checkpoint changes; both presets derive from the shipped pipeline configs.

…riant)

The distilled schedule is front-loaded (all four solver steps sit at
sigma >= 0.83; at LoRA-identity the first step's flow matches the
4-step integrated mean velocity to ~97%), so a single step reaches
quality parity. Measured (GB300, 18 held-out cells, 40 chunks):
MUSIQ 58.9 vs 58.8 (4-step), drift Delta +8.01 vs +8.27, per-chunk
1.80 s -> 0.81 s (2.2x); interactive taehv preset ~1.2 s -> ~0.45 s
(~2.6x, ~30 fps effective at 464x832). Known issue: dynamic degree
-18% vs 4-step (53.8 vs 65.6 RAFT) -- disclosed in the README row.
ci_cpu test asserts the 1-step schedule equals the 4-step schedule's
first step for both presets.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Wenqing Wang <wenqingw@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Aug 9, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@greptile-apps

greptile-apps Bot commented Aug 9, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

The PR adds two optional one-step LingBot-World runner presets while retaining the existing four-step defaults.

  • Derives Wan-VAE and LightTAE presets with a single scheduler timestep.
  • Registers both presets as package entry points and documents their public slugs.
  • Adds CPU smoke coverage confirming that each one-step schedule matches its four-step counterpart’s initial timestep and sigma.

Confidence Score: 5/5

The PR appears safe to merge.

No blocking failure remains.

Important Files Changed

Filename Overview
integrations/lingbot/lingbot/config.py Adds two derived one-step pipeline and runner configurations and includes them in the local registries.
integrations/lingbot/pyproject.toml Registers the two new runner slugs against their matching configuration attributes.
integrations/lingbot/tests/test_smoke.py Verifies both one-step scheduler configurations and their equality with the initial four-step schedule point.
integrations/lingbot/README.md Documents the two optional one-step preset slugs and their intended latency characteristics.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  User[Runner slug] --> EntryPoint[Package entry point]
  EntryPoint --> Runner[RunnerConfig]
  Runner --> Pipeline[Derived LingBot pipeline]
  Pipeline --> Scheduler[FlowMatch scheduler]
  Scheduler --> Step[Single denoising step at first four-step schedule point]
Loading

Reviews (2): Last reviewed commit: "lingbot: add 1-step speed presets (lingb..." | Re-trigger Greptile

@wenqingw-nv wenqingw-nv changed the title lingbot: add 1-step speed presets lingbot: add 1-step speed presets, 2.2x speed up with PDD Aug 9, 2026
@wenqingw-nv wenqingw-nv changed the title lingbot: add 1-step speed presets, 2.2x speed up with PDD lingbot: add 1-step speed presets, 2.2x speed up inspired by PDD Aug 9, 2026
@wenqingw-nv

Copy link
Copy Markdown
Collaborator Author

/ok to test 589dedb

@wenqingw-nv
wenqingw-nv force-pushed the lingbot-1step-presets branch from 589dedb to b992d3d Compare August 11, 2026 19:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant