feat(diffusion): add OmniDreams autoregressive video world model - #27442

Open

Cerdore wants to merge 43 commits into

sgl-project:mainfrom

Cerdore:fea_omni

Commits on Jun 8, 2026

feat(diffusion): add OmniDreams 2B DiT autoregressive video world model
Cerdore
committed
62562cb
Merge branch 'main' into main
Cerdore
authored
4a6264f

Commits on Jun 9, 2026

fix(diffusion): prevent OOM when OmniDreams loads with CPU offload
Cerdore
committed
1143fd2
chore: apply black formatting
Cerdore
committed
2897296

Commits on Jun 13, 2026

Commits on Jun 14, 2026

feat(omnidreams): add 4 performance optimizations + documentation

Cerdore
and
claude
committed
3e7c24d
fix(omnidreams): correct RoPE fast-path batch-dim broadcast
Cerdore
committed
da32844
test(omnidreams): add CPU unit tests for 4 performance optimizations
Cerdore
committed
34a157a

Commits on Jun 18, 2026

refactor(omnidreams): attention TP via Merged/Column/RowParallelLinear

AgainstEntropy
and
claude
committed
aa8470d
fix(omnidreams): zero-init BlockKVCache buffers

AgainstEntropy
and
claude
committed
f78a4cd
refactor(omnidreams): reuse NDRotaryEmbedding + _apply_rotary_emb for 3D RoPE

AgainstEntropy
and
claude
committed
011dbd0
perf(omnidreams): reuse LayerNormScaleShift in the final AdaLN layer

AgainstEntropy
and
claude
committed
618cdd4
chore(omnidreams): remove dead code, stale docs, and redundant comments

AgainstEntropy
and
claude
committed
b89e41b
fix lint
AgainstEntropy
committed
16d327a

Commits on Jun 22, 2026

Commits on Jun 23, 2026

feat(omnidreams): add weight-only FP8 mode, remove LightVAE native path
Cerdore
committed
288a15d

Commits on Jun 24, 2026

Commits on Jun 25, 2026

Commits on Jun 26, 2026

Merge remote-tracking branch 'upstream/main' into conflict-test
Cerdore
committed
256b3aa

Commits on Jun 28, 2026

Commits on Jul 2, 2026

refactor(omnidreams): drop sgl-kernel sage3 + custom CUDA graph, consolidate tests
Cerdore
committed
cdfbd07

Commits on Jul 3, 2026

Merge upstream/main into omnidreams PR (resolve perf_baselines rename)
Cerdore
committed
c9bc56b

Commits on Jul 8, 2026

Merge branch 'main' into fea_omni
Cerdore
authored
763e3c4

Commits on Jul 11, 2026

refactor(omnidreams): drop redundant CPU scale_shift fallback in forward_native

Cerdore
and
claude
committed
bba83f5

Commits on Jul 12, 2026

fix(omnidreams): realtime AR multi-chunk (crash + frame count + flicker)
Cerdore
committed
b1fca1b

Commits on Jul 13, 2026

Merge remote-tracking branch 'upstream/main' into fea_omni
Cerdore
committed
a411b99
style(omnidreams): isort import order in omnidreams stage

Cerdore
and
claude
committed
c3e6006

Commits on Jul 14, 2026

fix(omnidreams): import vision helpers from runtime.utils.vision
Cerdore
committed
ecc9cc3
test(omnidreams): slim to 1 e2e case + 9 unit tests
Cerdore
committed
c699b8c
style(omnidreams): fix isort order of utils.vision import
Cerdore
committed
8c5d5ab

Commits on Aug 5, 2026

Merge remote-tracking branch 'upstream/main' into fea_omni
Cerdore
committed
27f2516

Commits on Aug 12, 2026

Merge remote-tracking branch 'upstream/main' into fea_omni
Cerdore
committed
1283ff4

Commits on Aug 20, 2026

refactor+perf(omnidreams): concise refactor + sglang-native fp8/bf16 acceleration + BCG

Cerdore
and
claude
committed
974c69e