feat(model): enable Nemotron Omni audio, video, and packing - #5007

Merged

cuichenx merged 33 commits into

mainfrom

agent/nemotron-omni-audio-video

Aug 5, 2026

Commits on Jul 30, 2026

feat(model): enable Nemotron Omni audio and video
cuichenx
committed
0542a77
refactor(model): move Nemotron Omni packing to collator
cuichenx
committed
94cfad7
fix(model): make canonical Nemotron Omni path the default
cuichenx
committed
183cf51
fix(model): deprecate Nemotron Omni LLaVA model
cuichenx
committed
42f6d9e
test(model): preserve Nemotron Omni inference expansion
cuichenx
committed
071e98d
docs(model): explain packed padding mask
cuichenx
committed
a5502ad
feat(model): allow omitting Nemotron Omni sound encoder
cuichenx
committed
a2b03d2
refactor(model): remove Nemotron Omni has_sound flag
cuichenx
committed
d64f5e7
fix(model): unify Nemotron Omni sound capability
cuichenx
committed
26515b4
fix(model): defer Nemotron Omni padding mask routing
cuichenx
committed
8f3942b
docs(model): clarify Nemotron Omni padding routing
cuichenx
committed
91c02ea
test(model): repair Nemotron Omni packed image smoke
cuichenx
committed
a3c8d07
docs(model): add Nemotron Omni verification card
cuichenx
committed
7888d7a
Merge branch 'main' into agent/nemotron-omni-audio-video
cuichenx
authored
d3ceb67

Commits on Jul 31, 2026

fix(examples): support large HF parity checks
cuichenx
committed
4e1618f
fix(conversion): preserve Nemotron Omni HF buffers
cuichenx
committed
d10a1d8
feat(recipes): add Nemotron Omni long-context SFT
cuichenx
committed
0f7bb5e
fix(examples): compare composite text backbones
cuichenx
committed
6adfd7b
fix(examples): pin Nemotron Omni inference revision
cuichenx
committed
ffb0905
merge(main): refresh Nemotron Omni verification
cuichenx
committed
558bdfd
fix(recipes): trust Nemotron Omni processor code
cuichenx
committed
960e416
fix(conversion): initialize CPU models with Gloo
cuichenx
committed
c9853c0
fix(data): ignore padding in Omni loss masks
cuichenx
committed
23cc39f
fix(nemotron-omni): complete model verification
cuichenx
committed
fbbafc7
docs(model): verify Nemotron Omni workflows
cuichenx
committed
5aa4034

Commits on Aug 2, 2026

fix(recipe): declare long-context Omni environment
cuichenx
committed
0607c1f

Commits on Aug 3, 2026

fix(conversion): release temporary import process groups
cuichenx
committed
dc2eb3d

Commits on Aug 4, 2026

fix(examples): avoid Hugging Face tensor parallel loading
cuichenx
committed
ef8f8bc
fix(conversion): scope CPU import distributed state
cuichenx
committed
8784644
fix(data): clear stale packed padding masks
cuichenx
committed
64a2052

Commits on Aug 5, 2026

Merge branch 'main' into agent/nemotron-omni-audio-video
cuichenx
authored
e33694c
fix(distributed): avoid temporary rendezvous port collisions
cuichenx
committed
558e6b0
revert: remove temporary rendezvous hardening
cuichenx
committed
a554f71