Repository navigation

Redesign inference metadata as a generic control-flow IR - #828

Merged

justinchuby merged 158 commits into

mainfrom

justinchuby/simplify-composite-metadata

Aug 21, 2026

Merged

Redesign inference metadata as a generic control-flow IR#828
justinchuby merged 158 commits into
mainfrom
justinchuby/simplify-composite-metadata

Commits on Aug 21, 2026
- Simplify composite inference metadata
  
  justinchuby
  and
  Copilot
  committed
  7c6dfa5
- Separate strategy ownership from auxiliary phases
  
  justinchuby
  and
  Copilot
  committed
  28a591a
- Introduce generic inference control-flow IR
  
  justinchuby
  and
  Copilot
  committed
  e62da33
- Add sound workflow contracts
  
  justinchuby
  and
  Copilot
  committed
  570be98
- Execute recursive SSA workflows
  
  justinchuby
  and
  Copilot
  committed
  5eec7b3
- Define ONNX workflow policy contracts
  
  justinchuby
  and
  Copilot
  committed
  5e4ac4e
- Complete generic workflow policy execution
  
  justinchuby
  and
  Copilot
  committed
  b83ca9e
- Add typed workflow branch joins
  
  justinchuby
  and
  Copilot
  committed
  07dfd3d
- Materialize preprocessing outputs in workflow SSA
  
  justinchuby
  and
  Copilot
  committed
  920007c
- Validate workflow state initializers
  
  justinchuby
  and
  Copilot
  committed
  8d3242a
- Add lexical loop induction values
  
  justinchuby
  and
  Copilot
  committed
  bf37bc8
- Execute Mobius workflow packages generically
  
  justinchuby
  and
  Copilot
  committed
  641bb86
- Remove legacy composite pipeline execution
  
  justinchuby
  and
  Copilot
  committed
  5793f25
- Add bounded workflow emission and state selection
  
  justinchuby
  and
  Copilot
  committed
  a12247b
- Add grammar and adaptive budget workflow contracts
  
  justinchuby
  and
  Copilot
  committed
  bd6ba5e
- Add world model checkpoint replay conformance
  
  justinchuby
  and
  Copilot
  committed
  50f9daa
- Compile concise workflows into strict execution IR
  
  justinchuby
  and
  Copilot
  committed
  ec809c2
- Add generic policy component overrides
  
  justinchuby
  and
  Copilot
  committed
  cbf4a20
- Fuse pure workflow components into execution islands
  
  justinchuby
  and
  Copilot
  committed
  6eb8307
- Benchmark workflow execution islands
  
  justinchuby
  and
  Copilot
  committed
  5c96c4b
- Simplify and validate row-aware workflows
  
  justinchuby
  and
  Copilot
  committed
  9088cca
- Finalize producer workflow contracts
  
  justinchuby
  and
  Copilot
  committed
  d99a335
- Keep workflow island values device-resident
  
  justinchuby
  and
  Copilot
  committed
  89b21cc
- Fix session state checkpoint identity
  
  justinchuby
  and
  Copilot
  committed
  840dfbd
- Remove superseded generation metadata surfaces
  
  justinchuby
  and
  Copilot
  committed
  3c83a96
- Delete dead legacy metadata types
  
  justinchuby
  and
  Copilot
  committed
  977da71
- Prove grammar and adaptive-K execution semantics
  
  justinchuby
  and
  Copilot
  committed
  edac7e7
- Remove metadata-driven native speculation
  
  justinchuby
  and
  Copilot
  committed
  30fcd3f
- Stop runtime speculator auto-discovery
  
  justinchuby
  and
  Copilot
  committed
  d6fdc55
- Remove legacy metadata-driven KV paths
  
  justinchuby
  and
  Copilot
  committed
  5e9427b
- Rename fallback decode path as generic
  
  justinchuby
  and
  Copilot
  committed
  a02955c
- Run checked-in Mobius workflows in CI
  
  justinchuby
  and
  Copilot
  committed
  b74e3a4
- Preserve device-aware VRAM admission
  
  justinchuby
  and
  Copilot
  committed
  d10efab
- Remove stale ComfyUI crate workflow references
  
  justinchuby
  and
  Copilot
  committed
  4198530
- Fix cross-platform workflow CI
  
  justinchuby
  and
  Copilot
  committed
  8b48f1a
- Remove remaining legacy fixture CI references
  
  justinchuby
  and
  Copilot
  committed
  240e826
- Stabilize workflow migration quality gates
  
  justinchuby
  and
  Copilot
  committed
  d9ae18f
- Remove obsolete static-cache HTTP coverage
  
  justinchuby
  and
  Copilot
  committed
  2965324
- Remove stale native VLM parity test
  
  justinchuby
  and
  Copilot
  committed
  800950d
- Serialize native backend CI tests
  
  justinchuby
  and
  Copilot
  committed
  186ac40
- Migrate model benchmarks off legacy static cache
  
  justinchuby
  and
  Copilot
  committed
  cb47c3c
- Update benchmark fixture documentation
  
  justinchuby
  and
  Copilot
  committed
  27f2df7
- Serialize ORT-backed integration tests
  
  justinchuby
  and
  Copilot
  committed
  59cd80f
- Adapt workflow runtime to current memory planning
  
  justinchuby
  and
  Copilot
  committed
  9f3a1c9
- Repin Mobius workflow conformance packages
  
  justinchuby
  and
  Copilot
  committed
  6854f11
- Run checked-in workflow fixtures by default
  
  justinchuby
  and
  Copilot
  committed
  3367b3d
- Namespace island dimension symbols per artifact
  
  justinchuby
  and
  Copilot
  committed
  3d71d65
- Synchronize repeated work-stealing dispatches
  
  justinchuby
  and
  Copilot
  committed
  970b077
- Optimize persistent workflow execution islands
  
  justinchuby
  and
  Copilot
  committed
  ca9d0f0
- Account for reverted weight-fold research probe
  
  justinchuby
  and
  Copilot
  committed
  6caf558
- Add explicit optional workflow input presence
  
  justinchuby
  and
  Copilot
  committed
  b542381
- Resolve preprocessing-derived workflow extents
  
  justinchuby
  and
  Copilot
  committed
  e29094c
- Tokenize prompts for workflow profiling
  
  justinchuby
  and
  Copilot
  committed
  d072bff
- Keep fixed-count generation loops on device
  
  justinchuby
  and
  Copilot
  committed
  e58befe
- Make workflow CUDA profiling executable
  
  justinchuby
  and
  Copilot
  committed
  63dffdc
- Use exact prompt IDs in profiler runs
  
  justinchuby
  and
  Copilot
  committed
  012da0f
- Add workflow image input profiling
  
  justinchuby
  and
  Copilot
  committed
  de54e28
- Fix CUDA tensor residency classification
  
  justinchuby
  and
  Copilot
  committed
  5556304
- Keep workflow decode tensors on CUDA
  
  justinchuby
  and
  Copilot
  committed
  68b1363
- Preserve external weights in linked execution islands
  
  justinchuby
  and
  Copilot
  committed
  38898dd
- Capture file-backed execution islands on stock ORT
  
  justinchuby
  and
  Copilot
  committed
  76dd8d7
- Require per-row batching for policy islands
  
  justinchuby
  and
  Copilot
  committed
  cc3960c
- Tighten batched policy island contracts
  
  justinchuby
  and
  Copilot
  committed
  c58b505
- Require done masks in batched policy islands
  
  justinchuby
  and
  Copilot
  committed
  50a5005
- Integrate row-wise Mobius workflow outputs
  
  justinchuby
  and
  Copilot
  committed
  2ebc099
- Add semantic identities for row-wise workflow outputs
  
  justinchuby
  and
  Copilot
  committed
  1966a0f
- Align row emission with serving slot identities
  
  justinchuby
  and
  Copilot
  committed
  ba6e0dc
- Finalize the per-row policy v2 fusion ABI
  
  justinchuby
  and
  Copilot
  committed
  ef02ca3
- Integrate Mobius per-row policy v2 artifacts
  
  justinchuby
  and
  Copilot
  committed
  3c90054
- Separate semantic row identities from serving slots
  
  justinchuby
  and
  Copilot
  committed
  ae4e8f7
- Align ragged outputs with serving slot identity
  
  justinchuby
  and
  Copilot
  committed
  2736181
- Align fused policy gate with exact v2 ABI
  
  justinchuby
  and
  Copilot
  committed
  41c65c5
- Enable stock ORT capture for file-backed islands
  
  justinchuby
  and
  Copilot
  committed
  46a1943
- Consume singleton VLM loop iteration contract
  
  justinchuby
  and
  Copilot
  committed
  81bcf08
- Fix file-backed shared KV capture parity
  
  justinchuby
  and
  Copilot
  committed
  4be2803
- Consume final canonical Mobius policy artifacts
  
  justinchuby
  and
  Copilot
  committed
  23a45b7
- Refresh workflow fixtures from final Mobius producer
  
  justinchuby
  and
  Copilot
  committed
  17f003f
- Integrate semantic workflow compaction
  
  justinchuby
  and
  Copilot
  committed
  df93c0d
- Sync final Mobius compaction fixtures
  
  justinchuby
  and
  Copilot
  committed
  1ced0e1
- Test nested compaction identity lowering
  
  justinchuby
  and
  Copilot
  committed
  4f91a42
- Enable nested TTS row compaction
  
  justinchuby
  and
  Copilot
  committed
  bbbb1a1
- Pin authoritative Mobius compaction producer
  
  justinchuby
  and
  Copilot
  committed
  2cb9a75
- Require explicit TTS serving slot IDs
  
  justinchuby
  and
  Copilot
  committed
  be3f2e0
- Add generic parameter adapter workflows
  
  justinchuby
  and
  Copilot
  committed
  5b45121
- Key adapter selections by request epoch
  
  justinchuby
  and
  Copilot
  committed
  78d0cac
- Reject duplicate row adapter activations
  
  justinchuby
  and
  Copilot
  committed
  4134255
- Use standard ONNX for wide policy ArgMax
  
  justinchuby
  and
  Copilot
  committed
  6a6e760
- Publish the generic adapter wire ABI
  
  justinchuby
  and
  Copilot
  committed
  b7beb1c
- Integrate the native LoRA metadata contracts
  
  justinchuby
  and
  Copilot
  committed
  cca2a7f
- Preserve exact native LoRA source semantics
  
  justinchuby
  and
  Copilot
  committed
  58b39b1
- Align adapter manifests with producer target identities
  
  justinchuby
  and
  Copilot
  committed
  556ebd3
- Cover heterogeneous PEFT target overrides
  
  justinchuby
  and
  Copilot
  committed
  cdcde0b
- Consume the canonical Mobius adapter fixture
  
  justinchuby
  and
  Copilot
  committed
  14564f2
- Record final adapter producer validation
  
  justinchuby
  and
  Copilot
  committed
  bc184ec
- Correct final Mobius producer provenance
  
  justinchuby
  and
  Copilot
  committed
  b5d9eb4
- Pin final executable adapter validation
  
  justinchuby
  and
  Copilot
  committed
  533d72b
- Sync exact final Mobius conformance handoff
  
  justinchuby
  and
  Copilot
  committed
  4e9796d
- Document inference metadata design decisions
  
  justinchuby
  and
  Copilot
  committed
  f861d0d
- Redesign inference metadata around a single structural workflow IR
  
  justinchuby
  and
  Copilot
  committed
  10af60b
- Make the metadata specification self-consistent for review
  
  justinchuby
  and
  Copilot
  committed
  5dd0187
- Reconcile the workflow redesign with current main
  
  justinchuby
  and
  Copilot
  committed
  ec721f4
- Let workflow input literals carry per-position tensor constants
  
  justinchuby
  and
  Copilot
  committed
  5bd12a2
- Stop literal workflow inputs from pinning shared shape symbols
  
  justinchuby
  and
  Copilot
  committed
  285df6b
- Let a zero-element tensor be aliased
  
  Copilot
  authored and
  justinchuby
  committed
  7898f85
- Publish workflow outputs along a declared axis
  
  Copilot
  authored and
  justinchuby
  committed
  d2e50f8
- Cover causal video decode in workflow conformance
  
  Copilot
  authored and
  justinchuby
  committed
  8b2f533
- Add architecture-neutral CTC ASR (speech-to-text) support to inference metadata
  
  justinchuby
  and
  Copilot
  committed
  f5957f7
- Pin CTC rendering semantics and declare batch padding sensitivity
  
  justinchuby
  and
  Copilot
  committed
  dbdd6b6
- Execute an encoder-conditioned ASR package through workflow metadata
  
  justinchuby
  and
  Copilot
  committed
  311bdf6
- Add a generic audio preprocessing program and execute a Whisper workflow
  
  justinchuby
  and
  Copilot
  committed
  836e1e2
- Cover a guided multistep diffusion workflow in conformance
  
  justinchuby
  and
  Copilot
  committed
  d98698f
- Prove the diffusion workflow against real Stable Diffusion weights
  
  justinchuby
  and
  Copilot
  committed
  b3e02a8
- Add a real-weights Qwen Image Edit workflow execution test
  
  justinchuby
  and
  Copilot
  committed
  906e0aa
- Run the fail-closed importer at load time instead of beside it
  
  justinchuby
  and
  Copilot
  committed
  14798fe
- Carry a package's declared sampling regime through to generation
  
  justinchuby
  and
  Copilot
  committed
  8d5d42c
- Let a package declare that its KV buffers may be aliased
  
  justinchuby
  and
  Copilot
  committed
  fffd3c1
- Bind an audio input from what the package declares, not from nothing
  
  justinchuby
  and
  Copilot
  committed
  f65f19a
- Expand a package's image placeholder into the run its features occupy
  
  justinchuby
  and
  Copilot
  committed
  8ed14e4
- Count the sequences a batched forward really carried
  
  justinchuby
  and
  Copilot
  committed
  4c337f7
- Tell a busy output buffer apart from a closed one
  
  justinchuby
  and
  Copilot
  committed
  65db91d
- Say why the keys every real package drops are dropped
  
  justinchuby
  and
  Copilot
  committed
  ed72deb
- Honor greedy decoding when binding workflow sampler parameters
  
  authored and
  justinchuby
  committed
  e068ef0
- Wait briefly for driver event capacity instead of dropping routes
  
  justinchuby
  and
  Copilot
  committed
  6a44ba8
- Track the video fixture graphs and reformat the integrated tree
  
  justinchuby
  and
  Copilot
  committed
  5d3d591
- State what a declared preprocessing program is, for both modalities
  
  justinchuby
  and
  Copilot
  committed
  e965e6d
- Build the native backend against the aliasing-aware ModelIoSpec
  
  justinchuby
  and
  Copilot
  committed
  71b5bbc
- Document executable workflow pattern catalogue
  
  justinchuby
  and
  Copilot
  committed
  57ff646
- Connect fixed-capacity state and FP8 to the workflow contract
  
  justinchuby
  and
  Copilot
  committed
  8766422
- Let a port ABI sit beside the workflow that binds it
  
  justinchuby
  and
  Copilot
  committed
  2fa318f
- Make pipeline.workflow the sole serialized graph ABI
  
  justinchuby
  and
  Copilot
  committed
  79dd6d6
- Pin that the import-only ABI path stays readable and labelled
  
  justinchuby
  and
  Copilot
  committed
  002a8be
- Keep the captured step-input greedy decode reachable after the rebase
  
  justinchuby
  and
  Copilot
  committed
  62d969b
- Record what actually blocks FP8 KV on CUDA, and on what evidence
  
  justinchuby
  and
  Copilot
  committed
  94a853d
- Make a declared cache ABI provably bindable, not merely well-formed
  
  justinchuby
  and
  Copilot
  committed
  d7ace2a
- Prove the scatter driver runs from a workflow-derived ABI
  
  justinchuby
  and
  Copilot
  committed
  dd873a0
- Let a declared role name a port without transcribing the graph
  
  justinchuby
  and
  Copilot
  committed
  4a68268
- Make the canonical package validate the way a producer will run it
  
  justinchuby
  and
  Copilot
  committed
  b7ad87f
- Enforce the one-ABI rule where producers actually validate
  
  justinchuby
  and
  Copilot
  committed
  e2e1650
- Reject a sole decoder that declares no sequence role
  
  justinchuby
  and
  Copilot
  committed
  79c09e9
- Keep the island device-memory sampler alive across the CUDA rename
  
  justinchuby
  and
  Copilot
  committed
  a01a5ce
- Re-seat the padded-past operator gate on the declared-aliasing path
  
  justinchuby
  and
  Copilot
  committed
  ddec1e4
- Retire the diffusion scripts that drove the deleted composite runner
  
  justinchuby
  and
  Copilot
  committed
  bdadf79
- Source native MTP from the sidecar it is declared in
  
  justinchuby
  and
  Copilot
  committed
  ed2b1eb
- Seed the draft head through a derived ABI, not a second serialized one
  
  justinchuby
  and
  Copilot
  committed
  4315a94
- Track real Qwen-Image-Edit output as durable in-tree evidence
  
  justinchuby
  and
  Copilot
  committed
  43fbd2a
- Merge main into inference metadata redesign
  justinchuby
  committed
  62c91dd
- Restore ComfyUI import as a lowering into the canonical workflow IR
  
  justinchuby
  and
  Copilot
  committed
  c76b22f
- feat(metadata): model fixed recurrent state with replace updates
  
  justinchuby
  and
  Copilot
  committed
  b01212d
- test: migrate checked-in ONNX graphs to textproto
  
  justinchuby
  and
  Copilot
  committed
  0ede26b
- docs: commit real multimodal inference evidence
  
  justinchuby
  and
  Copilot
  committed
  831a94f
- Add inference metadata model catalogue
  
  justinchuby
  and
  Copilot
  committed
  26653cf
- fix(metadata): enforce fixed replacement state policy
  
  justinchuby
  and
  Copilot
  committed
  857d96c
- Document Qwen3.5 hybrid speculative state
  
  justinchuby
  and
  Copilot
  committed
  878acae
- Restore ComfyUI crate CI and publishing
  
  justinchuby
  and
  Copilot
  committed
  8af8893
- Remove duplicated workflow version and opset facts
  
  justinchuby
  and
  Copilot
  committed
  f26772b
- Clarify heterogeneous KV port semantics
  
  justinchuby
  and
  Copilot
  committed
  509cd4e
- Merge remote-tracking branch 'origin/main' into justinchuby/simplify-composite-metadata
  justinchuby
  committed
  d39d2c7
- Format merged runtime changes
  
  justinchuby
  and
  Copilot
  committed
  92d1217

Commits

Commits on Aug 21, 2026