backlog(B-0771): audio codecs working (DAW-ready) + Intel NPU/VPU exposed + ONNX as operator contract#5058
Closed
AceHack wants to merge 1 commit into
Conversation
… as cluster compute resource — beyond cosmetic firmware fix Aaron 2026-05-25 mid-iter-3-prep, extending the cosmetic firmware fix scope: 'i'd like the sound codecs workikng and npus for use like by daw and others' + 'OpenVINO what about ONYX?' (ONNX). B-0754 iter-3 PR #5057 bundles hardware.enableRedistributableFirmware to silence Intel SoF audio probe warnings. But that's only the firmware layer. To actually use audio (DAW workloads) + NPU (AI inference) on Zeta cluster nodes, the full stack needs config: - Audio: PipeWire + ALSA + RT priority + per-DAW recipes - NPU: intel_vpu kernel module + intel-npu-driver userspace + OpenVINO 2024.0+ runtime + intel-device-plugins-for-kubernetes - Per-role: new workstation host config; existing roles get NPU auto-enable if hardware detected - Scheduler awareness: composes with B-0767 Wave-1 NPU-aware scheduler plugin ONNX is the operator-facing contract (per B-0763 + B-0765 ServiceTitan-route + B-0741 ontology negotiation): - Model format: ONNX (operator deploys one model definition; runs everywhere Zeta supports) - Runtime: ONNX Runtime with Execution Provider per hardware (OpenVINO EP for Intel, CUDA/TensorRT EP for NVIDIA, ROCm EP for AMD, CoreML EP for Apple, default CPU EP fallback) - Operator override: vendor-native runtimes (OpenVINO IR / TensorRT engine / MIGraphX MXR) available for max-perf at cost of portability Composes with B-0754 / B-0755 (workstation role) / B-0759 persona / B-0761 reference arch / B-0763 interfaces / B-0764 CNCF / B-0767 scheduler. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Adds a new P2 backlog row (B-0771) describing the intended full-stack delivery for DAW-ready audio on cluster nodes, Intel NPU/VPU exposure as a schedulable resource, and ONNX/ONNX Runtime as the operator-facing inference contract; updates the generated backlog index to include the new row.
Changes:
- Add
B-0771per-row backlog document underdocs/backlog/P2/. - Add
B-0771entry todocs/BACKLOG.mdunder the P2 section.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 5 comments.
| File | Description |
|---|---|
| docs/backlog/P2/B-0771-audio-codecs-working-plus-intel-npu-vpu-exposed-for-daw-and-ai-workloads-aaron-2026-05-25.md | New backlog row capturing scope/acceptance for audio + Intel NPU/VPU + ONNX layering. |
| docs/BACKLOG.md | Adds the new B-0771 index entry under P2. |
| - B-0755 | ||
| - B-0759 | ||
| - B-0761 | ||
| - B-0763 |
|
|
||
| ### Capability 1: Audio | ||
|
|
||
| - [ ] `modules/audio-stack.nix` ships PipeWire as the default |
Comment on lines
+99
to
+103
| - [ ] `modules/intel-npu.nix` ships: | ||
| - `boot.kernelModules = [ "intel_vpu" ];` (mainline | ||
| kernel 6.5+ has the driver) | ||
| - `hardware.firmware = with pkgs; [ intel-npu-driver-firmware ];` | ||
| (Intel NPU firmware blobs) |
| (Intel NPU firmware blobs) | ||
| - User-namespace permission to `/dev/accel/accel0` via | ||
| udev rule + group membership | ||
| - [ ] `modules/openvino.nix` ships OpenVINO 2024.0+ runtime |
Comment on lines
+122
to
+126
| - [ ] New `nixos/hosts/workstation/configuration.nix` host | ||
| config: composes modules/audio-stack.nix + modules/ | ||
| intel-npu.nix + modules/desktop-environment.nix (GNOME | ||
| or KDE Plasma) + modules/k3s-agent.nix (so workstation | ||
| is also a cluster member) |
Member
Author
|
Closing as substrate-recoverable per |
auto-merge was automatically disabled
May 26, 2026 04:59
Pull request was closed
AceHack
added a commit
that referenced
this pull request
May 26, 2026
…/VPU exposed + ONNX as operator contract (#5094) * backlog(B-0771): re-land audio codecs working (DAW-ready) + Intel NPU/VPU exposed + ONNX as operator contract Re-land of stale-DIRTY PR #5058 (Tier-3 per pr-triage-tiers). Same B-0771 row (269 lines) from PR #5058 head cf9f8e2; BACKLOG.md regenerated; pre-emptive MD022 fix (heading wrap across lines collapsed to single line to satisfy blanks-around-headings). Co-Authored-By: Claude <noreply@anthropic.com> * fix(B-0771): collapse MD012 double blank introduced by MD022 heading-wrap fix Co-Authored-By: Claude <noreply@anthropic.com> --------- Co-authored-by: Lior <lior@zeta.dev> Co-authored-by: Claude <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Aaron 2026-05-25: 'i'd like the sound codecs workikng and npus for use like by daw and others' + 'OpenVINO what about ONYX?' (ONNX).
Beyond the cosmetic firmware fix in iter-3 (#5057). Full stack:
Composes with B-0754 / B-0755 / B-0759 / B-0761 / B-0763 / B-0764 / B-0767. Per B-0763 vendor swap: alternative runtimes (TVM, IREE, MLIR) + alternative NPU hardware (AMD XDNA, Apple Neural Engine, Hailo) fit the same Zeta.AI.Inference interface.