Skip to content

[CPU][Zen] Add DA8W4 (W4A8) int4 support for dense and MoE layers #54024

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
DarkLight1337 merged 21 commits into from
Oct 1, 2026
Merged

[CPU][Zen] Add DA8W4 (W4A8) int4 support for dense and MoE layers #54024

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
edbadc0
[CPU][Zen] Add DA8W4 (W4A8) int4 support for dense and MoE layers
ganeshr10 Aug 25, 2026
d1630c6
[CPU][Zen] Accept SwiGLU-OAI and biased W4A16 checkpoints on DA8W4
ganeshr10 Aug 31, 2026
60b1be8
[CPU][Zen] Support custom MoE routing on the DA8W4 int4 path
ganeshr10 Sep 1, 2026
ba1815f
[CPU][Zen] Reject expert parallelism and MoeWNA16 layouts on DA8W4
ganeshr10 Sep 1, 2026
e0c8a94
[CPU][Zen] Cover the DA8W4 expert-parallel and MoeWNA16 gates
ganeshr10 Sep 1, 2026
d95d95a
Merge upstream/main into cpu-zen-da8w4-w4a8
ganeshr10 Sep 16, 2026
77fefaa
[CPU][Zen] Fold the DA8W4 eligibility check into the repack
ganeshr10 Sep 18, 2026
75a204e
[CPU][Zen] Leave the WNA16 oracle's may_have_bias alone
ganeshr10 Sep 18, 2026
0269043
Merge upstream/main into cpu-zen-da8w4-w4a8
ganeshr10 Sep 21, 2026
e11951f
[CPU][Zen] Drop the inherited N/K alignment gate from ZentorchWNA16
ganeshr10 Sep 22, 2026
4325b98
[CPU][Zen] Skip the DA8W4 tests off CPU
ganeshr10 Sep 23, 2026
da59753
Merge upstream/main into cpu-zen-da8w4-w4a8
ganeshr10 Sep 23, 2026
df9197f
[CPU][Zen] Require the WNA16 group size to divide K
ganeshr10 Sep 28, 2026
48a2a9f
Merge upstream/main into cpu-zen-da8w4-w4a8
ganeshr10 Sep 28, 2026
92226f0
Merge upstream/main into cpu-zen-da8w4-w4a8
ganeshr10 Sep 29, 2026
8fc8a8d
[CPU][Zen] Follow the N-first CT WNA16 MoE weight format
ganeshr10 Sep 29, 2026
e592350
Merge branch 'main' into cpu-zen-da8w4-w4a8
mergify[bot] Sep 30, 2026
5aab6d4
Merge remote-tracking branch 'origin/main' into cpu-zen-da8w4-w4a8
ganeshr10 Oct 1, 2026
380deef
[CPU][Zen] Narrow can_implement's reason before the substring check
ganeshr10 Oct 1, 2026
52e8541
[CPU][Zen] Build the DA8W4 MoE test weights N-first
ganeshr10 Oct 1, 2026
4b0bf3d
Merge remote-tracking branch 'origin/main' into cpu-zen-da8w4-w4a8Cha…
ganeshr10 Oct 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .buildkite/hardware_tests/cpu.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,9 @@ steps:
- tests/kernels/test_onednn.py
- tests/kernels/test_awq_int4_to_int8.py
- tests/kernels/quantization/test_cpu_fp8_scaled_mm.py
- tests/kernels/quantization/test_zen_da8w4.py
- vllm/model_executor/kernels/linear/mixed_precision/zentorch.py
- vllm/model_executor/layers/fused_moe/experts/zentorch_moe.py
- tests/kernels/mamba/cpu/test_cpu_gdn_ops.py
- tests/kernels/mamba/test_cpu_short_conv.py
- tests/kernels/mamba/test_causal_conv1d.py
Expand All @@ -46,6 +49,7 @@ steps:
tests/kernels/test_onednn.py \
tests/kernels/test_awq_int4_to_int8.py \
tests/kernels/quantization/test_cpu_fp8_scaled_mm.py \
tests/kernels/quantization/test_zen_da8w4.py \
tests/kernels/mamba/cpu/test_cpu_gdn_ops.py \
tests/kernels/mamba/test_causal_conv1d.py \
tests/kernels/mamba/test_mamba_ssm.py \
Expand Down
Loading
Loading